Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. Ford, et al., “TCP

Performance 52

Performance Latency Hardware Storage 52

SQL Performance

FEBRUARY 26, 2020

Azure SQL Database Managed Instance became generally available in late 2018. The General Purpose tier is designed for applications with typical performance and I/O latency requirements and provides built-in HA. The Business Critical tier is designed for applications that require low I/O latency and higher HA requirements.

Azure 63

Azure Performance Storage Latency 63

Abhishek Tiwari

DECEMBER 27, 2017

In 2018, a widespread adaptation of Kubernetes for big data processing is anitcipated. faster access to external storage and data locality (I/O, bandwidth). Storage provisioning. But Kubernetes storage is evolving quite quickly. Kubernetes has emerged as go to container orchestration platform for data engineering teams.

Big Data 63

Big Data Storage Benchmarking Hardware 63

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

HammerDB

MAY 5, 2019

However in the Skylake microarchitecture (you can see a list of CPUs here ) the PAUSE instruction changed and in the documentation it says “the latency of the PAUSE instruction in prior generation microarchitectures is about 10 cycles, whereas in Skylake microarchitecture it has been extended to as many as 140 cycles.”

Testing 49

Testing Tuning Storage Latency 49

Percona

AUGUST 10, 2018

sec < 2018-08-06 07:22:35.199 EDT > LOG: automatic analyze of table "vactest.scott.employee" system usage: CPU 0.00s/0.02u sec elapsed 0.15 sec < 2018-08-06 07:22:35.199 EDT > LOG: automatic analyze of table "vactest.scott.employee" system usage: CPU 0.00s/0.02u sec elapsed 0.15 1 second = 1000 milliseconds).

Tuning 69

Tuning Cache Database Storage 69

HammerDB

OCTOBER 12, 2018

As is also the case this limitation is at the database level (especially the storage engine) rather than the hardware level. InnoDB is the storage engine that will deliver the best OLTP throughput and should be chosen for this test. . maximum transition latency: Cannot determine or is not supported. . c_ytd_payment: 10.00

Best Practices 40

Best Practices Scalability Performance C++ 40

Alex Russell

MARCH 6, 2021

A then-representative $200USD device had 4-8 slow (in-order, low-cache) cores, ~2GiB of RAM, and relatively slow MLC NAND flash storage. India became a 4G-centric market sometime in 2018. Sadly, data on latency is harder to get, even from Google's perch, so progress there is somewhat more difficult to judge.

Performance 127

Performance Network Mobile Metrics 127

Alex Russell

APRIL 29, 2021

Chrome has missed several APIs for 3+ years: Storage Access API. After years of standards discussion and the first delivered to other platforms in 2018, iOS 14.5 April 2018 , but not usable until several releases later). Where Chrome Has Lagged. finally shipped Audio Worklets this week. Pointer Lock. Media Recorder.

Media 145

Media Games Education Engineering 145

Percona

JULY 1, 2023

This post was originally published in July 2018 and was updated in July 2023. It efficiently manages read and write operations, optimizes data access, and minimizes contention, resulting in high throughput and low latency to ensure that applications perform at their best. What are the differences between Aurora and RDS?

AWS 52

AWS Database Serverless Storage 52

Alex Russell

OCTOBER 22, 2017

It simulates a link with a 400ms RTT and 400-600Kbps of throughput (plus latency variability and simulated packet loss). Simulated packet loss and variable latency, however, can make benchmarking extremely difficult and slow. Our baseline, then, should probably trade lower throughput/higher-latency for packet loss.

Performance 74

Performance Network Benchmarking Mobile 74

HammerDB

NOVEMBER 5, 2018

Additionally for the log disk component it is latency for an individual write that is crucial rather than the total I/O bandwidth. 2018-11-02T15:38:27.662098+00:00 Thread 1 advanced to log sequence 1402 (LGWR switch) Current log# 1 seq# 1402 mem# 0: /home/oracle/app/oracle/oradata/VULCDB1/onlinelog/o1_mf_1_fjj87ghr_.log PostgreSQL.

Benchmarking 40

Benchmarking Database C++ Virtualization 40

Testsigma

FEBRUARY 12, 2021

By 2021, a distributed cloud would help companies physically put all services closely together, thereby addressing low-latency challenges, minimising the expense of storage and ensuring that data standards are consistent with the laws in a given geographical region. Automation to Enhance AI Security Defence. The most recent 2021 trend.

Artificial Intelligence 92

Artificial Intelligence Software Software IoT 92

Smashing Magazine

JANUARY 7, 2019

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. To optimize storage interally, you could use Dropbox’s new Lepton format for losslessly compressing JPEGs by an average of 22%. In 2018, the Alliance of Open Media has released a new promising video format called AV1.

Performance 111

Performance Cache Network Metrics 111

Smashing Magazine

JANUARY 6, 2020

Globally in 2018–2019, according to the IDC, 87% of all shipped mobile phones are Android devices. Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. To optimize storage interally, you could use Dropbox’s new Lepton format for losslessly compressing JPEGs by an average of 22%.

Performance 112

Performance Cache Servers Network 112

Smashing Magazine

JANUARY 11, 2021

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Designed for the modern web, it responds to actual congestion, rather than packet loss like TCP does, it is significantly faster , with higher throughput and lower latency — and the algorithm works differently.

Performance 145

Performance Cache Media Metrics 145