Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 103

Performance Latency Cache Virtualization 103

Brendan Gregg

SEPTEMBER 5, 2017

Here's some output from my zfsdist tool, in bcc/BPF, which measures ZFS latency as a histogram on Linux: # zfsdist. Tracing ZFS operation latency. Many new tools can now be written, and the main toolkit we're working on is [bcc]. Hit Ctrl-C to end. ^C

Virtualization 75

Virtualization AWS Engineering Hardware 75

Alex Russell

DECEMBER 18, 2022

The talks are up on YouTube , including my own (behind a paywall, but the slides are freely available [1] ): The talk, like this post, is an update on network and CPU realities this series has documented since 2017. These are depressingly similar specs to devices I recommended for testing in 2017. 2023 Content Targets #. 4GiB of RAM.

Performance 120

Performance Mobile Network Latency 120

Sutter's Mill

FEBRUARY 13, 2017

Tue-Thu Apr 25-27: High-Performance and Low-Latency C++ (Stockholm). On April 25-27, I’ll be in Stockholm (Kista) giving a three-day seminar on “High-Performance and Low-Latency C++.” If you’re interested in attending, please check out the links, and I look forward to meeting and re-meeting many of you there.

Latency 48

Latency C++ Hardware Performance 48

All Things Distributed

NOVEMBER 13, 2018

Since then, AWS has added another PoP in Palermo in 2017. We needed to serve our growing base of startup, government, and enterprise customers across many vertical industries, including automotive, financial services, media and entertainment, high technology, education, and energy.

AWS 165

AWS Energy Automotive Traffic 165

All Things Distributed

OCTOBER 25, 2018

The new AWS Africa (Cape Town) Region will have three Availability Zones and provide lower latency to end users across Sub-Saharan Africa. In 2017, we brought the Amazon Global Network to Africa, through AWS Direct Connect. It is our first Region in Africa, and we're shooting to have it ready in the first half of 2020.

AWS 167

AWS Cloud Education Programming 167

Alex Russell

MARCH 6, 2021

TL;DR: A lot has changed since 2017 when we last estimated a global baseline resource per-page resource budget of 130-170KiB. To update our global baseline from 2017, we want to update our priors on a few dimensions: The evolved device landscape. The Moto G4 , for example. Here begins our 2021 adventure. Hard Reset.

Performance 127

Performance Network Metrics Cache 127

The Morning Paper

NOVEMBER 8, 2020

Back in 2017 the engineering team at Facebook had a problem. The initial version of Delos went into production after eight months using a ZooKeeper-backed Loglet implementation, and then four months later it was swapped out for a new custom-built NativeLoglet that gave a 10x improvement in end-to-end latency. Every little helps!

Virtualization 126

Virtualization Latency Storage Systems 126

All Things Distributed

SEPTEMBER 25, 2017

This Region will consist of three Availability Zones at launch, and it will provide even lower latency to users across the Middle East. 2017 continues a busy year for AWS in the Middle East. The Region will be in the heart of Gulf Cooperation Council (GCC) countries, and we're aiming to have it ready by early 2019.

Cloud 122

Cloud Education Energy Government 122

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. The change was obvious in the production graphs, showing a drop in write latencies: Once tested more broadly, it showed the write latencies dropped by 43%, delivering slightly better performance than on CentOS.

Speed 103

Speed Java AWS Virtualization 103

Scalegrid

AUGUST 27, 2024

RabbitMQ excels at managing asynchronous processing and reducing latency while distributing workloads effectively across the system. By prioritizing such messages, RabbitMQ delivers notifications with minimal latency, thus improving the user experience while sustaining the efficacy of communication systems. RabbitMQ in Action.

IoT 130

IoT Ecommerce Games Scalability 130

Adrian Cockcroft

JANUARY 29, 2023

The mean and percentile measurements hide this structure, but the rest of this post will show how the structure can be measured and analyzed so that you can figure out a useful model of your system, understand what is driving the long tail of latencies and come up with better SLAs and measures of capacity.

Lambda 98

Lambda Latency Cache C++ 98

All Things Distributed

DECEMBER 12, 2018

In April 2017, Amazon Web Services announced that it would launch a new AWS infrastructure region Region in Sweden. They can run applications in Sweden, serve end users across the Nordics with lower latency, and leverage advanced technologies such as containers, serverless computing, and more.

AWS 120

AWS Cloud Games Serverless 120

Brendan Gregg

JULY 4, 2021

## References I've reproduced the talk references below, so you can click on links: - [Gregg 08] Brendan Gregg, “ZFS L2ARC,” [link] Jul 2008 - [Gregg 10] Brendan Gregg, “Visualizations for Performance Analysis (and More),” [link] 2010 - [Greenberg 11] Marc Greenberg, “DDR4: Double the speed, double the latency? Ford, et al., “TCP

Performance 52

Performance Latency Hardware Storage 52

All Things Distributed

OCTOBER 2, 2017

In support of Amazon Prime Day 2017, the biggest day in Amazon retail history, DynamoDB served over 12.9 Performant – DynamoDB consistently delivers single-digit millisecond latencies even as your traffic volume increases. million requests per second.

Internet 113

Internet Internet AWS Performance 113

Brendan Gregg

AUGUST 8, 2017

rc5-virtual (bgregg-xenial-bpf-i-0b7296777a2585be1) 08/01/2017 _x86_64_ (8 CPU) 10:15:51 PM UID PID %usr %system %guest %CPU CPU Command 10:16:51 PM 0 18468 2.85 Some people have found values that seem to work for their systems and workloads: they know that when load goes over X, application latency is high and customers start complaining.

Latency 111

Latency Metrics C++ Systems 111

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Alex Russell

FEBRUARY 3, 2023

They understood that most websites lack tight latency budgeting, dedicated performance teams, hawkish management reviews, ship gates to prevent regressions, and end-to-end measurements of critical user journeys. This raises a follow-on question: what's an interaction?

Social Media 130

Social Media Website Technology Technology 130

Alex Russell

JANUARY 30, 2024

If you or your company are able to generate a credible worldwide latency estimate in the higher percentiles for next year's update, please get in touch. So what did $650, give or take, buy in late 2017 or early 2018? But it won't be based on the sort of numbers that folks explicitly running speed tests see; those aren't real life.

Performance 98

Performance Network Mobile Speed 98

KeyCDN

JANUARY 31, 2019

The next closest active POP location to Bucharest was Istanbul which was still almost 900km away; this distance adds up in terms of latency. As for Romania, it covers an area of over 238,000 square kilometers and as of 2017 had a population of almost 20 million. In 2017, the average speed was 21.33Mb/s ranking them 18th in the world.

Internet 48

Internet Internet Ecommerce Speed 48

O'Reilly Software

APRIL 4, 2018

A message-oriented implementation requires an efficient messaging backbone that facilitates the exchange of data in a reliable and secure way with the lowest latency possible. Another element they have in common is that they are both consuming and producing messages. Apache Kafka is currently the leading project in this area.

Architecture 80

Architecture Scalability Google Operating System 80

Alex Russell

OCTOBER 22, 2017

— Alex Russell (@slightlylate) October 4, 2017. It simulates a link with a 400ms RTT and 400-600Kbps of throughput (plus latency variability and simulated packet loss). Simulated packet loss and variable latency, however, can make benchmarking extremely difficult and slow. Maybe "ambush by JS"? First Load.

Performance 74

Performance Network Benchmarking Mobile 74

Smashing Magazine

AUGUST 10, 2023

In contrast, tools like DebugBear and WebPageTest use more realistic throttling that accurately reflects network round trips on a higher-latency connection. The report, released in 2017, provides network data from sessions collected from real Chrome users. Real usage data would be better, of course.

Speed 82

Speed Monitoring Testing Network 82

CSS - Tricks

APRIL 1, 2021

A 2017 study by Akamai says as much when it found that even a 100ms delay in page load can decrease conversions by 7% and lose 1% of their sales for every 100ms it takes for their site to load which, at the time of the study, was equivalent to $1.6 Site performance is potentially the most important metric.

Cache 92

Cache Social Media Media Network 92

KeyCDN

OCTOBER 24, 2018

Although both countries are relatively close to one another, they are separated by a distance of approximately 500km, which adds up in terms of latency. According to Wikipedia , the average connection speed in Q1 of 2017 was 20.5Mbps. This is a massive increase from year 2000 when only 37.2% of the population were Internet users.

Internet 48

Internet Internet Speed Network 48

SQL Performance

SEPTEMBER 17, 2019

For years SSRS was bundled with the installation of SQL Server, which helped add to some of the confusion around licensing and support for the product, so beginning with SSRS 2017, the installation package for Reporting Services is a separate download. Disk latency for ReportServer and ReportServerTempDB are very important.

Tuning 67

Tuning Servers Database Best Practices 67

SQL Performance

APRIL 8, 2019

Back on December 5, 2017, Microsoft announced that they were using AMD EPYC 7551 processors in their storage-optimized Lv2-Series virtual machines. They feature low latency, local NVMe storage that can directly leverage the 128 PCIe 3.0 Since then, Microsoft has changed the naming of this series to Lsv2. Memory (GiB).

Azure 42

Azure Virtualization Storage Benchmarking 42

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. The change was obvious in the production graphs, showing a drop in write latencies: Once tested more broadly, it showed the write latencies dropped by 43%, delivering slightly better performance than on CentOS.

Speed 40

Speed Java AWS Virtualization 40

John McCalpin

JANUARY 22, 2018

Introduction: In December 2017, my colleague Damon McDougall (now at AMD) asked for help in porting the fused multiply-add example code from a Colfax report ( [link] ) to the Xeon Phi x200 (Knights Landing) processors here at TACC. simple addition instead of FMA) or with fewer registers and shorter pipeline latency (e.g,

Latency 40

Latency Hardware Code Testing 40

IO River

NOVEMBER 2, 2023

Delta Air Lines experienced a severe system outage in 2017, resulting in flight cancellations and delays across their network. Proactive monitoring aids in detecting performance bottlenecks, latency difficulties, and other anomalies that may influence availability.

Availability 52

Availability Social Media Traffic Games 52

IO River

NOVEMBER 2, 2023

Delta Air Lines experienced a severe system outage in 2017, resulting in flight cancellations and delays across their network. Proactive monitoring aids in detecting performance bottlenecks, latency difficulties, and other anomalies that may influence availability.

Availability 52

Availability Social Media Traffic Games 52

Alex Russell

APRIL 29, 2021

WebGL 2 launched for other platforms on Chrome and Firefox in 2017. For heavily latency-sensitive use-cases like WebXR, this is a critical component in delivering a good experience. The underlying graphics capabilities from OpenGL ES 3.0 have been available in iOS since 2013 with iOS 7.0. Offscreen Canvas.

Media 145

Media Games Education Engineering 145

The Symphonia

MAY 22, 2018

Gojko Adzic has done some great speaking and writing on his experience here, and I included the link to his talk from late 2017. I also rewrote the section on Startup Latency since Cold Starts are one of the big “FUD” areas of Serverless. I also wrote an article on just this area last year.

Serverless 40

Serverless Architecture Lambda Azure 40

All Things Distributed

SEPTEMBER 29, 2016

Based in the Paris area, the region will provide even lower latency and will allow users who want to store their content in datacenters in France to easily do so. The new region in France will be ready for customers to use in 2017. Cette nouvelle région sera disponible pour les clients dès 2017.

AWS 161

AWS IoT Internet Internet 161

KeyCDN

JUNE 20, 2019

According to Monetate , the following conversion rate results were gathered for Q3 of 2017 until Q3 of 2018. Online users are becoming less and less patient meaning you as an eCommerce store owner need to implement methods for reducing latency and speeding up your website. This reduces latency and speeds up your website.

Ecommerce 41

Ecommerce Speed Website Mobile 41

Smashing Magazine

JANUARY 7, 2019

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. An interesting way of avoiding parsing costs is to use binary templates that Ember has introduced in 2017. Alex Danilo has explained WebAssembly and how it works at his Google I/O 2017 talk. Bundle Buddy. Bundlephobia.

Performance 105

Performance Cache Metrics Network 105