All Things Distributed

NOVEMBER 15, 2010

For example, the most fundamental abstraction trade-off has always been latency versus throughput. Modern CPUs strongly favor lower latency of operations with clock cycles in the nanoseconds and we have built general purpose software architectures that can exploit these low latencies very well. Where to go from here?

AWS 125

AWS Programming Latency Architecture 125

All Things Distributed

OCTOBER 2, 2017

VPC Endpoints give you the ability to control whether network traffic between your application and DynamoDB traverses the public Internet or stays within your virtual private cloud. Performant – DynamoDB consistently delivers single-digit millisecond latencies even as your traffic volume increases.

Internet 111

Internet Internet AWS Performance 111

The Morning Paper

JULY 4, 2019

degraded hardware, transient networking problem) or, more often, because of some change deployed by Netflix engineers that did not have the intended effect. Two failure modes we focus on are a service becoming slower (increase in response latency) or a service failing outright (returning errors). On error rates.

Latency 77

Latency Engineering Metrics Traffic 77

CSS - Tricks

APRIL 1, 2021

With all of this in mind, I thought improving the speed of my own version of a slow site would be a fun exercise. Redirects are often pretty light in terms of the latency that they add to a website, but they are an easy first thing to check, and they can generally be removed with little effort. Improvement #2: The Critical Render Path.

Cache 94

Cache Social Media Media Website 94

Brendan Gregg

JUNE 30, 2018

sounds like a homework exercise of purely academic value. I've refuted many benchmarks by showing that they would require a network throughput that would far exceed the maximum network bandwidth (off by, for example, as much as 10x!). Networking is the easiest to check. This is really asking "what's the limiter?"

Benchmarking 47

Benchmarking Latency Cache Network 47

Brendan Gregg

JUNE 29, 2018

sounds like a homework exercise of purely academic value. I've refuted many benchmarks by showing that they would require a network throughput that would far exceed the maximum network bandwidth (off by, for example, as much as 10x!). Networking is the easiest to check. This is really asking "what's the limiter?"

Benchmarking 40

Benchmarking Latency Cache Network 40

The Morning Paper

NOVEMBER 14, 2019

It’s another networking paper to close out the week (and our coverage of SOSP’19), but whereas Snap looked at traffic routing within the datacenter, Taiji is concerned with routing traffic from the edge to a datacenter. For example, balance utilisation across all data centers, or optimise for network latency. SOSP’19.

Traffic 42

Traffic Internet Internet Latency 42

John McCalpin

AUGUST 1, 2018

This is an intellectually challenging and labor-intensive exercise, requiring detailed review of the published details of each of the components of the system, and usually requiring significant “detective work” (using customized microbenchmarks, hardware performance counter analysis, and creative thinking) to fill in the gaps.

Hardware 40

Hardware Transportation Performance Latency 40

John McCalpin

AUGUST 1, 2018

This is an intellectually challenging and labor-intensive exercise, requiring detailed review of the published details of each of the components of the system, and usually requiring significant “detective work” (using customized microbenchmarks, hardware performance counter analysis, and creative thinking) to fill in the gaps.

Hardware 40

Hardware Transportation Performance Latency 40

The Morning Paper

DECEMBER 8, 2019

Therefore any programming abstraction must be low latency and the kernel needs to be kept off the path of persistent data access as much as possible. Traditionally one of the major costs when moving data in and out of memory (be it to persistent media or over the network) is serialisation. What about security?

Hardware 56

Hardware Programming Media Storage 56

Adrian Cockcroft

NOVEMBER 11, 2019

There are many possible failure modes, and each exercises a different aspect of resilience. Collecting some critical metrics at one second intervals, with a total observability latency of ten seconds or less matches the human attention span much better. A resilient system continues to operate successfully in the presence of failures.

Latency 53

Latency Systems Engineering Hardware 53

Adrian Cockcroft

NOVEMBER 11, 2019

There are many possible failure modes, and each exercises a different aspect of resilience. Collecting some critical metrics at one second intervals, with a total observability latency of ten seconds or less matches the human attention span much better. A resilient system continues to operate successfully in the presence of failures.

Latency 52

Latency Systems Engineering Hardware 52