Scalegrid

APRIL 16, 2020

Deploying your application and database on the same VPC also provides the lowest possible latency path. Use Follower Clusters keep two independent database systems (of the same type) in sync so you can analyze, optimize and test app performance for MySQL, PostgreSQL and MongoDB® database. Expert Tip. Security Groups. No problem.

Cloud 242

Cloud Azure AWS Database 242

All Things Distributed

NOVEMBER 15, 2010

Werner Vogels weblog on building scalable and robust distributed systems. For example, the most fundamental abstraction trade-off has always been latency versus throughput. The throughput of this pipeline is more important than the latency of the individual operations. All Things Distributed. Comments ().

AWS 125

AWS Programming Latency Architecture 125

All Things Distributed

NOVEMBER 21, 2017

Redis's microsecond latency has made it a de facto choice for caching. Four years ago, as part of our AWS fast data journey, we introduced Amazon ElastiCache for Redis , a fully managed, in-memory data store that operates at microsecond latency. The system is more robust. TB of in-memory capacity in a single cluster.

Games 96

Games Retail Latency Education 96

The Morning Paper

JULY 4, 2019

Are you ready to take your system assurance programme to the next level? In all cases we need to be able to carefully monitor the impact on the system, and back out if things start going badly wrong. Netflix’s system is deployed on the public cloud as complex set of interacting microservices.

Latency 77

Latency Engineering Metrics Traffic 77

All Things Distributed

OCTOBER 2, 2017

With these requirements in mind, and a willingness to question the status quo, a small group of distributed systems experts came together and designed a horizontally scalable distributed database that would scale out for both reads and writes to meet the long-term needs of our business. This was the genesis of the Amazon Dynamo database.

Internet 110

Internet Internet AWS Performance 110

Brendan Gregg

JUNE 30, 2018

sounds like a homework exercise of purely academic value. If you develop a habit of reading only the operation rate and latency numbers from a lengthy benchmark report (or you have a shell script to do this that feeds a GUI), it's easy to miss other details in the report such as the error rate. ### 4. What's the limiter?" No packets.

Benchmarking 47

Benchmarking Latency Cache Network 47

Adrian Cockcroft

MARCH 17, 2020

Picture taken by Adrian March 17, 2020 A resilient system continues to operate successfully in the presence of failures. There are many possible failure modes, and each exercises a different aspect of resilience. Hence, one way to reduce risk is to make systems more observable. The first technique is the most generally useful.

Healthcare 52

Healthcare Government Airlines Systems 52

Adrian Cockcroft

NOVEMBER 11, 2019

A resilient system continues to operate successfully in the presence of failures. There are many possible failure modes, and each exercises a different aspect of resilience. Hence, one way to reduce risk is to make systems more observable. This discussion focuses on hardware, software and operational failure modes.

Latency 53

Latency Systems Engineering Hardware 53

Adrian Cockcroft

NOVEMBER 11, 2019

A resilient system continues to operate successfully in the presence of failures. There are many possible failure modes, and each exercises a different aspect of resilience. Hence, one way to reduce risk is to make systems more observable. This discussion focuses on hardware, software and operational failure modes.

Latency 52

Latency Systems Engineering Hardware 52

The Morning Paper

DECEMBER 8, 2019

At the start of November I was privileged to attend HPTS (the High Performance Transaction Systems) conference in Asilomar. Byte-addressable non-volatile memory,) NVM will fundamentally change the way hardware interacts, the way operating systems are designed, and the way applications operate on data. PLOS’19.

Hardware 56

Hardware Programming Media Storage 56

The Morning Paper

JANUARY 23, 2020

1:18pm a key observation was made that an API call to populate the homepage sidebar saw a huge jump in latency. The process tracing exercise included: Examning IRC transcripts from multiple channels. First look for any correlation to the last change made to the system.

Internet 53

Internet Internet Cache Engineering 53

Brendan Gregg

JUNE 29, 2018

sounds like a homework exercise of purely academic value. If you develop a habit of reading only the operation rate and latency numbers from a lengthy benchmark report (or you have a shell script to do this that feeds a GUI), it's easy to miss other details in the report such as the error rate. ### 4. What's the limiter?" No packets.

Benchmarking 40

Benchmarking Latency Cache Network 40

The Morning Paper

NOVEMBER 14, 2019

Taiji’s routing table is a materialized representation of how user traffic at various edge nodes ought to be distributed over available data centers to balance data center utilization and minimize latency. For example, balance utilisation across all data centers, or optimise for network latency. a chance to warm up.

Traffic 42

Traffic Internet Internet Latency 42

John McCalpin

AUGUST 1, 2018

This is an intellectually challenging and labor-intensive exercise, requiring detailed review of the published details of each of the components of the system, and usually requiring significant “detective work” (using customized microbenchmarks, hardware performance counter analysis, and creative thinking) to fill in the gaps.

Hardware 40

Hardware Transportation Performance Latency 40

John McCalpin

AUGUST 1, 2018

This is an intellectually challenging and labor-intensive exercise, requiring detailed review of the published details of each of the components of the system, and usually requiring significant “detective work” (using customized microbenchmarks, hardware performance counter analysis, and creative thinking) to fill in the gaps.

Hardware 40

Hardware Transportation Performance Latency 40

O'Reilly Software

MARCH 7, 2018

Build a more scalable, composable, and functional architecture for interconnecting systems and applications. Welcome to a new world of data-driven systems. Today, data needs to be available at all times, serving its users—both humans and computer systems—across all time zones, continuously, in close to real time.

Transportation 72

Transportation Java Programming Architecture 72

John McCalpin

JANUARY 22, 2018

The exercise seemed simple enough — just fix one item in the Colfax code and we should be finished. Each of the two vector units can issue one FMA instruction per cycle, assuming that there are enough independent accumulators to tolerate the 6-cycle dependent-operation latency. Instead, we found puzzle after puzzle. FMAs/cycle.

Latency 40

Latency Hardware Code Testing 40

John McCalpin

JANUARY 22, 2018

There was no deep goal — just a desire to see the maximum GFLOPS in action. The exercise seemed simple enough — just fix one item in the Colfax code and we should be finished. Using the minimum number of accumulator registers needed to tolerate the pipeline latency (12), the assembly code for the inner loop is: B1.8:

Latency 40

Latency Hardware Code Testing 40

The Agile Manager

AUGUST 23, 2007

When it all comes together, the overall benefit of the resulting system can be incredible, such as an increase in life expectancy. IT reward systems are also often based on individual performance tied to granular and highly focused statements of accomplishment. As Thomas Teal wrote succinctly , “Good management works miracles.”

Innovation 40

Innovation Technology Technology Latency 40

The Netflix TechBlog

MARCH 6, 2019

Mounting object storage in Netflix’s media processing platform By Barak Alon (on behalf of Netflix’s Media Cloud Engineering team) MezzFS (short for “Mezzanine File System”) is a tool we’ve developed at Netflix that mounts cloud objects as local files via FUSE. MezzFS can be configured to cache objects on the local disk. Regional caching? —?Netflix

Media 218

Media Storage Processing Cache 218