The Netflix TechBlog

SEPTEMBER 8, 2020

How we migrated our Android endpoints out of a monolith into a new microservice by Rohan Dhruva , Ed Ballot As Android developers, we usually have the luxury of treating our backends as magic boxes running in the cloud, faithfully returning us JSON. Background The Netflix Android app uses the falcor data model and query protocol.

Latency 236

Latency Cache Java Traffic 236

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person!

Performance 52

Performance Latency Cache Virtualization 52

The Morning Paper

OCTOBER 4, 2020

Understanding operational 5G: a first measurement study on its coverage, performance and energy consumption , Xu et al., What is the end-to-end throughput and latency, and where are the bottlenecks? Throughput and latency. 5G network paths achieve an average latency of 21.8ms, a 32% reduction on the comparable 4G times.

Energy 130

Energy Latency Performance Network 130

The Morning Paper

AUGUST 29, 2019

Choosing a cloud DBMS: architectures and tradeoffs Tan et al., If you’re moving an OLAP workload to the cloud (AWS in the context of this paper), what DBMS setup should you go with? InS does now offer an NVMe variant too, and the authors perform limited testing on that as well. Query performance. VLDB’19.

Architecture 76

Architecture Cloud Storage Serverless 76

ACM Sigarch

MAY 31, 2023

Heterogeneous and Composable Memory (HCM) offers a feasible solution for terabyte- or petabyte-scale systems, addressing the performance and efficiency demands of emerging big-data applications. CXL-based disaggregated memory provides a new opportunity with two orders of magnitude better performance than RDMA (as illustrated in Figure 2).

Latency 52

Latency Hardware Cache Architecture 52

The Morning Paper

MAY 14, 2019

Seer: leveraging big data to navigate the complexity of performance debugging in cloud microservices Gan et al., Seer is an online system that observes the behaviour of cloud applications (using the DeathStarBench microservices for the evaluation) and predicts when QoS violations may be about to occur. ASPLOS’19.

Big Data 45

Big Data Cloud Performance Hardware 45

Brendan Gregg

AUGUST 29, 2021

A service team was debugging a performance issue and noticed it coincided with a high rate of paging. I was asked to help, and used a variety of performance tools to solve this including those that use eBPF and Ftrace. Reads usually have apps waiting on them; writes may not (write-back caching). Counting cache functions.

Cache 103

Cache C++ AWS Java 103

All Things Distributed

NOVEMBER 26, 2013

About 5 years ago, I introduced you to AWS Availability Zones, which are distinct locations within a Region that are engineered to be insulated from failures in other Availability Zones and provide inexpensive, low latency network connectivity to other Availability Zones in the same region.

Cloud 136

Cloud AWS Traffic Latency 136

The Netflix TechBlog

NOVEMBER 9, 2022

A quick canary test was free of errors and showed lower latency, which is expected given that our standard canary setup routes an equal amount of traffic to both the baseline running on 4xl and the canary on 12xl. What’s worse, average latency degraded by more than 50%, with both CPU and latency patterns becoming more “choppy.”

Hardware 363

Hardware Cache Performance Latency 363

All Things Distributed

DECEMBER 5, 2010

Expanding the Cloud with DNS - Introducing Amazon Route 53. I am very excited that today we have launched Amazon Route 53, a high-performance and highly-available Domain Name System (DNS) service. There are two main types of DNS servers: authoritative servers and caching resolvers. By Werner Vogels on 05 December 2010 02:00 PM.

Cloud 116

Cloud Internet Internet AWS 116

Brendan Gregg

JULY 2, 2021

biolatency Disk I/O latency histogram heat map. cachestat File system cache statistics line charts. runqlat CPU scheduler latency heat map. biolatency Disk I/O latency histogram heat map. cachestat File system cache statistics line charts. runqlat CPU scheduler latency heat map. opensnoop Files opened table.

Latency 145

Latency Cache Energy Systems 145

The Netflix TechBlog

NOVEMBER 3, 2022

by Tomasz Bak and Fabio Kung Introduction Titus is the Netflix cloud container runtime that runs and manages containers at scale. We introduce a caching mechanism in the API gateway layer, allowing us to offload processing from singleton leader elected controllers without giving up strict data consistency and guarantees clients observe.

Cache 227

Cache Latency Traffic Systems 227

The Netflix TechBlog

SEPTEMBER 10, 2024

Finally, the device receives the message, and the action, such as “Show me Stranger Things on Netflix”, is performed. Dynomite had great performance, but it required manual scaling as the system grew. In our case, we value low latency — the faster we can read from KeyValue, the faster these messages can get delivered.

Latency 225

Latency Cache Tuning Efficiency 225

The Netflix TechBlog

SEPTEMBER 18, 2024

Firstly, developers struggled to reason about consistency, durability and performance in this complex global deployment across multiple stores. These include challenges with tail latency and idempotency, managing “wide” partitions with many rows, handling single large “fat” columns, and slow response pagination.

Latency 239

Latency Storage Cache Efficiency 239

Scalegrid

MARCH 28, 2024

In this comparison of Redis vs Memcached, we strip away the complexity, focusing on each in-memory data store’s performance, scalability, and unique features. Redis and Memcached both provide high performance with sub-millisecond response times. Choosing between Redis and Memcached hinges on specific application requirements.

Cache 130

Cache Storage Architecture Scalability 130

The Netflix TechBlog

SEPTEMBER 24, 2021

As an example, cloud-based post-production editing and collaboration pipelines demand a complex set of functionalities, including the generation and hosting of high quality proxy content. The ProRes codec family provides great editing performance and image quality.

Cloud 239

Cloud Media Storage Cache 239

Brendan Gregg

AUGUST 29, 2021

A service team was debugging a performance issue and noticed it coincided with a high rate of paging. I was asked to help, and used a variety of Linux performance tools to solve this including those that use eBPF and Ftrace. Reads usually have apps waiting on them; writes may not (write-back caching). These are rough notes.

Cache 40

Cache C++ AWS Systems 40

Percona

MARCH 23, 2023

This blog is in reference to our previous ones for ‘Innodb Performance Optimizations Basics’ 2007 and 2013. Although there have been many blogs about adjusting MySQL variables for better performance since then, I think this topic deserves a blog update since the last update was a decade ago, and MySQL 5.7

Performance 127

Performance Hardware Tuning Storage 127

Dynatrace

MAY 13, 2022

This extension provides fully app-centric Cassandra performance monitoring for Azure Managed Instance for Apache Cassandra. Because of its scalability and distributed architecture, thousands of companies trust it to run their cloud and hybrid-based workloads at high availability without compromising performance.

Azure 233

Azure Latency Metrics Infrastructure 233

Brendan Gregg

JULY 2, 2021

biolatency Disk I/O latency histogram heat map 5. cachestat File system cache statistics line charts 7. runqlat CPU scheduler latency heat map 10. biolatency Disk I/O latency histogram heat map 5. cachestat File system cache statistics line charts 7. runqlat CPU scheduler latency heat map 10. at the time.

Open Source 40

Open Source Latency Cache Energy 40

All Things Distributed

SEPTEMBER 3, 2013

Today, we added two important choices for customers running high performance apps in the cloud: support for Redis in Amazon ElastiCache and a new high memory database instance (db.cr1.8xlarge) for Amazon RDS. Today, we are further expanding the choices available for designing and developing highly scalable and high performance apps.

Cache 121

Cache Cloud Performance Retail 121

Percona

AUGUST 10, 2018

The performance of a PostgreSQL database can be compromised by dead tuples, since they continue to occupy space and can lead to bloat. Now, though, it’s time to look at autovacuum for postgres, and the internals you to know to maintain a high performance PostgreSQL database needed by demanding applications. You May Also Like.

Tuning 45

Tuning Cache Database Storage 45

Scalegrid

MAY 11, 2024

This allowed for sequential access and indexed access, but random writes could cause performance issues. Choosing the appropriate storage engine can have a significant impact on application performance. Choosing the right storage engine is crucial for application performance as each engine has its own strengths and weaknesses.

Storage 130

Storage Engineering Cache Database 130

Scalegrid

FEBRUARY 8, 2024

Durability Availability Fault tolerance These combined outcomes help minimize latency experienced by clients spread across different geographical regions. Opting for synchronous replication within distributed storage brings about reinforced consistency and integrity of data, but also bears higher expenses than other forms of replicating data.

Storage 130

Storage Systems Big Data Azure 130

CSS Wizardry

AUGUST 13, 2019

It turns out that Cloud.typography is a hybrid solution, somewhere between cloud- and self-hosted. So, what are the performance implications of all of this? To further exacerbate the problem, the 302 response has a Cache-Control: must-revalidate, private. com , which introduces yet more latency for the connection setup.

Latency 206

Latency Cache Strategy Media 206

Sutter's Mill

FEBRUARY 13, 2017

Tue-Thu Apr 25-27: High-Performance and Low-Latency C++ (Stockholm). On April 25-27, I’ll be in Stockholm (Kista) giving a three-day seminar on “High-Performance and Low-Latency C++.” Here is the summary, below; for a more detailed topic breakdown see the link above. Description.

Latency 46

Latency C++ Hardware Performance 46

The Morning Paper

FEBRUARY 6, 2020

Last week we looked at a function shipping solution to the problem; Cloudburst uses the more common data shipping to bring data to caches next to function runtimes (though you could also make a case that the scheduling algorithm placing function execution in locations where the data is cached a flavour of function-shipping too).

Serverless 98

Serverless Lambda Cache Latency 98

Dynatrace

OCTOBER 4, 2022

The performance of these queries needs to be at a level where they can support ad-hoc analytics use cases. Data lakehouses deliver the query response with minimal latency. It uses cost-effective and durable object storage to store massive volumes of data without the traditional cost and performance tradeoffs.

Artificial Intelligence 203

Artificial Intelligence Storage Analytics Government 203

Alex Russell

MARCH 6, 2021

Back in 2016, I gave a talk outlining the causes and effects of the terrible performance of web apps built using popular tools on the fastest-growing device segment: low-end to mid-range Android phones. Poor performance has a compound effect on user expectations at an ecosystem level. Live by the link, die by the link.

Performance 127

Performance Network Metrics Cache 127

High Scalability

JULY 20, 2018

And if you know anyone looking for a simple book that uses lots of pictures and lots of examples to explain the cloud, then please recommend my new book: Explain the Cloud Like I'm 10. That means multiple data indirections mean multiple cache misses. This is where your performance goes. It would mean a great deal to me.

Internet 121

Internet Internet Scalability Automotive 121

Dynatrace

NOVEMBER 3, 2021

Because monitoring tends to focus on key indicators such as utilization rates and throughput, monitoring indicates overall system performance. For example, when monitoring a database, you’ll want to know about any latency when writing data to a disk or average query response time.

Monitoring 215

Monitoring Metrics DevOps Scalability 215

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., Microservices fundamentally change a lot of assumptions current cloud systems are designed with, and present both opportunities and challenges when optimizing for quality of service (QoS) and utilization.

Open Source 61

Open Source Hardware Benchmarking Systems 61

The Morning Paper

SEPTEMBER 10, 2019

When each of those use cases is powered by a dedicated back-end, investments in better performance, improved scalability and efficiency etc. That’s hard for many reasons, including the differing trade-offs between throughput and latency that need to be made across the use cases. are divided. Reporting and dashboarding use cases (e.g.

Analytics 75

Analytics Latency Cache Google 75

The Morning Paper

JUNE 23, 2019

Generally to cache data (including non-persistent data that never sees a backing store), to share non-persistent data across application services (e.g. ” Even re-reading that today, the letter of the law there is surprisingly strict to me: you can use the local memory space or filesystem as a brief single transaction cache, but no more.

Cache 79

Cache Latency Google Lambda 79

Percona

MARCH 20, 2023

When deciding what to pick, there are many things to consider, like where the proxy needs to be, if it “just” needs to redirect the connections, or if more features need to be in, like caching and filtering, or if it needs to be integrated with some MySQL embedded automation. Given that, there never was a single straight answer.

Games 123

Games Latency Traffic Cache 123

Percona

JULY 17, 2023

DBAs and developers appreciate its combination of flexibility, scalability, and performance. Those problems (some with shared elements) include: High cost and complicated pricing structure : Many companies say MongoDB has an expensive and complicated pricing structure ( Cloud Zero, January 2023 ). MongoDB Enterprise is commercial.

Open Source 78

Open Source Database Scalability Software 78

All Things Distributed

JUNE 21, 2017

Today, I'm excited to announce the general availability of Amazon DynamoDB Accelerator (DAX) , a fully managed, highly available, in-memory cache that can speed up DynamoDB response times from milliseconds to microseconds, even at millions of requests per second. DynamoDB was the first service at AWS to use SSD storage.

Speed 114

Speed Cache Latency AWS 114