The Netflix TechBlog

NOVEMBER 12, 2024

This counting service, built on top of the TimeSeries Abstraction, enables distributed counting at scale while maintaining similar low latency performance. Both categories share common requirements, such as high throughput and high availability. Today, we’re excited to present the Distributed Counter Abstraction.

Latency 253

Latency Cache Infrastructure Strategy 253

The Netflix TechBlog

JUNE 14, 2023

This blog post will share broadly-applicable techniques (beyond GraphQL) we used to perform this migration. And we definitely couldn’t replay test non-functional requirements like caching and logging user interaction. The Replay Testing framework leverages the @override directive available in GraphQL Federation.

Traffic 358

Traffic Latency Metrics Cache 358

The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. CFS is widely used and therefore well tested and Linux machines around the world run with reasonable performance.

Cache 260

Cache Latency Airlines Logistics 260

Smashing Magazine

MAY 9, 2022

Performance Game Changer: Browser Back/Forward Cache. Performance Game Changer: Browser Back/Forward Cache. With that caveat out of the way, let’s get to the guts of the article: What is the Back/Forward Cache and why does it matter so much? Didn’t The HTTP Cache Do All That Anyway? Barry Pollard.

Cache 93

Cache Games Performance Website 93

InfoQ

JANUARY 29, 2024

RevenueCat extensively uses caching to improve the availability and performance of its product API while ensuring consistency. The company shared its techniques to deliver the platform, which can handle over 1.2 billion daily API requests. By Rafal Gancarz

Cache 108

Cache Open Source Availability Performance 108

Dynatrace

APRIL 10, 2023

Managing cloud performance is increasingly challenging for organizations that spread workloads across a greater variety of platforms. Moreover, organizations have to balance maintaining security, retaining cloud management expertise, and managing infrastructure performance. Rural lifestyle retail giant Tractor Supply Co.

Cloud 182

Cloud Ecommerce Performance Retail 182

CSS Wizardry

MAY 31, 2019

Users might already have the file cached. If website-a.com links to [link] , and a user goes from there to website-b.com who also links to [link] , then the user will already have that file in their cache. Penalty: Caching. This makes it very safe and sensible to enforce a reasonably aggressive cache policy.

Cache 275

Cache Latency Infrastructure Website 275

Alex Russell

MARCH 31, 2022

Browsers will cache tools popular among vocal, leading-edge developers. There's plenty of space for caching most popular frameworks. The best available proxy data also suggests that shared caches would have a minimal positive effect on performance. Suppose a user has only downloaded part of the cache.

Cache 89

Cache Government Traffic Network 89

Dynatrace

JANUARY 31, 2024

This blog post explores how AI observability enables organizations to predict and control costs, performance, and data reliability. Data dependencies and framework intricacies require observing the lifecycle of an AI-powered application end to end, from infrastructure and model performance to semantic caches and workflow orchestration.

Cache 215

Cache Azure Infrastructure Monitoring 215

Dynatrace

JANUARY 16, 2023

The study analyzes factual Kubernetes production data from thousands of organizations worldwide that are using the Dynatrace Software Intelligence Platform to keep their Kubernetes clusters secure, healthy, and high performing. The report also reveals the leading programming languages practitioners use for application workloads.

Open Source 351

Open Source Java Operating System Programming 351

The Netflix TechBlog

SEPTEMBER 18, 2024

Central to this infrastructure is our use of multiple online distributed databases such as Apache Cassandra , a NoSQL database known for its high availability and scalability. Firstly, developers struggled to reason about consistency, durability and performance in this complex global deployment across multiple stores.

Latency 254

Latency Storage Cache Efficiency 254

The Netflix TechBlog

MARCH 7, 2024

These integrations are implemented through Metaflow’s extension mechanism which is publicly available but subject to change, and hence not a part of Metaflow’s stable API yet. Occasionally, these use cases involve terabytes of data, so we have to pay attention to performance.

Systems 238

Systems Media Cache Open Source 238

High Scalability

FEBRUARY 17, 2021

Application example: user profile cache, where profiles are constructed elsewhere (e.g., Here Redis and Yugabyte have higher latencies, Yugabyte performs bad for both Insert and Read for the test. Yugabyte performs really good in this test. Workload C: Read only. This workload is 100% read. Workload E: Short ranges.

Benchmarking 308

Benchmarking Latency C++ Database 308

The Netflix TechBlog

JULY 12, 2019

The Tech Hollow , an OSS technology we released a few years ago, has been best described as a total high-density near cache : Total : The entire dataset is cached on each node?—?there there is no eviction policy, and there are no cache misses. Near : the cache exists in RAM on any instance which requires access to the dataset.

Cache 184

Cache Architecture Latency Engineering 184

KeyCDN

JUNE 6, 2019

We’re happy to announce that WebP Caching has landed! The new feature integrates into the existing CDN and is available to all customers. How Does WebP Caching Work? Enable the Feature for your Zones Cache Key WebP can be enabled for all Pull Zones. It’s all about the accept header sent from the client.

Cache 81

Cache Servers Website Traffic 81

The Netflix TechBlog

APRIL 27, 2023

Moreover, common database optimizations like caching recently queried data don’t really work for alerting queries because, generally speaking, the last received datapoint is required for correctness. This is especially true when either the data is not available in Atlas or the query is not supported because of (say) cardinality constraints.

Storage 300

Storage Cache Metrics Database 300

CSS Wizardry

SEPTEMBER 16, 2024

However, there are a handful of ways available to us—some are, admittedly, more easy and free than others. It’s a magical tool that makes life as a performance engineer so much easier (and much more fun). Interestingly, 304 responses are still a form of redirect: the server is redirecting your visitor back to their HTTP cache.

Latency 215

Latency Cache Transportation Mobile 215

Dynatrace

AUGUST 30, 2019

Digital Performance: 99% reduction in Response Time, from 18.2s Dynatrace Real User Monitoring (RUM) captures very detailed user behavior, as well as experience and performance information, about every user on your applications. Here are two I would start with: Web Performance Optimization with Dynatrace.

Cache 205

Cache Database Architecture Government 205

The Netflix TechBlog

MAY 4, 2023

The first phase involves validating functional correctness, scalability, and performance concerns and ensuring the new systems’ resilience before the migration. These include Quality-of-Experience(QoE) measurements at the customer device level, Service-Level-Agreements (SLAs), and business-level Key-Performance-Indicators(KPIs).

Traffic 349

Traffic Latency Tuning Systems 349

Scalegrid

JULY 8, 2020

If you must kill the script at this point, there are two options available: SCRIPT KILL command can be used to stop a script that hasn’t yet done any writes. If the script has already performed writes to the server and must still be killed, use the SHUTDOWN NOSAVE to shutdown the server completely. Expert Tip. Demonstration.

Servers 239

Servers Database Availability Monitoring 239

Dynatrace

MAY 13, 2022

This extension provides fully app-centric Cassandra performance monitoring for Azure Managed Instance for Apache Cassandra. Because of its scalability and distributed architecture, thousands of companies trust it to run their cloud and hybrid-based workloads at high availability without compromising performance.

Azure 242

Azure Latency Metrics Infrastructure 242

Percona

MARCH 23, 2023

This blog is in reference to our previous ones for ‘Innodb Performance Optimizations Basics’ 2007 and 2013. Although there have been many blogs about adjusting MySQL variables for better performance since then, I think this topic deserves a blog update since the last update was a decade ago, and MySQL 5.7

Performance 130

Performance Hardware Tuning Storage 130

Dynatrace

JULY 16, 2020

It wouldn’t scale and it wouldn’t perform either. Highly parallel and performant for any API call and doesn’t introduce much overhead. ? This would also mean I need a service that detects any new environments, creates API tokens for them, refreshes API tokens on expiry and ensures that there is always a valid API token available.

Cache 236

Cache Serverless Efficiency Tuning 236

Smashing Magazine

JUNE 20, 2019

Optimizing Google Fonts Performance. Optimizing Google Fonts Performance. The Google Fonts API does more than just provide the font files to the browser, it also performs a smart check to see how it can deliver the files in the most optimized format. Browser Caching. Danny Cooper. 2019-06-20T11:00:16+02:00. Light (300).

Google 111

Google Performance Cache Website 111

Scalegrid

OCTOBER 2, 2019

The demand for Redis is skyrocketing across dozens of use cases, particularly for cache, queues, geospatial data, and high speed transactions. ScaleGrid is the only Redis cloud service that allows you to customize your master-slave and cross-datacenter configurations for 100% uptime and availability across 30 different Azure regions.

Azure 37

Azure Cloud Open Source Virtualization 37

The Netflix TechBlog

JULY 1, 2019

Development As part of developing this type of UI experience on any platform, we knew we would need to think about creating smooth, performant animations with a balance between quality and download size for the images and video previews, all without degrading the performance of the app. One such area is our graphics memory management.

Cache 167

Cache Design Testing Development 167

Percona

JUNE 22, 2023

To make data count and to ensure cloud computing is unabated, companies and organizations must have highly available databases. This guide provides an overview of what high availability means, the components involved, how to measure high availability, and how to achieve it. How does high availability work?

Availability 114

Availability Database Open Source Hardware 114

Dynatrace

DECEMBER 21, 2023

Level 2: Hosts and containers You might run thousands of hosts and containers, many of which have been sized by prioritizing performance over energy consumption. Implement appropriate caching layers (for example, read-only cache for static data). And data-observability solutions focus on performance, not carbon emissions.

Cloud 222

Cloud Energy Best Practices Cache 222

CSS Wizardry

AUGUST 7, 2019

only to find that the resource they’re requesting isn’t in that PoP ’s cache. DDoS or heavy load: In a similar vein to the previous point, increased load with no way of auto-scaling your application will lead to degraded performance where you begin to probe the limits of your infrastructure. View full size/quality (533KB).

Latency 271

Latency Ecommerce Servers Mobile 271

Scalegrid

OCTOBER 2, 2019

The demand for Redis™ is skyrocketing across dozens of use cases, particularly for cache, queues, geospatial data, and high speed transactions.

Azure 100

Azure Availability Open Source Virtualization 100

Dean Hume

MAY 16, 2018

Have you ever been on a website and noticed a popup notification that suggests that there is a new version of the site available? This is where a pop up notification like Google’s Inbox provides the user with a means of always having the latest version of cached resources. then(cache => cache.addAll([ './dog.jpg'

Availability 100

Availability Cache Code Google 100

SQL Performance

SEPTEMBER 25, 2019

Performance spools are lazy spools added by the optimizer to reduce the estimated cost of the inner side of nested loops joins. An example plan shape showing a lazy table performance spool is below: The questions I set out to answer in this article are why, how, and when the query optimizer introduces each type of performance spool.

Performance 104

Performance Cache Servers Education 104

Dynatrace

SEPTEMBER 13, 2023

The framework comprises six pillars: Operational Excellence, Security, Reliability, Performance Efficiency, Cost Optimization, and Sustainability. And how can you verify this performance consistently across a multicloud environment that also uses Microsoft Azure and Google Cloud Platform frameworks?

AWS 259

AWS Efficiency Azure Cloud 259

Scalegrid

MARCH 28, 2024

In this comparison of Redis vs Memcached, we strip away the complexity, focusing on each in-memory data store’s performance, scalability, and unique features. Redis and Memcached both provide high performance with sub-millisecond response times. Choosing between Redis and Memcached hinges on specific application requirements.

Cache 130

Cache Storage Architecture Scalability 130

The Netflix TechBlog

SEPTEMBER 10, 2024

Finally, the device receives the message, and the action, such as “Show me Stranger Things on Netflix”, is performed. Throughout this evolution, we’ve been able to maintain high availability and a consistent message delivery rate, with Pushy successfully maintaining 99.999% reliability for message delivery over the last few months.

Latency 233

Latency Cache Tuning Efficiency 233

Scalegrid

APRIL 16, 2020

Each of these models is suitable for production deployments and high traffic applications, and are available for all of our supported databases, including MySQL , PostgreSQL , Redis™ and MongoDB® database ( Greenplum® database coming soon). This becomes really important for cache solutions like Redis™. Reserved Instances. Expert Tip.

Cloud 242

Cloud Azure AWS Database 242

Dynatrace

NOVEMBER 3, 2021

Because monitoring tends to focus on key indicators such as utilization rates and throughput, monitoring indicates overall system performance. Examples include a spike in memory utilization, a decrease in cache hit ratio, or an increase in CPU utilization. This centralized, automatic approach eliminates the need for manual diagnostics.

Monitoring 233

Monitoring Metrics DevOps Scalability 233