The Netflix TechBlog

MARCH 28, 2025

Key insights from this shiftinclude: A Data-Centric Approach : Shifting focus from model-centric strategies, which heavily rely on feature engineering, to a data-centric one. At inference time, when multi-step decoding is needed, we can deploy KV caching to efficiently reuse past computations and maintain lowlatency.

Tuning 165

Tuning Efficiency Latency Strategy 165

Dynatrace

JANUARY 31, 2024

The RAG process begins by summarizing and converting user prompts into queries that are sent to a search platform that uses semantic similarities to find relevant data in vector databases, semantic caches, or other online data sources. Development and demand for AI tools come with a growing concern about their environmental cost.

Cache 276

Cache Azure Infrastructure Monitoring 276

Scalegrid

JANUARY 21, 2025

To monitor Redis instances effectively, collect Redis metrics focusing on cache hit ratio, memory allocated, and latency threshold. Selecting the right tool plays an important role in managing your strategy correctly while ensuring optimal performance across all clusters or singularly monitored redistributions.

Strategy 130

Strategy Monitoring Latency DevOps 130

The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. This avoids thrashing caches too much for B and evens out the pressure on the L3 caches of the machine.

Cache 258

Cache Latency Airlines Logistics 258

Dynatrace

APRIL 10, 2023

And according to recent data from Enterprise Strategy Group, 59% of survey respondents indicated spending on public cloud applications would increase in 2023. The company made these changes to support its ONETractor strategy, which seeks to deliver personalized, convenient shopping experiences anytime, anywhere.

Cloud 243

Cloud Ecommerce Performance Retail 243

CSS Wizardry

MAY 31, 2019

Users might already have the file cached. If website-a.com links to [link] , and a user goes from there to website-b.com who also links to [link] , then the user will already have that file in their cache. Penalty: Caching. This makes it very safe and sensible to enforce a reasonably aggressive cache policy.

Cache 274

Cache Latency Infrastructure Website 274

Scalegrid

DECEMBER 21, 2023

To monitor Redis® instances effectively, collect Redis metrics focusing on cache hit ratio, memory allocated, and latency threshold. Selecting the right tool plays an important role in managing your strategy correctly while ensuring optimal performance across all clusters or singularly monitored redistributions.

Strategy 130

Strategy Monitoring Latency DevOps 130

CSS Wizardry

NOVEMBER 9, 2018

While this strategy is effective, it’s not simple: highly dynamic sites can be difficult to extract styles from, the process needs to be automated, we have to make assumptions about what above the fold even is, it’s hard to capture edge cases, and tooling still in its relative infancy. This is on purpose. Test, test, test.

Network 278

Network Performance Media Cache 278

Dynatrace

APRIL 7, 2022

Every company has its own strategy as to which technologies to use. It exports any pre-instrumented metrics for JVM, CPU Usage, Spring MVC, and WebFlux request latencies, cache utilization, data source utilization as well as custom metrics to the Dynatrace Metrics API v2. Dynatrace news. That’s a large amount of data to handle.

Metrics 246

Metrics Java Latency Cache 246

Alex Russell

MARCH 31, 2022

Browsers will cache tools popular among vocal, leading-edge developers. There's plenty of space for caching most popular frameworks. The best available proxy data also suggests that shared caches would have a minimal positive effect on performance. Browsers now understand the classic shared HTTP cache behaviour as a privacy bug.

Cache 89

Cache Government Traffic Network 89

The Netflix TechBlog

SEPTEMBER 18, 2024

In this example configuration, the ngsegment namespace is backed by both a Cassandra cluster and an EVCache caching layer, allowing for highly durable persistent storage and lower-latency point reads. "persistence_configuration":[ Developers just provide their data problem rather than a database solution!

Latency 260

Latency Storage Cache Servers 260

Dynatrace

JANUARY 5, 2023

To prevent such a significant service disruption from happening again, we are taking several immediate and mid-term actions in addition to the existing rigorous automated testing process: Improve architectural design to eliminate SSO bottleneck risk.

Cache 246

Cache Monitoring Strategy Speed 246

CSS Wizardry

SEPTEMBER 16, 2024

Interestingly, 304 responses are still a form of redirect: the server is redirecting your visitor back to their HTTP cache. Ensure you aren’t wastefully revalidating still-fresh resources : These files were revalidated for a repeat page view as they all carried Cache-Control: public, max-age=0, must-revalidate.

Latency 234

Latency Cache Transportation Mobile 234

The Polyglot Developer

SEPTEMBER 9, 2019

Recently I’ve been playing around with Netlify and as a result I’m becoming more familiar with caching strategies commonly found with content delivery networks (CDN). One such strategy makes use of ETag identifiers for web resources.

Cache 69

Cache Testing Strategy Network 69

SQL Performance

OCTOBER 13, 2021

I also compare them with stored procedures, mainly focusing on differences in terms of default optimization strategy, and plan caching and reuse behavior. As mentioned earlier, the default query optimization strategy for iTVFs is different than the one for stored procedures. iTVFs vs. Stored Procedures. plan_handle , Q.

Cache 144

Cache Strategy C++ Code 144

The Netflix TechBlog

SEPTEMBER 8, 2020

Over the course of this post, we will talk about our approach to this migration, the strategies that we employed, and the tools we built to support this. This allows the app to query a list of “paths” in each HTTP request, and get specially formatted JSON (jsonGraph) that we use to cache the data and hydrate the UI.

Latency 241

Latency Cache Java Traffic 241

The Netflix TechBlog

MAY 4, 2023

This blog series will examine the tools, techniques, and strategies we have utilized to achieve this goal. In this testing strategy, we execute a copy (replay) of production traffic against a system’s existing and new versions to perform relevant validations. This approach has a handful of benefits.

Traffic 347

Traffic Latency Tuning Systems 347

Dynatrace

OCTOBER 29, 2019

Within the ServiceNow New York release, the Dynatrace integration includes a scheduled job called Dynatrace Inactivate Undiscoverable CIs that implements a default decommissioning strategy for Dynatrace CIs. As many companies implement their own strategies, this script is deactivated by default and can be activated on demand.

Cache 34

Cache Strategy Monitoring Engineering 34

CSS Wizardry

AUGUST 13, 2019

To further exacerbate the problem, the 302 response has a Cache-Control: must-revalidate, private. header , meaning that we will always make an outgoing request for this resource regardless of whether or not we’re hitting the site from a cold or a warm cache. Technically, what we have here is a CSS problem, not a font problem.

Latency 209

Latency Cache Strategy Media 209

ACM Sigarch

DECEMBER 19, 2022

We assume a base multi-core processor four-way-issue load/store machine with 64-bit integer/address registers Rx, 128-bit (16-byte) data registers Vx, and an L1 D-cache that can do two operations per cycle, each reading or writing an aligned 16-byte memory word. Cache pollution is addressed in a section below.). Cache Underpinning.

Design 145

Design Systems Cache Network 145

Dynatrace

SEPTEMBER 13, 2023

Because Google offers its own Google Cloud Architecture Framework and Microsoft its Azure Well-Architected Framework , organizations that use a combination of these platforms triple the challenge of integrating their performance frameworks into a cohesive strategy.

AWS 305

AWS Efficiency Azure Cloud 305

The Netflix TechBlog

OCTOBER 8, 2024

TimeSeries Abstraction The TimeSeries Abstraction was developed to meet these requirements, built around the following core design principles: Partitioned Data : Data is partitioned using a unique temporal partitioning strategy combined with an event bucketing approach to efficiently manage bursty workloads and streamline queries.

Latency 239

Latency Storage Traffic Tuning 239

Smashing Magazine

JUNE 29, 2021

Without build optimizations (incremental builds, caching, we will get to those soon) this will eventually become unmanageable as well — think about going through all images in a website: resizing, deleting, and/or creating new files over and over again. The cache is invalidated on a time basis. Creating an On-Demand builder.

Cache 139

Cache Website Strategy Traffic 139

The Netflix TechBlog

AUGUST 10, 2020

This multi-pass strategy , previously employed for our mobile encodes , allows us to avoid over-allocating bits to less complex content, as compared to using a complexity-defined, albeit fixed, bitrate for the entire title. how long it takes for the video to start playing), rebuffer rates, etc.,

Innovation 242

Innovation Traffic Network Efficiency 242

Dynatrace

OCTOBER 21, 2020

To solve this problem several strategies were discussed. One of them being a small cache that would have brought the initial startup time down by about 95%. Step 4: Fixing the issue. Another one was to rethink the whole requirement for this check during startup.

Code 246

Code Cloud Engineering Java 246

Smashing Magazine

NOVEMBER 8, 2021

At the limit, statically generated, edge delivered, and HTML-first pages look like the optimal strategy. On top of this foundation, we add layers of caching, prerendering and edge delivery optimizations — not the other way around. Large preview ). This is not a debate about dynamic vs. static. You need both.

Cache 139

Cache Best Practices Strategy Servers 139

Smashing Magazine

DECEMBER 23, 2020

The service workers enable the offline usage of the PWA by fetching cached data or informing the user about the absence of an Internet connection. When developing a PWA, you can cache the application shell’s resources and assets in the browser. Cached content with IndexedDB. Cache first, then network. Service Workers.

Cache 136

Cache Internet Internet Google 136

Dynatrace

NOVEMBER 3, 2021

Examples include a spike in memory utilization, a decrease in cache hit ratio, or an increase in CPU utilization. For example, when monitoring a database, you’ll want to know about any latency when writing data to a disk or average query response time. The post Observability vs. monitoring: What’s the difference?

Monitoring 264

Monitoring Metrics DevOps Scalability 264

The Netflix TechBlog

JULY 21, 2022

Some features (as an example) include Device Type ID, SDK Version, Buffer Sizes, Cache Capacities, UI resolution, Chipset Manufacturer and Brand. Internally, the app caches several pre-fetched data, images, descriptions etc, and the time spent in the level could indicate whether or not those caches are cleared.

Big Data 188

Big Data Cache Engineering Data Engineering 188

Dynatrace

DECEMBER 13, 2023

In-app purchases can help to measure the overall effectiveness of your business strategy. This can be achieved by reducing the size of files or images, using caching, and compressing data. App crashes and errors help identify issues that may be impacting the user experience, so they can be remediated. Optimize images and videos.

Best Practices 246

Best Practices Mobile Metrics Performance 246

Dynatrace

APRIL 8, 2020

Nearly all garbage collection strategies are well suited for such a scenario; they do their job well and are fast. You should also be careful when adding any sort of cache or object reuse strategy. The best optimization strategy is to simply remove unnecessary allocations by optimizing the code.

Speed 214

Speed Code Java Lambda 214

Speed Curve

JANUARY 19, 2025

Of course writes were much less common than reads, so I added a caching layer for reads, and that did the trick. There were two case studies highlighting third party wins published on web.dev ( 1 , 2 ), and Google Publisher Tag launched a new yielding strategy.

Performance 98

Performance Google Speed Metrics 98

Scalegrid

MARCH 28, 2024

Key Takeaways Redis offers complex data structures and additional features for versatile data handling, while Memcached excels in simplicity with a fast, multi-threaded architecture for basic caching needs. Redis is better suited for complex data models, and Memcached is better suited for high-throughput, string-based caching scenarios.

Cache 130

Cache Storage Scalability Architecture 130

The Netflix TechBlog

OCTOBER 16, 2019

Often the data is held in memory by consumers and used as a “total cache”, where it is accessed at runtime by client code and atomically swapped out under the hood. for example Open Connect Appliance cache configuration, supported device type IDs, supported payment method metadata, and A/B test configuration.

Cache 191

Cache Architecture Metrics Java 191

Smashing Magazine

JULY 15, 2021

These terms are strategies for incrementally building websites. It is based on a caching strategy called “stale while revalidate”, meaning a page can be “stale” with old information until it’s re-generated and the cache is updated. That’s where you’re wrong! You’re about to understand them now. What Are These Things?

Cache 129

Cache Website Strategy Servers 129

Dynatrace

DECEMBER 20, 2021

Streamlined asset caching: Asset caching is critical for creating accurate replays. Develop a broad recording strategy. Make sure you know what assets your replay tool is recording and how you can access them. Analyzing session recordings. Is the plan to record all user sessions across all websites and apps?

Mobile 264

Mobile Website Analytics Cache 264

Dynatrace

MAY 2, 2019

Best practice: Reduce bandwidth consumption by caching and keeping information. Host and service details typically don’t change from minute to minute, so try to cache that information across multiple API calls to reduce the bandwidth required for API calls.

Best Practices 174

Best Practices Monitoring Cache Speed 174