The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. This avoids thrashing caches too much for B and evens out the pressure on the L3 caches of the machine.

Cache 258

Cache Latency Airlines Logistics 258

The Netflix TechBlog

SEPTEMBER 18, 2024

Additionally, the tight coupling with multiple native database APIs — APIs that continually evolve and sometimes introduce backward-incompatible changes — resulted in org-wide engineering efforts to maintain and optimize our microservice’s data access. Either or both may be required by backing storage engines to de-duplicate mutations.

Latency 260

Latency Storage Cache Servers 260

Alex Russell

MARCH 31, 2022

Browsers will cache tools popular among vocal, leading-edge developers. There's plenty of space for caching most popular frameworks. The best available proxy data also suggests that shared caches would have a minimal positive effect on performance. Suppose a user has only downloaded part of the cache. None of this holds.

Cache 89

Cache Government Traffic Network 89

CSS Wizardry

SEPTEMBER 16, 2024

This gives fascinating insights into the network topography of our visitors, and how much we might be impacted by high latency regions. You can’t change that someone was from Nigeria, you can’t change that someone was on a mobile, and you can’t change their network conditions. Go and give it a quick read—the context will help.

Latency 234

Latency Cache Transportation Mobile 234

The Netflix TechBlog

SEPTEMBER 24, 2021

It is worth pointing out that cloud processing is always subject to variable network conditions. Our previous blog post described how MezzFS addresses the challenges for reads using various techniques, such as adaptive buffering and regional caches, to make the system performant and to lower costs. We’re hiring!

Cloud 242

Cloud Media Storage Cache 242

Dynatrace

NOVEMBER 28, 2022

Lambda then takes a snapshot of the memory and disk state of the initialized execution environment, persists the encrypted snapshot, and caches it for low-latency access. Saving your cloud operations and site reliability engineering teams hours of guesswork and manual tagging, the Davis AI engine analyzes billions of events in real time.

Lambda 246

Lambda AWS Serverless Latency 246

The Netflix TechBlog

SEPTEMBER 8, 2020

This allowed Android engineers to have much more control and observability over how we get our data. This allows the app to query a list of “paths” in each HTTP request, and get specially formatted JSON (jsonGraph) that we use to cache the data and hydrate the UI. This meant that data that was static (e.g.

Latency 241

Latency Cache Java Traffic 241

The Netflix TechBlog

MARCH 6, 2019

Mounting object storage in Netflix’s media processing platform By Barak Alon (on behalf of Netflix’s Media Cloud Engineering team) MezzFS (short for “Mezzanine File System”) is a tool we’ve developed at Netflix that mounts cloud objects as local files via FUSE. Disk Caching? — ? Regional caching? —?Netflix Replays? —?More

Media 218

Media Storage Processing Cache 218

Scalegrid

OCTOBER 2, 2019

Redis, the #1 key-value store and top 10 database in the world, has grown by over 300% in popularity over that past 5 years, per the DB-Engines knowledge base. The demand for Redis is skyrocketing across dozens of use cases, particularly for cache, queues, geospatial data, and high speed transactions.

Azure 37

Azure Cloud Open Source Virtualization 37

The Morning Paper

MARCH 8, 2020

Building an elastic query engine on disaggregated storage , Vuppalapati, NSDI’20. If all data was read from S3 every time, performance would suffer, so of course Snowflake has a caching layer – a distributed ephemeral storage service shared by all the nodes in a warehouse. joins) during query processing.

Storage 112

Storage Engineering Cache Serverless 112

ACM Sigarch

DECEMBER 19, 2022

When I worked at Google, fleet-wide profiling revealed that 25-35% of all CPU time was spent just moving bytes around: memcpy, strcmp, copying between user and kernel buffers in network and disk I/O, hidden copy-on-write in soft page faults, checksumming, compressing, decrypting, assembling/disassembling packets and HTML pages, etc.

Design 145

Design Systems Cache Network 145

The Netflix TechBlog

JULY 1, 2019

As UI engineers we are excited about delivering creative and engaging experiences that help members choose the content they will love so we are always trying to push the limits of our UI. Our UI runs on top of a custom rendering engine which uses what we call a “surface cache” to optimize our use of graphics memory.

Cache 167

Cache Design Testing Development 167

The Netflix TechBlog

NOVEMBER 23, 2020

Introducing gnmi-gateway: a modular, distributed, and highly available service for modern network telemetry via OpenConfig and gNMI By: Colin McIntosh, Michael Costello Netflix runs its own content delivery network, Open Connect , which delivers all streaming traffic to our members.

Open Source 188

Open Source Network Transportation Cache 188

All Things Distributed

SEPTEMBER 3, 2013

Amazon ElastiCache is a fully managed, in-memory caching service for customers to optimize the latency, performance and cost of their read workloads. The db.cr1.8xlarge has 88 ECUs, 244GB of memory, high-bandwidth network, and the ability to deliver up to 20,000 IOPS for MySQL 5.6,

Cache 99

Cache Cloud Performance Retail 99

Dynatrace

SEPTEMBER 13, 2023

These workflows also utilize Davis® , the Dynatrace causal AI engine, and all your observability and security data across all platforms, in context, at scale, and in real-time. Storing frequently accessed data in faster storage, usually in-memory caching, improves data retrieval speed and overall system performance. Beyond

AWS 305

AWS Efficiency Azure Cloud 305

The Netflix TechBlog

MARCH 5, 2019

Netflix’s engineering culture is predicated on Freedom & Responsibility, the idea that everyone (and every team) at Netflix is entrusted with a core responsibility and they are free to operate with freedom to satisfy their mission. All these micro-services are currently operated in AWS cloud infrastructure.

Infrastructure 185

Infrastructure Cloud Scalability AWS 185

Smashing Magazine

DECEMBER 23, 2020

However, let’s take a step further and learn how to deploy modern qualities to PWAs, such as offline functionality, network-based optimizing, cross-device user experience, SEO capabilities, and non-intrusive notifications and requests. When developing a PWA, you can cache the application shell’s resources and assets in the browser.

Cache 136

Cache Internet Internet Google 136

The Netflix TechBlog

SEPTEMBER 10, 2024

The folks on the Cloud Data Engineering (CDE) team, the ones building the paved path for internal data at Netflix, graciously helped us scale it up and make adjustments, but it ended up being an involved process as we kept growing. For these requests where caching removed KeyValue from the hot path, we were able to greatly speed things up.

Latency 234

Latency Cache Tuning Efficiency 234

Speed Curve

JANUARY 19, 2025

Of course writes were much less common than reads, so I added a caching layer for reads, and that did the trick. A critical part of the code yellow was ensuring Google's sites would be fast for users across the globe, even if they had slow networks and low end devices. What is the charter of the Chrome Speed Metrics team?

Performance 98

Performance Google Speed Metrics 98

Scalegrid

MARCH 28, 2024

Key Takeaways Redis offers complex data structures and additional features for versatile data handling, while Memcached excels in simplicity with a fast, multi-threaded architecture for basic caching needs. Redis is better suited for complex data models, and Memcached is better suited for high-throughput, string-based caching scenarios.

Cache 130

Cache Storage Scalability Architecture 130

High Scalability

OCTOBER 3, 2019

Redis, the #1 key-value store and top 10 database in the world, has grown by over 300% in popularity over that past 5 years, per the DB-Engines knowledge base. The demand for Redis is skyrocketing across dozens of use cases, particularly for cache, queues, geospatial data, and high speed transactions.

Azure 23

Azure Cloud Open Source Cache 23

Dynatrace

APRIL 21, 2022

Using a data-driven approach to size Azure resources, Dynatrace OneAgent captures host metrics out-of-the-box to assess CPU, memory, and network utilization on a VM host. In comparison, the Dynatrace platform reliably takes that burden off human operators by utilizing its causation-based AI engine, Davis. Missing caching layers.

Azure 246

Azure Monitoring Virtualization Metrics 246

Smashing Magazine

NOVEMBER 8, 2021

On top of this foundation, we add layers of caching, prerendering and edge delivery optimizations — not the other way around. Hydrogen fuels dynamic commerce by uniting React Server Components, streaming server-side rendering, and smart caching controls. Large preview ). This is not a debate about dynamic vs. static.

Cache 139

Cache Best Practices Strategy Servers 139

Smashing Magazine

JUNE 8, 2021

Image optimization , loading behavior and rendering in the browser require understanding of image formats and image compression techniques, image decoding and browser rendering, image CDNs and adaptive media loading, not to mention effective caching and preloading. Optimizing Network Requests with Caching and Preloading. +.

Media 124

Media Cache Google Best Practices 124

All Things Distributed

DECEMBER 5, 2010

There is more than one Werner Vogels in this world and although I never get emails, snail mail or phones calls for any of my peers, I am sure they are somewhat frustrated if they type in our name in a search engine :-). There are two main types of DNS servers: authoritative servers and caching resolvers.

Cloud 113

Cloud Internet Internet AWS 113

Smashing Magazine

MAY 25, 2022

When the JavaScript engine runs a garbage-collection process, the man object will be removed from memory and from the WeakMap that we assigned it to. As we know from the section on garbage collection above, the JavaScript engine keeps a value in memory as long as it is reachable. Comparing Map and WeakMap. Let’s see this in action.

Cache 128

Cache Programming Storage Code 128

The Netflix TechBlog

OCTOBER 8, 2024

Challenges At Netflix, temporal data is continuously generated and utilized, whether from user interactions like video-play events, asset impressions, or complex micro-service network activities. Once a range of data becomes immutable, we can safely do things like caching, compressing, and compacting it for reads.

Latency 239

Latency Storage Traffic Tuning 239

Scalegrid

OCTOBER 2, 2019

Redis™, the #1 key-value store and top 10 database in the world, has grown by over 300% in popularity over that past 5 years, per the DB-Engines knowledge base. The demand for Redis™ is skyrocketing across dozens of use cases, particularly for cache, queues, geospatial data, and high speed transactions.

Azure 100

Azure Availability Open Source Virtualization 100

All Things Distributed

JUNE 21, 2017

Today, I'm excited to announce the general availability of Amazon DynamoDB Accelerator (DAX) , a fully managed, highly available, in-memory cache that can speed up DynamoDB response times from milliseconds to microseconds, even at millions of requests per second. Adding caching when your app is already experiencing load is not easy.

Speed 95

Speed Cache Latency AWS 95

Smashing Magazine

APRIL 28, 2021

Image optimization , loading behavior and rendering in the browser require understanding of image formats and image compression techniques, image decoding and browser rendering, image CDNs and adaptive media loading, not to mention effective caching and preloading. Optimizing Network Requests with Caching and Preloading. +.

Media 105

Media Cache Google Best Practices 105

All Things Distributed

JUNE 20, 2017

As well as AWS Regions, we also have 21 AWS Edge Network Locations in Asia Pacific. It's an entertainment website where users can post content or "memes" that they find amusing and share them across social media networks. AWS Partner Network (APN) Consulting Partners in Hong Kong help customers migrate to the cloud.

AWS 126

AWS Logistics Cloud Social Media 126

CSS - Tricks

JULY 25, 2019

Cache-Headers missing? Lighthouse uses Chrome’s Remote Debugging Protocol to read network request information, measure JavaScript performance, observe accessibility standards and measure user-focused timing metrics like First Contentful Paint , Time to Interactive or Speed Index. After that, it’ll be mitigated by cache.

Google 73

Google Engineering Speed Mobile 73

The Morning Paper

FEBRUARY 6, 2020

Last week we looked at a function shipping solution to the problem; Cloudburst uses the more common data shipping to bring data to caches next to function runtimes (though you could also make a case that the scheduling algorithm placing function execution in locations where the data is cached a flavour of function-shipping too).

Serverless 98

Serverless Lambda Cache Latency 98

Alex Russell

APRIL 29, 2021

Apple forces developers of competing browsers to use their engine for all browsers on iOS , restricting their ability to deliver a better version of the web platform. They are, pound for pound, some of the best engine developers globally and genuinely want good things for the web. So is speedy resolution and agreement.

Media 145

Media Games Education Engineering 145

Percona

MAY 2, 2023

At the same time that I see database engineers relying on the tool, sites such as StackOverflow are banning ChatGPT. ChatGPT: The InnoDB buffer pool is used by MySQL to cache frequently accessed data in memory. If we expand the cache concept more, the buffer pool could be even less if the working set (hot data) is smaller.

Social Media 145

Social Media Database Servers Cache 145

Smashing Magazine

JULY 6, 2021

If content items are not visualized in a tree structure, a strong search engine with facets and tagging capabilities is paramount for your content editors. The delivery of static assets in formats such as WebP via a Content Delivery Network (CDN) is also crucial to serving your users a fast website. Custom domain capabilities.

Cache 145

Cache Website Mobile Google 145

Smashing Magazine

JULY 29, 2019

Failing that, we are usually able to connect to home or public WiFi networks that are on fast broadband connections and have effectively unlimited data. The speed of mobile networks, too, varies considerably between countries. As for mobile network connection type, 84.7% Kyrgyzstan, Kazakhstan and Ukraine follow at $0.27, $0.49

Cache 99

Cache Mobile Google Network 99