The Netflix TechBlog

MARCH 7, 2024

In this article, we cover a few key integrations that we provide for various layers of the Metaflow stack at Netflix, as illustrated above. These integrations are implemented through Metaflow’s extension mechanism which is publicly available but subject to change, and hence not a part of Metaflow’s stable API yet.

Systems 238

Systems Media Cache Open Source 238

Dean Hume

MAY 16, 2018

Have you ever been on a website and noticed a popup notification that suggests that there is a new version of the site available? This is where a pop up notification like Google’s Inbox provides the user with a means of always having the latest version of cached resources. then(cache => cache.addAll([ './dog.jpg'

Availability 100

Availability Cache Code Google 100

KeyCDN

JUNE 6, 2019

We’re happy to announce that WebP Caching has landed! The new feature integrates into the existing CDN and is available to all customers. How Does WebP Caching Work? our article Convert to WebP Format we explain in detail how to configure your origin server. Make sure these settings are aligned with your setup.

Cache 81

Cache Servers Website Traffic 81

CSS Wizardry

NOVEMBER 9, 2018

This article is getting way, way more forensic than I intended. We’re bound to an inefficient caching strategy: a change to, say, the background colour of the currently-selected day on a date picker used on only one page, would require that we cache-bust the entirety of app.css. There is a lot to digest in this article.

Network 279

Network Performance Media Cache 279

The Netflix TechBlog

SEPTEMBER 18, 2024

Central to this infrastructure is our use of multiple online distributed databases such as Apache Cassandra , a NoSQL database known for its high availability and scalability. In addition to storing item size information in the page token, the server also estimates the average item size for a given namespace and caches it locally.

Latency 254

Latency Storage Cache Efficiency 254

The Netflix TechBlog

SEPTEMBER 8, 2020

This allows the app to query a list of “paths” in each HTTP request, and get specially formatted JSON (jsonGraph) that we use to cache the data and hydrate the UI. ecosystem was chosen for this new service deserves an article in and of itself. ecosystem and the rich selection of npm packages available.

Latency 243

Latency Cache Java Traffic 243

Scalegrid

MARCH 28, 2024

Key Takeaways Redis offers complex data structures and additional features for versatile data handling, while Memcached excels in simplicity with a fast, multi-threaded architecture for basic caching needs. Redis is better suited for complex data models, and Memcached is better suited for high-throughput, string-based caching scenarios.

Cache 130

Cache Storage Architecture Scalability 130

The Netflix TechBlog

SEPTEMBER 10, 2024

Since that presentation, Pushy has grown in both size and scope, and this article will be discussing the investments we’ve made to evolve Pushy for the next generation of features. This also enables things like subscribing to device events to know when another device comes online and when they’re available to pair or send a message to.

Latency 233

Latency Cache Tuning Efficiency 233

The Netflix TechBlog

MARCH 7, 2023

We refer the reader to our previous blog article for details. Marken Architecture Our goal was to help teams at Netflix to create data pipelines without thinking about how that data is available to the readers or the client teams. This new operation is marked to be in STARTED state. They pass annotations along with the OperationID.

Media 275

Media Latency Architecture Database 275

The Netflix TechBlog

JULY 21, 2022

Problem Statement The purpose of this article is to give insights into analyzing and predicting “out of memory” or OOM kills on the Netflix App. More importantly, the low resource availability or “out of memory” scenario is one of the common reasons for crashes/kills. Labeling the data?—?Ground of the time (False Positives).

Big Data 190

Big Data Cache Engineering Data Engineering 190

KeyCDN

SEPTEMBER 3, 2020

Even if a browser doesn't support WebP, our WebP caching feature will ensure that the correct image format is delivered. WebP delivery doesn't require any change on the origin server with the WebP caching feature. We won't go into detail in this article. The available operations are listed in our documentation.

Processing 127

Processing Cache Website Servers 127

Dynatrace

MAY 17, 2023

bBy making your system observable and making use of the available tools and technologies (and logging is still one of them), you’ll be able to super-charge the information you can get from your runtime and spot issues and performance bottlenecks a lot easier.

Metrics 192

Metrics Open Source Traffic Cache 192

The Netflix TechBlog

NOVEMBER 23, 2020

Introducing gnmi-gateway: a modular, distributed, and highly available service for modern network telemetry via OpenConfig and gNMI By: Colin McIntosh, Michael Costello Netflix runs its own content delivery network, Open Connect , which delivers all streaming traffic to our members. The Gateway To fill these gaps?—?under

Open Source 188

Open Source Network Transportation Cache 188

KeyCDN

FEBRUARY 4, 2021

For example, if a lookup fails and times out to your first DNS server it queries the next DNS server until the correct IP address is returned, or it is unable to resolve as seen in the infamous "This webpage is not available" error below. Oddly enough we encountered this error to a third party website while writing this article.

Cache 134

Cache Website Internet Internet 134

Percona

MAY 10, 2023

There is a good article that goes into more detail on the subject, but basically, “IOWait” is kind of idle CPU time. With this extension, we can clearly see which processes are runnable (running or blocked on CPU availability) and which are waiting on disk I/O!

Cache 144

Cache Monitoring Open Source Processing 144

Percona

APRIL 24, 2023

I keep seeing many articles and talks on “tuning” discussing how creating new indexes speeds up SQL but rarely ones discussing removing them. Effectively, the memory available for pages of the table gets less. The more indexes, the more the requirement of memory for effective caching.

Tuning 131

Tuning Cache Storage Database 131

SQL Shack

NOVEMBER 23, 2021

This article explores the Hybrid Buffer Pool feature available in the SQL Server 2019. Introduction SQL Server uses Dynamic Random Access Memory (D-RAM) buffer pool for caching data pages retrieved from the disk. The buffer cache stores the page and writes back to disk only if it is modified.

Servers 93

Servers Cache Availability Performance 93

Highly Scalable

SEPTEMBER 18, 2012

In this article I’m trying to provide more or less systematic description of techniques related to distributed operations in NoSQL databases. In the rest of this article we study a number of distributed activities like replication of failure detection that could happen in a database. Data Placement. Read/Write latency. Consistency.

Database 213

Database Latency C++ Scalability 213

Smashing Magazine

JUNE 29, 2021

Without build optimizations (incremental builds, caching, we will get to those soon) this will eventually become unmanageable as well — think about going through all images in a website: resizing, deleting, and/or creating new files over and over again. The cache is invalidated on a time basis. Creating an On-Demand builder.

Cache 132

Cache Website Strategy Traffic 132

Smashing Magazine

DECEMBER 23, 2020

The service workers enable the offline usage of the PWA by fetching cached data or informing the user about the absence of an Internet connection. When developing a PWA, you can cache the application shell’s resources and assets in the browser. Cached content with IndexedDB. Cache first, then network. Service Workers.

Cache 126

Cache Internet Internet Google 126

Smashing Magazine

JULY 6, 2021

In this article, I will highlight a few core features that every headless CMS should provide. But where do they preview the content before it is made available to the general public? A preview feature must be available in the pricing plan you have chosen for the headless CMS of your choice. Content Previews. Native SDKs.

Cache 144

Cache Website Mobile Google 144

Smashing Magazine

NOVEMBER 4, 2021

It allows developers to define, handle, and make queries/mutations available within our application. In this article, we’re going to learn how to handle real-time updates on the client-side using GraphQL. We’ll be learning how to do this with GraphQL Features like Cache Update, Subscriptions, and Optimistic UI.

Cache 118

Cache Servers Code Transportation 118

Smashing Magazine

MAY 25, 2022

The code below illustrates how to use WeakSet() and some of the methods available: const human = new WeakSet(); let paul = {name: "Paul"}; let mary = {gender: "Mary"}; // Add the human with the name paul to the classroom. WeakMap can be used in two areas of web development: caching and additional data storage. Let’s see this in action.

Cache 120

Cache Programming Storage Code 120

CSS - Tricks

APRIL 19, 2021

Milica Mihajlija puts a point on exactly why: When there is CSS available for a page, whether it’s inline or an external stylesheet, the browser delays rendering until the CSS is parsed. The classics like caching, minification, and compression help. Direct Link to Article — Permalink. So how do you improve it?

Performance 98

Performance Cache Availability 98

CSS - Tricks

APRIL 1, 2021

The code for the site is available on GitHub for reference. In that spirit, what we’re looking at in this article is focused more on the incremental wins and less on providing an exhaustive list or checklist of performance strategies. Compressing, minifying and caching assets. Again, every millisecond counts. Lighthouse.

Cache 92

Cache Social Media Media Network 92

SQL Performance

SEPTEMBER 25, 2019

An example plan shape showing a lazy table performance spool is below: The questions I set out to answer in this article are why, how, and when the query optimizer introduces each type of performance spool. For more details, please see my linked article. When a spool is able to replay cached results, this is known as a rewind.

Performance 104

Performance Cache Servers Education 104

Smashing Magazine

JULY 29, 2019

This article is part of a series in which I attempt to use the web under various constraints, representing a given demographic of user. MB , that suggests I’ve got around 29 pages in my budget, although probably a few more than that if I’m able to stay on the same sites and leverage browser caching. Let’s talk about caching.

Cache 97

Cache Mobile Google Network 97

O'Reilly Software

DECEMBER 28, 2017

Learn how to properly design RESTful APIs communication with clients, accounting for request structure, authentication, and caching. This series of articles shows you how to derive an easy-to-use, robust, efficient API to serve users on the web or on mobile devices. We are using the principles of RESTful architecture over HTTP.

Servers 83

Servers Cache Mobile Architecture 83

Highly Scalable

APRIL 2, 2012

In this article, I describe major architectural decisions we made and techniques we used. Besides this, each product has some transient information like in-stock availability that is a subject of frequent updates (every 5 minutes or so). I can recommend this article by Peter Morville and Jeffrey Callender for further reading.

Ecommerce 100

Ecommerce Cache Storage Architecture 100

Brendan Gregg

MARCH 16, 2024

This technique saves two instructions in the prologue and epilogue and makes one additional general-purpose register (%rbp) available." Only in extreme circumstances does the cost (in processor time and I-cache footprint) translate to a tangible benefit - circumstances which usually resort to hand-coded assembly anyway.

Java 137

Java Cache Google Hardware 137

Smashing Magazine

MAY 16, 2022

For this article, that’s all we’ll need to start exposing the value and leave other more specific articles to go deeper. There are a handful of different entry subtypes but, for the scope of this article, we will be concerned with the PerformanceResourceTiming and PerformanceNavigationTiming subtypes. More after jump!

Servers 95

Servers Monitoring Cache Network 95

Smashing Magazine

MAY 25, 2021

Smashing Magazine, like most publishers, makes use of web fonts and the below screenshot shows the difference between the initial render (with the fallback fonts), and the final render (with the web fonts): Smashing Magazine article with fallback font and with full web fonts. Large preview ). Large preview ). When Can We Start Using This?

Operating System 144

Operating System Google Website Cache 144

Smashing Magazine

AUGUST 31, 2021

This article is intended to be used as a primer for managing complex states in a Next.js Unfortunately, the framework is way too versatile for us to cover all possible use cases in this article. It would be beyond the scope of this article to suggest when to use one or another, so let’s keep it simple by saying: useState.

Cache 104

Cache Servers Best Practices Code 104

Smashing Magazine

OCTOBER 26, 2021

In this article, we will go through how to optimize and build a high-performance Next.js If you’re a developer looking to optimize applications and create reuseable components across applications effectively, this article will show you how to quickly scale your applications, and how to work with Nx. Optimizing Next.js Optimizing Next.js

Cache 112

Cache Servers Code Testing 112

SQL Performance

OCTOBER 7, 2020

Its raison d’être is to cache result rows from a plan subtree, then replay those rows on subsequent iterations if any correlated loop parameters are unchanged. For more background on these performance spools see my prior article. With those out of the way, this article is exclusively about Sorts and when they can rewind.

Servers 106

Servers Cache Azure Performance 106

Brendan Gregg

AUGUST 29, 2021

Reads usually have apps waiting on them; writes may not (write-back caching). total used free shared buff/cache available Mem: 64414 15421 349 5 48643 48409 Swap: 0 0 0. There's not much memory left, 349 Mbytes, but more interesting is the amount in the buffer/page cache: 48,643 Mbytes (48 Gbytes). This is "cache busting."

Cache 78

Cache C++ AWS Java 78

Jos

APRIL 6, 2018

The article will be using Preact/React, yet the ideas can be applied to any other component library. At the time of writing this article, Googlebot supports IntersectionObserver and it invokes its callback with changes in the viewport above the fold. This post is also available in Spanish Did you see any typo or wrong information?

Code 147

Code Performance Media Google 147