The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. This avoids thrashing caches too much for B and evens out the pressure on the L3 caches of the machine.

Cache 255

Cache Latency Airlines Logistics 255

High Scalability

JANUARY 11, 2022

Generating machine learning based personalized recommendations to discover new people, photos, videos, and stories relevant one’s interest. We will use a cache having an LRU based eviction policy for caching user feeds of active users. Users should be able to like and comment the posts. Out of Scope. High Level Design.

Design 334

Design Media Storage Logistics 334

The Netflix TechBlog

MARCH 10, 2023

By Burak Bacioglu , Meenakshi Jindal Asset Management at Netflix At Netflix, all of our digital media assets (images, videos, text, etc.) Most applications in content and studio engineering at Netflix deal with assets; such as videos, images, text, etc. are stored in secure storage layers.

Strategy 261

Strategy Cache Analytics Storage 261

The Netflix TechBlog

MARCH 7, 2023

in a video file. As described in the above picture During the first run of the algorithm it identified 500 objects in a particular Video file. Now when we re-ran the algorithm on the same video file it created 600 annotations of schema type Objects and stored them in our service. The Algorithm team improved their algorithm.

Media 268

Media Latency Architecture Database 268

Dynatrace

DECEMBER 13, 2023

This can be achieved by reducing the size of files or images, using caching, and compressing data. Optimize images and videos. Images and videos can be resource-intensive and can slow down your app’s performance.

Best Practices 246

Best Practices Mobile Metrics Performance 246

Dynatrace

AUGUST 1, 2022

Interestingly, our partner RedHat reported in 2021 that around 80% of deployed workloads are databases or data caches, storing data in persistent volume claims (PVCs). You also decide to run your database for storing user uploads – such as images or videos – directly in Kubernetes.

Storage 246

Storage Database Network Metrics 246

Dynatrace

DECEMBER 20, 2021

Session replay is an IT technology that creates anonymized video-like recordings of actions taken by users interacting with your website or mobile application. The result is a complete recreation of the user experience in a video-like format. Streamlined asset caching: Asset caching is critical for creating accurate replays.

Mobile 264

Mobile Website Analytics Cache 264

The Netflix TechBlog

JULY 1, 2019

Development As part of developing this type of UI experience on any platform, we knew we would need to think about creating smooth, performant animations with a balance between quality and download size for the images and video previews, all without degrading the performance of the app. images no longer in the viewport).

Cache 166

Cache Design Testing Development 166

Dynatrace

NOVEMBER 29, 2021

According to the official AWS announcement, Graviton2-based Lambda functions offer up to 34% better price-performance improvement.

Lambda 246

Lambda AWS Serverless Metrics 246

The Netflix TechBlog

OCTOBER 8, 2024

Rajiv Shringi Vinay Chella Kaidan Fullerton Oleksii Tkachuk Joey Lynch Introduction As Netflix continues to expand and diversify into various sectors like Video on Demand and Gaming , the ability to ingest and store vast amounts of temporal data — often reaching petabytes — with millisecond access latency has become increasingly vital.

Latency 235

Latency Storage Traffic Infrastructure 235

Smashing Magazine

JULY 6, 2021

Web pages, such as the one you’re reading now, have text, images, videos and other assets to bring information to you. Along with images, the next heaviest assets are videos. Once again, with the microservices mindset, streaming of videos should be left to service providers such as YouTube, Vimeo and other online streaming services.

Cache 145

Cache Website Mobile Google 145

The Polyglot Developer

SEPTEMBER 15, 2021

So you want to add your YouTube videos to your static generated website, but you don’t want to manually keep track of all your videos and playlists? It’s a Pokémon website built with Eleventy that shows a list of my YouTube videos among other things. I get it because I’ve been there!

Cache 59

Cache Website Development 59

Brendan Gregg

SEPTEMBER 5, 2021

The ZFS Adapative Replacement Cache (ARC) is the main memory cache for the file system. The arc_reclaim_thread periodically runs arc_adjust() to evict memory from the cache to keep it from growing too large, and to maintain a threshold of free memory that applications can quickly use. I worked on this code back at Sun.

Cache 141

Cache Cloud Code Java 141

Smashing Magazine

JULY 29, 2019

MB , that suggests I’ve got around 29 pages in my budget, although probably a few more than that if I’m able to stay on the same sites and leverage browser caching. There’s a trade-off to be made here, as external stylesheets can be cached but inline ones cannot (unless you get clever with JavaScript ). Let’s talk about caching.

Cache 99

Cache Mobile Google Network 99

Smashing Magazine

SEPTEMBER 28, 2022

Continue reading below ↓ Meet Smashing Online Workshops on front-end & UX , with practical takeaways, live sessions, video recordings and a friendly Q&A. Active Memory Caching. When you want to get data that you already had quickly, you need to do caching — caching stores data that a user recently retrieved.

Cache 141

Cache Performance Servers Architecture 141

Speed Curve

FEBRUARY 10, 2025

1 Mbps Music streaming: 1-2 Mbps SD video streaming: 2-3 Mbps Video calls and gaming: 3-5 Mbps HD video streaming: 5-25 Mbps Stream 4K content and play competitive online games: 25-50 Mbps Keep in mind that the numbers above are bare minimums. Meeting these thresholds does not guarantee an optimal experience.

Hardware 52

Hardware Internet Internet Speed 52

High Scalability

NOVEMBER 2, 2018

They'll love it and you'll be their hero forever. $10

Internet 126

Internet Internet Scalability Azure 126

Smashing Magazine

NOVEMBER 4, 2021

We’ll be learning how to do this with GraphQL Features like Cache Update, Subscriptions, and Optimistic UI. Continue reading below ↓ Meet Smashing Online Workshops on front-end & UX , with practical takeaways, live sessions, video recordings and a friendly Q&A. More after jump! On design systems, CSS/JS and UX.

Cache 129

Cache Servers Code Transportation 129

Smashing Magazine

FEBRUARY 3, 2022

While working on a site recently, I noticed that an embedded YouTube video loaded around 600kB of JS for any visitor regardless of whether that user even chose to watch the video. On closer inspection, it appeared that other content embedded within tweets (video in particular) was contributing to this. With video.

Social Media 121

Social Media Media Website Airlines 121

Smashing Magazine

OCTOBER 2, 2023

Image Optimization Images are pieces of content in many contexts, and they are a very important and prominent part of the WaterBear app’s experience, from video posters and category banners to partner logos and campaign image assets. After scrolling the video category page, a bunch more images are loaded.

Cache 84

Cache Strategy Best Practices Design 84

Alex Russell

APRIL 29, 2021

Next-generation video codecs, supported in many modern chips, but also a licensing minefield. Necessary for building competitive video experiences, including messaging and videoconferencing. Fundamentally enabling for video creation apps. Without it, video recordings must fit in memory, leading to crashes. getUserMedia().

Media 145

Media Games Education Engineering 145

The Morning Paper

OCTOBER 4, 2020

Does 5G improve the end-user experience for applications (web browsing, and 4K+ video streaming)? Emerging architectures that shorten the path length, e.g. edge caching and computing, may also confine the latency. What about UHD video? The authors tested a mobile UHD panoramic video telephony app. energy consumption).

Energy 130

Energy Latency Performance Network 130

Smashing Magazine

NOVEMBER 22, 2021

This includes features like videos and animations, sophisticated interactions, and greater customization. Another benefit of moving computations from browsers to servers is that the results of these computations can often be cached and reused between sessions even for unrelated visitors, thus reducing per-session execution time dramatically.

Website 141

Website Performance Google Website Performance 141

Smashing Magazine

SEPTEMBER 2, 2021

Continue reading below ↓ Meet Smashing Online Workshops on front-end & UX , with practical takeaways, live sessions, video recordings and a friendly Q&A. Grid Critters is another interactive challenge-based platform to learn the different parts of the Grid Layout spec in a video-game-like environment. More after jump!

Development 145

Development Games Education Programming 145

Randon ASCII

SEPTEMBER 30, 2022

All I wanted was to record a forty-second voiceover for a throw-away video , so I fired up the Windows Voice Recorder app and hit the record button. In my case the directory structure of my documents directory was entirely cached in memory so there was zero disk activity required to do the scan, but some users are not so lucky.

Software 100

Software Software Cache Hardware 100

All Things Distributed

OCTOBER 12, 2016

While caching continues to be a dominant use of ElastiCache for Redis, we see customers increasingly use it as an in-memory NoSQL database. There are some great examples and use cases for Redis, which you can see at companies like Hudl, which offers mobile and desktop video analytics solutions to sports teams and athletes.

Scalability 102

Scalability Cache Analytics AWS 102

Speed Curve

APRIL 9, 2023

With the release of Lighthouse 10, one new performance audit was added and another best practices audit was modified: Page prevented back/forward (BF) cache navigation – When a site is able to leverage BF cache navigations, users can see a huge benefit and a perceived 'instant' loading of the page. What's new in Lighthouse 10?

Cache 83

Cache Best Practices Metrics Google 83

Dotcom-Montior

AUGUST 5, 2020

Browser Caching: Although it may seem commonplace, caching is sometimes overlooked. Depending on how often you change content, you may want to set a long expiration time for your cache. Caching can ensure your browser doesn’t have to load all those elements if a visitor returns to your pages.

Website 92

Website Speed Cache Traffic 92

n0derunner

JULY 23, 2019

In this video I migrate a Postgres DB running PGbench benchmark. Many different queries are executing in parallel, some hitting RAM cache, some hitting storage. Effect of removing CPU constraints and maintaining data locality on a running DB instance. The DB is running on a Host which is CPU constrained.

Benchmarking 76

Benchmarking Storage Cache Tuning 76

Percona

MAY 2, 2023

ChatGPT: The InnoDB buffer pool is used by MySQL to cache frequently accessed data in memory. If we expand the cache concept more, the buffer pool could be even less if the working set (hot data) is smaller. Questions Q: I have a MySQL server with 500 GB of RAM; my data set is 100 GB. How large my InnoDB buffer pool needs to be?

Social Media 145

Social Media Database Servers Cache 145

Brendan Gregg

FEBRUARY 28, 2023

The video is now on [YouTube]: The slides are [online] and as a [PDF]: first prev next last / permalink/zoom In Q&A I was asked about CXL (compute express link) which was fortunate as I had planned to cover it and then forgot, so the question let me talk about it (although Q&A is missing from the video).

Performance 103

Performance Latency Cache Google 103

Smashing Magazine

APRIL 17, 2019

The browser caches the results of these lookups, but they can be slow. You might think of a prefetch as being a bit like adding a file to the browser’s cache. Video or audio WebVTT tracks. One performance optimization technique is to reduce the number of DNS lookups required by organizing resources onto fewer domains.

Performance 109

Performance Servers Games Cache 109

Smashing Magazine

JUNE 25, 2020

Today, we’ll address storing and serving files for both single-server and scalable deployments while considering factors like compression, caching, and availability. Static files range from a few kilobytes of CSS to gigabytes of video. Most of the problems caused by static assets like photos and videos are because they are big files.

Media 77

Media Cache Storage AWS 77

SQL Performance

MARCH 30, 2021

If you would like to see that in action, see this short video by Erik Darling. Running a parallel plan on a single thread can also happen when a cached parallel plan is reused by a session that is limited to DOP 1 by an environmental setting (e.g. See Myth: SQL Server Caches a Serial Plan with every Parallel Plan for details.

Cache 98

Cache Servers Processing Operating System 98

CSS - Tricks

JULY 27, 2021

You can watch the video right here on the site, or over on their Twitch channel , which is worth a subscribe for more performance investigations like these. That redirect costs time, and as we dug into, not just first-page-load time, but every single page load, even cached page loads. Especially as it affects cached page loads too.

Cache 98

Cache Testing Google Innovation 98

Tim Kadlec

MARCH 7, 2017

When they split the talks out into separate videos, I’d definitely recommend watching this one. Paul would point out you could, for example, cache your AMP content on your own servers. It’s not decentralized because at least all AMP pages are hosted on Google’s cache. And AMP does all those things.

Cache 72

Cache Google Performance Metrics 72

The Polyglot Developer

JANUARY 19, 2022

A few months ago you might remember a tutorial I put out regarding remote caching in Eleventy. Fast forward to now and we’ve got a problem with too many videos loading all at once with a ten hour scroll to reach the bottom. This lead me to pagination and showing only a small subset of videos per page.

Website 52

Website Cache Development 52