The Netflix TechBlog

NOVEMBER 15, 2022

Rachel Kelley (AWS), Ranjit Raju (AWS) Rendering is core to the the VFX process VFX studios around the world create amazing imagery for Netflix productions. Rendering on AWS provides the flexibility to control how quickly a project is completed. By: Peter Cioni (Netflix), Alex Schworer (Netflix), Mac Moore (Conductor Tech.),

Cloud 291

Cloud Entertainment AWS Infrastructure 291

Dynatrace

JANUARY 16, 2023

Most Kubernetes clusters in the cloud (73%) are built on top of managed distributions from the hyperscalers like AWS Elastic Kubernetes Service (EKS), Azure Kubernetes Service (AKS), or Google Kubernetes Engine (GKE). Cloud-hosted Kubernetes clusters are on par to overtake on-premises deployments in 2023.

Open Source 358

Open Source Java Operating System Programming 358

Scalegrid

APRIL 16, 2020

AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure , DigitalOcean. Are you a startup that has free AWS or Azure hosting credits you’d like to use for your database hosting? Do you want to deploy in an AWS VPC or Azure VNET?

Cloud 242

Cloud Azure AWS Database 242

The Netflix TechBlog

JUNE 14, 2023

The GraphQL shim enabled client engineers to move quickly onto GraphQL, figure out client-side concerns like cache normalization, experiment with different GraphQL clients, and investigate client performance without being blocked by server-side migrations. Watch our Chaos Engineering talk from AWS Reinvent to learn more about Sticky Canaries.

Traffic 357

Traffic Latency Metrics Cache 357

All Things Distributed

JUNE 20, 2017

Today, I am very excited to announce our plans to open a new AWS Region in Hong Kong! The new region will give Hong Kong-based businesses, government organizations, non-profits, and global companies with customers in Hong Kong, the ability to leverage AWS technologies from data centers in Hong Kong.

AWS 126

AWS Logistics Cloud Social Media 126

The Netflix TechBlog

MARCH 8, 2021

Below is a broad technical overview of how to go from an AWS instance to a Netflix Workstation. Instead, we created a service to take the most popular configurations and cache them. Now that you know why, here is how we did it. Most artists were requesting a handful of standard configurations and did not need maximum flexibility.

Entertainment 307

Entertainment Storage Open Source Hardware 307

The Netflix TechBlog

MARCH 7, 2024

Compute: Titus Whereas open-source users of Metaflow rely on AWS Batch or Kubernetes as the compute backend , we rely on our centralized compute-platform, Titus. We have talked about the importance of a production-grade workflow orchestrator in the context of Metaflow when we released support for AWS Step Functions years ago.

Systems 235

Systems Media Cache Open Source 235

The Netflix TechBlog

SEPTEMBER 24, 2021

Our previous blog post described how MezzFS addresses the challenges for reads using various techniques, such as adaptive buffering and regional caches, to make the system performant and to lower costs. It downloads the part(s) that contain the referenced, uploaded bytes and keeps them in an LRU active cache.

Cloud 242

Cloud Media Storage Cache 242

The Netflix TechBlog

MARCH 10, 2023

Elasticsearch recommends each shard to be under 65GB (AWS recommends them to be under 50GB), so we could create time based indices where each index holds somewhere between 16–20GB of data, giving some buffer for data growth. For every asset indexing request, we look at the cache to determine the corresponding time bucket index for the asset.

Strategy 264

Strategy Cache Storage Analytics 264

All Things Distributed

AUGUST 22, 2011

Today AWS has launched Amazon ElastiCache , a new service that makes it easy to add distributed in-memory caching to any application. Amazon ElastiCache handles the complexity of creating, scaling and managing an in-memory cache to free up brainpower for more differentiating activities. Comments ().

Cloud 106

Cloud Cache AWS Storage 106

All Things Distributed

MARCH 5, 2012

Driving Compute Cost Down for AWS Customers. AWS today announced a substantial price drop from March 1, 2012 for many of the Amazon EC2, Amazon RDS, and Amazon ElastiCache instances types around the world. Amazon ElastiCache customers will see their prices drop by up to 10%, depending on their cache node types. Comments ().

AWS 92

AWS Innovation Scalability Cache 92

All Things Distributed

SEPTEMBER 3, 2013

AWS offers its customers a choice of different database services, each optimized for different workloads. Amazon ElastiCache is a fully managed, in-memory caching service for customers to optimize the latency, performance and cost of their read workloads.

Cache 99

Cache Cloud Performance Retail 99

All Things Distributed

JULY 14, 2015

Streams provide you with the underlying infrastructure to create new applications, such as continuously updated free-text search indexes, caches, or other creative extensions requiring up-to-date table changes. An AWS Lambda function is a simpler option that you can use, as it only requires you to code the logic, set it, and forget it.

Database 158

Database Lambda AWS IoT 158

All Things Distributed

DECEMBER 5, 2010

Route 53 has the business properties that you have come to expect from an AWS service: fully self-service and programmable, with transparent pay-as-you-go pricing and no minimum usage commitments. There are two main types of DNS servers: authoritative servers and caching resolvers. Some fundamentals on Naming. No lock-in. Contact Info.

Cloud 113

Cloud Internet Internet AWS 113

InfoQ

MARCH 15, 2024

The company used serverless services on AWS, including Lambda, Step Functions, EventBridge, and Redis Cache. Hashnode created a scalable event-driven architecture (EDA) for composing feed data for thousands of users. The solution leverages Step Functions' distributed maps feature that enables high-concurrency processing.

Scalability 76

Scalability AWS Architecture Lambda 76

The Netflix TechBlog

MARCH 5, 2019

the order of the rows on your Netflix home page, issuing content licenses when you click play, finding the Open Connect cache closest to you with the content you requested, and many more). All these micro-services are currently operated in AWS cloud infrastructure.

Infrastructure 185

Infrastructure Cloud Scalability AWS 185

The Netflix TechBlog

SEPTEMBER 10, 2024

Where aws ends and the internet begins is an exercise left to the reader. The DeviceToDeviceManager is also responsible for observability, with metrics around cache hits, calls to the data store, message delivery rates, and latency percentile measurements. Sample system diagram for an Alexa voice command.

Latency 234

Latency Cache Tuning Efficiency 234

The Netflix TechBlog

OCTOBER 16, 2019

Often the data is held in memory by consumers and used as a “total cache”, where it is accessed at runtime by client code and atomically swapped out under the hood. for example Open Connect Appliance cache configuration, supported device type IDs, supported payment method metadata, and A/B test configuration.

Cache 191

Cache Architecture Metrics Java 191

Dynatrace

OCTOBER 4, 2022

Data lakehouses take advantage of low-cost object stores like AWS S3 or Microsoft Azure Blob Storage to store and manage data cost-effectively. By applying massively parallel processing and high-performance caches, all this contextualized data can be interrogated at high speeds for ad-hoc analytics or AI-powered precise answers.

Artificial Intelligence 246

Artificial Intelligence Storage Analytics Government 246

All Things Distributed

MAY 13, 2012

Of course non-AWS origins are also permitted. Query String based Caching: the ability to include query string parameters as part of the objects cache key. URL based configuration: the ability to configure cache behaviors based on URL path patterns. Selecting the best AWS region for Origin Fetch. Contact Info.

Cache 97

Cache Latency AWS Website 97

All Things Distributed

JUNE 21, 2018

In fact, this is been proven by our customers as Amazon Aurora remains the fastest growing service in AWS history. Developers are building highly distributed and decoupled applications, and AWS enables developers to build these cloud-native applications by using multiple AWS services. The opposite is true.

Database 167

Database AWS Games Latency 167

All Things Distributed

JUNE 21, 2017

Today, I'm excited to announce the general availability of Amazon DynamoDB Accelerator (DAX) , a fully managed, highly available, in-memory cache that can speed up DynamoDB response times from milliseconds to microseconds, even at millions of requests per second. DynamoDB was the first service at AWS to use SSD storage.

Speed 95

Speed Cache Latency AWS 95

The Morning Paper

FEBRUARY 6, 2020

Last week we looked at a function shipping solution to the problem; Cloudburst uses the more common data shipping to bring data to caches next to function runtimes (though you could also make a case that the scheduling algorithm placing function execution in locations where the data is cached a flavour of function-shipping too).

Serverless 98

Serverless Lambda Cache Latency 98

All Things Distributed

APRIL 27, 2011

We use high-performance transactions systems, complex rendering and object caching, workflow and queuing systems, business intelligence and data analytics, machine learning and pattern recognition, neural networks and probabilistic decision making, and a wide variety of other techniques. Driving Storage Costs Down for AWS Customers.

Technology 129

Technology Technology AWS Storage 129

CSS - Tricks

APRIL 28, 2022

While CloudFront’s edge caching does offer benefits, serving your app’s resources from these multiple locations is not without a cost of its own. We’ll be changing DNS records and, depending on your web app, you may have to add some cache headers in order to prevent certain assets from ever being cached. Setting up our DNS.

Cache 83

Cache AWS Servers Traffic 83

All Things Distributed

NOVEMBER 26, 2013

As I discussed in my re:Invent keynote earlier this month, I am now happy to announce the immediate availability of Amazon RDS Cross Region Read Replicas , which is another important enhancement for our customers using or planning to use multiple AWS Regions to deploy their applications. Cross Region Read Replicas are available for MySQL 5.6

Cloud 111

Cloud AWS Traffic Latency 111

All Things Distributed

AUGUST 17, 2011

My templates and blog posts are now located in DropBox and thus locally cached at each machine I use. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Countdown to What is Next in AWS. Introducing the AWS South America (Sao Paulo) Region. All postings. Recent Entries.

Servers 111

Servers Social Media AWS Website 111

All Things Distributed

OCTOBER 12, 2016

Three years ago, as part of our AWS Fast Data journey we introduced Amazon ElastiCache for Redis , a fully managed in-memory data store that operates at sub-millisecond latency. While caching continues to be a dominant use of ElastiCache for Redis, we see customers increasingly use it as an in-memory NoSQL database.

Scalability 102

Scalability Cache Analytics AWS 102

All Things Distributed

OCTOBER 2, 2017

As we began growing the AWS business, we realized that external customers might find our Dynamo database just as useful as we found it within Amazon.com. So, we set out to build a fully hosted AWS database service based upon the original Dynamo design.

Internet 111

Internet Internet AWS Performance 111

The Morning Paper

MARCH 8, 2020

If all data was read from S3 every time, performance would suffer, so of course Snowflake has a caching layer – a distributed ephemeral storage service shared by all the nodes in a warehouse. The caching use case may be the most familiar, but in fact it’s not the primary purpose of the ephemeral storage service. Elasticity.

Storage 112

Storage Engineering Cache Serverless 112

Brendan Gregg

APRIL 14, 2022

The Netflix stack is more diverse than I was expecting, and is explained in detail in the [Netflix tech blog]: The production cloud is AWS EC2, Ubuntu Linux, Intel x86, mostly Java with some Node.js (and other languages), microservices, Cassandra (storage), EVCache (caching), Spinnaker (deployment), Titus (containers), Apache Spark (analytics), Atlas (..)

Java 142

Java Cloud Cache AWS 142

Smashing Magazine

JULY 6, 2021

From a developer perspective, not only static assets need to be cached on a CDN. Many headless CMSes cache content retrieved via RESTful or GraphQL APIs. While CDN caching is super useful, there are times when cache corruption or older cached items could create issues. Custom domain capabilities.

Cache 145

Cache Website Mobile Google 145

High Scalability

JULY 20, 2018

That means multiple data indirections mean multiple cache misses. Mark LaPedus : MRAM, a next-generation memory type, is being touted as a replacement for embedded flash and cache applications. Cliff Click : The JVM is very good at eliminating the cost of code abstraction, but not the cost of data abstraction. They are very expensive.

Internet 121

Internet Internet Scalability Automotive 121

All Things Distributed

JANUARY 18, 2012

Amazon DynamoDB stores data on Solid State Drives (SSDs) and replicates it synchronously across multiple AWS Availability Zones in an AWS Region to provide built-in high availability and data durability. Customers can typically achieve average service-side in the single-digit milliseconds. History of NoSQL at Amazon â??

Scalability 162

Scalability Database Ecommerce Latency 162

Smashing Magazine

JULY 18, 2022

The “stale-while-revalidate” cache control strategy can reduce the TTFB issue by serving a cached version of the page until it’s updated. Once you understand that it’s all about caching renders and then getting the right cached render for each request, everything will click into place. And now we even pay for it!

Cache 127

Cache Website Servers Energy 127

All Things Distributed

SEPTEMBER 21, 2012

I was in Los Angeles this week for the Digital Media on AWS Summit and to visit many of the studios and production houses that are using AWS for production and post-production work. There is some real jaw dropping work being done around this town and I had the privilege to see some of these highly guarded secrets, all powered by AWS.

AWS 66

AWS Media Cache Operating System 66

Brendan Gregg

AUGUST 29, 2021

1072-aws (xxx) 12/18/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 5.03 1072-aws (xxx) 12/18/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 5.03 Reads usually have apps waiting on them; writes may not (write-back caching). Counting cache functions. 17 48011 [.].

Cache 78

Cache C++ AWS Java 78