The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 100

AWS Entertainment Open Source Benchmarking 100

All Things Distributed

JANUARY 18, 2012

Amazon DynamoDB offers low, predictable latencies at any scale. Amazon DynamoDB stores data on Solid State Drives (SSDs) and replicates it synchronously across multiple AWS Availability Zones in an AWS Region to provide built-in high availability and data durability. s read latency, particularly as dataset sizes grow.

Scalability 164

Scalability Database Ecommerce Latency 164

The Netflix TechBlog

OCTOBER 27, 2020

The processed data is typically stored as data warehouse tables in AWS S3. The data warehouse is not designed to serve point requests from microservices with low latency. Therefore, we must efficiently move data from the data warehouse to a global, low-latency and highly-reliable key-value store.

Latency 254

Latency Storage Big Data Tuning 254

Smashing Magazine

AUGUST 20, 2021

Jamstack CMS: The Past, The Present and The Future. Jamstack CMS: The Past, The Present and The Future. Twitch developer documentation hosted on AWS, edited on CloudCannon. Netlify , Vercel , CloudFlare , and AWS all have the concept of serverless functions run at edge nodes of a CDN. Mike Neumegen. Large preview ).

Ecommerce 140

Ecommerce Website Government Internet 140

The Netflix TechBlog

SEPTEMBER 10, 2024

Where aws ends and the internet begins is an exercise left to the reader. Since that presentation, Pushy has grown in both size and scope, and this article will be discussing the investments we’ve made to evolve Pushy for the next generation of features. This initial functionality was built out for FireTVs and was expanded from there.

Latency 233

Latency Cache Tuning Efficiency 233

All Things Distributed

JUNE 21, 2018

This doesn't mean relational databases do not provide utility in present-day development and are not available, scalable, or provide high performance. In fact, this is been proven by our customers as Amazon Aurora remains the fastest growing service in AWS history. The opposite is true. Take Expedia, for example.

Database 167

Database AWS Games Latency 167

All Things Distributed

AUGUST 16, 2011

Expanding the Cloud - The AWS GovCloud (US) Region. Today AWS announced the launch of the AWS GovCloud (US) Region. The concept of regions gives AWS customers control over the placement of their resources and services. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems.

AWS 90

AWS Government Big Data Cloud 90

The Netflix TechBlog

AUGUST 29, 2023

A brief history of IPC at Netflix Netflix was early to the cloud, particularly for large-scale companies: we began the migration in 2008, and by 2010, Netflix streaming was fully run on AWS. Eureka and Ribbon presented a simple but powerful interface, which made adopting them easy.

Traffic 231

Traffic Latency Cloud C++ 231

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 121

Performance Latency Hardware Storage 121

The Netflix TechBlog

DECEMBER 21, 2020

By Anupom Syam Background At Netflix, our current data warehouse contains hundreds of Petabytes of data stored in AWS S3 , and each day we ingest and create additional Petabytes. This article will list some of the use cases of AutoOptimize, discuss the design principles that help enhance efficiency, and present the high-level architecture.

Storage 214

Storage Latency Efficiency Data Engineering 214

The Netflix TechBlog

FEBRUARY 9, 2021

We need to be able to easily determine what imagery is present for a given platform, region, and language. Server-generated assets, since client-side generation would require the retrieval of many individual images, which would increase latency and time-to-render. We can leverage high performance VMs in AWS to generate the assets.

Engineering 174

Engineering Storage Latency Entertainment 174

All Things Distributed

OCTOBER 16, 2019

Because these IoT devices are powered by microprocessors or microcontrollers that have limited processing power and memory, they often rely heavily on AWS and the cloud for processing, analytics, storage, and machine learning. Sometimes an internet connection is weak or not available at all, as is often the case in remote locations.

IoT 121

IoT Healthcare Internet Internet 121

Scalegrid

MARCH 14, 2024

Providers such as AWS Outposts, Microsoft Azure Stack, Google Anthos, and VMware Cloud on AWS offer compatible private clouds that integrate seamlessly with established public cloud platforms — a key feature for constructing hybrid cloud systems. It should offer user-friendly operation.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. The change was obvious in the production graphs, showing a drop in write latencies: Once tested more broadly, it showed the write latencies dropped by 43%, delivering slightly better performance than on CentOS.

Speed 103

Speed Java AWS Virtualization 103

Percona

NOVEMBER 3, 2023

PostgreSQL Cluster One coordinator node citus-coord-01 Three worker nodes citus1 citus2 citus3 Hardware AWS Instance Ubuntu Server 20.04, SSD volume type 64-bit (x86) c5.xlarge And now, execute the benchmark: -- execute the following on the coordinator node pgbench -c 20 -j 3 -T 60 -P 3 pgbench The results are not pretty.

Database 110

Database Benchmarking Latency C++ 110

Adrian Cockcroft

NOVEMBER 18, 2019

AWS Developer Relations on how the shift from Robot Operating System (ROS) 1 to ROS 2 will change the landscape for all robot lovers. OPN205-R Contributing to the AWS Construct Library (repeats) Using and loving the AWS Cloud Development Kit and want to help make it better? Alejandra Olvera-Novack?—?AWS

Open Source 40

Open Source AWS Lambda Serverless 40

Adrian Cockcroft

NOVEMBER 18, 2019

AWS Developer Relations on how the shift from Robot Operating System (ROS) 1 to ROS 2 will change the landscape for all robot lovers. OPN205-R Contributing to the AWS Construct Library (repeats) Using and loving the AWS Cloud Development Kit and want to help make it better? Alejandra Olvera-Novack?—?AWS

Open Source 40

Open Source AWS Lambda Serverless 40

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 103

Performance Latency Cache Virtualization 103

The Netflix TechBlog

DECEMBER 17, 2019

There are services at Netflix that use RDBMS kind of databases such as MySQL or PostgreSQL via AWS RDS. Go to step 1 if more chunks present. Passive instances across regions are also possible, though it is recommended to operate in the same region as the database host in order to keep the change capture latencies low.

Database 223

Database Traffic Transportation Open Source 223

The Netflix TechBlog

DECEMBER 17, 2019

There are services at Netflix that use RDBMS kind of databases such as MySQL or PostgreSQL via AWS RDS. Go to step 1 if more chunks present. Passive instances across regions are also possible, though it is recommended to operate in the same region as the database host in order to keep the change capture latencies low.

Database 209

Database Traffic Transportation Open Source 209

All Things Distributed

NOVEMBER 29, 2017

As there are few individuals with this expertise, an easier process presents a significant opportunity for companies who want to accelerate their ML usage. Amazon SageMaker takes care of launching the instances, deploying the model, and setting up the HTTPS endpoint for your application to achieve low latency / high throughput prediction.

Tuning 77

Tuning AWS Scalability Infrastructure 77

The Morning Paper

MAY 12, 2019

Microservices fundamentally change a lot of assumptions current cloud systems are designed with, and present both opportunities and challenges when optimizing for quality of service (QoS) and utilization. The top line shows the change in tail latency across a set of monolithic applications as operating frequency decreases.

Open Source 61

Open Source Hardware Benchmarking Systems 61

Adrian Cockcroft

JANUARY 20, 2023

Clouds using Ethernet that are multipath optimized using libfabric and features like EFA on AWS are going to be increasingly competitive, and Ethernet will replace other interconnects between racks. I presented a keynote for Sun at Supercomputing 2003 in Phoenix Arizona and included the slide shown below.

Architecture 52

Architecture Latency Benchmarking AWS 52

Scalegrid

JANUARY 12, 2024

While managing cloud workloads offers numerous benefits, it also presents several challenges such as security risks, compliance issues, and resource optimization, which can be addressed effectively with tools like ScaleGrid, offering features like encryption, disaster recovery, and real-time resource optimization for diverse databases.

Cloud 130

Cloud Virtualization Storage Efficiency 130

All Things Distributed

DECEMBER 12, 2013

Moreover, a GSI''s performance is designed to meet DynamoDB''s single digit millisecond latency - you can add items to a Users table for a gaming app with tens of millions of users with UserId as the primary key, but retrieve them based on their home city, with no reduction in query performance.

Games 110

Games Scalability Database Retail 110

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 52

Performance Latency Hardware Storage 52

Brendan Gregg

AUGUST 29, 2021

1072-aws (xxx) 12/18/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 5.03 biolatency From [bcc], this eBPF tool shows a latency histogram of disk I/O. 1072-aws (xxx) 12/19/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 12.25 avg-cpu: %user %nice %system %iowait %steal %idle 14.81

Cache 78

Cache C++ AWS Java 78

Smashing Magazine

AUGUST 3, 2023

Large preview ) The graph presents the LCP values for the 75th percentile of our users visiting the Route Landing Page group. This proximity significantly reduces the time it takes for the data to travel from the server to the user, thus reducing latency and improving load times. LCP seconds over time. Time to First Byte over time.

Performance 75

Performance Cache Traffic Metrics 75

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. The change was obvious in the production graphs, showing a drop in write latencies: Once tested more broadly, it showed the write latencies dropped by 43%, delivering slightly better performance than on CentOS.

Speed 52

Speed Java AWS Virtualization 52

Speed Curve

FEBRUARY 5, 2024

Latency – How much time does it take to deliver a packet from A to B. Amazon Cloudfront You can add server-timing headers via opt-in via the AWS Console as mentioned in this post. Today, it's possible to add these headers from your CDN with ease, if they aren't already set up out of the box.

Servers 60

Servers Cache Retail Benchmarking 60

O'Reilly

NOVEMBER 12, 2019

Given that Amazon’s AWS Lambda functions are only five years old this November, anyone with more than three years of experience is a very early adopter. latency, startup, mocking, etc.) Serverless presents a conceptually simpler path to deploying software for those in development roles with no need to manage servers and storage.

Serverless 88

Serverless Architecture FinTech Infrastructure 88

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

The Morning Paper

MAY 28, 2019

We don’t talk about energy as often as we probably should on this blog, but it’s certainly true that our data centres and various IT systems consume an awful lot of it. Boosted race trees for low energy classification Tzimpragos et al., ASPLOS’19. Introducing race logic. Race logic encodes values by delaying signals.

Energy 52

Energy Hardware Efficiency Architecture 52

Brendan Gregg

SEPTEMBER 5, 2017

Here's some output from my zfsdist tool, in bcc/BPF, which measures ZFS latency as a histogram on Linux: # zfsdist. Tracing ZFS operation latency. Just from a quick search, see this presentation PDF , which digs into oops message components. Many new tools can now be written, and the main toolkit we're working on is [bcc].

Virtualization 75

Virtualization AWS Engineering Hardware 75

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. The change was obvious in the production graphs, showing a drop in write latencies: Once tested more broadly, it showed the write latencies dropped by 43%, delivering slightly better performance than on CentOS.

Speed 40

Speed Java AWS Virtualization 40

Adrian Cockcroft

APRIL 5, 2023

This proposal seeks to define a standard for real-time carbon and energy data as time-series data that would be accessed alongside and synchronized with the existing throughput, utilization and latency metrics that are provided for the components and applications in computing environments.

Energy 52

Energy Metrics Cloud Operating System 52