The Netflix TechBlog

AUGUST 29, 2023

Today we have a wealth of tools, both OSS and commercial, all designed for cloud-native environments. To improve availability, we designed systems where components could fail separately and avoid single points of failure. There is a downside to fetching this data on-demand: this adds latency to the first request to a cluster.

Traffic 225

Traffic Latency Cloud C++ 225

Randon ASCII

JANUARY 12, 2022

That meant I started having regular meetings with the hardware engineers who were working with IBM on the CPU which gave me even more expertise on this CPU, which was critical in helping me discover a design flaw in one of its instructions , and in helping game developers master this finicky beast. So, anyway. Standard stuff.

Cache 126

Cache Latency Benchmarking Hardware 126

Scalegrid

MARCH 22, 2024

A well-planned multi cloud strategy can seriously upgrade your business’s tech game, making you more agile. They can also bolster uptime and limit latency issues or potential downtimes. Its Database-as-a-Service (DBaaS) offerings are designed for flawless integration within multi-cloud and hybrid-cloud infrastructures.

Strategy 130

Strategy Cloud Government Innovation 130

The Morning Paper

JANUARY 30, 2020

Edge servers are the middle ground – more compute power than a mobile device, but with latency of just a few ms. The client MWW combines these estimates with an estimate of the input/output transmission time (latency) to find the worker with the minimum overall execution latency.

Mobile 104

Mobile Cloud Latency Games 104

Alex Russell

FEBRUARY 28, 2022

Tim Berners-Lee tweets that 'This is for everyone' at the 2012 Olympic Games opening ceremony using the NeXT computer he used to build the first browser and web server. The chief effect of the architectural difference is to shift the distribution of latency within the loop. Improving latency for one scenario can degrade it in another.

Performance 113

Performance Latency Architecture Network 113

High Scalability

AUGUST 17, 2018

12 million requests / hour with sub-second latency, ~300GB of throughput / day. A much better way to do this would be to make a "next Logo" that would allow game players to make the AI brains needed by the robots. When logic and memory chips get to be under ten bucks I can take these big games and shove them into a pinball machine.

Internet 105

Internet Internet Scalability Games 105

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 103

Performance Latency Cache Virtualization 103

All Things Distributed

NOVEMBER 21, 2017

Redis's microsecond latency has made it a de facto choice for caching. Four years ago, as part of our AWS fast data journey, we introduced Amazon ElastiCache for Redis , a fully managed, in-memory data store that operates at microsecond latency. Whether it is gaming, adtech, travel, or retail—speed wins, it's simple.

Games 104

Games Retail Latency Education 104

All Things Distributed

JUNE 21, 2018

Further, with the growth and scale of Amazon.com, boundless horizontal scale needed to be a key design point--scaling up simply wasn't an option. Typical use cases for a relational database include web and mobile applications, enterprise applications, and online gaming.

Database 167

Database AWS Games Latency 167

The Netflix TechBlog

NOVEMBER 22, 2019

Netflix delivers shows like Sacred Games, Stranger Things, Money Heist, and many more to more than 150 million subscribers across 190+ countries around the world. In this talk, we share how Netflix deploys systems to meet its demands, Ceph’s design for high availability, and results from our benchmarking.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

Netflix delivers shows like Sacred Games, Stranger Things, Money Heist, and many more to more than 150 million subscribers across 190+ countries around the world. In this talk, we share how Netflix deploys systems to meet its demands, Ceph’s design for high availability, and results from our benchmarking.

AWS 100

AWS Entertainment Open Source Benchmarking 100

Dynatrace

APRIL 26, 2022

STM generates traffic that replicates the typical path or behavior of a user on a network to measure performance for example, response times, availability, packet loss, latency, jitter, and other variables). How digital experience monitoring changes the game.

Monitoring 217

Monitoring Social Media IoT Metrics 217

Adrian Cockcroft

JANUARY 20, 2023

In recent years GPU development that was originally funded by the gaming market (and ended up being used as a supercomputer accelerator) has been dominated by use in the AI/ML accelerator market. The emergence of chiplet technology also allows higher performance and integration without having to design every chip from scratch.

Architecture 52

Architecture Latency Benchmarking AWS 52

All Things Distributed

APRIL 17, 2013

While DynamoDB already allows you to perform low-latency queries based on your tableâ??s This gives you the ability to perform richer queries while still meeting the low-latency demands of responsive, scalable applications. s say that your social gaming application tracks player activity. With LSI we expand DynamoDBâ??s

Cloud 101

Cloud Latency Games Scalability 101

Sutter's Mill

SEPTEMBER 11, 2020

Attendees can ask questions across the board from C++20 features, to how the committee is working during the pandemic on C++23, to specific C++ features I’ve designed or contributed to like concurrency or structured bindings or the spaceship operator, or other things you may think of. I can’t wait!

C++ 90

C++ Games Programming Latency 90

Alex Russell

DECEMBER 18, 2022

From Edge's telemetry, we see that nearly half of devices fall into our "low-end" designation, which means that they have: HDD s (not SSD s). For example, let's say you send more HTML and less JavaScript, or your serving game is on lock and all critical assets load over a single H/2 link. 2-4 CPU cores. 4GB RAM or less.

Performance 120

Performance Mobile Network Latency 120

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

The Morning Paper

MARCH 3, 2020

It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. This work is latency critical, because volume IO is blocked until it is complete. NSDI’20. Requirements.

Database 106

Database AWS Network Design 106

Alex Russell

APRIL 29, 2021

Consistent improvement is the name of the game, and it can still have positive impacts, particularly as users lean on the system more heavily over time. Real-time network protocols for enabling videoconferencing, desktop sharing, and game streaming applications. Critical for gaming with a mouse. Delayed five years. Gamepad API.

Media 145

Media Games Education Engineering 145

All Things Distributed

MARCH 2, 2011

Japanese companies and consumers have become used to low latency and high-speed networking available between their businesses, residences, and mobile devices. The advanced Asia Pacific network infrastructure also makes the AWS Tokyo Region a viable low-latency option for customers from South Korea. Recent Entries. Amazon DynamoDB â??

AWS 104

AWS Cloud Games Latency 104

All Things Distributed

DECEMBER 12, 2013

DynamoDB continues to be embraced for workloads in Gaming, Ad-tech, Mobile, Web Apps, and other segments where scale and performance are critical. Let’s walk through another gaming example. Consider a table named GameScores that keeps track of users and scores for a mobile gaming application.

Games 121

Games Scalability Database Retail 121

All Things Distributed

JANUARY 18, 2012

a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Today is a very exciting day as we release Amazon DynamoDB , a fast, highly reliable and cost-effective NoSQL database service designed for internet scale applications. Amazon DynamoDB offers low, predictable latencies at any scale. Comments ().

Scalability 165

Scalability Database Ecommerce Latency 165

IO River

NOVEMBER 2, 2023

Gaming‍With millions of players worldwide often playing simultaneously, online gaming companies cannot afford significant downtime without risking player satisfaction and potential revenue. Many games, like Fortnite or World of Warcraft, have worldwide fanbases that expect the ability to play at any time.

Availability 52

Availability Social Media Traffic Games 52

IO River

NOVEMBER 2, 2023

Many games, like Fortnite or World of Warcraft, have worldwide fanbases that expect the ability to play at any time. In massively multiplayer online games (MMOs), where players can trade virtual goods, downtime can even have real-world financial implications for players.

Availability 52

Availability Social Media Traffic Games 52

All Things Distributed

SEPTEMBER 3, 2013

Amazon ElastiCache is a fully managed, in-memory caching service for customers to optimize the latency, performance and cost of their read workloads. Today, we are further expanding the choices available for designing and developing highly scalable and high performance apps. For features that need data structures like sorted sets (e.g.,

Cache 114

Cache Cloud Performance Retail 114

Alex Russell

MAY 9, 2022

This is a complex topic, but to borrow from a recent post , web performance expands access to information and services by reducing latency and variance across interactions in a session, with a particular focus on the tail of the distribution (P75+). Consistent performance matters just as much as low average latency.

Performance 99

Performance Latency Metrics Engineering 99

O'Reilly

JULY 20, 2021

But we, as technologists, have typically ignored our own expectations when designing and building those devices. If the devices aren’t designed with those expectations in mind, they’re destined for the landfill. When designing an experience, you need to consider the identity context and where the experience will take place.

Google 121

Google Games Technology Technology 121

All Things Distributed

APRIL 9, 2015

When we designed Amazon EFS we decided to build along the AWS principles: Elastic, scalable, highly available, consistent performance, secure, and cost-effective. Amazon EFS is designed to be highly available and durable, storing each file system object redundantly across multiple Availability Zones.

Lambda 115

Lambda Cloud IoT AWS 115

All Things Distributed

JULY 14, 2015

A common design pattern is to capture transactional and operational data (such as logs) that require high throughput and performance in DynamoDB, and provide periodic updates to search clusters and data warehouses. DynamoDB Streams simplifies and improves this design pattern with a distributed systems approach. Summing It All Up.

Database 165

Database Lambda AWS IoT 165

The Morning Paper

SEPTEMBER 1, 2019

At the end of the day, you get the dual benefit of higher throughput and lower latency (as compared to coordination-based approaches) coupled with knowing that there isn’t some nasty invariant-violating concurrency bug waiting to bite you (so long as you specified your invariants and operation effects correctly of course!).

Database 42

Database Latency Games Design 42

Alex Russell

MARCH 6, 2021

Chip design choices and silicon economics are the defining feature of the still-growing Performance Inequality Gap. Sadly, data on latency is harder to get, even from Google's perch, so progress there is somewhat more difficult to judge. Recently updated designs for budget parts finally get out-of-order dispatch and better parallelism.

Performance 127

Performance Network Cache Metrics 127

The Netflix TechBlog

NOVEMBER 22, 2019

Netflix delivers shows like Sacred Games, Stranger Things, Money Heist, and many more to more than 150 million subscribers across 190+ countries around the world. In this talk, we share how Netflix deploys systems to meet its demands, Ceph’s design for high availability, and results from our benchmarking.

AWS 38

AWS Entertainment Open Source Benchmarking 38

Alex Russell

JULY 14, 2021

The benefits to apps that adopt WebView-based IABs are numerous: WebViews are system components designed for use within other apps. CCT's core design is sound and has enormous potential if made mandatory in place of WebView IABs by the Android and Play teams. There's reason to worry that this is unlikely.

Google 134

Google Mobile Engineering Games 134

All Things Distributed

JULY 13, 2010

Cluster Computer Instances for Amazon EC2 are a new instance type specifically designed for High Performance Computing applications. Other industries using Amazon EC2 for HPC-style workloads include pharmaceuticals, oil exploration, industrial and automotive design, media and entertainment, and more. Recent Entries.

Cloud 110

Cloud AWS Automotive Latency 110

Adrian Cockcroft

MARCH 17, 2020

Another problem is that a design control, intended to mitigate a failure mode, may not work as intended. A learning organization, disaster recovery testing, game days, and chaos engineering tools are all important components of a resilient system. Hence, one way to reduce risk is to make systems more observable. What Happens Next?

Healthcare 52

Healthcare Government Airlines Systems 52

ACM Sigarch

DECEMBER 6, 2018

interactive AR/VR, gaming and critical decision making). Each of these categories opens up challenging problems in AI/visual algorithms, high-density computing, bandwidth/latency, distributed systems. Such compression is designed to replicate the data such that the reconstruction losses are imperceptible to the human eye.

Wireless 54

Wireless IoT Architecture Analytics 54

Smashing Magazine

AUGUST 20, 2021

Piecing together a website using a WYSIWYG editor and seeing the code it generated was a fascinating and educational experience that sparked an initial interest in web design. In Designing The Perfect Navigation , Vitaly will explore 100s of practical examples of better mega-dropdowns , hamburgers, carousels, modals and filters.

Ecommerce 140

Ecommerce Website Government Internet 140