The Netflix TechBlog

SEPTEMBER 8, 2020

We went from an essentially serverless model in a monolithic service, to deploying and maintaining a new microservice that hosted our app backend endpoints. While this gave client teams a very convenient “serverless” model, over time we ran into multiple operational and devex challenges with this service.

Latency 236

Latency Cache Java Traffic 236

High Scalability

MARCH 22, 2019

µs of replication latency on lossy Ethernet, which is faster than or comparable to specialized replication systems that use programmable switches, FPGAs, or RDMA.". slobodan_ : "It is serverless the same way WiFi is wireless. We achieve 5.5 matthewstoller : I just looked at Netflix’s 10K. 3B this year, $4B next year.

Internet 134

Internet Internet Scalability Wireless 134

The Morning Paper

JANUARY 30, 2020

Edge servers are the middle ground – more compute power than a mobile device, but with latency of just a few ms. The client MWW combines these estimates with an estimate of the input/output transmission time (latency) to find the worker with the minimum overall execution latency. The opencv app has the largest state (4.6

Mobile 104

Mobile Cloud Latency Games 104

The Morning Paper

JUNE 13, 2019

Making queries to an inference engine has many of the same throughput, latency, and cost considerations as making queries to a datastore, and more and more applications are coming to depend on such queries. First off there still is a model of course (but then there are servers hiding behind a serverless abstraction too!). autoscaling).

Hardware 58

Hardware Latency Serverless Energy 58

The Morning Paper

AUGUST 29, 2019

InS does now offer an NVMe variant too, and the authors perform limited testing on that as well. For query executors that can be frequently started and stopped the authors explore performance with cold and warm caches (where applicable), and also the horizontal and vertical scaling performance. Serverless o?erings

Architecture 76

Architecture Cloud Storage Serverless 76

The Morning Paper

JANUARY 28, 2020

Narrowing the gap between serverless and its state with storage functions , Zhang et al., While being motivated by serverless use cases, there’s nothing especially serverless about the key-value store, Shredder , this paper reports on. A key challenge… is that serverless functions are stateless.

Serverless 99

Serverless Storage Latency Cloud 99

Smashing Magazine

AUGUST 3, 2023

How We Optimized Performance To Serve A Global Audience How We Optimized Performance To Serve A Global Audience Liran Cohen 2023-08-03T10:00:00+00:00 2023-08-03T13:06:00+00:00 I work for Bookaway , a digital travel brand. Large preview ) We’ve known for a long time that fast page performance influences search engine rankings.

Performance 75

Performance Cache Traffic Metrics 75

The Morning Paper

FEBRUARY 6, 2020

Today’s paper choice is a fresh-from-the-arXivs take on serverless computing from the RISELab at Berkeley, addressing some of the limitations outlined in last year’s ‘ Berkeley view on serverless computing.’ A low-latency autoscaling KVS can serve as both global storage and a DHT-like overlay network.

Serverless 98

Serverless Lambda Cache Latency 98

SQL Performance

APRIL 27, 2020

The business-critical tier has local SSD which provide much better IO performance with max data IOPS ranging from 8000 for a 2 vCore database up to 204,800 for an 80 vCore database. Hyperscale achieves high performance from each compute node having SSD-based caches which helps minimize the network round trips to fetch data.

Azure 55

Azure Database Serverless Hardware 55

The Morning Paper

MAY 12, 2019

The paper examines the implications of microservices at the hardware, OS and networking stack, cluster management, and application framework levels, as well as the impact of tail latency. The top line shows the change in tail latency across a set of monolithic applications as operating frequency decreases. Hardware implications.

Open Source 61

Open Source Hardware Benchmarking Systems 61

All Things Distributed

JUNE 21, 2018

As I have talked about before, one of the reasons why we built Amazon DynamoDB was that Amazon was pushing the limits of what was a leading commercial database at the time and we were unable to sustain the availability, scalability, and performance needs that our growing Amazon.com business demanded. The opposite is true.

Database 167

Database AWS Games Latency 167

Abhishek Tiwari

NOVEMBER 3, 2018

Recently I was asked about content management systems (CMS) of the future - more specifically how they are evolving in the era of microservices, APIs, and serverless computing. Case-in-point, most enterprise CMS vendors lack robust full-site content delivery network (CDN) integration.

Systems 63

Systems Cache Website Network 63

All Things Distributed

OCTOBER 12, 2016

Three years ago, as part of our AWS Fast Data journey we introduced Amazon ElastiCache for Redis , a fully managed in-memory data store that operates at sub-millisecond latency. Developers love the blazing fast performance and in-memory capabilities provided by Redis, making it among the most popular NoSQL key-value stores.

Scalability 123

Scalability Analytics Cache AWS 123

Adrian Cockcroft

NOVEMBER 18, 2019

OPN303 BPF performance analysis (repeats) Learn how Netflix uses eBPF to create powerful performance analysis tools. OPN304 Learnings from migrating a service from JDK 8 to JDK 11 AWS Lambda improved latency by migrating to JDK 11 with Amazon Corretto. based on my short eBook, Cloud for CEOs ARC335 Failure is Not an Option ?—?a

Open Source 40

Open Source AWS Lambda Serverless 40

Adrian Cockcroft

NOVEMBER 18, 2019

OPN303 BPF performance analysis (repeats) Learn how Netflix uses eBPF to create powerful performance analysis tools. OPN304 Learnings from migrating a service from JDK 8 to JDK 11 AWS Lambda improved latency by migrating to JDK 11 with Amazon Corretto. based on my short eBook, Cloud for CEOs ARC335 Failure is Not an Option ?—?a

Open Source 40

Open Source AWS Lambda Serverless 40

High Scalability

JANUARY 24, 2019

Sascha Segan : The processor in the Samsung Galaxy S10 performs better than the latest iPhones on most measures. TServerless : We sat with a solution architect, apparently they are aware of the latency issue and suggested to ditch api gw and build our own solution. Stand under Explain the Cloud Like I'm 10 (35 nearly 5 star reviews).

Internet 29

Internet Internet Scalability Games 29