The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 202 A day in the life of a Netflix Engineer Dave Hahn , SRE Engineering Manager Abstract : Netflix is a large, ever-changing ecosystem serving millions of customers across the globe through cloud-based systems and a globally distributed CDN. Wednesday?—?December

AWS 38

AWS Entertainment Open Source Benchmarking 38

The Netflix TechBlog

NOVEMBER 29, 2023

Bitrate versus quality comparison HDR-VMAF is designed to be format-agnostic — it measures the perceptual quality of HDR video signal regardless of its container format, for example, Dolby Vision or HDR10. The graphic below (Fig. 1) depicts the migration of traffic from fixed bitrates to DO encodes. Krasula, A. Choudhury, S. Malfait, A.

Open Source 260

Open Source Software Engineering Internet Internet 260

High Scalability

OCTOBER 5, 2018

Because the device in question is a high-speed unit designed to process a high volume of ballots for an entire county, hacking just one of these machines could enable anattacker to flip the Electoral College and determine the outcome of a presidential election?. They'll love it and you'll be their hero forever.

Internet 156

Internet Internet Scalability Software Engineering 156

The Netflix TechBlog

APRIL 26, 2022

We will share how its design has evolved over the years and the lessons learned while building it. To understand Axion’s design, we need to know the various components that interact with it. The motivation has not changed since then; the design has. Design evolution Axion fact store has four components?—?fact

Storage 195

Storage Design Scalability Latency 195

The Netflix TechBlog

JANUARY 11, 2022

To directly support great decision-making throughout the company, there are a number of data science teams at Netflix that partner directly with Product Managers, engineering teams, and other business units to design, execute, and learn from experiments. see the end of those relationships when members elect to cancel.

Innovation 245

Innovation Metrics Engineering Testing 245

The Netflix TechBlog

NOVEMBER 3, 2022

Collapse multiple keep-alive requests in Titus Job Coordinator, sending a response to the latest one which has the arrival timestamp less than that of the timestamp of the last event sent over the network. Designing Data-Intensive Applications is an excellent book that goes into detail about consistency models discussed in this blog post.

Cache 233

Cache Latency Traffic Systems 233

The Netflix TechBlog

FEBRUARY 9, 2021

A few years ago, we decided to address this complexity by spinning up a new initiative, and eventually a new team, to move the complex handling of user and device authentication, and various security protocols and tokens, to the edge of the network, managed by a set of centralized services, and a single team.

Architecture 228

Architecture Latency Servers Website 228

The Morning Paper

FEBRUARY 16, 2020

Migrating a privacy-safe information extraction system to a software 2.0 design , Sheng, CIDR’20. This is a comparatively short (7 pages) but very interesting paper detailing the migration of a software system to a ‘Software 2.0’ ’ design. " Switching to a Software 2.0

Systems 84

Systems Design Software Software 84

The Morning Paper

MARCH 3, 2020

It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. Engineering decisions involve making lots of trade-offs. Millions of tiny databases , Brooker et al.,

Database 106

Database AWS Network Design 106

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 202 A day in the life of a Netflix Engineer Dave Hahn , SRE Engineering Manager Abstract : Netflix is a large, ever-changing ecosystem serving millions of customers across the globe through cloud-based systems and a globally distributed CDN. Wednesday?—?December

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 202 A day in the life of a Netflix Engineer Dave Hahn , SRE Engineering Manager Abstract : Netflix is a large, ever-changing ecosystem serving millions of customers across the globe through cloud-based systems and a globally distributed CDN. Wednesday?—?December

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

FEBRUARY 9, 2021

Before designing a solution it’s important to understand the main product requirements for such a feature: The content needs to be new, relevant, and regional (not all countries have the same catalogue). The homepage needs to load in a reasonable amount of time, even in poor network conditions.

Engineering 172

Engineering Storage Latency Entertainment 172

The Netflix TechBlog

MAY 30, 2019

Our very first mobile app is called Prodicle and was built for Android & iOS using the same reactive architecture in both platforms, which allowed us to build 2 apps from scratch in 3 months with 4 software engineers. A component defines its own state as a data class in the top of the file.

Architecture 156

Architecture Mobile Testing Code 156

High Scalability

JULY 18, 2022

has hours of system design content. They also do live system design discussions every week. T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. InterviewCamp.io They break down interview prep into fundamental building blocks.

Education 100

Education DevOps Infrastructure Scalability 100

High Scalability

JUNE 10, 2022

has hours of system design content. They also do live system design discussions every week. T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. InterviewCamp.io They break down interview prep into fundamental building blocks.

Education 100

Education DevOps Infrastructure Scalability 100

The Morning Paper

JANUARY 21, 2020

The Internet itself, over which these systems operate, is a dynamically distributed network spanning national borders and policies with no central coordinating agent. Moreover: Causality is complex and networked. Preventative design is not enough. Routing, for example, is non-deterministic.

Internet 98

Internet Internet Strategy Energy 98

ACM Sigarch

APRIL 8, 2019

Networking sessions that create opportunities for students to interact with graduate students and established architects in academia and industry. Her current work focuses on hardware/software co-design for extremely large-scale deep learning training. Lena Olson is a Software Engineer at Google. .

Architecture 74

Architecture Open Source Hardware Software Engineering 74

O'Reilly

JULY 20, 2021

But we, as technologists, have typically ignored our own expectations when designing and building those devices. If the devices aren’t designed with those expectations in mind, they’re destined for the landfill. When designing an experience, you need to consider the identity context and where the experience will take place.

Google 132

Google Games Technology Technology 132

O'Reilly

MAY 19, 2020

. • More than one-third have adopted site reliability engineering (SRE); slightly less have developed production AI services. Software engineers represent the largest cohort, comprising almost 20% of all respondents (see Figure 1 ). Designing a survey inevitably entails making a spate of methodological trade-offs.

Cloud 144

Cloud Serverless AWS DevOps 144

SQL Server According to Bob

MAY 19, 2019

Testing shows that locking mechanisms, such as spin locks, start to become saturated when shared across 8 to 12 CPUs and where the physics become a direct contributor to partitioned design. Networking Pump Threads. SQLPAL uses a dynamic set of networking, I/O pump threads to handle network requests. Async Pump Threads.

IoT 61

IoT Servers Development Cache 61

SQL Server According to Bob

OCTOBER 24, 2019

I thought the network trace might reveal a SYN, a long delay that exceeded the connection timeout and a close (RST) from the client. What was causing the SQL Server networking client to call the TCP open and then call TCP close without exceeding the connection timeout and without attempting the TDS login activities?

Servers 40

Servers Network Software Engineering Traffic 40

Alex Russell

JUNE 22, 2022

World-class experts in graphics, networking, cryptography, databases, language design, VM implementation, security, usability (particularly usable security), power management, compilers, fonts, high-performance layout, codecs, real-time media, audio and video pipelines, and per- OS specialisation are required.

Engineering 124

Engineering Traffic Government Google 124

The Morning Paper

JULY 4, 2019

This is a fascinating paper from members of Netflix’s Resilience Engineering team describing their chaos engineering initiatives: automated controlled experiments designed to verify hypotheses about how the system should behave under gray failure conditions, and to probe for and flush out any weaknesses. Safeguards.

Latency 77

Latency Engineering Metrics Traffic 77

Abhishek Tiwari

DECEMBER 13, 2017

This has far-reaching implications how future data systems and algorithms will be designed. These areas benefit not only from neural networks ability to handle high-dimensional relationships but also recent hardware trends. Data structures are very foundational for the computer science and software engineering.

Artificial Intelligence 40

Artificial Intelligence Hardware Google Benchmarking 40

The Morning Paper

DECEMBER 12, 2019

We’re back in 1968, a time when it was taken for granted that before building a system, it was necessary to design it. The systems under discussion are not restricted to computer systems either by the way – one of example of a system is "the public transport network."

Design 43

Design Transportation Systems Network 43

The Morning Paper

APRIL 16, 2019

The networking model is asynchronous (allowing out of order, dropped, delayed, and duplicated messages), the failure model is crash-stop. We would like students to consider the performance characteristics of their systems, and our tests check that their designs attain reasonable run-time performance. Testing and model checking.

Systems 43

Systems Efficiency Testing Design 43

The Morning Paper

NOVEMBER 12, 2019

I’m sure that Google engineers do indeed take extreme care when building the low level networking code that powers Google’s datacenters, but their fundamental design point was to enable frequent releases for fast iteration, feedback on their designs, and yes, early detection of problems.

Code 45

Code Systems Programming Google 45

SQL Server According to Bob

MAY 20, 2018

Bob Dorr – Principal Software Engineer SQL Server. tmpdir/$now. # # Replay captured data # if [ $3 == 1 ]; then echo Launching data replay pmafm $folio check pmafm $folio list pmdumplog -all -d -i -m $tmpdir/$now.0 0 pmafm $folio replay & fi. $now.$host.txt host.txt $tmpdir/StatsCapture.$now.$host.txt host.txt done.

Monitoring 40

Monitoring Servers Performance C++ 40

O'Reilly

FEBRUARY 4, 2025

In the early days of the personal computer, every computer manufacturer needed software engineers who could write low-level drivers that performed the work of reading and writing to memory boards, hard disks, and peripherals such as modems and printers. Schillace asks, What if traditional software engineering isnt fully relevant here?

Programming 145

Programming Google Infrastructure Internet 145

All Things Distributed

DECEMBER 18, 2012

Jul 6 - End-To-End Arguments in System Design , by J. Jul - 13 Hints for Computer Systems Design Proceedings of the Ninth ACM Symposium on Operating Systems Principles, pp. Aug 11 - " On the Naming and Binding of Network Destinations ", Saltzer, J. Saltzer, D. Reed, and D. 33-48, October 1983, Bretton Woods, NH, USA. Lorie, G.F.

Operating System 131

Operating System Cache AWS Scalability 131

Testsigma

OCTOBER 28, 2021

Rahul Parwal is a software engineer, speaker, mentor, and writer out of Jaipur, Rajasthan. He has dabbled in software development, testing, and automation, and often shares his learnings in his blog. Lesson: Test your software in real user conditions. A failing test establishes my confidence in a test I’ve designed.

Engineering 96

Engineering Hardware Testing Software Engineering 96

Rigor

SEPTEMBER 11, 2019

Rick is a software engineer on the Google Chrome team, “leading an effort to make the web just work for developers.” One of the top players in web performance, Ilya is a web performance engineer at Google, co-chair of the W3C Web Performance Working Group , and author of High Performance Browser Networking.

Performance 89

Performance Education Google Website 89

Abhishek Tiwari

NOVEMBER 3, 2018

Case-in-point, most enterprise CMS vendors lack robust full-site content delivery network (CDN) integration. A few months back, I was pulled into a scenario where a business has been working with a leading CMS vendor to roll-out a network of multi-regional websites.

Systems 63

Systems Cache Website Network 63

Alex Russell

OCTOBER 27, 2024

My business card says "Product Manager" which is an uncomfortable fudge in much the way "Software Engineer" was an odd fit in my dozen+ years on the Chrome team. Companies also don't ask strategists to design and implement solutions in the opportunity spaces they identify. That's by design.

Strategy 76

Strategy Mobile Google Social Media 76