The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 100

AWS Entertainment Open Source Benchmarking 100

O'Reilly

OCTOBER 19, 2021

This is both frustrating for companies that would prefer making ML an ordinary, fuss-free value-generating function like software engineering, as well as exciting for vendors who see the opportunity to create buzz around a new category of enterprise software. The new category is often called MLOps. This approach is not novel.

DevOps 145

DevOps Software Engineering Open Source Infrastructure 145

The Netflix TechBlog

MARCH 25, 2019

Now, imagine yourself in the role of a software engineer responsible for a micro-service which publishes data consumed by few critical customer facing services (e.g. To improve data accuracy, we decided to leverage AWS S3 access logs to identify entity relationships not been captured by our traditional ingestion process.

Infrastructure 225

Infrastructure Big Data Transportation Architecture 225

High Scalability

AUGUST 4, 2020

T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Learn how engineering teams are using products like StackHawk and Snyk to add security bug testing to their CI pipelines. Learn the stuff they don't teach you in the AWS docs.

Education 115

Education AWS Scalability Java 115

High Scalability

JUNE 11, 2020

T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Learn how engineering teams are using products like StackHawk and Snyk to add security bug testing to their CI pipelines. Learn the stuff they don't teach you in the AWS docs.

Education 105

Education AWS Scalability Java 105

High Scalability

SEPTEMBER 3, 2020

T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Learn how engineering teams are using products like StackHawk and Snyk to add security bug testing to their CI pipelines. Learn the stuff they don't teach you in the AWS docs.

Education 105

Education AWS Scalability Java 105

High Scalability

JULY 8, 2020

T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Learn how engineering teams are using products like StackHawk and Snyk to add security bug testing to their CI pipelines. Learn the stuff they don't teach you in the AWS docs.

Education 102

Education AWS Scalability Java 102

High Scalability

OCTOBER 14, 2020

T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Learn how engineering teams are using products like StackHawk and Snyk to add security bug testing to their CI pipelines. Learn the stuff they don't teach you in the AWS docs.

Education 102

Education AWS Scalability Java 102

High Scalability

SEPTEMBER 18, 2020

T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Learn how engineering teams are using products like StackHawk and Snyk to add security bug testing to their CI pipelines. Learn the stuff they don't teach you in the AWS docs.

Education 102

Education AWS Scalability Java 102

High Scalability

JULY 8, 2020

T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Learn how engineering teams are using products like StackHawk and Snyk to add security bug testing to their CI pipelines. Learn the stuff they don't teach you in the AWS docs.

Education 100

Education AWS Scalability Java 100

The Netflix TechBlog

OCTOBER 18, 2022

As Big data and ML became more prevalent and impactful, the scalability, reliability, and usability of the orchestrating ecosystem have increasingly become more important for our data scientists and the company. Motivation Scalability and usability are essential to enable large-scale workflows and support a wide range of use cases.

Java 211

Java Scalability Traffic Architecture 211

High Scalability

DECEMBER 22, 2020

T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Learn how engineering teams are using products like StackHawk and Snyk to add security bug testing to their CI pipelines. Learn the stuff they don't teach you in the AWS docs.

Education 100

Education AWS Scalability Java 100

High Scalability

DECEMBER 8, 2020

T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Learn how engineering teams are using products like StackHawk and Snyk to add security bug testing to their CI pipelines. Learn the stuff they don't teach you in the AWS docs.

Education 100

Education AWS Scalability Java 100

High Scalability

NOVEMBER 24, 2020

T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Learn how engineering teams are using products like StackHawk and Snyk to add security bug testing to their CI pipelines. Learn the stuff they don't teach you in the AWS docs.

Education 100

Education AWS Scalability Java 100

High Scalability

NOVEMBER 10, 2020

T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Learn how engineering teams are using products like StackHawk and Snyk to add security bug testing to their CI pipelines. Learn the stuff they don't teach you in the AWS docs.

Education 100

Education AWS Scalability Java 100

High Scalability

SEPTEMBER 29, 2020

T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Learn how engineering teams are using products like StackHawk and Snyk to add security bug testing to their CI pipelines. Learn the stuff they don't teach you in the AWS docs.

Education 100

Education AWS Scalability Java 100

The Netflix TechBlog

APRIL 26, 2022

We use Keystone as it is easy to use, reliable, scalable, and provides aggregation of facts from different cloud regions into a single AWS region. We plan to split these Keystone streams into multiple streams for horizontal scalability. We needed scalability testing and performance testing as well.

Storage 195

Storage Design Scalability Latency 195

High Scalability

MARCH 8, 2021

T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Learn how engineering teams are using products like StackHawk and Snyk to add security bug testing to their CI pipelines. Learn the stuff they don't teach you in the AWS docs.

Education 100

Education AWS Scalability Java 100

High Scalability

FEBRUARY 17, 2021

T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Learn how engineering teams are using products like StackHawk and Snyk to add security bug testing to their CI pipelines. Learn the stuff they don't teach you in the AWS docs.

Education 100

Education AWS Scalability Java 100

High Scalability

FEBRUARY 2, 2021

T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Learn how engineering teams are using products like StackHawk and Snyk to add security bug testing to their CI pipelines. Learn the stuff they don't teach you in the AWS docs.

Education 100

Education AWS Scalability Java 100

High Scalability

JANUARY 25, 2021

T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Learn how engineering teams are using products like StackHawk and Snyk to add security bug testing to their CI pipelines. Learn the stuff they don't teach you in the AWS docs.

Education 100

Education AWS Scalability Java 100

High Scalability

JANUARY 5, 2021

T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Learn how engineering teams are using products like StackHawk and Snyk to add security bug testing to their CI pipelines. Learn the stuff they don't teach you in the AWS docs.

Education 100

Education AWS Scalability Java 100

High Scalability

MAY 26, 2020

Scrapinghub is hiring a Senior Software Engineer (Big Data/AI). this is going to be a challenging journey for any backend engineer! T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Learn the Good Parts of AWS.

Education 100

Education AWS Software Engineering Scalability 100

The Netflix TechBlog

DECEMBER 3, 2019

mainly because of mundane reasons related to software engineering. Netflix has been one of the largest users of Amazon Web Services (AWS) for many years and we have accumulated plenty of operational experience and expertise in dealing with the cloud, AWS in particular.

Open Source 135

Open Source AWS Infrastructure Energy 135

High Scalability

MARCH 18, 2021

T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Learn how engineering teams are using products like StackHawk and Snyk to add security bug testing to their CI pipelines. Learn the stuff they don't teach you in the AWS docs.

Education 100

Education DevOps AWS Scalability 100

The Netflix TechBlog

NOVEMBER 3, 2022

Doing so would require a substantial migration effort to move all clients off the old API with questionable value to the affected teams (except for helping us solve Titus' internal scalability problems). Previous results hold, showing better scalability with the caching solution. V., & Gharachorloo, K.

Cache 233

Cache Latency Traffic Systems 233

The Netflix TechBlog

AUGUST 16, 2023

Each of the 3 colors represents our deployment regions in AWS, and the blue vertical line shows when we turned on the feature. Total Connections This graph (as well as the ones below) shows a week’s worth of data, with the typical diurnal cycle of Netflix usage.

Traffic 178

Traffic Servers Google Metrics 178

Dotcom-Montior

OCTOBER 6, 2021

A site reliability engineer, or SRE, is a role that that encompasses aspects of both software engineering and operations/infrastructure. The term site reliability engineering first came into existence at Google in 2003 when a site reliability team was created. At that time, the team was made up of software engineers.

Engineering 67

Engineering DevOps Monitoring Google 67

All Things Distributed

DECEMBER 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. After the AWS re: Invent conference I spent two weeks in Europe for the last customer visits of the year. Although there are still a few very exciting AWS news updates to happen this year. All Things Distributed. The Back-to-Basics Readings of 2012.

Operating System 131

Operating System Cache AWS Scalability 131