The Netflix TechBlog

OCTOBER 28, 2021

Interview with Pallavi Phadnis This post is part of our “ Data Engineers of Netflix ” series, where our very own data engineers talk about their journeys to Data Engineering @ Netflix. Pallavi Phadnis is a Senior Software Engineer at Netflix. Pallavi, what’s your journey to data engineering at Netflix?

Data Engineering 177

Data Engineering Engineering Big Data Software Engineering 177

Dynatrace

NOVEMBER 7, 2023

Platform engineering is on the rise. According to leading analyst firm Gartner, “80% of software engineering organizations will establish platform teams as internal providers of reusable services, components, and tools for application delivery…” by 2026.

Engineering 306

Engineering DevOps Best Practices Infrastructure 306

The Netflix TechBlog

DECEMBER 3, 2019

mainly because of mundane reasons related to software engineering. By design, Metaflow is a deceptively simple Python library: Data scientists can structure their workflow as a Directed Acyclic Graph of steps, as depicted above. It leverages elasticity of the cloud by design?—?both Metaflow is a cloud-native framework.

Open Source 235

Open Source AWS Infrastructure Energy 235

The Netflix TechBlog

NOVEMBER 22, 2019

December 2 1pm-2pm CMP 326-R Capacity Management Made Easy with Amazon EC2 Auto Scaling Vadim Filanovsky , Senior Performance Engineer & Anoop Kapoor, AWS Abstract :Amazon EC2 Auto Scaling offers a hands-free capacity management experience to help customers maintain a healthy fleet, improve application availability, and reduce costs.

AWS 38

AWS Entertainment Open Source Benchmarking 38

The Netflix TechBlog

NOVEMBER 9, 2021

To achieve this goal, the Encoding Technologies team made the following design decisions about AV1 encoding recipes: We always encode at the highest available source resolution and frame rate. The Encoding Technologies team currently has a number of openings, and we can’t wait to have more stunning engineers joining us.

Media 246

Media Open Source Software Engineering Efficiency 246

The Netflix TechBlog

MARCH 25, 2019

Now, imagine yourself in the role of a software engineer responsible for a micro-service which publishes data consumed by few critical customer facing services (e.g. Design a flexible data model ? —?Represent Can I run a check myself to understand what data is behind this metric?” Enable seamless integration?—?

Infrastructure 222

Infrastructure Big Data Transportation Architecture 222

The Netflix TechBlog

NOVEMBER 29, 2023

HDR was launched at Netflix in 2016 and the number of titles available in HDR has been growing ever since. Bitrate versus quality comparison HDR-VMAF is designed to be format-agnostic — it measures the perceptual quality of HDR video signal regardless of its container format, for example, Dolby Vision or HDR10. The graphic below (Fig.

Open Source 256

Open Source Software Engineering Internet Internet 256

J. Paul Reed

MARCH 14, 2019

The 737Max and Why Software Engineers Might Want to Pay Attention As someone with a bit of a reputation for talking about aviation and software development and operations , I’ve been asked about the 737Max repeatedly over the past week. a selling point ?—?and

Software Engineering 75

Software Engineering Engineering Software Software 75

The Netflix TechBlog

FEBRUARY 1, 2022

It’s also a great opportunity for you to learn more about the available roles, the technical challenges the teams are facing and what it’s like to work on a backend engineering team at Netflix. The interview panel consists of two or three engineers, a hiring manager and a recruiter. This is a conversation, not an inquisition!

Engineering 204

Engineering Games Entertainment Innovation 204

Dynatrace

JANUARY 19, 2021

– Robert Trueman, Head of Software Engineering at CDL. available for quite some time?already. This additional insight enables you to design strategies for handling the effects of cold starts, like warming up your functions or configuring provisioned concurrency for your functions. AWS Lambda?extension analyzed in?context

Lambda 264

Lambda Serverless AWS Mobile 264

The Netflix TechBlog

APRIL 26, 2022

We will share how its design has evolved over the years and the lessons learned while building it. To understand Axion’s design, we need to know the various components that interact with it. These facts are managed and made available by services like viewing history or video metadata services outside of Axion.

Storage 191

Storage Design Scalability Latency 191

The Netflix TechBlog

MARCH 4, 2025

This endpoint efficiently reads from all available Hollow Feeds to obtain the current status, thanks to Hollows in-memory capabilities. Many of the metadata and assets involved in title setup have specific timelines for when they become available to members.

Traffic 160

Traffic Strategy Entertainment Innovation 160

O'Reilly

OCTOBER 19, 2021

This is both frustrating for companies that would prefer making ML an ordinary, fuss-free value-generating function like software engineering, as well as exciting for vendors who see the opportunity to create buzz around a new category of enterprise software. The new category is often called MLOps. This approach is not novel.

DevOps 141

DevOps Software Engineering Infrastructure Open Source 141

High Scalability

APRIL 16, 2019

Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Join Etleap , an Amazon Redshift ETL tool to learn the latest trends in designing a modern analytics infrastructure. Make your job search O (1), not O ( n ). Apply here.

Analytics 26

Analytics Java Metrics Software Engineering 26

High Scalability

APRIL 10, 2019

Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Join Etleap , an Amazon Redshift ETL tool to learn the latest trends in designing a modern analytics infrastructure. Make your job search O (1), not O ( n ). Apply here.

Analytics 26

Analytics Java Metrics Software Engineering 26

Dynatrace

JUNE 2, 2022

Site reliability engineering (SRE) continues to gain popularity as organizations embrace hybrid cloud strategies and IT automation at scale. By applying software engineering principles to operations and infrastructure practices, SRE enables organizations to streamline and automate IT processes. Dynatrace news.

DevOps 147

DevOps Innovation Engineering Benchmarking 147

High Scalability

AUGUST 4, 2020

has hours of system design content. They also do live system design discussions every week. T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Client libraries are available for Node, Ruby, Python, PHP, Go, Java and.NET.

Education 115

Education AWS Scalability Java 115

High Scalability

MAY 14, 2019

Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Join Etleap , an Amazon Redshift ETL tool to learn the latest trends in designing a modern analytics infrastructure. Make your job search O (1), not O ( n ). Apply here.

Analytics 24

Analytics Java Metrics Software Engineering 24

Scalegrid

OCTOBER 18, 2024

Learning Resources: Are there tutorials, guides, and comprehensive documentation available for the tool? Cross-Platform Compatibility: Is the tool available on multiple operating systems (Windows, macOS, Linux)? Lacks some advanced coding and debugging tools available in other products. Pricing: Free: Only 14-day trial.

Open Source 147

Open Source Database Cloud Operating System 147

High Scalability

JANUARY 8, 2019

Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Client libraries are available for Node, Ruby, Python, PHP, Go, Java and.NET. Who's Hiring? Make your job search O (1), not O ( n ). Apply here. Need excellent people?

Java 137

Java Metrics Software Engineering DevOps 137

High Scalability

JUNE 11, 2020

has hours of system design content. They also do live system design discussions every week. T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Client libraries are available for Node, Ruby, Python, PHP, Go, Java and.NET.

Education 105

Education AWS Scalability Java 105

Dynatrace

JANUARY 18, 2023

Site reliability engineering (SRE) is a software operations methodology that enables organizations to create highly reliable and scalable applications. SRE applies software engineering principles to operations and infrastructure processes. Site reliability engineers, or SREs, lead these efforts.

DevOps 246

DevOps Best Practices Innovation Strategy 246

High Scalability

NOVEMBER 12, 2019

Sisu Data is looking for machine learning engineers who are eager to deliver their features end-to-end, from Jupyter notebook to production, and provide actionable insights to businesses based on their first-party, streaming, and structured relational data. Client libraries are available for Node, Ruby, Python, PHP, Go, Java and.NET.

Education 22

Education Java Software Engineering Engineering 22

High Scalability

SEPTEMBER 3, 2020

has hours of system design content. They also do live system design discussions every week. T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Client libraries are available for Node, Ruby, Python, PHP, Go, Java and.NET.

Education 105

Education AWS Scalability Java 105

High Scalability

APRIL 14, 2020

has hours of system design content. They also do live system design discussions every week. Scrapinghub is hiring a Senior Software Engineer (Big Data/AI). this is going to be a challenging journey for any backend engineer! Learn to balance architecture trade-offs and design scalable enterprise-level software.

Education 105

Education Software Engineering Scalability Engineering 105

The Netflix TechBlog

DECEMBER 3, 2019

mainly because of mundane reasons related to software engineering. By design, Metaflow is a deceptively simple Python library: Data scientists can structure their workflow as a Directed Acyclic Graph of steps, as depicted above. It leverages elasticity of the cloud by design?—?both Metaflow is a cloud-native framework.

Open Source 134

Open Source AWS Infrastructure Energy 134

High Scalability

JULY 8, 2020

has hours of system design content. They also do live system design discussions every week. T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Client libraries are available for Node, Ruby, Python, PHP, Go, Java and.NET.

Education 102

Education AWS Scalability Java 102

High Scalability

OCTOBER 15, 2019

Sisu Data is looking for machine learning engineers who are eager to deliver their features end-to-end, from Jupyter notebook to production, and provide actionable insights to businesses based on their first-party, streaming, and structured relational data. Client libraries are available for Node, Ruby, Python, PHP, Go, Java and.NET.

Education 22

Education Java Engineering Software Engineering 22

High Scalability

OCTOBER 29, 2019

Sisu Data is looking for machine learning engineers who are eager to deliver their features end-to-end, from Jupyter notebook to production, and provide actionable insights to businesses based on their first-party, streaming, and structured relational data. Client libraries are available for Node, Ruby, Python, PHP, Go, Java and.NET.

Education 22

Education Java Software Engineering Engineering 22

High Scalability

DECEMBER 11, 2018

Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Client libraries are available for Node, Ruby, Python, PHP, Go, Java and.NET. Who's Hiring? Make your job search O (1), not O ( n ). Apply here. Need excellent people?

Java 125

Java Metrics Software Engineering DevOps 125

High Scalability

MAY 12, 2020

has hours of system design content. They also do live system design discussions every week. Scrapinghub is hiring a Senior Software Engineer (Big Data/AI). this is going to be a challenging journey for any backend engineer! Learn to balance architecture trade-offs and design scalable enterprise-level software.

Education 102

Education Software Engineering Scalability Engineering 102

High Scalability

APRIL 28, 2020

has hours of system design content. They also do live system design discussions every week. Scrapinghub is hiring a Senior Software Engineer (Big Data/AI). this is going to be a challenging journey for any backend engineer! Learn to balance architecture trade-offs and design scalable enterprise-level software.

Education 102

Education Software Engineering Scalability Engineering 102

High Scalability

MARCH 30, 2020

has hours of system design content. They also do live system design discussions every week. Scrapinghub is hiring a Senior Software Engineer (Big Data/AI). this is going to be a challenging journey for any backend engineer! Client libraries are available for Node, Ruby, Python, PHP, Go, Java and.NET.

Education 105

Education Software Engineering Engineering Big Data 105

High Scalability

MARCH 24, 2020

Scrapinghub is hiring a Senior Software Engineer (Big Data/AI). You will be designing and implementing distributed systems : large-scale web crawling platform, integrating Deep Learning based web data extraction components, working on queue algorithms, large datasets, creating a development platform for other company departments, etc.

Education 105

Education Software Engineering Engineering Big Data 105

High Scalability

FEBRUARY 19, 2019

Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Join Etleap , an Amazon Redshift ETL tool to learn the latest trends in designing a modern analytics infrastructure. Make your job search O (1), not O ( n ). Apply here.

Software 125

Software Software Analytics Infrastructure 125

High Scalability

JULY 8, 2020

has hours of system design content. They also do live system design discussions every week. T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Client libraries are available for Node, Ruby, Python, PHP, Go, Java and.NET.

Education 100

Education AWS Scalability Java 100

Testlodge

MAY 26, 2021

Projects these days are becoming increasingly complex and any potential risk of failure needs to be managed using available resources that won’t compromise the product’s quality. Besides, complex architecture, non-availability of required expertise, a lack of new tools or advanced technology, inappropriate domain knowledge, etc.,

Testing 105

Testing Software Engineering Best Practices Monitoring 105