The Netflix TechBlog

MARCH 7, 2024

The Machine Learning Platform (MLP) team at Netflix provides an entire ecosystem of tools around Metaflow , an open source machine learning infrastructure framework we started, to empower data scientists and machine learning practitioners to build and manage a variety of ML systems. ETL workflows), as well as downstream (e.g.

Systems 235

Systems Media Cache Open Source 235

The Netflix TechBlog

JULY 21, 2022

Since memory management is not something one usually associates with classification problems, this blog focuses on formulating the problem as an ML problem and the data engineering that goes along with it. Some nuances while creating this dataset come from the on-field domain knowledge of our engineers. Labeling the data?

Big Data 188

Big Data Cache Engineering Data Engineering 188

The Netflix TechBlog

SEPTEMBER 10, 2024

Sample system diagram for an Alexa voice command. The other main use case was RENO, the Rapid Event Notification System mentioned above. Rewriting always comes with a risk, and it’s never the first solution we reach for, particularly when working with a system that’s in place and working well.

Latency 234

Latency Cache Tuning Efficiency 234

The Netflix TechBlog

MARCH 5, 2019

the order of the rows on your Netflix home page, issuing content licenses when you click play, finding the Open Connect cache closest to you with the content you requested, and many more). How can we develop templated detection modules (rules- and ML-based) and data streams to increases speed of development?

Infrastructure 185

Infrastructure Cloud Scalability AWS 185

Abhishek Tiwari

DECEMBER 27, 2017

Unified data management architecture. A unified data management (UDM) system combines the best of data warehouses, data lakes, and streaming without expensive and error-prone ETL. In contrast, Alluxio a middleware for data access - think Alluxio storage layer as fast cache.

Big Data 49

Big Data Artificial Intelligence Storage Hardware 49

DZone

MARCH 21, 2025

As a DBA or data engineer, you've likely experienced the awkward moments of being "swarmed" by users. Faced with repetitive query demands, the system acts like a "forgetful patient," recalculating every time, which is truly frustrating. "The morning meeting is about to start, and the report is still loading."

Cache 147

Cache Data Engineering Engineering Systems 147