Remove Latency Remove Storage Remove Video
article thumbnail

Netflix Video Quality at Scale with Cosmos Microservices

The Netflix TechBlog

Moorthy and Zhi Li Introduction Measuring video quality at scale is an essential component of the Netflix streaming pipeline. Perceptual quality measurements are used to drive video encoding optimizations , perform video codec comparisons , carry out A/B testing and optimize streaming QoE decisions to mention a few.

Media 180
article thumbnail

Netflix Cloud Packaging in the Terabyte Era

The Netflix TechBlog

After content ingestion, inspection and encoding, the packaging step encapsulates encoded video and audio in codec agnostic container formats and provides features such as audio video synchronization, random access and DRM protection. Uploading and downloading data always come with a penalty, namely latency.

Cloud 242
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Designing Instagram

High Scalability

Generating machine learning based personalized recommendations to discover new people, photos, videos, and stories relevant one’s interest. After that, the post gets added to the feed of all the followers in the columnar data storage. Users should be able to like and comment the posts. Out of Scope. High Level Design.

Design 334
article thumbnail

Introducing Netflix TimeSeries Data Abstraction Layer

The Netflix TechBlog

Rajiv Shringi Vinay Chella Kaidan Fullerton Oleksii Tkachuk Joey Lynch Introduction As Netflix continues to expand and diversify into various sectors like Video on Demand and Gaming , the ability to ingest and store vast amounts of temporal data — often reaching petabytes — with millisecond access latency has become increasingly vital.

Latency 242
article thumbnail

Edgar: Solving Mysteries Faster with Observability

The Netflix TechBlog

This difference has substantial technological implications, from the classification of what’s interesting to transport to cost-effective storage (keep an eye out for later Netflix Tech Blog posts addressing these topics). As you can imagine, this comes with very real storage costs. Is this an anomaly or are we dealing with a pattern?

Latency 299
article thumbnail

Bulldozer: Batch Data Moving from Data Warehouse to Online Key-Value Stores

The Netflix TechBlog

Data scientists and engineers collect this data from our subscribers and videos, and implement data analytics models to discover customer behaviour with the goal of maximizing user joy. The data warehouse is not designed to serve point requests from microservices with low latency.

Latency 254
article thumbnail

Data ingestion pipeline with Operation Management

The Netflix TechBlog

in a video file. As described in the above picture During the first run of the algorithm it identified 500 objects in a particular Video file. Now when we re-ran the algorithm on the same video file it created 600 annotations of schema type Objects and stored them in our service. The Algorithm team improved their algorithm.

Media 275