Remove Network Remove Software Engineering Remove Storage
article thumbnail

Designing Instagram

High Scalability

Firstly, the synchronous process which is responsible for uploading image content on file storage, persisting the media metadata in graph data-storage, returning the confirmation message to the user and triggering the process to update the user activity. Some of the keys of understanding the user network are listed below.

Design 334
article thumbnail

All of Netflix’s HDR video streaming is now dynamically optimized

The Netflix TechBlog

In spite of reaching higher qualities than the fixed ladder, the HDR-DO ladder, on average, occupies only 58% of the storage space compared to fixed-bitrate ladder. Join us and be a part of the amazing team that brought you this tech-blog; open positions: Software Engineer, Cloud Gaming Software Engineer, Live Streaming References [1] L.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

AWS observability: AWS monitoring best practices for resiliency

Dynatrace

With EC2, Amazon manages the basic compute, storage, networking infrastructure and virtualization layer, and leaves the rest for you to manage: OS, middleware, runtime environment, data, and applications. Amazon EC2. EC2 is Amazon’s Infrastructure-as-a-service (IaaS) compute platform designed to handle any workload at scale.

article thumbnail

Netflix at AWS re:Invent 2019

The Netflix TechBlog

4:45pm-5:45pm NFX 209 File system as a service at Netflix Kishore Kasi , Senior Software Engineer Abstract : As Netflix grows in original content creation, its need for storage is also increasing at a rapid pace. In this session, we present our human-centric design principles that enable the autonomy our engineers enjoy.

AWS 38
article thumbnail

Evolution of ML Fact Store

The Netflix TechBlog

The first version of our logger library optimized for storage by deduplicating facts and optimized for network i/o using different compression methods for each fact. Since we were optimizing at the logging level for storage and performance, we had less data and metadata to play with to optimize the query performance.

Storage 195
article thumbnail

Consistent caching mechanism in Titus Gateway

The Netflix TechBlog

When a new leader is elected it loads all data from external storage. Collapse multiple keep-alive requests in Titus Job Coordinator, sending a response to the latest one which has the arrival timestamp less than that of the timestamp of the last event sent over the network.

Cache 233
article thumbnail

Growth Engineering at Netflix?—?Automated Imagery Generation

The Netflix TechBlog

The homepage needs to load in a reasonable amount of time, even in poor network conditions. This requires an asset storage solution. Asset Storage We refer to asset storage and management simply as asset management. We need to be able to easily determine what imagery is present for a given platform, region, and language.