The Netflix TechBlog

MARCH 31, 2025

As file sizes grow and workflows become more complex, these issues are magnified, leading to inefficiencies that slow down post-production and reduce the available time spent on creativework. Besides the need for robust cloud storage for their media, artists need access to powerful workstations and real-time playback. So what isit?

Media 203

Media Logistics Innovation Cloud 203

Dynatrace

DECEMBER 12, 2024

Boost your operational resilience: Combining availability and security is now essential. The Federal Reserve Regulation HH in the United States focuses on operational resilience requirements for systemically important financial market utilities. Its time to adopt a unified observability and security approach.

Analytics 289

Analytics Government Efficiency Innovation 289

Dynatrace

AUGUST 21, 2024

These releases often assumed ideal conditions such as zero latency, infinite bandwidth, and no network loss, as highlighted in Peter Deutsch’s eight fallacies of distributed systems. With Dynatrace, teams can seamlessly monitor the entire system, including network switches, database storage, and third-party dependencies.

Engineering 262

Engineering Systems Latency Metrics 262

The Netflix TechBlog

DECEMBER 21, 2020

At this scale, we can gain a significant amount of performance and cost benefits by optimizing the storage layout (records, objects, partitions) as the data lands into our warehouse. We built AutoOptimize to efficiently and transparently optimize the data and metadata storage layout while maximizing their cost and performance benefits.

Storage 212

Storage Latency Efficiency Data Engineering 212

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. This guide delves into how these systems work, the challenges they solve, and their essential role in businesses and technology.

Storage 130

Storage Systems Big Data Azure 130

Dynatrace

MARCH 5, 2025

Integration with existing systems and processes : Integration with existing IT infrastructure, observability solutions, and workflows often requires significant investment and customization. The certification results are now publicly available. Storage calculations assume that one terabyte consumes 1.2

Energy 223

Energy Analytics Traffic Cloud 223

Dynatrace

SEPTEMBER 8, 2022

Log management is an organization’s rules and policies for managing and enabling the creation, transmission, analysis, storage, and other tasks related to IT systems’ and applications’ log data. Distributed cloud systems are complex, dynamic, and difficult to manage without the proper tools. Dynatrace news.

Cloud 260

Cloud Systems Analytics DevOps 260

The Netflix TechBlog

MARCH 4, 2025

Part 3: System Strategies and Architecture By: VarunKhaitan With special thanks to my stunning colleagues: Mallika Rao , Esmir Mesic , HugoMarques This blog post is a continuation of Part 2 , where we cleared the ambiguity around title launch observability at Netflix. The request schema for the observability endpoint.

Traffic 180

Traffic Strategy Entertainment Innovation 180

Scalegrid

FEBRUARY 6, 2025

Introduction to Message Brokers Message brokers enable applications, services, and systems to communicate by acting as intermediaries between senders and receivers. This decoupling simplifies system architecture and supports scalability in distributed environments.

Latency 147

Latency Analytics Architecture Storage 147

Dynatrace

JULY 31, 2020

Dynatrace Managed now available on the Google Cloud Platform. We’re currently adding individual mount points for different storage types and separate disk setup for each of these storage types. For more details, see Dynatrace Managed hardware and systems requirements.

Cloud 264

Cloud Availability Azure Google 264

The Netflix TechBlog

FEBRUARY 14, 2025

It requires a state-of-the-art system that can track and process these impressions while maintaining a detailed history of each profiles exposure. In this multi-part blog series, we take you behind the scenes of our system that processes billions of impressions daily.

Tuning 166

Tuning Latency Efficiency Storage 166

Dynatrace

JANUARY 12, 2022

Messaging systems can significantly improve the reliability, performance, and scalability of the communication processes between applications and services. In serverless and microservices architectures, messaging systems are often used to build asynchronous service-to-service communication. Dynatrace news. This is great!

Analytics 246

Analytics Systems DevOps Healthcare 246

Dynatrace

JUNE 25, 2020

Dynatrace Managed is intrinsically highly available as it stores three copies of all events, user sessions, and metrics across its cluster nodes. Our Premium High Availability comes with the following features: Active-active deployment model for optimum hardware utilization. Dynatrace news. Minimized cross-data center network traffic.

Availability 264

Availability Hardware Latency Traffic 264

Scalegrid

MAY 13, 2020

High performance, query optimization, open source and polymorphic data storage are the major Greenplum advantages. The MPP system leverages a shared-nothing architecture to handle multiple operations in parallel. Typically an MPP system has one leader node and one or many compute nodes. Polymorphic Data Storage.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

Scalegrid

FEBRUARY 27, 2025

Performance Optimizations PostgreSQL 17 significantly improves performance, query handling, and database management, making it more efficient for high-demand systems. Unlike full backups that duplicate everything, incremental backups store only changes since the last save, reducing storage needs and speeding up recovery.

Speed 130

Speed Database Storage Efficiency 130

Dynatrace

APRIL 4, 2025

Journald provides unified structured logging for systems, services, and applications, eliminating the need for custom parsing for severity or details. Dynatrace Grail lets you focus on extracting insights rather than managing complex schemas or index and storage concepts.

Analytics 147

Analytics Operating System Scalability Infrastructure 147

Dynatrace

MARCH 11, 2025

The Dynatrace platform now enables comprehensive data exploration and interactive analytics across data sets (trace, logs, events, and metrics)empowering you to solve complex use cases, handle any observability scenario, and gain unprecedented visibility into your systems. But why stop there?

Games 165

Games Analytics Innovation Metrics 165

Scalegrid

FEBRUARY 24, 2025

Scaling RabbitMQ ensures your system can handle growing traffic and maintain high performance. Key Takeaways RabbitMQ improves scalability and fault tolerance in distributed systems by decoupling applications, enabling reliable message exchanges.

Best Practices 147

Best Practices Traffic Strategy Scalability 147

Scalegrid

MAY 11, 2024

MongoDB offers several storage engines that cater to various use cases. The default storage engine in earlier versions was MMAPv1, which utilized memory-mapped files and document-level locking. The newer, pluggable storage engine, WiredTiger, addresses this by using prefix compression, collection-level locking, and row-based storage.

Storage 130

Storage Engineering Cache Database 130

Percona

DECEMBER 11, 2023

There are a wealth of options on how you can approach storage configuration in Percona Operator for PostgreSQL , and in this blog post, we review various storage strategies — from basics to more sophisticated use cases. For example, you can choose the public cloud storage type – gp3, io2, etc, or set file system.

Storage 122

Storage Strategy Cloud Network 122

Dynatrace

OCTOBER 7, 2021

This means you no longer have to provision, scale, and maintain servers to run your applications, databases, and storage systems. Speed is next; serverless solutions are quick to spin up or down as needed, and there are no delays due to limited storage or resource access. AWS offers four serverless offerings for storage.

Serverless 325

Serverless AWS Lambda Storage 325

DZone

AUGUST 13, 2024

But this also caused storage challenges like disk failures and data recovery. To avoid extensive maintenance, we adopted JuiceFS, a distributed file system with high performance. This architecture ensures high availability and stability of the data while significantly enhancing system performance and data recovery capabilities.

Artificial Intelligence 243

Artificial Intelligence Architecture AWS Storage 243

The Netflix TechBlog

SEPTEMBER 18, 2024

Central to this infrastructure is our use of multiple online distributed databases such as Apache Cassandra , a NoSQL database known for its high availability and scalability. This flexibility allows our Data Platform to route different use cases to the most suitable storage system based on performance, durability, and consistency needs.

Latency 260

Latency Storage Cache Servers 260

Dynatrace

OCTOBER 23, 2023

Microsoft Hyper-V is a virtualization platform that manages virtual machines (VMs) on Windows-based systems. It enables multiple operating systems to run simultaneously on the same physical hardware and integrates closely with Windows-hosted services. This leads to a more efficient and streamlined experience for users.

Efficiency 264

Efficiency Virtualization Hardware Performance 264

Dynatrace

OCTOBER 4, 2022

Limited data availability constrains value creation. Teams have introduced workarounds to reduce storage costs. Additionally, efforts such as lowered data retention times, two-tiered storage systems, shaky index management, sampled data, and data pipelines reduce the overall amount of stored data.

Analytics 264

Analytics Artificial Intelligence Storage Serverless 264

The Netflix TechBlog

DECEMBER 17, 2024

Analytics Engineers deliver these insights by establishing deep business and product partnerships; translating business challenges into solutions that unblock critical decisions; and designing, building, and maintaining end-to-end analytical systems. DJ has a strong pedigreethere are several prior semantic layers in the industry (e.g.

Analytics 212

Analytics Engineering Entertainment Metrics 212

Dynatrace

OCTOBER 4, 2022

This architecture offers rich data management and analytics features (taken from the data warehouse model) on top of low-cost cloud storage systems (which are used by data lakes). This decoupling ensures the openness of data and storage formats, while also preserving data in context. This scenario is a thing of the past.

Artificial Intelligence 290

Artificial Intelligence Analytics Storage Architecture 290

Dynatrace

MAY 21, 2024

That’s because it does not require any pre-prepared schemas, and access to cold/hot storage is fully automatic and with zero latency. Dynatrace analytics capabilities, powered by hypermodal AI , enable executives to drive improved availability , strengthened security compliance , and heightened confidence in AI initiatives.

Technology 275

Technology Technology Analytics Storage 275

DZone

JANUARY 23, 2022

Building resilient systems requires comprehensive error management. Errors could occur in any part of the system / or its ecosystem and there are different ways of handling these e.g. Datacenter - data center failure where the whole DC could become unavailable due to power failure, network connectivity failure, environmental catastrophe, etc.

Hardware 243

Hardware DevOps Network Storage 243

The Netflix TechBlog

APRIL 27, 2023

Engineers want their alerting system to be realtime, reliable, and actionable. A few years ago, we were paged by our SRE team due to our Metrics Alerting System falling behind — critical application health alerts reached engineers 45 minutes late! In other words, false positives are bad but false negatives are the absolute worst!

Storage 297

Storage Cache Metrics Database 297

High Scalability

APRIL 16, 2019

In this three-part blog series, we introduced a High Availability (HA) Framework for MySQL hosting in Part I, and discussed the details of MySQL semisynchronous replication in Part II. Now in Part III, we review how the framework handles some of the important MySQL failure scenarios and recovers to ensure high availability.

Availability 149

Availability Network Azure AWS 149

Dynatrace

OCTOBER 4, 2022

Application and system logs are often collected in data silos using different tools, with no relationships between them, and then correlated in manual and often meaningless ways. The advantage of an index-free system in log analytics and log management. In most data storage models, indexing engines enable faster access to query logs.

Analytics 264

Analytics Storage Infrastructure Metrics 264

The Netflix TechBlog

MAY 4, 2023

Behind the scenes, a myriad of systems and services are involved in orchestrating the product experience. These backend systems are consistently being evolved and optimized to meet and exceed customer and product expectations. It provides a good read on the availability and latency ranges under different production conditions.

Traffic 347

Traffic Latency Tuning Systems 347

Dynatrace

DECEMBER 5, 2023

Streamline privacy requirements with flexible retention periods Data retention is a critical aspect of data handling, and it’s not just about privacy compliance—it’s about having the flexibility to optimize data storage times in Grail for your Dynatrace use cases. Grail buckets function like folders in a file system.

Storage 242

Storage Healthcare Best Practices Speed 242

Scalegrid

JULY 17, 2020

Often times an external system is providing data as JSON, so it might be a temporary store before data is ingested into other parts of the system. JSONB storage has some drawbacks vs. traditional columns: PostreSQL does not store column statistics for JSONB columns. JSONB storage results in a larger storage footprint.

Storage 321

Storage Database Efficiency Processing 321

Dynatrace

JUNE 14, 2024

Since March 2024, the Dynatrace ® platform has been available on AWS in Tokyo, allowing customers to leverage the latest Dynatrace capabilities from Japan. Domain-specific guidelines recommend local data storage in Japan. An overview of how to upgrade is available in our guide, Upgrade to Dynatrace SaaS.

AWS 278

AWS Government Azure Healthcare 278

Dynatrace

AUGUST 24, 2020

To make this possible, the application code should be instrumented with telemetry data for deep insights, including: Metrics to find out how the behavior of a system has changed over time. Traces help find the flow of a request through a distributed system. Logs represent event data in plain-text, structured or binary format.

Analytics 305

Analytics Infrastructure AWS Operating System 305