The Netflix TechBlog

JANUARY 10, 2024

Future blogs will provide deeper dives into each service, sharing insights and lessons learned from this process. The Netflix video processing pipeline went live with the launch of our streaming service in 2007. The Netflix video processing pipeline went live with the launch of our streaming service in 2007.

Processing 235

Processing Media Latency Innovation 235

The Netflix TechBlog

DECEMBER 17, 2024

As Netflix expanded globally and the volume of title launches skyrocketed, the operational challenges of maintaining this manual process became undeniable. Metadata and assets must be correctly configured, data must flow seamlessly, microservices must process titles without error, and algorithms must function as intended.

Traffic 170

Traffic Scalability Strategy Monitoring 170

The Netflix TechBlog

MARCH 25, 2019

Building and Scaling Data Lineage at Netflix to Improve Data Infrastructure Reliability, and Efficiency By: Di Lin , Girish Lingappa , Jitender Aswani Imagine yourself in the role of a data-inspired decision maker staring at a metric on a dashboard about to make a critical business decision but pausing to ask a question?—?“Can

Infrastructure 223

Infrastructure Big Data Transportation Architecture 223

Dynatrace

MAY 23, 2024

Stream processing One approach to such a challenging scenario is stream processing, a computing paradigm and software architectural style for data-intensive software systems that emerged to cope with requirements for near real-time processing of massive amounts of data.

Engineering 245

Engineering Tuning Latency Open Source 245

The Netflix TechBlog

JUNE 7, 2021

Challenges The cloud network infrastructure that Netflix utilizes today consists of AWS services such as VPC, DirectConnect, VPC Peering, Transit Gateways, NAT Gateways, etc and Netflix owned devices. These metrics are visualized using Lumen , a self-service dashboarding infrastructure. What is BPF?

Network 327

Network Transportation AWS Cloud 327

Dynatrace

JULY 6, 2022

At its most basic, automating IT processes works by executing scripts or procedures either on a schedule or in response to particular events, such as checking a file into a code repository. Adding AIOps to automation processes makes the volume of data that applications and multicloud environments generate much less overwhelming.

Artificial Intelligence 246

Artificial Intelligence Tuning Strategy Big Data 246

Dynatrace

MARCH 13, 2025

OpenTelemetry provides a common set of tools, APIs, and SDKs to help collect observability signals from applications and infrastructure endpoints. Traces, metrics, and logs are already well covered, but interesting enhancements are being made frequently, so stay tuned.

Open Source 147

Open Source Metrics Architecture Infrastructure 147

Dynatrace

MAY 28, 2024

You can easily pivot between a hot Kubernetes cluster and the log file related to the issue in 2-3 clicks in these Dynatrace® Apps: Infrastructure & Observability (I&O), Databases, Clouds, and Kubernetes. A sudden drop in received log data? For a single log record found, you can easily see the surrounding logs.

Analytics 267

Analytics Infrastructure Database Cloud 267

Dynatrace

OCTOBER 4, 2024

Today, development teams suffer from a lack of automation for time-consuming tasks, the absence of standardization due to an overabundance of tool options, and insufficiently mature DevSecOps processes. This process begins when the developer merges a code change and ends when it is running in a production environment.

Software 278

Software Software Development Performance 278

Dynatrace

JANUARY 26, 2021

DevSecOps is a cross-team collaboration framework that integrates security into DevOps processes from the start rather than waiting to address security in a separate silo. DevOps has gained ground in recent years as a way to combine key operational principles with development cycles, recognizing that these two processes must coexist.

DevOps 306

DevOps Best Practices Open Source Tuning 306

Dynatrace

FEBRUARY 17, 2022

So when people hear me explain things, it’s this process of convincing myself I completely understand it.”. There are stakeholders, dependencies, and end-users throughout the process. Infrastructure as code vs infrastructure as data. As a result, teams can automate more processes in their software development lifecycle.

Technology 246

Technology Technology Cloud Infrastructure 246

Dynatrace

MAY 15, 2020

This is especially true when we consider the explosive growth of cloud and container environments, where containers are orchestrated and infrastructure is software defined, meaning even the simplest of environments move at speeds beyond manual control, and beyond the speed of legacy Security practices. And this poses a significant risk.

Government 278

Government DevOps Infrastructure Network 278

Dynatrace

NOVEMBER 15, 2021

Logs can include data about user inputs, system processes, and hardware states. Log monitoring is a process by which developers and administrators continuously observe logs as they’re being recorded. Log analytics is the process of evaluating and interpreting log data so teams can quickly detect and resolve issues.

Analytics 264

Analytics Monitoring DevOps Artificial Intelligence 264

Dynatrace

MAY 17, 2022

To solve this problem , Dynatrace offers a fully automated approach to infrastructure and application observability including Kubernetes control plane, deployments, pods, nodes, and a wide array of cloud-native technologies. None of this complexity is exposed to application and infrastructure teams. A look to the future.

Availability 348

Availability Scalability Cloud Metrics 348

Dynatrace

APRIL 20, 2023

With more automated approaches to log monitoring and log analysis, however, organizations can gain visibility into their applications and infrastructure efficiently and with greater precision—even as cloud environments grow. They enable IT teams to identify and address the precise cause of application and infrastructure issues.

Analytics 246

Analytics Infrastructure Storage Architecture 246

Dynatrace

NOVEMBER 24, 2020

Tracking changes to automated processes, including auditing impacts to the system, and reverting to the previous environment states seamlessly. The ultimate goal of each of these reviews is to identify gaps, quantify risk, and develop recommendations for improving the team, processes, and architecture with each of the five pillars.

AWS 221

AWS Artificial Intelligence Best Practices Lambda 221

The Netflix TechBlog

AUGUST 22, 2019

Baking Windows with Packer By Justin Phelps and Manuel Correa Customizing Windows images at Netflix was a manual, error-prone, and time consuming process. We looked at our process for creating a Windows AMI and discovered it was error-prone and full of toil. Last year, we decided to improve the AMI baking process.

DevOps 209

DevOps AWS Tuning Infrastructure 209

The Netflix TechBlog

JANUARY 13, 2022

Pensive infrastructure comprises two separate systems to support batch and streaming workloads. This blog will explore these two systems and how they perform auto-diagnosis and remediation across our Big Data Platform and Real-time infrastructure. In the future, we are looking to automate this process.

Big Data 241

Big Data Infrastructure Metrics Games 241

Dynatrace

FEBRUARY 9, 2022

More recently, teams have begun to apply DevOps best practices to infrastructure automation, giving developers a more active role with GitOps as an operational framework. Key components of GitOps are declarative infrastructure as code, orchestration, and observability.

Code 246

Code Software Software DevOps 246

Dynatrace

NOVEMBER 20, 2019

At Dynatrace, where we provide a software intelligence platform for hybrid environments (from infrastructure to cloud) we see a growing need to measure how mainframe architecture and the services running on it contribute to the overall performance and availability of applications. Network metrics are also collected for detected processes.

Availability 43

Availability Hardware Java Tuning 43

Scalegrid

JUNE 4, 2020

As an open source database, it’s a highly popular choice for enterprise applications looking to modernize their infrastructure and reduce their total cost of ownership, along with startup and developer applications looking for a powerful, flexible and cost-effective database to work with. PostgreSQL Configuration Management & Tuning.

Database 230

Database Latency Benchmarking Performance 230

Scalegrid

FEBRUARY 24, 2025

Proper setup involves creating a configuration process that accounts for hostname changes, which could prevent nodes from rejoining the cluster. Message load balancing guarantees that messages are processed evenly across different queues and nodes within the RabbitMQ system. Erlang is the backbone of RabbitMQ clustering.

Best Practices 147

Best Practices Traffic Strategy Efficiency 147

Dynatrace

JULY 30, 2024

Complexity of digital ecosystems Pain point : Financial services operate in complex environments with numerous applications, hybrid cloud infrastructures, and third-party vendors. This complexity increases cybersecurity risks and complicates governance.

Government 227

Government Innovation Analytics Open Source 227

The Netflix TechBlog

SEPTEMBER 18, 2024

Vidhya Arvind , Rajasekhar Ummadisetty , Joey Lynch , Vinay Chella Introduction At Netflix our ability to deliver seamless, high-quality, streaming experiences to millions of users hinges on robust, global backend infrastructure. As the consumer processes these results, the system tracks the number of items consumed and the total size used.

Latency 258

Latency Storage Cache Efficiency 258

Dynatrace

JULY 18, 2023

As software development grows more complex, managing components using an automated onboarding process becomes increasingly important. The validation process is automated based on events that occur, while the objectives’ configuration, which is validated by the Site Reliability Guardian , is stored in a separate file.

Best Practices 246

Best Practices Code Infrastructure Latency 246

Scalegrid

JULY 13, 2020

Compare ease of use across compatibility, extensions, tuning, operating systems, languages and support providers. of PostgreSQL users are currently in the process of migrating to the RDBMS, according to the 2019 PostgreSQL Trends Report , an astounding percentage considering this is the 4th most popular database in the world.

Open Source 244

Open Source Tuning C++ Database 244

Dynatrace

JULY 6, 2022

Organizations that have achieved SRE maturity have a better handle on the state of their infrastructure, the ability to tie reliability metrics more tightly to business objectives, and the means to ensure a consistent and responsive customer experience. Design, implement, and tune effective SLOs.

Best Practices 246

Best Practices Open Source Tuning Infrastructure 246

Dynatrace

JUNE 13, 2019

The Dynatrace platform automatically integrates OpenTelemetry data, thereby providing the highest possible scalability, enterprise manageability, seamless processing of data, and, most importantly the best analytics through Davis (our AI-driven analytics engine), and automation support available. What Dynatrace will contribute.

IoT 53

IoT C++ Analytics Java 53

Dynatrace

JULY 22, 2024

Using OpenTelemetry, developers can collect and process telemetry data from applications, services, and systems. Text-based records of events and activities generated by applications and infrastructure components. To understand what this means, let’s first look at two of the core concepts: observability and telemetry.

Latency 264

Latency Best Practices Metrics Open Source 264

Dynatrace

FEBRUARY 14, 2022

Among these, you can find essential elements of application and infrastructure stacks, from app gateways (like HAProxy), through app fabric (like RabbitMQ), to databases (like MongoDB) and storage systems (like NetApp, Consul, Memcached, and InfluxDB, just to name a few). Many technologies expose their metrics in the Prometheus data format.

Technology 246

Technology Technology Metrics Infrastructure 246

Dynatrace

JUNE 4, 2024

This process, known as auto-adaptive thresholding, eliminates the need to define a static threshold upfront. While platform engineers can build and prepare the necessary infrastructure and templates for self-adoption, developers must still provide some customization.

Metrics 297

Metrics Engineering Code Tuning 297

Dynatrace

JANUARY 26, 2021

REST APIs, authentication, databases, email, and video processing all have a home on serverless platforms. The Serverless Process. Cloud-hosted managed services eliminate the minute day-to-day tasks associated with hosting IT infrastructure on-premises. The average request is handled, processed, and returned quickly.

Serverless 246

Serverless Efficiency Lambda AWS 246

Dynatrace

NOVEMBER 6, 2023

Recently, the Parliament of India released the Digital Personal Data Protection Act 2023 , which regulates the processing of digital personal data in India and recognizes the right of individuals to protect their data in India. Dynatrace is already supported in 17 local regions on three hyperscalers (AWS, Azure, and GCP).

AWS 264

AWS Azure Tuning Analytics 264

Dynatrace

NOVEMBER 14, 2023

Golden Paths for rapid product development Modern software development aims to streamline development and delivery processes to ensure fast releases to the market without violating quality and security standards. After completing this two-step process, a ready-to-use guardian is created.

Best Practices 246

Best Practices Government DevOps Engineering 246

The Netflix TechBlog

OCTOBER 8, 2024

The Key-Value Abstraction offers a flexible, scalable solution for storing and accessing structured key-value data, while the Data Gateway Platform provides essential infrastructure for protecting, configuring, and deploying the data tier. Let’s dive into the various aspects of this abstraction.

Latency 237

Latency Storage Traffic Tuning 237

Dynatrace

APRIL 25, 2023

These functions are executed by a serverless platform or provider (such as AWS Lambda, Azure Functions or Google Cloud Functions) that manages the underlying infrastructure, scaling and billing. Enable faster development and deployment cycles by abstracting away the infrastructure complexity.

Serverless 246

Serverless Lambda Azure AWS 246

Dynatrace

JULY 23, 2020

Today we’re happy to announce, that with the release of Dynatrace version 1.198 (SaaS and Managed), auto-adaptive baseline extends beyond application performance (APM) metrics to include thousands of infrastructure and cloud metrics as well. AI-powered root cause analysis via auto-adaptive baselines for more than classic APM metrics.

Metrics 277

Metrics Innovation Strategy Monitoring 277