The Netflix TechBlog

NOVEMBER 17, 2022

Recently, we added another powerful tool to our arsenal: neural networks for video downscaling. In this tech blog, we describe how we improved Netflix video quality with neural networks, the challenges we faced and what lies ahead. How can neural networks fit into Netflix video encoding?

Network 300

Network Media Innovation Efficiency 300

Scalegrid

MAY 13, 2020

Greenplum Database is a massively parallel processing (MPP) SQL database that is built and based on PostgreSQL. It can scale towards a multi-petabyte level data workload without a single issue, and it allows access to a cluster of powerful servers that will work together within a single SQL interface where you can view all of the data.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

Dynatrace

JANUARY 21, 2025

Ensuring smooth operations is no small feat, whether you’re in charge of application performance, IT infrastructure, or business processes. However, your responsibilities might change or expand, and you need to work with unfamiliar data sets. Your trained eye can interpret them at a glance, a skill that sets you apart.

Traffic 262

Traffic Metrics Analytics Monitoring 262

Dynatrace

MAY 19, 2023

For cloud operations teams, network performance monitoring is central in ensuring application and infrastructure performance. If the network is sluggish, an application may also be slow, frustrating users. Worse, a malicious attacker may gain access to the network, compromising sensitive application data.

Network 246

Network Monitoring Performance Traffic 246

Dynatrace

NOVEMBER 30, 2022

Complexity and data volume for IT infrastructure soars to new heights. The volume of data and events grows in tandem with the rising complexity of IT infrastructure. Monitoring modern IT infrastructure is difficult, sometimes impossible, without advanced network monitoring tools. How SNMP traps help detect problems.

Network 246

Network Infrastructure Metrics Monitoring 246

Dynatrace

JULY 15, 2024

Why browser and HTTP monitors might not be sufficient In modern IT environments, which are complex and dynamically changing, you often need deeper insights into the Transport or Network layers. Is it a bug in the codebase, a malfunctioning backend service, an overloaded hosting infrastructure, or perhaps a misconfigured network?

Availability 246

Availability Network Monitoring Infrastructure 246

DZone

FEBRUARY 26, 2025

With the evolution of modern applications serving increasing needs for real-time data processing and retrieval, scalability does, too. One such open-source, distributed search and analytics engine is Elasticsearch, which is very efficient at handling data in large sets and high-velocity queries.

Scalability 147

Scalability Open Source Latency Architecture 147

Dynatrace

MAY 1, 2023

IT operations analytics is the process of unifying, storing, and contextually analyzing operational data to understand the health of applications, infrastructure, and environments and streamline everyday operations. ITOA automates repetitive cloud operations tasks and streamlines the flow of analytics into decision-making processes.

Analytics 246

Analytics Artificial Intelligence Big Data Open Source 246

The Netflix TechBlog

NOVEMBER 14, 2023

By Abhinaya Shetty , Bharath Mummadisetty At Netflix, our Membership and Finance Data Engineering team harnesses diverse data related to plans, pricing, membership life cycle, and revenue to fuel analytics, power various dashboards, and make data-informed decisions. We expect complete and accurate data at the end of each run.

Data Engineering 271

Data Engineering Engineering Processing Games 271

Dynatrace

OCTOBER 14, 2022

Log data provides a unique source of truth for debugging applications, optimizing infrastructure, and investigating security incidents. This contextualization of log data enables AI-powered problem detection and root cause analysis at scale. Dynamic landscape and data handling requirements result in manual work.

Storage 278

Storage Government Network DevOps 278

The Netflix TechBlog

JANUARY 10, 2024

Future blogs will provide deeper dives into each service, sharing insights and lessons learned from this process. The Netflix video processing pipeline went live with the launch of our streaming service in 2007. The Netflix video processing pipeline went live with the launch of our streaming service in 2007.

Processing 238

Processing Media Latency Innovation 238

The Netflix TechBlog

APRIL 20, 2020

How Netflix brings safer and faster streaming experience to the living room on crowded networks using TLS 1.3 We want playback to start instantly and to never stop unexpectedly in any network environment. Confidentiality: Data sent over the channel is only visible to the endpoints. Authenticated Encryption For encryption, TLS 1.3

Network 245

Network Media Transportation Traffic 245

The Netflix TechBlog

SEPTEMBER 18, 2024

Second, developers had to constantly re-learn new data modeling practices and common yet critical data access patterns. To overcome these challenges, we developed a holistic approach that builds upon our Data Gateway Platform. Data Model At its core, the KV abstraction is built around a two-level map architecture.

Latency 260

Latency Storage Cache Servers 260

Dynatrace

MARCH 5, 2021

In today’s complex IT environments, the sheer volume of data created makes it impossible for humans to monitor, comprehend, or troubleshoot problems before they impact the experience of your end users. Still, you might have use cases that rely on important custom data streams. Now you can: Alert on the outage of a custom data source.

Metrics 286

Metrics Network Monitoring Infrastructure 286

Dynatrace

AUGUST 29, 2024

In today’s data-driven world, businesses across various industry verticals increasingly leverage the Internet of Things (IoT) to drive efficiency and innovation. Both methods allow you to ingest and process raw data and metrics. The ADS-B protocol differs significantly from web technologies.

IoT 264

IoT Analytics Transportation Metrics 264

DZone

JANUARY 7, 2025

Try to change your status on your favorite social network site and reload the page only to discover your previous status. Read Your Own Writes consistency is an assurance that once a process, usually a user, has updated a piece of data, all subsequent reads by that same process will return the updated value.

Network 147

Network Processing Systems 147

Dynatrace

MARCH 27, 2024

This is the ability to see into and measure the current state of a system based on the data it generates, which typically includes logs, metrics, traces, end-user experiences, and context across cloud, multi-cloud, and hybrid environments. This blog originally appeared in Federal News Network. First, let’s discuss observability.

Government 238

Government Network Artificial Intelligence Cloud 238

Dynatrace

JUNE 25, 2020

The network latency between cluster nodes should be around 10 ms or less. With Dynatrace actively managing business-critical applications, some of our globally distributed enterprise customers require Dynatrace Managed to continue operating even when an entire data center goes down. Minimized cross-data center network traffic.

Availability 264

Availability Hardware Latency Traffic 264

Dynatrace

SEPTEMBER 7, 2022

Dynatrace and the Dynatrace Intelligent Observability Platform have added support for the newly introduced Amazon VPC Flow Logs to Amazon Kinesis Data Firehose. This support enables customers to define specific endpoint delivery of real-time streaming data to platforms such as Dynatrace. What is VPC Flow Logs? Why Dynatrace?

Traffic 246

Traffic AWS Network Cloud 246

Dynatrace

MAY 3, 2024

Log data—the most verbose form of observability data, complementing other standardized signals like metrics and traces—is especially critical. As cloud complexity grows, it brings more volume, velocity, and variety of log data. When trying to address this challenge, your cloud architects will likely choose Amazon Data Firehose.

Cloud 279

Cloud Lambda AWS Analytics 279

DZone

FEBRUARY 8, 2022

Quality metrics contain: The ratio of successfully processed requests. Distribution of processing time between requests. Any service provider tries to reach several metrics in their activity. One group of these metrics is service quality. Number of requests dependent curves.

Network 246

Network Hardware Metrics Processing 246

Dynatrace

FEBRUARY 28, 2024

In a digital-first world, site reliability engineers and IT data analysts face numerous challenges with data quality and reliability in their quest for cloud control. Increasingly, organizations seek to address these problems using AI techniques as part of their exploratory data analytics practices.

Analytics 246

Analytics Metrics Media Monitoring 246

Scalegrid

FEBRUARY 24, 2025

Youll also learn strategies for maintaining data safety and managing node failures so your RabbitMQ setup is always up to the task. Implementing clustering and quorum queues in RabbitMQ significantly improves load distribution and data redundancy, ensuring high availability and fault tolerance for messaging services.

Best Practices 147

Best Practices Traffic Strategy Efficiency 147

Dynatrace

APRIL 13, 2023

The massive volumes of log data associated with a breach have made cybersecurity forensics a complicated, costly problem to solve. As organizations adopt more cloud-native technologies, observability data—telemetry from applications and infrastructure, including logs, metrics, and traces—and security data are converging.

Java 246

Java Analytics Infrastructure Cloud 246

Dynatrace

SEPTEMBER 23, 2020

Recent improvements in OneAgent runtime-data handling. As a consequence, the automatic updates as well as the automatic deep-code monitoring injection processes are even more stable. Storage and network transfer of files is a measurable cost. Customizable location of large runtime files. See details below.

Storage 227

Storage Latency Operating System Network 227

Dynatrace

MAY 17, 2023

OpenTelemetry , the open source observability tool, has become the go-to standard for instrumenting custom applications to collect observability telemetry data. For this third and final part of our series, we saved the best for last: How you can enhance telemetry data even more and with less effort on your end with Dynatrace OneAgent.

Metrics 243

Metrics Database Monitoring Network 243

DZone

MARCH 27, 2023

Apache Spark is an open-source distributed computing system designed for large-scale data processing. Spark provides a unified framework for processing and analyzing large datasets across distributed computing clusters.

Network 189

Network Open Source Programming Design 189

The Netflix TechBlog

OCTOBER 8, 2024

Rajiv Shringi Vinay Chella Kaidan Fullerton Oleksii Tkachuk Joey Lynch Introduction As Netflix continues to expand and diversify into various sectors like Video on Demand and Gaming , the ability to ingest and store vast amounts of temporal data — often reaching petabytes — with millisecond access latency has become increasingly vital.

Latency 239

Latency Storage Traffic Infrastructure 239

Dynatrace

AUGUST 8, 2024

It’s also critical to have a strategy in place to address these outages, including both documented remediation processes and an observability platform to help you proactively identify and resolve issues to minimize customer and business impact. This can result from improperly configured backups, corrupted data, or insufficient testing.

Software 290

Software Software Infrastructure Network 290

High Scalability

JANUARY 11, 2022

from a client it performs two parallel operations: i) persisting the action in the data store ii) publish the action in a streaming data store for a pub-sub model. User Feed Service, Media Counter Service) read the actions from the streaming data store and performs their specific tasks. After that, the various services (e.g.

Design 334

Design Media Storage Logistics 334

Scalegrid

FEBRUARY 6, 2025

RabbitMQ is designed for flexible routing and message reliability, while Kafka handles high-throughput event streaming and real-time data processing. Both serve distinct purposes, from managing message queues to ingesting large data volumes. What is Apache Kafka?

Latency 147

Latency Analytics Architecture Storage 147

Dynatrace

MARCH 27, 2025

To prevent immediate clean-up, the Content-Length header is manipulated to make the process think the file upload is not completed yet. The second flaw that is being exploited is the process of the ingress controller to test arbitrary admission templates via the nginx NGINX -t command.

Network 130

Network Internet Internet Code 130

Dynatrace

AUGUST 10, 2021

This year’s conference agenda was packed full of choices, including: Keynotes : Topics included accelerating digital transformation, with Dynatrace CIO Mike Maciag, and Spatial Collapse: The Great Acceleration of Turning Data Into an Asset, with Tricia Wang from Sudden Compass. We’ve all heard it: data is one of your biggest assets.

DevOps 246

DevOps Innovation Big Data Cloud 246

Dynatrace

SEPTEMBER 5, 2024

Understanding that the first mile of getting data in can often be the hardest, Dynatrace continues to invest in log ingest, offering a range of out-of-the-box solutions within the Dynatrace Platform and apps. Native support for syslog messages extends our infrastructure log support to all Linux/Unix systems and network devices.

Innovation 290

Innovation AWS Analytics Storage 290

DZone

MARCH 7, 2023

Apache Spark is a powerful open-source distributed computing framework that provides a variety of APIs to support big data processing. Broadcast variables can be used to efficiently distribute large read-only data structures, such as lookup tables, to worker nodes. For example, to broadcast a lookup table named lookup_table :

Big Data 173

Big Data Code Tuning Open Source 173

VoltDB

DECEMBER 11, 2024

Edge computing has transformed how businesses and industries process and manage data. By bringing computation closer to the data source, edge-based deployments reduce latency, enhance real-time capabilities, and optimize network bandwidth. Data interception during transit. Increased latency during peak loads.

IoT 52

IoT Energy Logistics Latency 52

Dynatrace

DECEMBER 16, 2020

Recently, some organizations fell victim to a software supply chain attack, which led to loss of confidential data. This way the attacker can exfiltrate data from the targeted organization. Track changes via our change management process. Access to source code repositories is limited on both the network and the user level.

Software 289

Software Software Development AWS 289