The Netflix TechBlog

SEPTEMBER 18, 2024

Second, developers had to constantly re-learn new data modeling practices and common yet critical data access patterns. To overcome these challenges, we developed a holistic approach that builds upon our Data Gateway Platform. Data Model At its core, the KV abstraction is built around a two-level map architecture.

Latency 260

Latency Storage Cache Servers 260

Dynatrace

MAY 19, 2023

For cloud operations teams, network performance monitoring is central in ensuring application and infrastructure performance. If the network is sluggish, an application may also be slow, frustrating users. Worse, a malicious attacker may gain access to the network, compromising sensitive application data.

Network 246

Network Monitoring Performance Traffic 246

Dynatrace

OCTOBER 14, 2022

Log data provides a unique source of truth for debugging applications, optimizing infrastructure, and investigating security incidents. This contextualization of log data enables AI-powered problem detection and root cause analysis at scale. Dynamic landscape and data handling requirements result in manual work.

Storage 278

Storage Government Network DevOps 278

DZone

MARCH 22, 2024

In today's data-driven world, businesses face numerous challenges when it comes to storing, securing, and analyzing vast amounts of information. Enter StoneFly , a leading provider of storage area network (SAN) and network-attached storage (NAS) solutions that aim to simplify your life and tackle complex business problems head-on.

Storage 189

Storage Scalability Development Network 189

The Netflix TechBlog

OCTOBER 8, 2024

Rajiv Shringi Vinay Chella Kaidan Fullerton Oleksii Tkachuk Joey Lynch Introduction As Netflix continues to expand and diversify into various sectors like Video on Demand and Gaming , the ability to ingest and store vast amounts of temporal data — often reaching petabytes — with millisecond access latency has become increasingly vital.

Latency 239

Latency Storage Traffic Tuning 239

The Netflix TechBlog

MARCH 6, 2019

Mounting object storage in Netflix’s media processing platform By Barak Alon (on behalf of Netflix’s Media Cloud Engineering team) MezzFS (short for “Mezzanine File System”) is a tool we’ve developed at Netflix that mounts cloud objects as local files via FUSE. Our object storage service splits objects into many parts and stores them in S3.

Media 218

Media Storage Processing Cache 218

Dynatrace

SEPTEMBER 23, 2020

Recent improvements in OneAgent runtime-data handling. Storage mount points in a system might be larger or smaller, local or remote, with high or low latency, and various speeds. Starting with OneAgent version 1.199, the runtime folder is configurable and consequently you can retain your storage mount point setup as-is.

Storage 227

Storage Latency Operating System Network 227

Dynatrace

JUNE 25, 2020

The network latency between cluster nodes should be around 10 ms or less. With Dynatrace actively managing business-critical applications, some of our globally distributed enterprise customers require Dynatrace Managed to continue operating even when an entire data center goes down. Minimized cross-data center network traffic.

Availability 264

Availability Hardware Latency Traffic 264

The Netflix TechBlog

DECEMBER 17, 2024

Metric definitions are often scattered across various databases, documentation sites, and code repositories, making it difficult for analysts and data scientists to find reliable information quickly. LORE: How were democratizing analytics atNetflix Apurva Kansara At Netflix, we rely on data and analytics to inform critical business decisions.

Analytics 212

Analytics Engineering Entertainment Metrics 212

The Netflix TechBlog

MARCH 31, 2025

The data produced on set is traditionally copied to physical tape stock like LTO. Besides the need for robust cloud storage for their media, artists need access to powerful workstations and real-time playback. Remote Workstations Offering access to remote editorial workstations and storage for post-production needs.

Media 203

Media Logistics Innovation Cloud 203

High Scalability

JANUARY 11, 2022

from a client it performs two parallel operations: i) persisting the action in the data store ii) publish the action in a streaming data store for a pub-sub model. User Feed Service, Media Counter Service) read the actions from the streaming data store and performs their specific tasks. Data Models. Graph Data Models.

Design 334

Design Media Storage Logistics 334

Dynatrace

SEPTEMBER 7, 2022

Dynatrace and the Dynatrace Intelligent Observability Platform have added support for the newly introduced Amazon VPC Flow Logs to Amazon Kinesis Data Firehose. This support enables customers to define specific endpoint delivery of real-time streaming data to platforms such as Dynatrace. What is VPC Flow Logs? Why Dynatrace?

Traffic 246

Traffic AWS Network Cloud 246

Scalegrid

FEBRUARY 6, 2025

RabbitMQ is designed for flexible routing and message reliability, while Kafka handles high-throughput event streaming and real-time data processing. Both serve distinct purposes, from managing message queues to ingesting large data volumes. What is RabbitMQ?

Latency 147

Latency Analytics Architecture Storage 147

DZone

JUNE 25, 2019

Surprisingly, the problem isn’t widely discussed, even though it is silently causing data corruption that can directly impact our jobs, our businesses, and our security. The Error-Prone Data Trail. Let’s assume for a moment that your data survives its many passes through a system’s DRAM and emerges intact.

Storage 145

Storage Systems Transportation Network 145

Dynatrace

NOVEMBER 11, 2022

More organizations are adopting a hybrid IT environment, with data center and virtualized components. However, today’s IT teams are stretched thin, with little time to firefight issues with deployment, integration, and data center management. But in an HCI framework, purchasing more storage means purchasing more compute.

Infrastructure 264

Infrastructure Storage Virtualization Network 264

DZone

JUNE 6, 2023

When building an IoT-based service, we need to implement a messaging mechanism that transmits data collected by the IoT devices to a hub or a server. When dealing with IoT, one of the first things that come to mind is the limited processing, networking, and storage capabilities these devices operate with.

IoT 305

IoT Tuning Storage Network 305

Dynatrace

SEPTEMBER 5, 2024

Understanding that the first mile of getting data in can often be the hardest, Dynatrace continues to invest in log ingest, offering a range of out-of-the-box solutions within the Dynatrace Platform and apps. Native support for syslog messages extends our infrastructure log support to all Linux/Unix systems and network devices.

Innovation 290

Innovation AWS Analytics Storage 290

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. Understanding distributed storage is imperative as data volumes and the need for robust storage solutions rise.

Storage 130

Storage Systems Big Data Azure 130

Dynatrace

JANUARY 11, 2023

As cloud and big data complexity scales beyond the ability of traditional monitoring tools to handle, next-generation cloud monitoring and observability are becoming necessities for IT teams. With agent monitoring, third-party software collects data and reports from the component that’s attached to the agent.

Cloud 295

Cloud Monitoring Best Practices Infrastructure 295

Dynatrace

FEBRUARY 2, 2022

Additional benefits of Dynatrace SaaS on Azure include: No infrastructure investment : Dynatrace manages the infrastructure for you, including automatic visibility, problem detection, and smart alerting across virtual networks, virtual infrastructure, and container orchestration.

Azure 325

Azure Availability Hardware Innovation 325

Percona

DECEMBER 11, 2023

There are a wealth of options on how you can approach storage configuration in Percona Operator for PostgreSQL , and in this blog post, we review various storage strategies — from basics to more sophisticated use cases. For example, you can choose the public cloud storage type – gp3, io2, etc, or set file system.

Storage 122

Storage Strategy Cloud Azure 122

Dynatrace

JUNE 10, 2024

Security analytics combines data collection, aggregation, and analysis to search for and identify potential threats. Using a combination of historical data and information collected in real time, security teams can detect threats earlier in the SDLC. Why is security analytics important? This offers two advantages for compliance.

Analytics 264

Analytics Network Open Source Hardware 264

Dynatrace

AUGUST 1, 2022

Kubernetes was initially designed with a strong focus on stateless workloads, meaning these workloads do not need to store any persistent data. Interestingly, our partner RedHat reported in 2021 that around 80% of deployed workloads are databases or data caches, storing data in persistent volume claims (PVCs).

Storage 246

Storage Database Network Metrics 246

Dynatrace

OCTOBER 23, 2023

Hyper-V plays a vital role in ensuring the reliable operations of data centers that are based on Microsoft platforms. Firstly, managing virtual networks can be complex as networking in a virtual environment differs significantly from traditional networking. What is Microsoft Hyper-V?

Efficiency 264

Efficiency Virtualization Hardware Performance 264

Dynatrace

NOVEMBER 6, 2023

Cloud-native workloads on edge devices are gaining momentum among organizations as they extend the hybrid cloud closer to the data source and end users at the edge. The challenge of cloud-native observability at the enterprise edge In aggregate, connected devices generate huge volumes of data.

Retail 306

Retail Storage Analytics Cloud 306

Dynatrace

SEPTEMBER 8, 2022

Log management is an organization’s rules and policies for managing and enabling the creation, transmission, analysis, storage, and other tasks related to IT systems’ and applications’ log data. In cloud-native environments, there can also be dozens of additional services and functions all generating data from user-driven events.

Cloud 260

Cloud Systems Analytics DevOps 260

VoltDB

DECEMBER 11, 2024

Edge computing has transformed how businesses and industries process and manage data. By bringing computation closer to the data source, edge-based deployments reduce latency, enhance real-time capabilities, and optimize network bandwidth. Data interception during transit. Redundancy and inefficiency in data aggregation.

IoT 52

IoT Energy Logistics Latency 52

DZone

JANUARY 23, 2022

Datacenter - data center failure where the whole DC could become unavailable due to power failure, network connectivity failure, environmental catastrophe, etc. Redundancy in power, network, cooling systems, and possibly everything else relevant. Redundancy by building additional data centers.

Hardware 243

Hardware DevOps Network Storage 243

Scalegrid

FEBRUARY 24, 2025

Youll also learn strategies for maintaining data safety and managing node failures so your RabbitMQ setup is always up to the task. Implementing clustering and quorum queues in RabbitMQ significantly improves load distribution and data redundancy, ensuring high availability and fault tolerance for messaging services.

Best Practices 147

Best Practices Traffic Strategy Scalability 147

DZone

MARCH 2, 2023

According to data provided by Sandvine in their 2022 Global Internet Phenomena Report , video traffic accounted for 53.72% of the total volume of internet traffic in 2021, and the closest trailing category (social) came in at just 12.69%.

Social Media 281

Social Media Java Traffic Internet 281

Dynatrace

NOVEMBER 9, 2023

Nutanix overview dashboard The extension automatically gathers real-time performance data from your Nutanix clusters to monitor resource usage, cluster health, and more, all in one place. Storage container metrics Track the usage and performance of storage containers to optimize resource allocation.

Virtualization 246

Virtualization Storage Metrics Monitoring 246

The Netflix TechBlog

OCTOBER 19, 2020

Reconstructing a streaming session was a tedious and time consuming process that involved tracing all interactions (requests) between the Netflix app, our Content Delivery Network (CDN), and backend microservices. Traces collected from various microservices are ingested in a stream processing manner into the data store.

Infrastructure 238

Infrastructure Transportation Storage Open Source 238

Dynatrace

OCTOBER 4, 2022

Several pain points have made it difficult for organizations to manage their data efficiently and create actual value. Limited data availability constrains value creation. Modern IT environments — whether multicloud, on-premises, or hybrid-cloud architectures — generate exponentially increasing data volumes.

Analytics 264

Analytics Artificial Intelligence Storage Serverless 264

Dynatrace

DECEMBER 16, 2020

Recently, some organizations fell victim to a software supply chain attack, which led to loss of confidential data. This way the attacker can exfiltrate data from the targeted organization. Access to source code repositories is limited on both the network and the user level. Dynatrace news.

Software 289

Software Software Development AWS 289

Dynatrace

JUNE 6, 2023

Networking. Large-scale, multicloud deployments can introduce challenges related to network visibility and interoperability. Traditional ways of operating networks using static IPs and ports simply don’t work in dynamic Kubernetes environments. Bad actors can use misconfigurations to gain access to sensitive data.

Open Source 246

Open Source Storage Analytics Innovation 246

DZone

JULY 3, 2023

Data engineering projects often require the setup and management of complex infrastructures that support data processing, storage, and analysis. In this article, we will explore the benefits of leveraging IaC for data engineering projects and provide detailed implementation steps to get started.

Data Engineering 150

Data Engineering Infrastructure Code Engineering 150

DZone

AUGUST 18, 2023

We all know that data is being generated at an unprecedented rate. You may also know that this has led to an increase in the demand for efficient and secure data storage solutions that won’t break the bank. What Are Edge Data Platforms? These platforms offer several advantages over traditional cloud computing.

IoT 130

IoT Media Latency Storage 130