The Netflix TechBlog

FEBRUARY 14, 2025

Every image you hover over isnt just a visual placeholder; its a critical data point that fuels our sophisticated personalization engine. This nuanced integration of data and technology empowers us to offer bespoke content recommendations. This queue ensures we are consistently capturing raw events from our global userbase.

Tuning 166

Tuning Latency Efficiency Storage 166

Highly Scalable

MARCH 1, 2012

At the same time, NoSQL data modeling is not so well studied and lacks the systematic theory found in relational databases. In this article I provide a short comparison of NoSQL system families from the data modeling point of view and digest several common modeling techniques.

Database 279

Database Ecommerce Efficiency Engineering 279

Dynatrace

OCTOBER 4, 2022

Software and data are a company’s competitive advantage. But for software to work perfectly, organizations need to use data to optimize every phase of the software lifecycle. The only way to address these challenges is through observability data — logs, metrics, and traces. Teams interact with myriad data types.

Analytics 246

Analytics Software Software Storage 246

Scalegrid

FEBRUARY 6, 2025

RabbitMQ is designed for flexible routing and message reliability, while Kafka handles high-throughput event streaming and real-time data processing. Both serve distinct purposes, from managing message queues to ingesting large data volumes. What is RabbitMQ?

Latency 147

Latency Analytics Architecture Storage 147

Scalegrid

FEBRUARY 27, 2025

Incremental Backups: Speeds up recovery and makes data management more efficient for active databases. Faster Write Operations: Enhancements to the write-ahead log (WAL) processing double PostgreSQLs ability to handle concurrent transactions, improving uptime and data accessibility. Start your free trial today!

Speed 130

Speed Database Storage Efficiency 130

Dynatrace

JANUARY 11, 2023

To stay competitive in an increasingly digital landscape, organizations seek easier access to business analytics data from IT to make better business decisions faster. As organizations add more tools, it creates a demand for common tooling, shared data, and democratized access. These technologies generate a crush of observability data.

Analytics 246

Analytics Strategy Storage Technology 246

Dynatrace

OCTOBER 7, 2021

Serverless architecture shifts application hosting functions away from local servers onto those managed by providers. This means you no longer have to provision, scale, and maintain servers to run your applications, databases, and storage systems. Data Store. AWS offers four serverless offerings for storage.

Serverless 325

Serverless AWS Lambda Storage 325

Dynatrace

APRIL 22, 2025

An attacker has gained access through security misconfigurations in an API server, escalated privileges, and deployed cryptocurrency mining pods that consume massive resources. API server The API server is the gateway to your Kubernetes kingdom. An unprotected kubelet is like giving attackers direct access to your servers.

Network 130

Network Strategy Servers Best Practices 130

Dynatrace

APRIL 4, 2025

It supports multi-line logs, handles log rotation, and even includes mechanisms to check for data corruption. Grail, the Dynatrace schema on-read data lakehouse , is at the heart of the Dynatrace platform. The Grail architecture ensures scalability, making log data accessible for detailed analysis regardless of volume.

Analytics 147

Analytics Operating System Scalability Infrastructure 147

DZone

JUNE 25, 2019

Surprisingly, the problem isn’t widely discussed, even though it is silently causing data corruption that can directly impact our jobs, our businesses, and our security. The Error-Prone Data Trail. Let’s assume for a moment that your data survives its many passes through a system’s DRAM and emerges intact.

Storage 145

Storage Systems Transportation Network 145

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. Understanding distributed storage is imperative as data volumes and the need for robust storage solutions rise.

Storage 130

Storage Systems Big Data Azure 130

Scalegrid

MAY 11, 2024

MongoDB offers several storage engines that cater to various use cases. The default storage engine in earlier versions was MMAPv1, which utilized memory-mapped files and document-level locking. The newer, pluggable storage engine, WiredTiger, addresses this by using prefix compression, collection-level locking, and row-based storage.

Storage 130

Storage Engineering Cache Database 130

Dynatrace

NOVEMBER 11, 2022

More organizations are adopting a hybrid IT environment, with data center and virtualized components. However, today’s IT teams are stretched thin, with little time to firefight issues with deployment, integration, and data center management. But in an HCI framework, purchasing more storage means purchasing more compute.

Infrastructure 264

Infrastructure Storage Virtualization Network 264

Dynatrace

JUNE 25, 2020

With Dynatrace actively managing business-critical applications, some of our globally distributed enterprise customers require Dynatrace Managed to continue operating even when an entire data center goes down. Near-zero RPO and RTO—monitoring continues seamlessly and without data loss in failover scenarios.

Availability 264

Availability Hardware Latency Traffic 264

High Scalability

JANUARY 11, 2022

When the server receives a request for an action (post, like etc.) from a client it performs two parallel operations: i) persisting the action in the data store ii) publish the action in a streaming data store for a pub-sub model. The streaming data store makes the system extensible to support other use-cases (e.g.

Design 334

Design Media Storage Logistics 334

DZone

JUNE 6, 2023

When building an IoT-based service, we need to implement a messaging mechanism that transmits data collected by the IoT devices to a hub or a server. When dealing with IoT, one of the first things that come to mind is the limited processing, networking, and storage capabilities these devices operate with.

IoT 305

IoT Tuning Storage Network 305

DZone

SEPTEMBER 25, 2023

It is the second of a series of articles that is built on top of that project, representing experiments with various statistical and machine learning models, data pipelines implemented using existing DAG tools, and storage services, both cloud-based and alternative on-premises solutions.

Storage 264

Storage AWS Architecture Cloud 264

Percona

JANUARY 4, 2024

Managing storage and performance efficiently in your MySQL database is crucial, and general tablespaces offer flexibility in achieving this. In contrast to the single system tablespace that holds system tables by default, general tablespaces are user-defined storage containers for multiple InnoDB tables.

Storage 114

Storage Engineering Database Open Source 114

Dynatrace

FEBRUARY 2, 2022

Security: Data is stored securely in the Dynatrace cloud (powered by Azure). Dynatrace captures all your data, including host and application metrics, basic-network metrics, real-user metrics, mobile metrics, cloud-infrastructure metrics, log metrics, and much more.

Azure 325

Azure Availability Hardware Innovation 325

Dynatrace

JANUARY 17, 2024

And an O’Reilly Media survey indicated that two-thirds of survey respondents have already adopted generative AI —a form of AI that uses training data to create text, images, code, or other types of content that reflect its users’ natural language queries. AI requires more compute and storage. AI performs frequent data transfers.

Strategy 288

Strategy Artificial Intelligence Storage Cloud 288

Dynatrace

JANUARY 11, 2023

As cloud and big data complexity scales beyond the ability of traditional monitoring tools to handle, next-generation cloud monitoring and observability are becoming necessities for IT teams. With agent monitoring, third-party software collects data and reports from the component that’s attached to the agent.

Cloud 295

Cloud Monitoring Best Practices Infrastructure 295

Percona

FEBRUARY 10, 2023

ViewBlock , a blockchain explorer, uses the Percona Operator for MongoDB to store critical data. Today along with their team, we will see how pvc-autoresizer can automate storage scaling for MongoDB clusters on Kubernetes. In our lab we will use AWS EKS with a standard storage class. Note : If you use version 1.14.0

Storage 130

Storage Blockchain AWS Cloud 130

DZone

AUGUST 16, 2023

Caching is the process of storing frequently accessed data or resources in a temporary storage location, such as memory or disk, to improve retrieval speed and reduce the need for repetitive processing.

Cache 246

Cache Scalability Performance Latency 246

DZone

JANUARY 23, 2022

Datacenter - data center failure where the whole DC could become unavailable due to power failure, network connectivity failure, environmental catastrophe, etc. Redundancy by building additional data centers. Monitor the servers on various parameters and build redundancy. this is addressed through monitoring and redundancy.

Hardware 243

Hardware DevOps Network Storage 243

DZone

MARCH 2, 2023

According to data provided by Sandvine in their 2022 Global Internet Phenomena Report , video traffic accounted for 53.72% of the total volume of internet traffic in 2021, and the closest trailing category (social) came in at just 12.69%.

Social Media 281

Social Media Java Traffic Internet 281

Dynatrace

NOVEMBER 6, 2023

Cloud-native workloads on edge devices are gaining momentum among organizations as they extend the hybrid cloud closer to the data source and end users at the edge. The challenge of cloud-native observability at the enterprise edge In aggregate, connected devices generate huge volumes of data.

Retail 306

Retail Storage Analytics Cloud 306

Dynatrace

JULY 11, 2023

But observability data (traces) can fill in the blanks to reveal useful evidence of possible exploitation, as proved by our analysis of the MoveIT vulnerability using Dynatrace. When exploiting the vulnerability, attackers can gain remote code injection capabilities in the MOVEit server and modify or steal sensitive data from its database.

Database 189

Database Government Servers Games 189

DZone

JULY 3, 2023

Data engineering projects often require the setup and management of complex infrastructures that support data processing, storage, and analysis. In this article, we will explore the benefits of leveraging IaC for data engineering projects and provide detailed implementation steps to get started.

Data Engineering 150

Data Engineering Infrastructure Code Engineering 150

The Netflix TechBlog

JUNE 25, 2021

By Gim Mahasintunan on behalf of Data Platform Engineering. Supporting a rapidly growing base of engineers of varied backgrounds using different data stores can be challenging in any organization. In this blog post, we are thrilled to share that we are open-sourcing one such tool: the Netflix Data Explorer.

Metrics 157

Metrics Best Practices Design Strategy 157

Dynatrace

SEPTEMBER 5, 2024

Understanding that the first mile of getting data in can often be the hardest, Dynatrace continues to invest in log ingest, offering a range of out-of-the-box solutions within the Dynatrace Platform and apps. Dynatrace ActiveGate addresses these issues by enforcing configurable security settings and ensuring data uniformity.

Innovation 290

Innovation AWS Analytics Storage 290

Dynatrace

OCTOBER 1, 2020

Applications and services are often slowed down by under-performing DNS communications or misconfigured DNS servers, which can result in frustrated customers uninstalling your application. Identify under-performing DNS servers. Slower response times can be a sign of a stressed DNS server or network communication issues.

Traffic 264

Traffic Network Infrastructure Artificial Intelligence 264

Dynatrace

OCTOBER 23, 2023

Hyper-V plays a vital role in ensuring the reliable operations of data centers that are based on Microsoft platforms. Secondly, determining the correct allocation of resources (CPU, memory, storage) to each virtual machine to ensure optimal performance without over-provisioning can be difficult. What is Microsoft Hyper-V?

Efficiency 264

Efficiency Virtualization Hardware Performance 264

Dynatrace

NOVEMBER 2, 2020

IT infrastructure is the heart of your digital business and connects every area – physical and virtual servers, storage, databases, networks, cloud services. This shift requires infrastructure monitoring to ensure all your components work together across applications, operating systems, storage, servers, virtualization, and more.

Infrastructure 246

Infrastructure Monitoring Virtualization Serverless 246

Dynatrace

JANUARY 16, 2023

The study analyzes factual Kubernetes production data from thousands of organizations worldwide that are using the Dynatrace Software Intelligence Platform to keep their Kubernetes clusters secure, healthy, and high performing. Big data : To store, search, and analyze large datasets, 32% of organizations use Elasticsearch.

Open Source 358

Open Source Java Operating System Programming 358

High Scalability

SEPTEMBER 8, 2018

They've posted about Anna's new superpowers in Going Fast and Cheap: How We Made Anna Autoscale : Using Anna v0 as an in-memory storage engine, we set out to address the cloud storage problems described above. Each storage server collects statistics about the requests it serves, the data it stores, etc.

Storage 199

Storage Performance AWS Media 199

The Netflix TechBlog

MAY 4, 2023

It can happen on an edge API system servicing customer devices, between the edge and mid-tier services, or from mid-tiers to data stores. These include options where replay traffic generation is orchestrated on the device, on the server, and via a dedicated service. We will examine these alternatives in the upcoming sections.

Traffic 347

Traffic Latency Tuning Systems 347

Scalegrid

SEPTEMBER 16, 2019

PostgreSQL graphical user interface (GUI) tools help these open source database users to manage, manipulate, and visualize their data. Offers great visualization to help you interpret your data. You can remotely access and navigate another database server. Convenient navigation among data. pgAdmin uses too many resources.

Open Source 262

Open Source Database Azure Cloud 262