The Netflix TechBlog

FEBRUARY 14, 2025

Analyzing impression history, for example, might help determine how well a specific row on the home page is functioning or assess the effectiveness of a merchandising strategy. The enriched data is seamlessly accessible for both real-time applications via Kafka and historical analysis through storage in an Apache Iceberg table.

Tuning 165

Tuning Latency Efficiency Storage 165

Dynatrace

JUNE 1, 2023

Certain service-level objective examples can help organizations get started on measuring and delivering metrics that matter. Teams can build on these SLO examples to improve application performance and reliability. In this post, I’ll lay out five SLO examples that every DevOps and SRE team should consider. or 99.99% of the time.

Traffic 173

Traffic Website Latency DevOps 173

Scalegrid

FEBRUARY 6, 2025

Message brokers handle validation, routing, storage, and delivery, ensuring efficient and reliable communication. Its design prioritizes high availability and efficient data transfer with minimal overhead, making it a practical choice for handling real-time data pipelines and distributed event processing. What is RabbitMQ?

Latency 147

Latency Analytics Architecture Storage 147

Scalegrid

MAY 13, 2020

High performance, query optimization, open source and polymorphic data storage are the major Greenplum advantages. Polymorphic Data Storage. Greenplum’s polymorphic data storage allows you to control the configuration for your table and partition storage with the freedom to execute and compress files within it at any time.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

The Netflix TechBlog

MARCH 4, 2025

Data storage and distribution through HollowFeeds Netflix Hollow is an Open Source java library and toolset for disseminating in-memory datasets from a single producer to many consumers for high performance read-only access. An example request with a future timestamp.

Traffic 160

Traffic Strategy Entertainment Innovation 160

Percona

DECEMBER 11, 2023

There are a wealth of options on how you can approach storage configuration in Percona Operator for PostgreSQL , and in this blog post, we review various storage strategies — from basics to more sophisticated use cases. For example, you can choose the public cloud storage type – gp3, io2, etc, or set file system.

Storage 122

Storage Strategy Cloud Network 122

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. Understanding distributed storage is imperative as data volumes and the need for robust storage solutions rise.

Storage 130

Storage Systems Big Data Azure 130

Scalegrid

JULY 17, 2020

If you store each of the keys as columns, it will result in frequent DML operations – this can be difficult when your data set is large - for example, event tracking, analytics, tags, etc. For example, Stripe transactions. JSONB storage results in a larger storage footprint. Syncing with external data sources.

Storage 321

Storage Database Efficiency Availability 321

Percona

FEBRUARY 10, 2023

Today along with their team, we will see how pvc-autoresizer can automate storage scaling for MongoDB clusters on Kubernetes. Our goal is to automate storage scaling when our disk reaches a certain threshold of use and simultaneously reduce the amount of alert noise related to that. kubectl annotate pvc --all resize.topolvm.io/storage_limit="100Gi"

Storage 130

Storage Blockchain AWS Cloud 130

Dynatrace

OCTOBER 4, 2022

Limited data availability constrains value creation. Teams have introduced workarounds to reduce storage costs. Additionally, efforts such as lowered data retention times, two-tiered storage systems, shaky index management, sampled data, and data pipelines reduce the overall amount of stored data.

Analytics 264

Analytics Artificial Intelligence Storage Serverless 264

Dynatrace

DECEMBER 5, 2023

Streamline privacy requirements with flexible retention periods Data retention is a critical aspect of data handling, and it’s not just about privacy compliance—it’s about having the flexibility to optimize data storage times in Grail for your Dynatrace use cases.

Storage 242

Storage Healthcare Best Practices Speed 242

Dynatrace

MAY 21, 2024

That’s because it does not require any pre-prepared schemas, and access to cold/hot storage is fully automatic and with zero latency. Dynatrace analytics capabilities, powered by hypermodal AI , enable executives to drive improved availability , strengthened security compliance , and heightened confidence in AI initiatives.

Technology 275

Technology Technology Analytics Storage 275

Dynatrace

OCTOBER 4, 2022

This architecture offers rich data management and analytics features (taken from the data warehouse model) on top of low-cost cloud storage systems (which are used by data lakes). This decoupling ensures the openness of data and storage formats, while also preserving data in context. Grail is built for such analytics, not storage.

Artificial Intelligence 290

Artificial Intelligence Analytics Storage Architecture 290

Dynatrace

APRIL 28, 2023

Optimize cost and availability while staying compliant Observability data like logs and metrics provide automated answers, root cause detection, and security issues. This means compromising between keeping data available as long as possible for analysis while juggling the costs and overhead of storage, archiving, and retrieval.

Analytics 246

Analytics Storage Infrastructure Metrics 246

Dynatrace

OCTOBER 6, 2023

Buckets are similar to folders, a physical storage location. For example, a separate bucket could be used for detailed logs from Dynatrace Synthetic nodes. Debug-level logs, which also generate high volumes and have a shorter lifespan or value period than other logs, could similarly benefit from dedicated storage.

Artificial Intelligence 279

Artificial Intelligence Metrics Analytics Storage 279

Dynatrace

OCTOBER 14, 2022

This way, it‘s possible to flexibly select what confidential or sensitive information (for example, PII) is hashed or completely removed before it leaves the enterprise premises. If a more granular rule is present on the host level, that rule will precede any blanket rule on, for example, the tenant level.

Storage 278

Storage Government Network Infrastructure 278

Dynatrace

MAY 21, 2024

Masking at storage: Data is persistently masked upon ingestion into Dynatrace. Leverage three masking layers Masking at capture and masking at storage operations exclude targeted sensitive data points. Open the available tabs to explore and easily tailor your data privacy settings.

Government 277

Government Storage Tuning Monitoring 277

The Netflix TechBlog

SEPTEMBER 18, 2024

Central to this infrastructure is our use of multiple online distributed databases such as Apache Cassandra , a NoSQL database known for its high availability and scalability. This flexibility allows our Data Platform to route different use cases to the most suitable storage system based on performance, durability, and consistency needs.

Latency 256

Latency Storage Cache Servers 256

The Netflix TechBlog

APRIL 27, 2023

While Atlas is architected around compute & storage separation, and we could theoretically just scale the query layer to meet the increased query demand, every query, regardless of its type, has a data component that needs to be pushed down to the storage layer.

Storage 293

Storage Cache Metrics Database 293

Dynatrace

JANUARY 11, 2023

With more organizations taking the multicloud plunge, monitoring cloud infrastructure is critical to ensure all components of the cloud computing stack are available, high-performing, and secure. For example, uptime detection can identify database instability and help to improve mean time to restoration. Cloud storage monitoring.

Cloud 295

Cloud Monitoring Best Practices Infrastructure 295

Dynatrace

AUGUST 24, 2020

But there are other related components and processes (for example, cloud provider infrastructure) that can cause problems in applications running on Kubernetes. And because Dynatrace can consume CloudWatch metrics, almost all your AWS usage information is available to you within Dynatrace. Dynatrace OneAgent documentation .

Analytics 305

Analytics Infrastructure AWS Operating System 305

Dynatrace

JUNE 14, 2024

Since March 2024, the Dynatrace ® platform has been available on AWS in Tokyo, allowing customers to leverage the latest Dynatrace capabilities from Japan. Domain-specific guidelines recommend local data storage in Japan. An overview of how to upgrade is available in our guide, Upgrade to Dynatrace SaaS.

AWS 278

AWS Government Azure Healthcare 278

Dynatrace

OCTOBER 2, 2024

The Clouds app provides a view of all available cloud-native services. Logs in context, along with other details, are instantly available after selecting a resource. The reasons are easy to find, looking at the latest improvements that went live along with the general availability of the Logs app.

Analytics 304

Analytics AWS DevOps Cloud 304

Dynatrace

JANUARY 31, 2024

OpenPipeline high-performance filtering and preprocessing provides full ingest and storage control for the Dynatrace platform. As an example, in early preview usage, AWS GuardDuty events were reduced by 84% by filtering out security-irrelevant events, which reduced cost and alert noise at the same time.

Analytics 272

Analytics Processing Transportation Storage 272

Scalegrid

APRIL 28, 2020

Since database hosting is more dependent on memory (RAM) than storage, we are going to compare various instance sizes ranging from just 1GB of RAM up to 64GB of RAM so you can see how costs vary across different application workloads. Is my database cluster still highly available? DigitalOcean using the below instance types: AWS.

Azure 344

Azure AWS Database Latency 344

High Scalability

APRIL 16, 2019

In this three-part blog series, we introduced a High Availability (HA) Framework for MySQL hosting in Part I, and discussed the details of MySQL semisynchronous replication in Part II. Now in Part III, we review how the framework handles some of the important MySQL failure scenarios and recovers to ensure high availability.

Availability 149

Availability Network Azure AWS 149

Percona

JUNE 22, 2023

To make data count and to ensure cloud computing is unabated, companies and organizations must have highly available databases. This guide provides an overview of what high availability means, the components involved, how to measure high availability, and how to achieve it. How does high availability work?

Availability 132

Availability Database Open Source Hardware 132

Dynatrace

AUGUST 11, 2022

Infrastructure as a service (IaaS) handles compute, storage, and network resources. Increased availability. Because FaaS is a cloud-native approach, it makes great use of multisite cloud architecture to improve availability and reliability. Consider a monolithic application, for example, designed to perform a host of functions.

Development 279

Development Serverless Best Practices Lambda 279

Dynatrace

JULY 29, 2022

Log analytics can determine whether the same service or function is consistently causing an application to not meet SLOs during peak season — for example, when a retailer offers an end-of-season sale, or a financial application is critical for closing out the year. Cold storage and rehydration. Cold storage and rehydration.

Analytics 246

Analytics Storage Retail DevOps 246

Dynatrace

JULY 29, 2022

Log analytics can determine whether the same service or function is consistently causing an application to not meet SLOs during peak season — for example, when a retailer offers an end-of-season sale, or a financial application is critical for closing out the year. Cold storage and rehydration. Cold storage and rehydration.

Analytics 245

Analytics Storage Retail DevOps 245

Dynatrace

SEPTEMBER 23, 2020

Storage mount points in a system might be larger or smaller, local or remote, with high or low latency, and various speeds. Sometimes these locations landed on mount points which, due to capacity, availability, or access constraints, weren’t well suited for large runtime storage. See details below. See details below.

Storage 227

Storage Latency Operating System Network 227

DZone

JUNE 3, 2019

For example, one well-respected vendor's standard solution is limited to 7.5TB of internal storage, and it can only scale to 30TB. Normally, GPU nodes don't have much room for SSDs, which limits the opportunity to train very deep neural networks that need more data.

Storage 100

Storage Performance Network Scalability 100

Percona

JANUARY 4, 2024

Managing storage and performance efficiently in your MySQL database is crucial, and general tablespaces offer flexibility in achieving this. This blog discusses general tablespaces and explores their functionalities, benefits, and practical usage, along with illustrative examples. What are MySQL general tablespaces?

Storage 114

Storage Engineering Database Open Source 114

Dynatrace

NOVEMBER 23, 2020

Nevertheless, there are related components and processes, for example, virtualization infrastructure and storage systems (see image below), that can lead to problems in your Kubernetes infrastructure. Configuring storage in Kubernetes is more complex than using a file system on your host. The Kubernetes experience.

Virtualization 237

Virtualization Infrastructure Monitoring Cloud 237

Dynatrace

SEPTEMBER 13, 2023

For example, optimizing resource utilization for greater scale and lower cost and driving insights to increase adoption of cloud-native serverless services. Storing frequently accessed data in faster storage, usually in-memory caching, improves data retrieval speed and overall system performance. Beyond

AWS 305

AWS Efficiency Azure Cloud 305

Scalegrid

JULY 8, 2019

In this post, we outline the best way to host MySQL on Azure , including managed solutions, instance types, high availability replication, backup, and disk types to use to optimize your cloud database performance. A good example would be slow query analysis. High Availability Deployment. MySQL DBaaS vs. Self-Managed MySQL.

Azure 219

Azure Cloud Virtualization Database 219

Dynatrace

MAY 6, 2024

Example implementation scenario #1 The diagram below illustrates configuration-event-based remediation with Dynatrace and Red Hat Ansible Automation Controller for a failing canary release. Within Red Hat Ansible Automation Controller, the corresponding job template remediates the problem: in this example, the canary weighting is reset.

DevOps 306

DevOps Software Engineering Games Infrastructure 306