The Netflix TechBlog

NOVEMBER 20, 2023

by Jun He , Yingyi Zhang , and Pawan Dixit Incremental processing is an approach to process new or changed data in workflows. The key advantage is that it only incrementally processes data that are newly added or updated to a dataset, instead of re-processing the complete dataset.

Processing 221

Processing Big Data Efficiency Engineering 221

DZone

JANUARY 17, 2023

Building performant services and systems is at the core of every business. Tons of technologies emerge daily, promising capabilities that help you surpass your performance benchmarks. However, production environments are chaotic landscapes that exact a heavy performance toll when not maintained and monitored.

Network 312

Network Performance Benchmarking Infrastructure 312

DZone

FEBRUARY 19, 2023

The second day of Dynatrace Perform kicked off with a great discussion between Kelsey Hightower, distinguished developer advocate at Google Cloud Platform, and Andi Grabner, DevOps evangelist at Dynatrace. The theme of their discussion was redefining the boundaries of people, processes, and platforms.

Performance 259

Performance DevOps Google Cloud 259

DZone

SEPTEMBER 9, 2024

Efficient data processing is crucial for businesses and organizations that rely on big data analytics to make informed decisions. One key factor that significantly affects the performance of data processing is the storage format of the data.

Big Data 278

Big Data Storage Analytics Benchmarking 278

DZone

OCTOBER 23, 2023

In most financial firms, online transaction processing (OLTP) often relies on static or infrequently updated data, also called reference data. I will share a coding lab to measure the performance of AWS-managed NoSQL databases such as DynamoDB , Cassandra , Redis , and MongoDB.

AWS 275

AWS Performance Database Architecture 275

Dynatrace

SEPTEMBER 27, 2024

Unrealized optimization potential of business processes due to monitoring gaps Imagine a retail company facing gaps in its business process monitoring due to disparate data sources. Due to separated systems that handle different parts of the process, the view of the process is fragmented.

Processing 210

Processing Retail Analytics Monitoring 210

DZone

OCTOBER 8, 2024

To fully leverage its capabilities and improve efficient data processing, it's crucial to optimize query performance. Snowflake is a powerful cloud-based data warehousing platform known for its scalability and flexibility. Snowflake’s architecture consists of three main layers:

Best Practices 282

Best Practices Performance Architecture Scalability 282

Dynatrace

FEBRUARY 10, 2023

These are just some of the topics being showcased at Perform 2023 in Las Vegas. Perform 2023 news At Perform 2023 in Las Vegas, the headliner theme is IT automation. By automating workflows, teams throughout the organization can eliminate manual processes and improve outcomes. We’ll post news here as it happens!

Efficiency 287

Efficiency Performance Analytics DevOps 287

DZone

JUNE 22, 2023

The post will provide a comprehensive guide to understanding the key principles and best practices for optimizing the performance of APIs. What Is API Performance Optimization? API performance optimization is the process of improving the speed, scalability, and reliability of APIs.

Scalability 245

Scalability Design Best Practices Performance 245

Dynatrace

OCTOBER 4, 2024

Today, development teams suffer from a lack of automation for time-consuming tasks, the absence of standardization due to an overabundance of tool options, and insufficiently mature DevSecOps processes. This process begins when the developer merges a code change and ends when it is running in a production environment.

Software 230

Software Software Development Performance 230

Dynatrace

OCTOBER 3, 2024

Dynatrace OTel Collector Understand your applications with ease Due to a lack of contextual insights and actionable intelligence, application teams often find themselves overwhelmed by data, unable to quickly identify the root causes of performance issues. The same is true when it comes to log ingestion.

Performance 259

Performance Architecture Innovation Latency 259

Dynatrace

JANUARY 31, 2024

Organizations choose data-driven approaches to maximize the value of their data, achieve better business outcomes, and realize cost savings by improving their products, services, and processes. Data is then dynamically routed into pipelines for further processing. Addressing security requirements.

Analytics 203

Analytics Processing Transportation Storage 203

DZone

AUGUST 16, 2023

Caching is the process of storing frequently accessed data or resources in a temporary storage location, such as memory or disk, to improve retrieval speed and reduce the need for repetitive processing.

Cache 246

Cache Scalability Performance Latency 246

DZone

AUGUST 20, 2023

Application performance is critical for delivering a fast and responsive user experience. Slow performance, or high latency, can lead to frustrated users and lost revenue for the organization. App performance also impacts overall efficiency. All of these factors can reduce a company’s ability to compete in the market.

Performance 225

Performance Latency Efficiency Processing 225

DZone

APRIL 13, 2023

Built using Rust, it offers a high degree of flexibility, loose coupling, and exceptional performance. This self-hosted graph routing solution is highly configurable, making it an ideal choice for developers who require a high-performance routing system.

Monitoring 245

Monitoring Performance Traffic Efficiency 245

DZone

JULY 7, 2024

After disabling the swap, reserve 20% for other programs. Configure the data heap, operator heap, and TEMP heap sizes as needed.

Hardware 258

Hardware Performance Programming Servers 258

DZone

MAY 1, 2023

CPU isolation and efficient system management are critical for any application which requires low-latency and high-performance computing. To achieve this level of performance, such systems require dedicated CPU cores that are free from interruptions by other processes, together with wider system tuning.

Tuning 253

Tuning Systems Latency Performance 253

Dynatrace

JANUARY 23, 2024

With our annual user conference, Dynatrace Perform 2024 rapidly approaching on January 29 through February 1, 2024, our teams, partners, and customers are buzzing with excitement and anticipation. Read on to learn what you can look forward to hearing about from each of our cloud partners at Perform. What can we move?

Cloud 224

Cloud Artificial Intelligence Performance AWS 224

DZone

OCTOBER 11, 2023

In the world of data processing, Apache Spark has established itself as a powerful and versatile framework. However, as the volume and complexity of data continue to grow, ensuring optimal performance becomes paramount.

Performance 214

Performance Processing 214

DZone

OCTOBER 9, 2024

A good starting point is to examine the storage, memory, and processing performance and verify that it aligns with the proposed use cases.

IoT 182

IoT Hardware Performance Internet 182

DZone

JUNE 13, 2024

Relational Databases are the bedrock of any FinTech application, especially for OLTP (Online transaction Processing). This foundational component in any application architecture usually poses challenges around scaling as the business expands rapidly.

FinTech 262

FinTech Tuning AWS Database 262

Dynatrace

NOVEMBER 30, 2023

Over the years, I have watched and written about online retail and e-commerce IT performance. Below is a Dynatrace honeycomb chart depicting the performance of the synthetics tests tracked by the Dynatrace Business Insights team. In the past, I tried to understand where in the page-loading process was the majority of time spent.

Retail 234

Retail Social Media Performance Benchmarking 234

Dynatrace

JANUARY 23, 2024

These are the goals of AI observability and data observability, a key theme at Dynatrace Perform 2024 , the observability provider’s annual conference, which takes place in Las Vegas from January 29 to February 1, 2024. Join us at Dynatrace Perform 2024 , either on-site or virtuall y, to explore these themes further.

Performance 198

Performance DevOps Innovation Artificial Intelligence 198

Dynatrace

SEPTEMBER 27, 2024

As batch jobs run without user interactions, failure or delays in processing them can result in disruptions to critical operations, missed deadlines, and an accumulation of unprocessed tasks, significantly impacting overall system efficiency and business outcomes. Individual batch job status with processing times and status Figure 4.

Monitoring 197

Monitoring Performance IoT Analytics 197

Dynatrace

FEBRUARY 28, 2024

Dynatrace container monitoring supports customers as they collect metrics, traces, logs, and other observability-enabled data to improve the health and performance of containerized applications. This is a continuous process,” Fuqua said. It’s an enterprise product that we use to help modernize the VA,” Fuqua said.

Monitoring 195

Monitoring Artificial Intelligence Performance Healthcare 195

Dynatrace

OCTOBER 23, 2023

Secondly, determining the correct allocation of resources (CPU, memory, storage) to each virtual machine to ensure optimal performance without over-provisioning can be difficult. This presents a challenge for IT operations teams, specifically in identifying and addressing performance issues or planning how to prevent future issues.

Efficiency 227

Efficiency Virtualization Hardware Performance 227

DZone

JUNE 21, 2024

This article analyzes the correlation between block sizes and their impact on storage performance. The amount of data processed or transferred in a single block within a system or storage device is referred to as the block size. It is one of the deciding factors for storage performance.

Storage 162

Storage Performance Benchmarking Systems 162

Dynatrace

OCTOBER 17, 2023

In the recently published Gartner® “ Critic al Capabilities for Application Performance Monitoring and Observability,” Dynatrace scored highest for the IT Operations Use Case (4.15/5) This is accomplished by using service monitoring and anomaly detection for early-warning notifications of performance issues.” 5) in the Gartner report.

Monitoring 239

Monitoring Artificial Intelligence Performance Analytics 239

DZone

SEPTEMBER 11, 2024

When reporting summary statistics for performance test results, there's a common assumption that the data follows a central tendency. This article explores why it's crucial to check for modality of performance test results, how to detect multimodal distributions, and how to handle them. But is this always true?

Performance Testing 147

Performance Testing Testing Performance Metrics 147

DZone

AUGUST 8, 2021

Scalability testing and performance testing are ways to assess software capabilities. Performance testing focuses on response times and software quality. Scalability testing targets the software’s performance when adding new resources. Continuous testing plays a different role in the development process.

Scalability 342

Scalability Testing Performance Testing Software 342

Dynatrace

SEPTEMBER 15, 2023

In the 2023 Magic Quadrant for Application Performance Monitoring (APM) and Observability, Gartner has named Dynatrace a Leader and positioned it highest for Ability to Execute and furthest for Completeness of Vision. Although implementations are nascent, the security capabilities of APM and observability tools have proved to be valuable.

Monitoring 257

Monitoring Performance Analytics DevOps 257

Dynatrace

OCTOBER 1, 2021

Because cloud services rely on a uniquely distributed and dynamic architecture, observability may also sometimes refer to the specific software tools and practices businesses use to interpret cloud performance data. Observability enables you to understand what is slow or broken and what needs to be done to improve performance.

Metrics 363

Metrics Open Source Monitoring Cloud 363

DZone

AUGUST 14, 2024

When building ETL data pipelines using Azure Data Factory (ADF) to process huge amounts of data from different sources, you may often run into performance and design-related challenges. This article will serve as a guide in building high-performance ETL pipelines that are both efficient and scalable.

Azure 306

Azure Cloud Scalability Efficiency 306

The Netflix TechBlog

SEPTEMBER 10, 2024

By Jose Fernandez , Sebastien Dabdoub , Jason Koch , Artem Tkachuk The Compute and Performance Engineering teams at Netflix regularly investigate performance issues in our multi-tenant environment. One issue that often complicates this process is the "noisy neighbor" problem.

Latency 251

Latency Metrics Programming Monitoring 251

DZone

OCTOBER 9, 2024

The Scheduler service enables this and is designed to address the performance and scalability improvements on Actor reminders and the Workflow API. This included the addition of a new Jobs API and Scheduler control plane service for managing jobs. Over the years, the Dapr project was often requested to include a Jobs API. Prior to v1.14

Scalability 318

Scalability Design Database Processing 318

DZone

JUNE 21, 2023

In the ever-evolving world of DevOps , the ability to gain deep insights into system behavior, diagnose issues, and improve overall performance is one of the top priorities. Monitoring and observability are two key concepts that facilitate this process, offering valuable visibility into the health and performance of systems.

DevOps 324

DevOps Systems Monitoring Metrics 324

The Netflix TechBlog

NOVEMBER 12, 2024

This counting service, built on top of the TimeSeries Abstraction, enables distributed counting at scale while maintaining similar low latency performance. Implementing idempotency would likely require using an external system for such keys, which can further degrade performance or cause race conditions.

Latency 253

Latency Cache Infrastructure Strategy 253