The Netflix TechBlog

NOVEMBER 14, 2023

By Abhinaya Shetty , Bharath Mummadisetty In the inaugural blog post of this series, we introduced you to the state of our pipelines before Psyberg and the challenges with incremental processing that led us to create the Psyberg framework within Netflix’s Membership and Finance data engineering team.

Processing 230

Processing Data Engineering Efficiency Analytics 230

DZone

NOVEMBER 7, 2023

Among the spectrum of methodologies available for this task, batch processing is often considered an old guard, especially with the advent of real-time and event-based processing technologies. However, it would be a mistake to dismiss batch processing as an antiquated approach.

Processing 189

Processing Architecture Technology Technology 189

Dynatrace

FEBRUARY 4, 2025

In this blog post, we will see how Dynatrace harnesses the power of observability and analytics to tailor a new experience to easily extend to the left, allowing developers to solve issues faster, build more efficient software, and ultimately improve developer experience!

Development 235

Development Analytics Code Architecture 235

The Netflix TechBlog

NOVEMBER 12, 2024

By: Rajiv Shringi , Oleksii Tkachuk , Kartik Sathyanarayanan Introduction In our previous blog post, we introduced Netflix’s TimeSeries Abstraction , a distributed service designed to store and query large volumes of temporal event data with low millisecond latencies. This process can also be used to track the provenance of increments.

Latency 247

Latency Cache Infrastructure Strategy 247

Dynatrace

NOVEMBER 4, 2024

Dynatrace OpenPipeline is a new stream processing technology that ingests and contextualizes data from any source. Business process monitoring and optimization. All of these steps are critical components of the process, likely to be implemented using different systems. Business event ingestion and analysis with log files.

Analytics 241

Analytics Airlines Metrics Monitoring 241

Dynatrace

AUGUST 16, 2022

Advanced processing on your observability platform unlocks the full value of log data. Dynatrace now includes powerful log-processing capabilities for all types of log data. Log data is processed on ingest, whether coming from a fleet of OneAgents deployed across your enterprise hosts or generic API ingest from cloud services.

Processing 246

Processing Metrics Monitoring Java 246

The Netflix TechBlog

NOVEMBER 20, 2023

by Jun He , Yingyi Zhang , and Pawan Dixit Incremental processing is an approach to process new or changed data in workflows. The key advantage is that it only incrementally processes data that are newly added or updated to a dataset, instead of re-processing the complete dataset.

Processing 214

Processing Big Data Efficiency Engineering 214

Dynatrace

FEBRUARY 25, 2025

This blog post dissects the vulnerability, explains how Struts processes file uploads, details the exploit mechanics, and outlines mitigation strategies. This allows developers to easily access and process the file without handling the upload mechanics directly. Complete mitigation is only guaranteed in Struts version 7.0.0

Servers 214

Servers Processing Java Tuning 214

Dynatrace

JANUARY 21, 2025

Ensuring smooth operations is no small feat, whether you’re in charge of application performance, IT infrastructure, or business processes. Have a look at our recent Davis CoPilot blog post for more information and practical use cases. Your trained eye can interpret them at a glance, a skill that sets you apart.

Traffic 262

Traffic Metrics Analytics Monitoring 262

Dynatrace

MARCH 5, 2025

The newly introduced step-by-step guidance streamlines the process, while quick data flow validation accelerates the onboarding experience even for power users. Step-by-step setup The log ingestion wizard guides you through the prerequisites and provides ready-to-use command examples to start the installation process. Figure 5.

Open Source 211

Open Source IoT Cloud Azure 211

Dynatrace

OCTOBER 10, 2024

In this blog, we will focus on histograms and why to use them. This self-monitoring aspect is crucial for maintaining the health and efficiency of the Collector itself, ensuring that it can handle the demands of large-scale data collection and processing without degradation. What are histograms, and why use them?

Metrics 240

Metrics Monitoring Efficiency Availability 240

Dynatrace

FEBRUARY 4, 2025

A production bug is the worst; besides impacting customer experience, you need special access privileges, making the process far more time-consuming. It also makes the process risky as production servers might be more exposed, leading to the need for real-time production data. This cumbersome process should not be the norm.

Open Source 223

Open Source Code Engineering Best Practices 223

Dynatrace

OCTOBER 29, 2024

In a recent blog post, we announced and demonstrated how the new Distributed Tracing app provides effortless trace insights. Conclusion In this blog post, we explored how the Distributed Tracing app can be harnessed to visualize data ingested from the OpenTelemetry collector to get an overview of application health.

Metrics 246

Metrics Tuning Monitoring Availability 246

Dynatrace

JANUARY 15, 2025

Smartscape topology visualizes the relationships between applications, services, processes, hosts, and data centers, highlighting problems and vulnerabilities. Workflows assembles a series of actions to build processes in graphical representations.

Systems 264

Systems DevOps Monitoring Analytics 264

Dynatrace

OCTOBER 14, 2024

If you’re an existing customer and want to upgrade to the attribute-based access control system, check out our new guide , which will walk you through the process. This blog post is part of our series on Tailored access management.

Monitoring 246

Monitoring Metrics Systems Scalability 246

Dynatrace

OCTOBER 23, 2024

For more details, see our recent blog post explaining how new Dynatrace capabilities help modern app teams analyze OpenTelemetry traces and log data at scale. Automatic data capture and display: More data, including span attributes, is available for out-of-the-box analysis, with no additional configuration necessary.

Tuning 299

Tuning Website Availability Performance 299

Dynatrace

FEBRUARY 28, 2025

In our latest research, we analyzed social media, blogs, and other online sources to identify early indicators of such vulnerabilities. To detect any possible effects of the vulnerability before it was published, we cross-referenced data from multiple sources, scraping Jira, Mastodon, GitHub, and various security blogs.

Social Media 147

Social Media Java Media Open Source 147

The Netflix TechBlog

FEBRUARY 14, 2025

It requires a state-of-the-art system that can track and process these impressions while maintaining a detailed history of each profiles exposure. In this multi-part blog series, we take you behind the scenes of our system that processes billions of impressions daily.

Tuning 165

Tuning Latency Efficiency Storage 165

Dynatrace

NOVEMBER 11, 2024

However, due to the fact that they boil down selected indicators to single values and track error budget levels, they also offer a suitable way to monitor optimization processes while aligning on single values to meet overall goals. By recognizing the insights provided, you can optimize processes and improve overall efficiency.

Efficiency 263

Efficiency Best Practices Monitoring Cloud 263

Dynatrace

MARCH 5, 2025

Integration with existing systems and processes : Integration with existing IT infrastructure, observability solutions, and workflows often requires significant investment and customization. Youll be able to read more about our approach to cloud cost optimization in an upcoming blog post.

Energy 223

Energy Analytics Traffic Cloud 223

Dynatrace

OCTOBER 16, 2024

In this blog post, we look at these enhancements, exploring methods for monitoring your Kubernetes environment and showcasing how modern dashboards can transform your data. Kickstarting the dashboard creation process is, however, just one advantage of ready-made dashboards.

Social Media 263

Social Media Metrics Network Analytics 263

The Netflix TechBlog

MARCH 4, 2025

Part 3: System Strategies and Architecture By: VarunKhaitan With special thanks to my stunning colleagues: Mallika Rao , Esmir Mesic , HugoMarques This blog post is a continuation of Part 2 , where we cleared the ambiguity around title launch observability at Netflix. The request schema for the observability endpoint.

Traffic 160

Traffic Strategy Entertainment Innovation 160

The Netflix TechBlog

JANUARY 2, 2025

However, due to the absence of a control group in these countries, we adopt a synthetic control framework ( blog post ) to estimate the counterfactual scenario. Each format has a different production process and different patterns of cash spend, called our Content Forecast. As plans change, the cash forecast will change.

Analytics 187

Analytics Engineering Games Entertainment 187

Dynatrace

APRIL 10, 2020

In my last blog I covered how our Engineering Productivity (EP) and Infrastructure & Services (IAS) Teams are ensuring that our DevOps tool chain is running as expected, even while workloads have shifted as our global engineering teams are now working from home. Dynatrace news.

Java 332

Java Performance DevOps Engineering 332

Dynatrace

OCTOBER 2, 2024

This shortens root cause analysis dramatically, as explained in our recent blog post Full Kubernetes logging in context from Fluent Bit to Dynatrace. This is explained in detail in our blog post, Unlock log analytics: Seamless insights without writing queries.

Analytics 304

Analytics AWS DevOps Cloud 304

Scalegrid

FEBRUARY 6, 2025

RabbitMQ is designed for flexible routing and message reliability, while Kafka handles high-throughput event streaming and real-time data processing. RabbitMQ follows a message broker model with advanced routing, while Kafkas event streaming architecture uses partitioned logs for distributed processing. What is Apache Kafka?

Latency 147

Latency Analytics Architecture Storage 147

DZone

OCTOBER 8, 2024

It’s a go-to database for many projects dealing with Online Transaction Processing systems. In this blog post, we’ll see other scenarios where PostgreSQL shines and will explain how to use it in these cases. In this blog post, we’ll see other scenarios where PostgreSQL shines and will explain how to use it in these cases.

Analytics 263

Analytics Database Processing Systems 263

Dynatrace

FEBRUARY 10, 2023

Grail, the Dynatrace causational data lakehouse with a massively parallel processing analytics engine, unites observability, security, and business data from multicloud and cloud-native environments while retaining the data’s context to deliver precise answers in real time. What is a data lakehouse?

Efficiency 306

Efficiency Performance Analytics DevOps 306

Dynatrace

NOVEMBER 17, 2023

In the first blog post of this series , we explored how the Dynatrace ® observability and security platform boosts the reliability of Site Reliability Engineers (SRE) CI/CD pipelines and enhances their ability to focus on innovation. In this blog post, we’ll focus on the first stage of the pipeline, the Build stage.

Innovation 278

Innovation Code Processing Architecture 278

Dynatrace

SEPTEMBER 27, 2024

As batch jobs run without user interactions, failure or delays in processing them can result in disruptions to critical operations, missed deadlines, and an accumulation of unprocessed tasks, significantly impacting overall system efficiency and business outcomes. Individual batch job status with processing times and status Figure 4.

Monitoring 260

Monitoring Performance IoT Analytics 260

Dynatrace

AUGUST 20, 2024

Information related to user experience, transaction parameters, and business process parameters has been an unretrieved treasure, now accessible through new and unique AI-powered contextual analytics in Dynatrace. Lack of visibility into business processes to improve, optimize, and remediate issues and systems harms business success.

Analytics 285

Analytics Latency Processing Systems 285

Dynatrace

JANUARY 18, 2023

However, getting reliable answers from observability data so teams can automate more processes to ensure speed, quality, and reliability can be challenging. SRE applies software engineering principles to operations and infrastructure processes. Unpacking the purpose and importance of an IT cultural revolution – blog.

DevOps 246

DevOps Best Practices Innovation Strategy 246

Dynatrace

FEBRUARY 4, 2025

In this blog post, we explain how the unique combination of causal, predictive, and generative AIaugmented by the latest Davis AI advancementsis transforming how Dynatrace customers manage and optimize their IT infrastructure. Traditional forecasting engines typically depend on historical data, stored in metrics.

Retail 130

Retail Engineering Metrics Efficiency 130

Dynatrace

NOVEMBER 20, 2023

Effectively automating IT processes is key to addressing the challenges of  complex cloud environments. Relying on manual processes results in outages, increased costs, and frustrated customers. These three types of AI used together enable more effective IT automation than a single form of AI on its own. What is causal AI?

AWS 277

AWS Artificial Intelligence Cloud Analytics 277

Scalegrid

MAY 13, 2020

Greenplum Database is a massively parallel processing (MPP) SQL database that is built and based on PostgreSQL. In this blog post, we explain what Greenplum is, and break down the Greenplum architecture, advantages, major use cases, and how to get started. You can leverage as few as two segment hosts and scale to an unlimited capacity.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

Dynatrace

DECEMBER 18, 2023

In the last blog post of this series, we delved into how Dynatrace, functioning as a deploy-stage orchestrator, solves the challenges confronted by Site Reliability Engineers (SREs) during the early of automating CI/CD processes. This slow feedback and time spent rerunning tests can hinder the overall software deployment process.

Testing 306

Testing Best Practices Performance Testing Engineering 306

Dynatrace

NOVEMBER 26, 2019

Read on for links to blog posts that highlight the key benefits you get with our next-generation AI causation engine. These blog posts, published over the course of this year, span a huge feature set comprising Davis 2.0, Dynatrace will target the end of Davis 1.0 for around the middle of 2020. Key benefits of the Dynatrace Davis 2.0

Engineering 69

Engineering Serverless Metrics Code 69