The Netflix TechBlog

DECEMBER 17, 2024

Metric definitions are often scattered across various databases, documentation sites, and code repositories, making it difficult for analysts and data scientists to find reliable information quickly. DJ stands out as an open source solution that is actively developed and stress-tested at Netflix.

Analytics 212

Analytics Engineering Entertainment Metrics 212

DZone

NOVEMBER 27, 2023

An open-source distributed SQL query engine, Trino is widely used for data analytics on distributed data storage. In this article, we will show you how to tune Trino by helping you identify performance bottlenecks and provide tuning tips that you can practice. But how do we do that?

Tuning 162

Tuning Speed Performance Open Source 162

Dynatrace

MARCH 13, 2025

OpenTelemetry Astronomy Shop is a demo application created by the OpenTelemetry community to showcase the features and capabilities of the popular open-source OpenTelemetry observability standard. metrics from span data. Afterward, the demo starts instantly, and the load generator automatically begins creating data.

Open Source 147

Open Source Metrics Architecture Infrastructure 147

The Netflix TechBlog

MARCH 4, 2025

Store the data in an optimized, highly distributed datastore. Additionally, some collectors will instead poll our kafka queue for impressions data. This data is processed from a real-time impressions stream into a Kafka queue, which our title health system regularly polls. Track real-time title impressions from the NetflixUI.

Traffic 180

Traffic Entertainment Strategy Innovation 180

The Netflix TechBlog

JULY 26, 2021

This happens at an unprecedented scale and introduces many interesting challenges; one of the challenges is how to provide visibility of Studio data across multiple phases and systems to facilitate operational excellence and empower decision making. With the latest Data Mesh Platform, data movement in Netflix Studio reaches a new stage.

Big Data 257

Big Data Government Processing Analytics 257

Scalegrid

JULY 13, 2020

The unstoppable rise of open source databases. One database in particular is causing a huge dent in Oracle’s market share – open source PostgreSQL. See how open source PostgreSQL Community version costs compare to Oracle Standard Edition and Oracle Enterprise Edition. What’s causing this massive shift?

Open Source 244

Open Source Tuning C++ Database 244

Scalegrid

FEBRUARY 6, 2025

RabbitMQ is designed for flexible routing and message reliability, while Kafka handles high-throughput event streaming and real-time data processing. Both serve distinct purposes, from managing message queues to ingesting large data volumes. What is RabbitMQ? What is Apache Kafka?

Latency 147

Latency Analytics Architecture Storage 147

DZone

MAY 1, 2023

The main purpose of this article and use case is to scrape AWS CloudWatch metrics into the Prometheus time series and to visualize the metrics data in Grafana. Prometheus and Grafana are the most powerful, robust open-source tools for monitoring, collecting, visualizing, and performance metrics of the deployed applications in production.

AWS 263

AWS Open Source Tuning Metrics 263

DZone

MARCH 7, 2023

Apache Spark is a powerful open-source distributed computing framework that provides a variety of APIs to support big data processing. In addition, pySpark applications can be tuned to optimize performance and achieve better execution time, scalability, and resource utilization.

Big Data 173

Big Data Code Tuning Open Source 173

The Netflix TechBlog

JUNE 20, 2024

A summary of sessions at the first Data Engineering Open Forum at Netflix on April 18th, 2024 The Data Engineering Open Forum at Netflix on April 18th, 2024. At Netflix, we aspire to entertain the world, and our data engineering teams play a crucial role in this mission by enabling data-driven decision-making at scale.

Data Engineering 206

Data Engineering Engineering Entertainment Software Engineering 206

DZone

OCTOBER 1, 2023

Elasticsearch is an open-source search engine and analytics store used by a variety of applications from search in e-commerce stores, to internal log management tools using the ELK stack (short for “Elasticsearch, Logstash, Kibana”).

Open Source 257

Open Source Tuning Analytics Scalability 257

Percona

OCTOBER 18, 2023

Migrating a proprietary database to open source is a major decision that can significantly affect your organization. Advantages of migrating to open source For many reasons mentioned earlier, organizations are increasingly shifting towards open source databases for their data management needs.

Open Source 111

Open Source Database Hardware Strategy 111

Dynatrace

FEBRUARY 16, 2023

How do you get more value from petabytes of exponentially exploding, increasingly heterogeneous data? The short answer: The three pillars of observability—logs, metrics, and traces—converging on a data lakehouse. To solve this problem, Dynatrace launched Grail, its causational data lakehouse , in 2022.

Analytics 246

Analytics Innovation Metrics Database 246

Percona

JUNE 2, 2023

While not the first open source content management system (CMS), WordPress caught on like nothing before and helped spread open source to millions. It was simple, easy to deploy, and easy to use, and WordPress had the added benefit of being open source. MySQL was founded in 1995 and went open source in 2000.

Open Source 114

Open Source Traffic Tuning Database 114

Dynatrace

JUNE 9, 2021

According to the 2019 Verizon Data Breach Investigations Report, web application attacks were the number one type of attack. Data from Forrester Research provides more detail, finding that 39% of all attacks were designed to exploit vulnerabilities in web applications. And open-source software is rife with vulnerabilities.

Open Source 261

Open Source Entertainment Tuning Internet 261

Dynatrace

OCTOBER 7, 2020

At the same time, you can now simply flip a switch to begin ingesting observability data from these tools into the Dynatrace platform, all while retaining your investment and increasing the value you get from Dynatrace. Open-source metric sources automatically map to our Smartscape model for AI analytics.

Open Source 264

Open Source Metrics Analytics Tuning 264

Dynatrace

MARCH 12, 2025

It provides an easy way to select, integrate, and customize foundation models with enterprise data using techniques like retrieval-augmented generation (RAG), fine-tuning, or continued pre-training. Send unified data to Dynatrace for analysis alongside your logs, metrics, and traces.

Metrics 165

Metrics Serverless Analytics Innovation 165

Dynatrace

SEPTEMBER 29, 2021

Docker Engine is built on top containerd , the leading open-source container runtime, a project of the Cloud Native Computing Foundation (DNCF). Kubernetes is an open-source container orchestration platform for managing, automating, and scaling containerized applications. Here the overlap with Kubernetes begins.

Open Source 334

Open Source DevOps Traffic Cloud 334

The Netflix TechBlog

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. Therefore, dumps are needed to capture the full state of a source. Designed with High Availability in mind.

Database 221

Database Traffic Transportation Open Source 221

The Netflix TechBlog

OCTOBER 18, 2022

by Jun He , Akash Dwivedi , Natallia Dzenisenka , Snehal Chennuru , Praneeth Yenugutala , Pawan Dixit At Netflix, Data and Machine Learning (ML) pipelines are widely used and have become central for the business, representing diverse use cases that go beyond recommendations, predictions and data transformations.

Java 211

Java Scalability Traffic Architecture 211

The Netflix TechBlog

APRIL 29, 2019

We use and contribute to many open-source Python packages, some of which are mentioned below. The configuration of these devices is controlled by several other systems including source of truth, application of configurations to devices, and back up. We also use Python to detect sensitive data using Lanius.

Open Source 280

Open Source Network Infrastructure Big Data 280

Brendan Gregg

OCTOBER 28, 2024

Our first version is available to customers in the Intel Tiber AI Cloud as a preview for the Intel Data Center GPU Max Series (previously called Ponte Vecchio). A daily tool for developers, with most of the visualization in the language of the developer : source code functions. This will become a daily tool for AI developers.

Programming 130

Programming Hardware Tuning C++ 130

Dynatrace

OCTOBER 4, 2024

Unlocked use cases Gaining insights into your pipelines and applying the power of Dynatrace analytics and automation unlocks numerous use cases: Make data-driven improvements: Invest in those software delivery capabilities that provide the most significant payoff. are data points that require special attention.

Software 278

Software Software Development Performance 278

The Netflix TechBlog

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. Therefore, dumps are needed to capture the full state of a source. Designed with High Availability in mind.

Database 206

Database Traffic Transportation Open Source 206

Dynatrace

DECEMBER 8, 2020

Open source has also become a fundamental building block of the entire cloud-native stack. While leveraging cloud-native platforms, open-source and third-party libraries accelerate time to value significantly, it also creates new challenges for application security. Is sensitive data affected?

Cloud 306

Cloud Open Source Internet Internet 306

Dynatrace

NOVEMBER 23, 2020

To ensure observability, the open source CNCF project OpenTelemetry aims at providing a standardized, vendor-neutral way of pre-instrumenting libraries and platforms and annotating UserLAnd code. Once the exporter is in place, Dynatrace starts ingesting, storing, and analyzing your data. Automatic baselining and alerting.

Metrics 200

Metrics Open Source Tuning Analytics 200

Dynatrace

NOVEMBER 27, 2020

After the seamless integration of your OpenTelemetry-instrumented custom metrics, Dynatrace takes care of storing and analyzing telemetry data at web scale, and providing an enterprise-grade single pane of glass. Collect usage statistics by pre-instrumenting an open-source framework. “We Stay tuned.

Metrics 214

Metrics Open Source Lambda Serverless 214

O'Reilly

NOVEMBER 19, 2024

Reasons for using RAG are clear: large language models (LLMs), which are effectively syntax engines, tend to “hallucinate” by inventing answers from pieces of their training data. Also, in place of expensive retraining or fine-tuning for an LLM, this approach allows for quick data updates at low cost. at Facebook—both from 2020.

Open Source 127

Open Source Entertainment Database Healthcare 127

Dynatrace

AUGUST 16, 2021

Microsoft’s GitHub is the largest open-source software community in the world with millions of open-source projects. Kubernetes deployments can be managed using a combination of both the open-source Azure Kubernetes set context Action and Kubernetes deployment GitHub Action. GitHub and GitHub Actions.

Software 246

Software Software Open Source Azure 246

Dynatrace

OCTOBER 6, 2022

OpenTelemetry is an exciting open source observability standard that provides a common collection of tools, APIs, and SDKs to help collect observability signals. You can ingest OpenTelemetry data in two ways: using Dynatrace OneAgent technology or using OpenTelemetry Protocol (OTLP), which relies exclusively on open source technology.

Open Source 244

Open Source Metrics Tuning Technology 244

Dynatrace

MARCH 15, 2024

As organizations strive for observability and data democratization, OpenTelemetry emerges as a key technology to create and transfer observability data. This collector, fully supported and maintained by Dynatrace, is entirely open source. A collector helps developers control their telemetry data streams for each signal.

Open Source 130

Open Source Best Practices Infrastructure Tuning 130

Dynatrace

MAY 17, 2023

OpenTelemetry , the open source observability tool, has become the go-to standard for instrumenting custom applications to collect observability telemetry data. However, this method limited us to instrumenting the code manually and collecting specific sets of data we defined upfront. What is OneAgent?

Metrics 243

Metrics Database Monitoring Network 243

Dynatrace

DECEMBER 15, 2020

OpenTelemetry metrics add domain specific data such as business KPIs and license relevant consumption details. Consequently, we’ve partnered with AWS to be part of future versions of the new AWS Distro for OpenTelemetry, which provides a new way to analyze domain specific data from your AWS deployments and AWS services in Dynatrace.

AWS 255

AWS Metrics Analytics Government 255

Dynatrace

FEBRUARY 8, 2021

Also, these modern, cloud-native architectures produce an immense volume, velocity, and variety of data. Every service and component exposes observability data (metrics, logs, and traces) that contains crucial information to drive digital businesses. Collecting data requires massive and ongoing configuration efforts.

Cloud 264

Cloud Azure Analytics Open Source 264

Dynatrace

NOVEMBER 17, 2020

We at Dynatrace understand the importance of contributing our expertise in enterprise-grade intelligent observability to the open source community. Armin: Dynatrace contributes distributed tracing knowledge, which was gained over years of experience via semantic conventions to ensure the highest quality of OpenTelemetry data.

Open Source 207

Open Source Software Engineering Government Java 207

Dynatrace

JUNE 27, 2023

Centralized log management for scalable ingestion into Grail As AWS S3 proves to be the preferred way of storing cloud logs, enterprise customers face mounting challenges in putting S3 log data to use. To date, some customers have used open source or community-backed components to forward logs from S3 to Dynatrace.

AWS 246

AWS Cloud Lambda Analytics 246

Dynatrace

JULY 22, 2024

OpenTelemetry is an open source observability project that encompasses a set of APIs, libraries, agents, and instrumentation standards. Using OpenTelemetry, developers can collect and process telemetry data from applications, services, and systems. There are three main types of telemetry data: Metrics.

Latency 264

Latency Best Practices Metrics Open Source 264