The Netflix TechBlog

DECEMBER 17, 2024

Metric definitions are often scattered across various databases, documentation sites, and code repositories, making it difficult for analysts and data scientists to find reliable information quickly. DJ stands out as an open source solution that is actively developed and stress-tested at Netflix.

Analytics 212

Analytics Engineering Entertainment Metrics 212

The Netflix TechBlog

DECEMBER 3, 2019

by David Berg , Ravi Kiran Chirravuri , Romain Cledat , Savin Goyal , Ferras Hamad , Ville Tuulos tl;dr Metaflow is now open-source! Netflix applies data science to hundreds of use cases across the company, including optimizing content delivery and video encoding. How could we improve the quality of life for data scientists?

Open Source 135

Open Source AWS Infrastructure Energy 135

Scalegrid

OCTOBER 18, 2024

Structured Query Language (SQL) is a simple declarative programming language utilized by various technology and business professionals to extract and transform data. Visualization & Reporting: Can the tool generate reports or visual representations like ER diagrams, data charts, or query execution plans?

Open Source 147

Open Source Database Cloud Operating System 147

High Scalability

SEPTEMBER 3, 2019

Redis , short for Remote Dictionary Server, is a BSD-licensed, open-source in-memory key-value data structure store written in C language by Salvatore Sanfillipo and was first released on May 10, 2009. Instead, Redis stores data in data structures which makes it very flexible to use. Data Structures in Redis.

Open Source 55

Open Source Cache C++ Database 55

High Scalability

JUNE 27, 2019

Ready to transition from a commercial database to open source, and want to know which databases are most popular in 2019? Wondering whether an on-premise vs. public cloud vs. hybrid cloud infrastructure is best for your database strategy?

Open Source 196

Open Source Database Cloud Strategy 196

Dynatrace

MAY 23, 2024

The jobs executing such workloads are usually required to operate indefinitely on unbounded streams of continuous data and exhibit heterogeneous modes of failure as they run over long periods. Failures are injected using Chaos Mesh , an open source chaos engineering platform integrated with Kubernetes deployment.

Engineering 245

Engineering Tuning Latency Open Source 245

Percona

APRIL 28, 2023

We are a company of open source proponents. We’re also dedicated and active participants in the global open source community. Both open source and proprietary options have advantages. With open source database software , anyone in the general public can access the source code, read it, and modify it.

Open Source 135

Open Source Database Software Software 135

Scalegrid

FEBRUARY 6, 2025

RabbitMQ is designed for flexible routing and message reliability, while Kafka handles high-throughput event streaming and real-time data processing. Both serve distinct purposes, from managing message queues to ingesting large data volumes. What is RabbitMQ? What is Apache Kafka?

Latency 147

Latency Analytics Architecture Storage 147

Dynatrace

MAY 1, 2023

IT operations analytics is the process of unifying, storing, and contextually analyzing operational data to understand the health of applications, infrastructure, and environments and streamline everyday operations. ITOA collects operational data to identify patterns and anomalies for faster incident management and near-real-time insights.

Analytics 246

Analytics Artificial Intelligence Big Data Open Source 246

Dynatrace

OCTOBER 4, 2022

Some time ago, at a restaurant near Boston, three Dynatrace colleagues dined and discussed the growing data challenge for enterprises. At its core, this challenge involves a rapid increase in the amount—and complexity—of data collected within a company. Work with different and independent data types. Thus, Grail was born.

Artificial Intelligence 290

Artificial Intelligence Analytics Storage Architecture 290

Dynatrace

JANUARY 31, 2024

Organizations choose data-driven approaches to maximize the value of their data, achieve better business outcomes, and realize cost savings by improving their products, services, and processes. However, there are many obstacles and limitations along the way to becoming a data-driven organization. Understanding the context.

Analytics 272

Analytics Processing Transportation Storage 272

Dynatrace

JANUARY 16, 2023

The study analyzes factual Kubernetes production data from thousands of organizations worldwide that are using the Dynatrace Software Intelligence Platform to keep their Kubernetes clusters secure, healthy, and high performing. Open-source software drives a vibrant Kubernetes ecosystem. Java, Go, and Node.js

Open Source 358

Open Source Java Operating System Programming 358

Percona

MARCH 30, 2023

The use of open source databases has increased steadily in recent years. Past trepidation — about perceived vulnerabilities and performance issues — has faded as decision makers realize what an “open source database” really is and what it offers. What is an open source database?

Open Source 107

Open Source Database Storage Scalability 107

DZone

FEBRUARY 15, 2023

In this article, I’m going to demonstrate how you can migrate a comprehensive web application from MySQL to YugabyteDB using the open-source data migration engine YugabyteDB Voyager. This helps improve availability, scalability, and performance.

Open Source 298

Open Source Scalability Database Servers 298

The Netflix TechBlog

MARCH 4, 2025

Store the data in an optimized, highly distributed datastore. Additionally, some collectors will instead poll our kafka queue for impressions data. This data is processed from a real-time impressions stream into a Kafka queue, which our title health system regularly polls. Track real-time title impressions from the NetflixUI.

Traffic 180

Traffic Strategy Entertainment Innovation 180

The Netflix TechBlog

MARCH 5, 2019

While our engineering teams have and continue to build solutions to lighten this cognitive load (better guardrails, improved tooling, …), data and its derived products are critical elements to understanding, optimizing and abstracting our infrastructure. In the Reliability space, our data teams focus on two main approaches.

Infrastructure 185

Infrastructure Cloud Scalability AWS 185

Dynatrace

OCTOBER 1, 2021

In IT and cloud computing, observability is the ability to measure a system’s current state based on the data it generates, such as logs, metrics, and traces. Organizations usually implement observability using a combination of instrumentation methods including open-source instrumentation tools, such as OpenTelemetry.

Metrics 363

Metrics Open Source Monitoring Cloud 363

Scalegrid

JULY 13, 2020

The unstoppable rise of open source databases. One database in particular is causing a huge dent in Oracle’s market share – open source PostgreSQL. See how open source PostgreSQL Community version costs compare to Oracle Standard Edition and Oracle Enterprise Edition. What’s causing this massive shift?

Open Source 244

Open Source Tuning C++ Database 244

Percona

OCTOBER 18, 2023

Migrating a proprietary database to open source is a major decision that can significantly affect your organization. Advantages of migrating to open source For many reasons mentioned earlier, organizations are increasingly shifting towards open source databases for their data management needs.

Open Source 111

Open Source Database Hardware Strategy 111

Dynatrace

SEPTEMBER 29, 2021

This opens the door to auto-scalable applications, which effortlessly matches the demands of rapidly growing and varying user traffic. Docker Engine is built on top containerd , the leading open-source container runtime, a project of the Cloud Native Computing Foundation (DNCF). What is Docker? What is Kubernetes?

Open Source 334

Open Source DevOps Traffic Cloud 334

The Netflix TechBlog

JUNE 20, 2024

A summary of sessions at the first Data Engineering Open Forum at Netflix on April 18th, 2024 The Data Engineering Open Forum at Netflix on April 18th, 2024. At Netflix, we aspire to entertain the world, and our data engineering teams play a crucial role in this mission by enabling data-driven decision-making at scale.

Data Engineering 206

Data Engineering Engineering Entertainment Software Engineering 206

Percona

OCTOBER 20, 2023

Many organizations are turning to open source solutions to streamline their operations and reduce costs. Open source migration can be a game-changer, offering flexibility, scalability, and cost-effectiveness. Common pitfalls when migrating to open source Lack of proper planning Proper is the operative word here.

Open Source 111

Open Source Database Best Practices Strategy 111

The Netflix TechBlog

OCTOBER 18, 2022

by Jun He , Akash Dwivedi , Natallia Dzenisenka , Snehal Chennuru , Praneeth Yenugutala , Pawan Dixit At Netflix, Data and Machine Learning (ML) pipelines are widely used and have become central for the business, representing diverse use cases that go beyond recommendations, predictions and data transformations.

Java 211

Java Scalability Traffic Architecture 211

Dynatrace

MARCH 11, 2025

With our latest enhancements, were transforming the way you work with trace data. For deeper exploration, our Distributed Tracing app empowers you to analyze raw trace data and uncover insights, whether troubleshooting errors, optimizing performance, or discovering the unknown unknowns. But why stop there?

Games 165

Games Analytics Innovation Metrics 165

High Scalability

JANUARY 11, 2019

can be an advantage when you’re looking for data science jobs, but unless you really want to 1) do research or 2) be a professor there’s no really no benefit to getting a Ph.D. Consume Explain the Cloud Like I'm 10 (35 nearly 5 star reviews). I think that having a Ph.D. Strong technologies adapt the world to themselves.

Internet 33

Internet Internet Scalability Open Source 33

DZone

MARCH 7, 2023

Apache Spark is a powerful open-source distributed computing framework that provides a variety of APIs to support big data processing. In addition, pySpark applications can be tuned to optimize performance and achieve better execution time, scalability, and resource utilization.

Big Data 173

Big Data Code Tuning Open Source 173

InfoQ

NOVEMBER 18, 2024

Uber uses Presto, an open-source distributed SQL query engine, to provide analytics across several data sources, including Apache Hive, Apache Pinot, MySQL, and Apache Kafka. To improve its performance, Uber engineers explored the advantages of dealing with quick queries, a.k.a.

Analytics 80

Analytics Open Source Engineering Performance 80

DZone

OCTOBER 1, 2023

Elasticsearch is an open-source search engine and analytics store used by a variety of applications from search in e-commerce stores, to internal log management tools using the ELK stack (short for “Elasticsearch, Logstash, Kibana”).

Open Source 257

Open Source Tuning Analytics Scalability 257

Dynatrace

DECEMBER 8, 2020

Open source has also become a fundamental building block of the entire cloud-native stack. While leveraging cloud-native platforms, open-source and third-party libraries accelerate time to value significantly, it also creates new challenges for application security.

Cloud 306

Cloud Open Source Internet Internet 306

Dynatrace

JUNE 9, 2021

According to the 2019 Verizon Data Breach Investigations Report, web application attacks were the number one type of attack. Data from Forrester Research provides more detail, finding that 39% of all attacks were designed to exploit vulnerabilities in web applications. And open-source software is rife with vulnerabilities.

Open Source 261

Open Source Entertainment Tuning Internet 261

The Netflix TechBlog

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. Therefore, dumps are needed to capture the full state of a source. Designed with High Availability in mind.

Database 221

Database Traffic Transportation Open Source 221

Dynatrace

OCTOBER 7, 2020

At the same time, you can now simply flip a switch to begin ingesting observability data from these tools into the Dynatrace platform, all while retaining your investment and increasing the value you get from Dynatrace. Open-source metric sources automatically map to our Smartscape model for AI analytics.

Open Source 264

Open Source Metrics Analytics Tuning 264

Percona

JUNE 2, 2023

While not the first open source content management system (CMS), WordPress caught on like nothing before and helped spread open source to millions. It was simple, easy to deploy, and easy to use, and WordPress had the added benefit of being open source. MySQL was founded in 1995 and went open source in 2000.

Open Source 114

Open Source Traffic Tuning Database 114

High Scalability

SEPTEMBER 28, 2018

2 billion : Pokémon GO revenue since launch; 10 : say happy birthday to StackOverflow; $148 million : Uber data breach fine; 75% : streaming music industry revenue in the US; 5.2 Then please recommend my well reviewed book: Explain the Cloud Like I'm 10. They'll love it and you'll be their hero forever. $2 seconds with the system.

Internet 35

Internet Internet Scalability Blockchain 35

The Netflix TechBlog

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. Therefore, dumps are needed to capture the full state of a source. Designed with High Availability in mind.

Database 206

Database Traffic Transportation Open Source 206

Dynatrace

JULY 25, 2024

After a decade of helping companies manage container orchestration, Kubernetes, the open source container platform, has established itself as a mature enterprise technology. The average deployment now spans 20 clusters running 10 or more software elements across clouds and data centers. Immediate entry. Automated notifications.

Strategy 264

Strategy Engineering Open Source Java 264

Dynatrace

JULY 29, 2021

The complexity of such deployments has accelerated with the adoption of emerging, open-source technologies that generate telemetry data, which is exploding in terms of volume, speed, and cardinality. How can we optimize for performance and scalability? Contextualization is one of the biggest challenges of observability.

Analytics 246

Analytics Open Source Serverless Architecture 246