The Netflix TechBlog

OCTOBER 8, 2024

Rajiv Shringi Vinay Chella Kaidan Fullerton Oleksii Tkachuk Joey Lynch Introduction As Netflix continues to expand and diversify into various sectors like Video on Demand and Gaming , the ability to ingest and store vast amounts of temporal data — often reaching petabytes — with millisecond access latency has become increasingly vital.

Latency 236

Latency Storage Traffic Tuning 236

Dynatrace

APRIL 21, 2022

While applications are built using a variety of technologies and frameworks, there is one thing they usually have in common: the data they work with must be stored in databases. Now, Dynatrace has gone a step further and expanded its coverage and intelligent observability into the next layer: database infrastructure.

Database 244

Database DevOps Analytics Servers 244

Scalegrid

MARCH 4, 2019

Wondering which databases are trending in 2019? We asked hundreds of developers, engineers, software architects, dev teams, and IT leaders at DeveloperWeek to discover the current NoSQL vs. SQL usage, most popular databases, important metrics to track, and their most time-consuming database management tasks. SQL Databases.

Database 255

Database Metrics Systems Strategy 255

The Netflix TechBlog

AUGUST 1, 2022

Data Mesh?—?A A Data Movement and Processing Platform @ Netflix By Bo Lei , Guilherme Pires , James Shao , Kasturi Chatterjee , Sujay Jain , Vlad Sydorenko Background Realtime processing technologies (A.K.A After evaluating the options , the team has decided to create Data Mesh as our next generation data pipeline solution.

Processing 273

Processing Transportation Entertainment Tuning 273

Scalegrid

NOVEMBER 25, 2019

ScyllaDB is an open-source distributed NoSQL data store, reimplemented from the popular Apache Cassandra database. We’ve heard a lot about this rising database from the DBA community and our users, and decided to become a sponsor for this years Scylla Summit to learn more about the deployment trends from its users.

Big Data 187

Big Data Database Open Source Azure 187

Dynatrace

OCTOBER 29, 2024

In this blog post, we’ll walk you through a hands-on demo that showcases how the Distributed Tracing app transforms raw OpenTelemetry data into actionable insights Set up the Demo To run this demo yourself, you’ll need the following: A Dynatrace tenant. If you don’t have one, you can use a trial account.

Metrics 186

Metrics Tuning Monitoring Availability 186

The Netflix TechBlog

MARCH 7, 2023

These media focused machine learning algorithms as well as other teams generate a lot of data from the media files, which we described in our previous blog , are stored as annotations in Marken. There are many naive solutions possible for this problem for example: Write different runs in different databases. in a video file.

Media 269

Media Latency Architecture Database 269

The Netflix TechBlog

JULY 26, 2021

From the moment a Netflix film or series is pitched and long before it becomes available on Netflix, it goes through many phases. Operational Reporting is a reporting paradigm specialized in covering high-resolution, low-latency data sets, serving detailed day-to-day activities¹ and processes of a business domain.

Big Data 256

Big Data Government Analytics Processing 256

Dynatrace

FEBRUARY 28, 2024

In a digital-first world, site reliability engineers and IT data analysts face numerous challenges with data quality and reliability in their quest for cloud control. Increasingly, organizations seek to address these problems using AI techniques as part of their exploratory data analytics practices.

Analytics 222

Analytics Metrics Media Monitoring 222

Scalegrid

APRIL 28, 2020

If you’re hosting your databases in the cloud, choosing the right cloud service provider is a significant decision to make for your long-term hosting costs. Over the last few weeks, we have been inundated with requests from SMB customers looking to improve the ROI on their database hosting. MongoDB® Database. EC2 instances.

Azure 344

Azure AWS Database Latency 344

Dynatrace

OCTOBER 4, 2022

For IT infrastructure managers and site reliability engineers, or SREs , logs provide a treasure trove of data. But on their own, logs present just another data silo as IT professionals attempt to troubleshoot and remediate problems. Data volume explosion in multicloud environments poses log issues.

Analytics 233

Analytics Storage Infrastructure Metrics 233

The Netflix TechBlog

DECEMBER 3, 2022

by Jasmine Omeke , Obi-Ike Nwoke , Olek Gorajek Intro This post is for all data practitioners, who are interested in learning about bootstrapping, standardization and automation of batch data pipelines at Netflix. You may remember Dataflow from the post we wrote last year titled Data pipeline asset management with Dataflow.

Best Practices 360

Best Practices Code Testing Data Engineering 360

Scalegrid

DECEMBER 6, 2023

In the digital age, data management has transformed from locally hosted servers to cloud solutions. The choice of self-managed cloud databases vs DBaaS is a common debate among those who are looking for the best option that will cater to their particular needs.

Database 130

Database Cloud Hardware Storage 130

Dynatrace

JANUARY 31, 2024

I have ingested important custom data into Dynatrace, critical to running my applications and making accurate business decisions… but can I trust the accuracy and reliability?” ” Welcome to the world of data observability. At its core, data observability is about ensuring the availability, reliability, and quality of data.

DevOps 203

DevOps Analytics Airlines Metrics 203

Scalegrid

JANUARY 5, 2024

Enhanced data security, better data integrity, and efficient access to information. If you’re considering a database management system, understanding these benefits is crucial. Understanding Database Management Systems (DBMS) A Database Management System (DBMS) assists users in creating and managing databases.

Efficiency 147

Efficiency Storage Database Scalability 147

Dynatrace

NOVEMBER 1, 2021

As cloud applications have become the norm, the databases that power these applications are now typically run as managed services by cloud providers. Optimize database performance. Small changes in a database can have an enormous impact on overall application performance. One place to rule them all.

Azure 208

Azure Database Performance Monitoring 208

Dynatrace

AUGUST 20, 2024

Driven by that value, Dynatrace brings real-time observability, security, and business data into context and makes sense of it so our customers can get answers, automate, predict, and prevent. Executives are sitting on a goldmine of data, and they don’t know it.

Analytics 219

Analytics Latency Processing Systems 219

The Netflix TechBlog

MARCH 10, 2023

This platform has evolved from supporting studio applications to data science applications, machine-learning applications to discover the assets metadata, and build various data facts. Hence we built the data pipeline that can be used to extract the existing assets metadata and process it specifically to each new use case.

Media 241

Media Traffic Processing Design 241

Dynatrace

DECEMBER 9, 2020

If you’re running SAP, you’re likely already familiar with the HANA relational database management system. HANA maintains all the business and analytics data that your business runs on. Today we’re proud to announce that we’ve extended our SAP monitoring capabilities to support SAP HANA databases.

Infrastructure 213

Infrastructure Database Monitoring Metrics 213

DZone

AUGUST 21, 2021

This article describes 3 different tricks that I used in dealing with big data sets (order of 10 million records) and that proved to enhance performance dramatically. Trick 1: CLOB Instead of Result Set.

Big Data 246

Big Data Performance Tuning Mobile 246

Scalegrid

JANUARY 19, 2024

When a MongoDB rollback happens, it can cause trouble to your data integrity and system consistency. Understanding how to address a rollback is critical for minimizing potential data loss and maintaining seamless operations. The consequences of rollbacks are significant and should not be underestimated.

Database 130

Database Network Servers Monitoring 130

Dynatrace

MAY 1, 2023

IT operations analytics is the process of unifying, storing, and contextually analyzing operational data to understand the health of applications, infrastructure, and environments and streamline everyday operations. ITOA collects operational data to identify patterns and anomalies for faster incident management and near-real-time insights.

Analytics 200

Analytics Artificial Intelligence Big Data Open Source 200

Scalegrid

AUGUST 22, 2019

In the final post of this series, we will review the last solution, Patroni by Zalando, and compare all three at the end so you can determine which high availability framework is best for your PostgreSQL hosting deployment. Managing High Availability in PostgreSQL – Part I: PostgreSQL Automatic Failover. Patroni for PostgreSQL.

Availability 277

Availability Servers Network Testing 277

Dynatrace

NOVEMBER 3, 2023

already address SNMP, WMI, SQL databases, and Prometheus technologies, serving the monitoring needs of hundreds of Dynatrace customers. While Python code can address most data acquisition and ingest requirements, it comes at the cost of complexity in implementation and use-case modeling. available, and more are in the pipeline.

Technology 255

Technology Technology Scalability Availability 255

Percona

JULY 7, 2023

With the average cost of unplanned downtime running from $300,000 to $500,000 per hour , businesses are increasingly using high availability (HA) technologies to maximize application uptime. Unfortunately, using certain open source database software as part of an HA architecture can present significant challenges.

Availability 87

Availability Open Source Architecture Database 87

The Netflix TechBlog

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events.

Database 217

Database Traffic Transportation Open Source 217

SQL Shack

SEPTEMBER 16, 2020

In the previous article, Transparent Data Encryption for SQL Server Always On Availability Groups, we discussed enabling TDE for the existing database in AG. In this article, we will explore options for a compressed backup of a TDE database. It uses the […].

Database 104

Database Availability Servers 104

Percona

DECEMBER 21, 2023

The integration of those projects, plus the years of Percona expertise in the database space, makes PMM one of the best database monitoring solutions on the market. Being software composed of different, multiple technologies can add complexity to a well-known concept: High Availability (HA). With this, the easy part is done.

Availability 105

Availability Monitoring Open Source Traffic 105

Dynatrace

MAY 17, 2023

OpenTelemetry , the open source observability tool, has become the go-to standard for instrumenting custom applications to collect observability telemetry data. For this third and final part of our series, we saved the best for last: How you can enhance telemetry data even more and with less effort on your end with Dynatrace OneAgent.

Metrics 182

Metrics Monitoring Database Network 182

Dynatrace

FEBRUARY 16, 2023

How do you get more value from petabytes of exponentially exploding, increasingly heterogeneous data? The short answer: The three pillars of observability—logs, metrics, and traces—converging on a data lakehouse. To solve this problem, Dynatrace launched Grail, its causational data lakehouse , in 2022.

Analytics 198

Analytics Innovation Metrics Database 198

The Netflix TechBlog

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events.

Database 203

Database Traffic Transportation Open Source 203

Percona

JUNE 12, 2023

When it comes to access to their applications, users demand instant, reliable, and secure interactions — and that means databases must be highly available. With database high availability (HA), services are largely uninterrupted, and end users are largely satisfied. They’re proven and ready-to-go.

Architecture 101

Architecture Availability Open Source Healthcare 101

Scalegrid

JUNE 4, 2020

ScaleGrid is a fully managed DBaaS that supports MySQL, PostgreSQL and Redis™, along with additional support for MongoDB® database and Greenplum® database. Along with many popular cloud providers, DigitalOcean also provides a Managed Databases service. So, which database service is right for your application? Single Node.

Database 230

Database Latency Benchmarking Performance 230

Percona

OCTOBER 10, 2023

Databases are different from a lot of software. This is not a general rule, but as databases are responsible for a core layer of any IT system – data storage and processing — they require reliability. For one, they often favor stability over innovation. Why choose Percona Server for MongoDB?

Availability 105

Availability Servers Database Open Source 105

Percona

OCTOBER 17, 2023

This blog post discusses using the CLONE INSTANCE command with the safety option DATA DIRECTORY when you do not have enough disk space to store two datasets. However, when you clone a replica that already has a huge dataset, you may not have enough space for two datasets: one from the source server and data present on the replica.

Open Source 103

Open Source Servers Database Strategy 103

SQL Shack

AUGUST 28, 2020

In this 15th article of SQL Server Always On Availability Groups series, we will cover Transparent Data Encryption (TDE) for AG databases. Introduction In the previous articles of SQL Server Always On series, we explored the following topics so far.

Availability 94

Availability Servers Virtualization Database 94

Scalegrid

JULY 29, 2019

MySQL is a free open source relational database management system that is leveraged across a majority of WordPress sites, and allows you to query your data such as posts, pages, images, user profiles, and more. We help you configure your MySQL deployment to optimize your performance based on the size of your databases.

Database 166

Database Cloud Website Azure 166