The Netflix TechBlog

OCTOBER 19, 2020

In our previous blog post we introduced Edgar, our troubleshooting tool for streaming sessions. Troubleshooting a session in Edgar When we started building Edgar four years ago, there were very few open-source distributed tracing systems that satisfied our needs. Stream Processing: to sample or not to sample trace data?

Infrastructure 238

Infrastructure Transportation Storage Open Source 238

Percona

MARCH 7, 2023

One approach is to separate compute and storage to allow for independent scaling. It’s an open source alternative to AWS Aurora Postgres that utilizes a serverless architecture. It’s an open source alternative to AWS Aurora Postgres that utilizes a serverless architecture. So, what is Neon?

Serverless 112

Serverless Storage Open Source Architecture 112

Dynatrace

DECEMBER 18, 2023

This challenge has given rise to the discipline of observability engineering, which concentrates on the details of telemetry data to fine-tune observability use cases. To get a more granular look into telemetry data, many analysts rely on custom metrics using Prometheus. What is Prometheus?

Metrics 170

Metrics Engineering Energy Tuning 170

Percona

MARCH 21, 2023

In this blog, I’ll discuss the use case for replication. We want to improve our ability to replicate your data and limit replication to row-based events securely, wherein we do not have control over the source(s). PRIVILEGE CHECKS USER is helpful in multi-source replication to carefully gather data from various sources.

Storage 88

Storage Open Source Database Engineering 88

Dynatrace

SEPTEMBER 29, 2021

Prometheus is an open-source monitoring and alerting toolkit for services and applications that run in containers. It offers a flexible multidimensional data model that’s based on key-value pairs and a potent query language (PromQL). Dynatrace news. What is Prometheus and how does it work?

Technology 200

Technology Technology Monitoring AWS 200

Dynatrace

FEBRUARY 10, 2023

Data proliferation—as well as a growing need for data analysis—has accelerated. According to recent Dynatrace data, 59% of CIOs say the increasing complexity of their technology stack could soon overload their teams without a more automated approach to IT operations. Digital transformation shows no signs of slowing down.

Efficiency 266

Efficiency Performance Analytics DevOps 266

Dynatrace

DECEMBER 15, 2022

In this blog, we share three log ingestion strategies from the field that demonstrate how building up efficient log collection can be environment-agnostic by using our generic log ingestion application programming interface (API). Yet observability into syslog data on Dynatrace would help you monitor and troubleshoot infrastructure.

Strategy 172

Strategy AWS Open Source Transportation 172

Scalegrid

NOVEMBER 12, 2019

There are many things I love about it – PL/ PG SQL, smart defaults, replication (that actually works out of the box), and an active and vibrant open source community. In this blog post, we will detail some of these operational challenges with PostgreSQL. Feature-wise, it is up there with the best, if not the best.

Database 184

Database Open Source Servers Storage 184

Percona

DECEMBER 20, 2018

Let’s look at some of the most popular Percona Database Performance Blog posts in 2018. With the Percona Database Performance Blog, Percona staff and leadership work hard to provide the open source community with insights, technical support, predictions and metrics around multiple open source database software technologies.

Database 40

Database Tuning Performance AWS 40

Dynatrace

DECEMBER 16, 2021

The vulnerability was first reported to the Apache Foundation (an open-source project) on November 24 by security researcher Chen Zhaojun of Alibaba, China’s largest e-commerce company, after an attack was documented on December 9 and affected servers of the game Minecraft. When was the vulnerability in the Log4j 2 library discovered?

Internet 256

Internet Internet Games Java 256

Dynatrace

NOVEMBER 17, 2020

With these release candidate APIs available, instrumentation for web frameworks, storage clients, and much more can be built. We at Dynatrace understand the importance of contributing our expertise in enterprise-grade intelligent observability to the open source community. Dynatrace fully embraces OpenTelemetry.

Open Source 151

Open Source Software Engineering Government Java 151

Percona

OCTOBER 13, 2023

A common practice among DBAs and developers is to copy table data and.frm files from the data dictionary. In the case of InnoDB tablespaces, this information is incorporated into the tablespace itself, creating a fusion of metadata and data primarily to enhance performance. In MySQL 8.0, ibd files), general tablespace files (.ibd

Storage 95

Storage Database Engineering Open Source 95

Dynatrace

MAY 26, 2021

From May 17 to May 18, 2021, the Open-Source Engineering team at Dynatrace attended the virtual observability conference, o11yfest. This blog dives into what we learned by listening to experts in the field and the key takeaways we gathered from the talks. Trace-based sampling can help you save storage costs.

AWS 202

AWS Strategy Storage Metrics 202

Percona

JULY 13, 2023

With the rise of globalization, the need to store and process multilingual data has become essential. In this blog post, we will explore utf8mb4 and its advantages in MySQL 8.0, The first two rows contain simple text data, while the third row contains an emoji. version as a game-changer. backed by practical examples.

Database 93

Database Games Open Source Engineering 93

The Morning Paper

NOVEMBER 5, 2019

File systems unfit as distributed storage backends: lessons from 10 years of Ceph evolution Aghayev et al., In this case, the assumption that a distributed storage backend should clearly be layered on top of a local file system. What is a distributed storage backend? SOSP’19. This is not surprising in hindsight.

Storage 64

Storage Systems Hardware Efficiency 64

Percona

JANUARY 24, 2023

Our Operators provide built-in backup and restore capabilities, but some users are still looking for old-fashioned ways, like storage-level snapshots (i.e., Both your storage and Container Storage Interface (CSI) must support snapshots. Example for mongod-data-my-cluster-name-cfg-0 : apiVersion: snapshot.storage.k8s.io/v1

Database 67

Database Storage Open Source AWS 67

Percona

JUNE 22, 2023

A monitoring tool like Percona Monitoring and Management (PMM) is a popular choice among open source options for effectively monitoring MySQL performance. In this blog, we will explore various MySQL KPIs that are basic and essential to track using monitoring tools like PMM.

Performance 105

Performance Monitoring Traffic Database 105

Scalegrid

APRIL 28, 2020

Since database hosting is more dependent on memory (RAM) than storage, we are going to compare various instance sizes ranging from just 1GB of RAM up to 64GB of RAM so you can see how costs vary across different application workloads. ScaleGrid provides an Import wizard to migrate data from one cluster to another. EC2 instances.

Azure 344

Azure AWS Database Latency 344

Percona

JUNE 4, 2023

This blog post was originally published in November 2017 and was updated in June 2023. In this blog, we’ll provide a comparison between MariaDB vs. MySQL (including Percona Server for MySQL ). It continues to be developed and maintained by the open source community and remains free to use under the GNU General Public License.

Open Source 52

Open Source Servers Storage Scalability 52

Dynatrace

NOVEMBER 22, 2021

These resources generate vast amounts of data in various locations, including containers, which can be virtual and ephemeral, thus more difficult to monitor. Make full use of CloudWatch data. As part of your monitoring plan, use CloudWatch to collect monitoring data from all parts of your AWS environment so you can debug any failures.

Best Practices 201

Best Practices AWS Monitoring Serverless 201

Percona

JANUARY 19, 2023

16 years ago, our founder Peter Zaitsev covered this topic and some of the points described there are still valid, and we will cover more on this blog. With disks being faster nowadays and CPU and memory resources being cheaper, we could easily say MySQL can handle TBs of data with good performance.

Open Source 89

Open Source Storage Database Big Data 89

Dynatrace

MAY 26, 2021

From May 17 to May 18, 2021, the Open-Source Engineering team at Dynatrace attended the virtual observability conference, o11yfest. This blog dives into what we learned by listening to experts in the field and the key takeaways we gathered from the talks. Trace-based sampling can help you save storage costs.

AWS 147

AWS Strategy Storage Metrics 147

Dynatrace

AUGUST 5, 2022

Consumers store messages in a queue — usually in a buffer or on a storage medium — until they can process and delete them. Additionally, a message queue can smooth out spiky workloads by enabling the producers and consumers to work at a consistent pace without losing data. A producer creates the message, and a consumer processes it.

Monitoring 190

Monitoring Serverless Programming Speed 190

Dynatrace

AUGUST 5, 2022

Consumers store messages in a queue — usually in a buffer or on a storage medium — until they can process and delete them. Additionally, a message queue can smooth out spiky workloads by enabling the producers and consumers to work at a consistent pace without losing data. A producer creates the message, and a consumer processes it.

Monitoring 189

Monitoring Serverless Programming Speed 189

Percona

MARCH 10, 2023

In this blog post, we will discuss the capped collection of MongoDB. This means once allocated files are full, data at the beginning of the first file is overwritten. Capped collection is useful in storing the log information as it keeps the data ordered by the events.

Open Source 104

Open Source Storage Speed Servers 104

Dynatrace

NOVEMBER 23, 2020

Nevertheless, there are related components and processes, for example, virtualization infrastructure and storage systems (see image below), that can lead to problems in your Kubernetes infrastructure. Configuring storage in Kubernetes is more complex than using a file system on your host. Logs can also be used to represent event data.

Virtualization 158

Virtualization Infrastructure Monitoring Cloud 158

Percona

FEBRUARY 10, 2023

Percona XtraBackup is an open source hot backup utility for MySQL-based servers. To take consistent and hot backup, it uses various locking methods, especially for non-transactional storage engine tables. allows acquiring an instance-level backup lock via the LOCK INSTANCE FOR BACKUP statement. So for Percona Server for MySQL 5.7

Storage 102

Storage Engineering Servers Open Source 102

Percona

JANUARY 20, 2023

When planning a database deployment, one of the most challenging factors to consider is the amount of space we need to dedicate to data on disk. When using cloud storage like EBS or similar, it is normally easy(er) to extend volumes, which gives us the luxury to plan the space to allocate for data with a good grade of relaxation.

AWS 93

AWS Storage Monitoring Cloud 93

Percona

AUGUST 1, 2023

In this blog, we’ll explore the process of altering VARCHAR columns online, delving into insights gained while expanding the size of such columns. To kick start our journey, let’s consider a table definition that requires the expansion of a VARCHAR column named “_varchar” to accommodate more data.

Storage 81

Storage Database Open Source Engineering 81

Percona

SEPTEMBER 12, 2023

this enhancement ensures that the maximum auto-increment counter value persists between server restarts, providing enhanced consistency and reliability in data management. MySQL 8’s solution MySQL 8 addresses the auto-increment counter loss issue in the InnoDB storage engine upon server restart. Compared to MySQL 5.7,

Servers 112

Servers Storage Database Open Source 112

HammerDB

APRIL 19, 2023

In this blog, we aim to call out some key considerations when trying to assess MySQL performance for your application. As database performance is heavily influenced by the performance of storage, network, memory, and processors, we must understand the upper limit of these key components. For storage, FIO is generally used.

Performance 54

Performance Benchmarking Cache Storage 54

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on.

Performance 140

Performance Latency Hardware Storage 140

Percona

JUNE 29, 2023

If you are not passing this parameter explicitly with the createIndex command, it will use the default settings on a replica set or sharded cluster and start building the index simultaneously across all data-bearing voting replica set members. “Majority” – A simple majority of data-bearing replica set members.

Servers 81

Servers C++ Storage Best Practices 81

Percona

AUGUST 18, 2023

This blog will explore the hurdles encountered during the upgrade process and the innovative solution that saved the day. I tried the in-place upgrade on my test VM for my own curiosity and got some redo log format errors/Data Dictionary errors. The logical backup/restore approach — but how to keep data in sync?

Open Source 67

Open Source Database Storage Engineering 67

Percona

AUGUST 7, 2023

In InnoDB, the undo log and the redo log are two indispensable components that play a vital role in maintaining data integrity and ensuring transactional consistency. InnoDB Undo Log The undo log, also known as the rollback segment, is a crucial part of the InnoDB storage engine.

Database 96

Database Tuning Storage Open Source 96

The Netflix TechBlog

JULY 30, 2019

and beyond By Anoop Panicker and Kishore Banala Conductor is a workflow orchestration engine developed and open-sourced by Netflix. In this blog, we would like to present the latest updates to Conductor, address some of the frequently asked questions and thank the community for their contributions.

Lambda 191

Lambda Media Open Source Metrics 191

Dynatrace

SEPTEMBER 17, 2019

Kubernetes (k8s) provides basic monitoring through the Kubernetes API and you can find instructions like Top 9 Open Source Tools for Monitoring Kubernetes as a “do it yourself guide”. Some vendors have just bolted on individual capabilities which often leads to six data silos. PostgreSQL & Elastic for data storage.

AWS 127

AWS Monitoring Ecommerce Lambda 127