The Netflix TechBlog

NOVEMBER 22, 2019

December 2 1pm-2pm CMP 326-R Capacity Management Made Easy with Amazon EC2 Auto Scaling Vadim Filanovsky , Senior Performance Engineer & Anoop Kapoor, AWS Abstract :Amazon EC2 Auto Scaling offers a hands-free capacity management experience to help customers maintain a healthy fleet, improve application availability, and reduce costs.

AWS 38

AWS Entertainment Open Source Benchmarking 38

Dynatrace

NOVEMBER 11, 2020

Dynatrace OneAgent deployment and life-cycle management are already widely considered to be industry benchmarks for reliability and efficiency. Easier rollout thanks to log storage best practices. Easier rollout thanks to log storage best practices. Dynatrace news. Advanced customization of OneAgent deployments made easy.

Best Practices 246

Best Practices Storage Java Benchmarking 246

Percona

JUNE 22, 2023

To make data count and to ensure cloud computing is unabated, companies and organizations must have highly available databases. This guide provides an overview of what high availability means, the components involved, how to measure high availability, and how to achieve it. How does high availability work?

Availability 132

Availability Database Open Source Hardware 132

The Netflix TechBlog

MARCH 14, 2023

We must quickly surface the most stand-out highlights from the titles available on our service in the form of images and videos in the member experience. Due to the bespoke nature of the implementation, we lacked catalog wide searches for all available ML sources. First, we must provide the content that will bring them joy.

Media 299

Media Innovation Energy Architecture 299

Percona

DECEMBER 11, 2023

A Dedicated Log Volume (DLV) is a specialized storage volume designed to house database transaction logs separately from the volume containing the database tables. DLVs are particularly advantageous for databases with large allocated storage, high I/O per second (IOPS) requirements, or latency-sensitive workloads.

AWS 117

AWS Benchmarking Performance Traffic 117

Scalegrid

JULY 13, 2020

Compare PostgreSQL vs. Oracle functionality across available tools, capabilities and services. Not available. Not available. Not available. New Oracle versions are generally available every 2-4 years. Data encryption can be achieved with advanced security plugins like pgcrypto which are available for free.

Open Source 244

Open Source Tuning C++ Database 244

Percona

MARCH 23, 2023

Storage The type of storage and disk used for database servers can have a significant impact on performance and reliability. Benchmark before you decide. Cloud Different cloud providers offer a range of instance types and sizes, each with varying amounts of CPU, memory, and storage. Transparent huge pages (THP) disabled.

Performance 144

Performance Hardware Tuning Storage 144

Percona

AUGUST 22, 2023

With so much at stake, database high availability and fault tolerance have become must-have items, but many companies just aren’t certain which one they must have. This blog article will examine shared attributes of high availability (HA) and fault tolerance (FT). What does high availability mean?

Availability 98

Availability Hardware Open Source Database 98

Percona

NOVEMBER 3, 2023

Rather than listing the concepts, function calls, etc, available in Citus, which frankly is a bit boring, I’m going to explore scaling out a database system starting with a single host. And now, execute the benchmark: -- execute the following on the coordinator node pgbench -c 20 -j 3 -T 60 -P 3 pgbench The results are not pretty.

Database 114

Database Benchmarking Latency C++ 114

Percona

JUNE 22, 2023

Database uptime and availability Monitoring database uptime and availability is crucial as it directly impacts the availability of critical data and the performance of applications or websites that rely on the MySQL database. This KPI is also directly related to Query Performance and helps improve it.

Performance 136

Performance Monitoring Traffic Database 136

Scalegrid

MARCH 28, 2024

This article will explore how they handle data storage and scalability, perform in different scenarios, and, most importantly, how these factors influence your choice. It uses a hash table to manage these pairs, divided into fixed-size buckets with linked lists for key-value storage.

Cache 130

Cache Storage Scalability Architecture 130

The Netflix TechBlog

NOVEMBER 22, 2019

December 2 1pm-2pm CMP 326-R Capacity Management Made Easy with Amazon EC2 Auto Scaling Vadim Filanovsky , Senior Performance Engineer & Anoop Kapoor, AWS Abstract :Amazon EC2 Auto Scaling offers a hands-free capacity management experience to help customers maintain a healthy fleet, improve application availability, and reduce costs.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

December 2 1pm-2pm CMP 326-R Capacity Management Made Easy with Amazon EC2 Auto Scaling Vadim Filanovsky , Senior Performance Engineer & Anoop Kapoor, AWS Abstract :Amazon EC2 Auto Scaling offers a hands-free capacity management experience to help customers maintain a healthy fleet, improve application availability, and reduce costs.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

MAY 21, 2019

Netflix engineers run a series of tests and benchmarks to validate the device across multiple dimensions including compatibility of the device with the Netflix SDK, device performance, audio-video playback quality, license handling, encryption and security. The library is available in the artifactory repository for easy installation.

Testing 164

Testing AWS Lambda Network 164

SQL Performance

NOVEMBER 18, 2019

IT professionals are familiar with scoping the size of VMs with regards to vCPU, memory, and storage capacity. Storage optimized – High disk throughput and IO. and the overall size will determine the amount of temporary storage available. Premium storage support. VM Types and Sizes. VM Image Options. Generation.

Azure 76

Azure Benchmarking Storage Virtualization 76

Percona

APRIL 7, 2023

To illustrate this, I ran the Sysbench-TPCC synthetic benchmark against two different GCP instances running a freshly installed Percona Server for MySQL version 8.0.31 MySQL comes pre-configured to be conservative instead of making the most of the resources available in the server. MySQL (B) 2517529 2610323 389048 5516900 194140 11523.48

Tuning 145

Tuning Cache Servers Benchmarking 145

Scalegrid

JANUARY 12, 2024

All rely heavily on utilizing allocated portions from existing pools made available through specific providers as part of their service offerings. There are numerous choices available for deploying these workloads on various cloud provider platforms that offer unique capabilities.

Cloud 130

Cloud Virtualization Storage Efficiency 130

The Morning Paper

NOVEMBER 8, 2020

USENIX is a nonprofit organisation committed to making content and research freely available – both conference proceedings and the recorded presentations of their events. They needed a table store to power core control plane services, which meant strong guarantees on durability, consistency, and availability.

Virtualization 126

Virtualization Latency Storage Systems 126

Percona

MARCH 17, 2023

PMM2 uses VictoriaMetrics (VM) as its metrics storage engine. Please note that the focus of these tests was around standard metrics gathering and display, we’ll use a future blog post to benchmark some of the more intensive query analytics (QAN) performance numbers. Virtual Memory utilization was averaging 48 GB of RAM.

Monitoring 117

Monitoring Scalability Database Cache 117

SQL Shack

SEPTEMBER 9, 2019

This option is available in index properties to manage data storage in the data pages. In this article, we will study in detail about the how SQL Server Index Fill factor works. Index Fill factor SQL Server Index Fill Factor is a percentage value to be filled data page with data in SQL Server. It […].

Benchmarking 56

Benchmarking Servers Performance Storage 56

The Morning Paper

AUGUST 29, 2019

use the TPC-H benchmark to assess Redshift, Redshift Spectrum, Athena, Presto, Hive, and Vertica to find out what works best and the trade-offs involved. We focused on OLAP-oriented parallel data warehouse products available for AWS and restricted our attention to commercially available systems. Key findings. Serverless o?erings

Architecture 76

Architecture Cloud Storage Serverless 76

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

SQL Performance

DECEMBER 17, 2019

This removes the burden of purchasing and maintaining your hardware, storage and networking infrastructure, while still giving you a very familiar experience with Windows and SQL Server itself. There are also large differences in storage capacity and throughput between these extremes.

Azure 72

Azure Virtualization Servers Storage 72

Percona

JANUARY 24, 2023

This will be clearly visible in PostgreSQL performance benchmarks as a “ Sawtooth wave ” pattern observed by Vadim in his tests: As we can see, the throughput suddenly drops after every checkpoint due to heavy WAL writing and gradually picks up until the next checkpoint. They do a much better job than what was available in PostgreSQL (pglz).

Database 142

Database Benchmarking Open Source Latency 142

Scalegrid

JANUARY 25, 2024

Key metrics like throughput, request latency, and memory utilization are essential for assessing Redis health, with tools like the MONITOR command and Redis-benchmark for latency and throughput analysis and MEMORY USAGE/STATS commands for evaluating memory. In addition, distributed data is a key factor in high availability.

Metrics 130

Metrics Monitoring Latency Cache 130

Scalegrid

DECEMBER 6, 2023

Self-managed databases come with their own set of expenses that must be factored in – managing a database requires time and effort which often includes backup storage, patching software upgrades as well as other typical administration tasks. Advantages of DBaaS Database management with DBaaS is like being on a luxury cruise.

Database 130

Database Cloud Hardware Storage 130

Alex Russell

APRIL 29, 2021

This post mines publicly available data on the pace of compatibility fixes and feature additions to assess the claim. As an engineer on a browser team, I'm privy to the blow-by-blow of various performance projects, benchmark fire drills, and the ways performance marketing (deeply) impacts engineering priorities. Higher is better.

Media 145

Media Games Education Engineering 145

Abhishek Tiwari

DECEMBER 27, 2017

faster access to external storage and data locality (I/O, bandwidth). A recent performance benchmark completed by Intel and BlueData using the BigBench benchmarking kit has shown that the performance ratios for container-based Hadoop workloads on BlueData EPIC are equal to and in some cases, better than bare-metal Hadoop [7].

Big Data 63

Big Data Storage Benchmarking Hardware 63

HammerDB

JUNE 27, 2022

HammerDB is a software application for database benchmarking. Databases are highly sophisticated software, and to design and run a fair benchmark workload is a complex undertaking. The Transaction Processing Performance Council (TPC) was founded to bring standards to database benchmarking, and the history of the TPC can be found here.

Benchmarking 63

Benchmarking Open Source C++ Cache 63

Percona

JANUARY 19, 2023

It can help us to save costs on storage and backup times. While MySQL can handle large data sets, it is always recommended to keep only the used data in the databases, as this will make data access more efficient, and also will help to save costs on storage and backups. It is available under a paid subscription.

Open Source 111

Open Source Storage Database Big Data 111

SQL Server According to Bob

SEPTEMBER 26, 2016

When we released Always On Availability Groups in SQL Server 2012 as a new and powerful way to achieve high availability, hardware environments included NUMA machines with low-end multi-core processors and SATA and SAN drives for storage (some SSDs). As we moved towards SQL Server 2014, the pace of hardware accelerated.

Availability 40

Availability Servers Hardware Benchmarking 40

Particular Software

OCTOBER 26, 2020

Backed by Cosmos DB, a fully managed, globally distributed, elastically scaled, pay-as-you-go service, your NServiceBus-based systems can benefit from guaranteed single-digit-millisecond latency with 99.999% availability. How does this compare with Azure Storage Persistence?

Azure 52

Azure Storage Benchmarking Latency 52

Percona

JULY 25, 2023

After the “data dictionary” (DD) engine and DD cache are initialized on a server, the Storage Engines can ask for a table definition. the IBD file is “self-describing”; for example, the table schema is available within an IBD file. This search tuple (key) is used to find the record to perform the undo operation.

Cache 98

Cache Servers Benchmarking Design 98

Percona

DECEMBER 23, 2022

I wrote this post on MyRocks because I believe it is the most interesting new MySQL storage engine to have appeared over the last few years. The use case is the TPC-C benchmark but executed not on a high-end server but on a lower-spec virtual machine that is I/O limited like for example, with AWS EBS volumes. Conclusion.

Storage 56

Storage Cache C++ Virtualization 56

SQL Performance

APRIL 8, 2019

Back on December 5, 2017, Microsoft announced that they were using AMD EPYC 7551 processors in their storage-optimized Lv2-Series virtual machines. These VMs are not available in all regions, so you will want to check the availability in the Azure region that you are interested in using. Figure 2: Microsoft Project Olympus.

Azure 42

Azure Virtualization Storage Benchmarking 42

Percona

JULY 1, 2023

These may be performance, high availability, operational cost, management, capacity planning, scalability, security, monitoring, etc. The RDS automated backup and PITR capabilities protect against data loss and system failures, ensuring high availability and performance while simplifying backup management for developers and DBAs.

AWS 52

AWS Database Serverless Storage 52

Percona

DECEMBER 20, 2018

As the MyRocks storage engine (based on the RocksDB key-value store [link] ) is now available as part of Percona Server for MySQL 5.7 , I wanted to take a look at how it performs on a relatively high-end server and SSD storage. Fsync Performance on Storage Devices. A Look at MyRocks Performance. Interested?

Database 50

Database Tuning Performance AWS 50