Brendan Gregg

JUNE 30, 2018

These have inspired me to summarize another performance activity: evaluating benchmark accuracy. Accurate benchmarking rewards engineering investment that actually improves performance, but, unfortunately, inaccurate benchmarking is more common. If the benchmark reported 20k ops/sec, you should ask: why not 40k ops/sec?

Benchmarking 47

Benchmarking Latency Cache Network 47

n0derunner

JULY 23, 2019

In this video I migrate a Postgres DB running PGbench benchmark. As the DB continues to run on the new host – the Nutanix storage detects the access patterns and “localizes” the data that the DB is accessing. Many different queries are executing in parallel, some hitting RAM cache, some hitting storage.

Benchmarking 76

Benchmarking Storage Tuning Cache 76

SQL Performance

NOVEMBER 18, 2019

IT professionals are familiar with scoping the size of VMs with regards to vCPU, memory, and storage capacity. Memory optimized – High memory-to-CPU ratio, relational database servers, medium to large caches, and in-memory analytics. Storage optimized – High disk throughput and IO. Premium storage support. Generation.

Azure 76

Azure Benchmarking Storage Virtualization 76

The Morning Paper

AUGUST 29, 2019

use the TPC-H benchmark to assess Redshift, Redshift Spectrum, Athena, Presto, Hive, and Vertica to find out what works best and the trade-offs involved. For cost calculations, the costs are a combination of compute costs, storage costs, data scan costs, and software license costs. Key findings. System initialisation time.

Architecture 76

Architecture Cloud Storage Cache 76

Percona

MARCH 17, 2023

PMM2 uses VictoriaMetrics (VM) as its metrics storage engine. Please note that the focus of these tests was around standard metrics gathering and display, we’ll use a future blog post to benchmark some of the more intensive query analytics (QAN) performance numbers. Virtual Memory utilization was averaging 48 GB of RAM.

Monitoring 106

Monitoring Scalability Database Cache 106

Percona

JUNE 22, 2023

This includes metrics such as query execution time, the number of queries executed per second, and the utilization of query cache and adaptive hash index. query cache: Disable (query_cache_size: 0, query_cache_type:OFF) innodb_adaptive_hash_index: Check adaptive hash index usage to determine its efficiency.

Performance 109

Performance Monitoring Traffic Database 109

Brendan Gregg

JUNE 29, 2018

These have inspired me to summarize another performance activity: evaluating benchmark accuracy. Accurate benchmarking rewards engineering investment that actually improves performance, but, unfortunately, inaccurate benchmarking is more common. If the benchmark reported 20k ops/sec, you should ask: why not 40k ops/sec?

Benchmarking 40

Benchmarking Latency Cache Network 40

Percona

JULY 25, 2023

After the “data dictionary” (DD) engine and DD cache are initialized on a server, the Storage Engines can ask for a table definition. Initializing a DD engine and the cache adds complexity and other server dependencies. Essentially LRU cache is disabled by loading the tables as non-evictable. ibd > t1.sdi

Cache 90

Cache Servers Benchmarking Design 90

ScaleOut Software

MAY 15, 2014

For example, the IMDG must be able to efficiently create millions of objects in each server to make use of its huge storage capacity. Given all this, we thought it would be a good opportunity to see how we are doing relative to the competition, and in particular, relative to Microsoft’s AppFabric caching for Windows on-premise servers.

Cache 40

Cache Servers Network Design 40

HammerDB

JUNE 27, 2022

HammerDB is a software application for database benchmarking. Databases are highly sophisticated software, and to design and run a fair benchmark workload is a complex undertaking. The Transaction Processing Performance Council (TPC) was founded to bring standards to database benchmarking, and the history of the TPC can be found here.

Benchmarking 63

Benchmarking Open Source C++ Cache 63

HammerDB

APRIL 19, 2023

As database performance is heavily influenced by the performance of storage, network, memory, and processors, we must understand the upper limit of these key components. For storage, FIO is generally used. Benchmarking the target Two of the more popular database benchmarks for MySQL are HammerDB and sysbench. 0.42 %sys 9.52

Performance 55

Performance Benchmarking Cache Storage 55

SQL Performance

DECEMBER 17, 2019

This removes the burden of purchasing and maintaining your hardware, storage and networking infrastructure, while still giving you a very familiar experience with Windows and SQL Server itself. There are also large differences in storage capacity and throughput between these extremes. GHz, 128MB of L3 cache, 128 PCIe 4.0

Azure 72

Azure Virtualization Servers Storage 72

Percona

DECEMBER 23, 2022

I wrote this post on MyRocks because I believe it is the most interesting new MySQL storage engine to have appeared over the last few years. The use case is the TPC-C benchmark but executed not on a high-end server but on a lower-spec virtual machine that is I/O limited like for example, with AWS EBS volumes. Conclusion.

Storage 56

Storage Cache C++ Virtualization 56

The Morning Paper

JUNE 16, 2019

If we do that naively though, we’re going to end up with a lot of universes to store and maintain and the storage requirements alone will be prohibitive. The amount of computation required on a base update can be reduced by sharing computation and cached data between universes.

Database 90

Database Cache Benchmarking Efficiency 90

Alex Russell

MARCH 6, 2021

A then-representative $200USD device had 4-8 slow (in-order, low-cache) cores, ~2GiB of RAM, and relatively slow MLC NAND flash storage. Using a global ASP as a benchmark can further mislead thanks to the distorting effect of ultra-high-end prices rising while shipment volumes stagnate. The Moto G4 , for example.

Performance 127

Performance Network Metrics Cache 127

n0derunner

MAY 6, 2019

A 2007 paper, that still has lots to say on the subject of benchmarking storage and filesystems. Primarily aimed at researchers and developers, but is relevant to anyone about to embark on a benchmarking effort. A Nine year study of filesystem and storage benchmarking Download. The post New (Old) Paper.

Benchmarking 40

Benchmarking Storage Cache Testing 40

Alex Russell

APRIL 29, 2021

As an engineer on a browser team, I'm privy to the blow-by-blow of various performance projects, benchmark fire drills, and the ways performance marketing (deeply) impacts engineering priorities. With each team, benchmarks lost are understood as bugs. Chrome has missed several APIs for 3+ years: Storage Access API.

Media 145

Media Games Education Engineering 145

Percona

JANUARY 9, 2023

NOTE : All tests were applied for MySQL version 8.0.30, and in the background, I ran every query three to five times to make sure that all of them were fully cached in the buffer pool (for InnoDB) or by the filesystem (for MyISAM). But why we can’t just cache the actual number of the rows?

Cache 82

Cache Engineering Storage Speed 82

CSS - Tricks

JUNE 5, 2020

The HBO sitcom Silicon Valley hilariously followed Pied Piper, a team of developers with startup dreams to create a compression algorithm so powerful that high-quality streaming and file storage concerns would become a thing of the past. In my benchmarks, Brotli:11 takes several hundred milliseconds to compress a single minified jQuery file.

Cache 80

Cache Website Servers Open Source 80

HammerDB

NOVEMBER 5, 2018

This post at an entry-level discusses the options you have to improve log throughput in your benchmark environment. . To illustrate the data reads on Oracle we can flush the buffer cache. Consequently we now need to increase the buffer cache in size if we are to see more CPU activity. so what are your options? PostgreSQL.

Benchmarking 40

Benchmarking Database C++ Virtualization 40

n0derunner

SEPTEMBER 17, 2018

Creating a HCI benchmark to simulate multi-tennent workloads. As with traditional storage, applications are writing to a shared storage environment which is necessary to support VM movement. As with traditional storage, applications are writing to a shared storage environment which is necessary to support VM movement.

Performance Testing 40

Performance Testing Benchmarking Testing Performance 40

SQL Performance

APRIL 8, 2019

Back on December 5, 2017, Microsoft announced that they were using AMD EPYC 7551 processors in their storage-optimized Lv2-Series virtual machines. The L3 cache size is 64MB. I wrote about using CPU-Z to benchmark the Intel Xeon E5-2673 v3 processor in an Azure VM in this article. Figure 1: CPU-Z Benchmark Results for LS16v2.

Azure 42

Azure Virtualization Storage Benchmarking 42

Percona

MAY 1, 2023

Hardware optimization : You need to ensure that the CPU, memory, and storage components meet the performance requirements of the database workload. Connection pooling: Minimizing connection overhead and improving response times for frequently accessed data by implementing mechanisms for connection pooling and caching strategies.

Tuning 52

Tuning Database Efficiency Performance 52

Alex Russell

OCTOBER 22, 2017

Budgets are scaled to a benchmark network & device. Deciding what benchmark to use for a performance budget is crucial. Simulated packet loss and variable latency, however, can make benchmarking extremely difficult and slow. Time required to read bytes from disk (it’s not zero, even on flash-based storage!).

Performance 74

Performance Network Benchmarking Mobile 74

Percona

SEPTEMBER 1, 2023

Inadequate CPU, memory, or storage can lead to bottlenecks and performance degradation, so remedying these issues involves upgrading hardware or optimizing resource utilization through query and server configuration adjustments. Avoid over-indexing, which can bloat storage and slow writes.

Tuning 52

Tuning Database Performance Hardware 52

Percona

JUNE 22, 2023

” Here are additional metrics used to determine the reliability of a database, make adjustments that minimize downtime, and set benchmarks for meeting business continuity requirements. Depending on your setup, costs can include: Hardware devices (servers, storage devices, network switches, etc.)

Availability 114

Availability Database Open Source Hardware 114

SQL Server According to Bob

JANUARY 11, 2020

Stable Media Stable media is often confused with physical storage. SQL Server defines stable media as storage that can survive system restart or common failure. Stable media is commonly physical disk storage, but other devices and certain caching facilities qualify as well.

Servers 40

Servers Cache Media Hardware 40

SQL Server According to Bob

JANUARY 11, 2020

Time of Last Access The time of last access is a caching ​​ algorithm ​​ that enables ​​ cache ​​ entries to be ordered by their ​​ access times.

Servers 40

Servers Cache Database Media 40

High Scalability

NOVEMBER 25, 2019

It is limited by the disk space; it can’t expand storage elastically; it chokes if you run few I/O intensive processes or try collaborating with 100 other users. Over time, costs for S3 and GCS became reasonable and with Egnyte’s storage plugin architecture, our customers can now bring in any storage backend of their choice.

Architecture 52

Architecture Cache Azure Storage 52

Smashing Magazine

JANUARY 6, 2020

Geekbench CPU performance benchmarks for the highest selling smartphones globally in 2019. The idea is quite straightforward: Push the minimal code needed to get interactive for the initial route to render quickly, then use service worker for caching and pre-caching resources and then lazy-load routes that you need, asynchronously.

Performance 112

Performance Cache Network Servers 112

Smashing Magazine

JANUARY 11, 2021

Build Optimizations JavaScript modules, module/nomodule pattern, tree-shaking, code-splitting, scope-hoisting, Webpack, differential serving, web worker, WebAssembly, JavaScript bundles, React, SPA, partial hydration, import on interaction, 3rd-parties, cache. This improves page load time and caching during navigations.

Performance 145

Performance Cache Media Metrics 145