Brendan Gregg

JUNE 29, 2018

These have inspired me to summarize another performance activity: evaluating benchmark accuracy. Accurate benchmarking rewards engineering investment that actually improves performance, but, unfortunately, inaccurate benchmarking is more common. If the benchmark reported 20k ops/sec, you should ask: why not 40k ops/sec?

Benchmarking 40

Benchmarking Latency Cache Network 40

Percona

MARCH 27, 2023

A lot of useful information can be retrieved from this schema, for example, table metadata and foreign key relations, but trying to query I_S can induce performance degradation if your server is under heavy load, as shown in the following example test. The same tests have been executed in Percona Server for MySQL 5.7

Cache 107

Cache Hardware Servers Benchmarking 107

The Morning Paper

SEPTEMBER 24, 2020

Static analysis of Java enterprise applications: frameworks and caches, the elephants in the room , Antoniadis et al., This means for example that it can be applied to analyse source code repositories and pull requests, be used as an additional test in CI pipelines, and even give assistance in your IDE if it’s fast enough.

Java 80

Java Cache Benchmarking Programming 80

HammerDB

JUNE 27, 2022

HammerDB is a software application for database benchmarking. Databases are highly sophisticated software, and to design and run a fair benchmark workload is a complex undertaking. The Transaction Processing Performance Council (TPC) was founded to bring standards to database benchmarking, and the history of the TPC can be found here.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

HammerDB

APRIL 19, 2023

Therefore, before we attempt to measure our database performance, we should know the system or cloud instance to be tested in detail. Benchmarking the target Two of the more popular database benchmarks for MySQL are HammerDB and sysbench. This allows us to know our operating environment and its capability. 4.22 %usr 38.40

Performance 54

Performance Benchmarking Cache Storage 54

Speed Curve

OCTOBER 29, 2024

Google Tag Manager) or A/B testing tool if you need to circumvent code changes. Capture cache hits/misses, time spent at the edge, origin, and even round-trip time (RTT) for most major CDN providers. Don't forget to test your campaign landing pages. Benchmark your site against your competitors. You probably need both.

Speed 57

Speed Benchmarking Traffic Retail 57

Brendan Gregg

MARCH 16, 2024

Only in extreme circumstances does the cost (in processor time and I-cache footprint) translate to a tangible benefit - circumstances which usually resort to hand-coded assembly anyway. It shouldn't be 10%, unless it's cache effects. And for leaf routines (which never establish a frame), this is a non-issue.

Java 137

Java Cache Google Hardware 137

Percona

JULY 25, 2023

After the “data dictionary” (DD) engine and DD cache are initialized on a server, the Storage Engines can ask for a table definition. Initializing a DD engine and the cache adds complexity and other server dependencies. ibd in the test directory. For example, mysql datadir/test/t1.ibd. ibd2sdi data/test/t1.ibd

Cache 89

Cache Servers Benchmarking Design 89

Percona

SEPTEMBER 1, 2023

Testing and Validation : Thorough testing and validation are essential when working with triggers, especially in a production environment. Changes to triggers should be carefully reviewed and tested to ensure they do not introduce unintended consequences. for i in `seq 1 1 16`; do mysql test -e "SELECT * FROM tc_test"; done.

Cache 64

Cache Database Games Healthcare 64

Percona

MARCH 17, 2023

We have tested PMM version 2.33.0 Please note that the focus of these tests was around standard metrics gathering and display, we’ll use a future blog post to benchmark some of the more intensive query analytics (QAN) performance numbers. The CPU usage averaged 24% utilization, as you can see in the above picture.

Monitoring 104

Monitoring Scalability Cache Database 104

John McCalpin

APRIL 2, 2020

To show that I can criticize my own work as well, here I show that sustained memory bandwidth (using an approximation to the STREAM Benchmark ) is also inadequate as a single figure of metric. (It Here I assumed a particular analytical function for the amount of memory traffic as a function of cache size to scale the bandwidth time.

Benchmarking 59

Benchmarking Performance Latency Architecture 59

ScaleOut Software

MAY 15, 2014

Given all this, we thought it would be a good opportunity to see how we are doing relative to the competition, and in particular, relative to Microsoft’s AppFabric caching for Windows on-premise servers. Testing Scale-Up Performance. So our comments will be confined to what testing we felt was valuable and how well SOSS performed.

Cache 40

Cache Servers Network Design 40

Percona

JUNE 22, 2023

This includes metrics such as query execution time, the number of queries executed per second, and the utilization of query cache and adaptive hash index. query cache: Disable (query_cache_size: 0, query_cache_type:OFF) innodb_adaptive_hash_index: Check adaptive hash index usage to determine its efficiency.

Performance 108

Performance Monitoring Traffic Database 108

SQL Performance

NOVEMBER 18, 2019

Memory optimized – High memory-to-CPU ratio, relational database servers, medium to large caches, and in-memory analytics. The common trend is to choose a VM based exclusively on vCPU, memory, and storage capacity without benchmarking the current IO and throughput requirements. I put each of these VMs to a test using CrystalDiskMark.

Azure 76

Azure Benchmarking Storage Virtualization 76

Speed Curve

DECEMBER 13, 2023

Background For this performance audit, I looked at this synthetic test for the LEGO.com home page. (We We track LEGO.com, along with a handful of other leading ecommerce sites, in our public-facing Retail Benchmarks dashboard , which I encourage you to check out. Are you compressing and caching the right things?

Performance 66

Performance Retail Benchmarking Ecommerce 66

Percona

MAY 1, 2023

Connection pooling: Minimizing connection overhead and improving response times for frequently accessed data by implementing mechanisms for connection pooling and caching strategies. PostgreSQL performance optimization is an ongoing process involving monitoring, benchmarking, and adjustments to maintain high-performing PostgreSQL databases.

Tuning 52

Tuning Database Efficiency Performance 52

KeyCDN

DECEMBER 8, 2022

Many factors affect the speed of your WordPress website; some of them are: Your web host Server-side optimizations (PHP version, compression, caching, etc.) Page loading speed test Before conducting any further tests, a website owner must determine at what speed his website loads. So let's discuss the process one step at a time.

Cache 52

Cache Website Speed Website Performance 52

n0derunner

MAY 6, 2019

A 2007 paper, that still has lots to say on the subject of benchmarking storage and filesystems. Primarily aimed at researchers and developers, but is relevant to anyone about to embark on a benchmarking effort. A Nine year study of filesystem and storage benchmarking Download. The post New (Old) Paper.

Benchmarking 40

Benchmarking Storage Cache Testing 40

Dotcom-Montior

AUGUST 5, 2020

Running a website speed test can help to determine what factors may be slowing your pages down. There are tools available such as Dotcom-Monitor’s free speed test that you can utilize to gauge performance. The tool gives you the option to run a speed test from 25 locations around the world. Optimize Your Pages.

Website 92

Website Speed Cache Traffic 92

John McCalpin

SEPTEMBER 11, 2014

The High Performance LINPACK (HPL) benchmark is well known for delivering a high fraction of peak floating-point performance. A colleague here at TACC ran into this while testing on a 2-socket Haswell EP system. But this does not mean that memory bandwidth will *never* be a performance limiter.

Benchmarking 40

Benchmarking Cache Performance Systems 40

n0derunner

SEPTEMBER 17, 2018

Creating a HCI benchmark to simulate multi-tennent workloads. We supply a pre-configured scenario which we call the DB Colocation test. The DB Colocation test utilizes two properties of X-Ray not found in other benchmarking tools. Time based benchmark actions. Distinct per-VM workload patterns.

Performance Testing 40

Performance Testing Benchmarking Testing Performance 40

The Morning Paper

AUGUST 29, 2019

use the TPC-H benchmark to assess Redshift, Redshift Spectrum, Athena, Presto, Hive, and Vertica to find out what works best and the trade-offs involved. As it is infeasible to test every OLAP system runnable on AWS, we chose widely-used systems that represented a variety of architectures and cost models. Key findings.

Architecture 76

Architecture Cloud Storage Serverless 76

HammerDB

NOVEMBER 5, 2018

If you are new to running Oracle, SQL Server, MySQL and PostgreSQL TPC-C workloads with HammerDB and have needed to investigate I/O performance the chances are that you have experienced waits on writing to the Redo, Transaction Log or WAL depending on the database you are testing. SQL> alter system flush buffer_cache; System altered.

Benchmarking 40

Benchmarking Database C++ Virtualization 40

n0derunner

JULY 23, 2019

In this video I migrate a Postgres DB running PGbench benchmark. The variation in the transaction rate is due to the benchmark itself, the transaction rate is not expected to be uniform. Many different queries are executing in parallel, some hitting RAM cache, some hitting storage.

Benchmarking 76

Benchmarking Storage Cache Tuning 76

Percona

MARCH 20, 2023

When deciding what to pick, there are many things to consider, like where the proxy needs to be, if it “just” needs to redirect the connections, or if more features need to be in, like caching and filtering, or if it needs to be integrated with some MySQL embedded automation. micro) The tests We will have very simple test cases.

Games 125

Games Latency Traffic Cache 125

MachMetrics

DECEMBER 14, 2019

It is typically reduced via server-side optimizations, such as enabling caching and database indexes. How do you test your site against the best practices? Now that we know where the average website falls, it’s time for you to test your own site. Even better if you’re under Google’s best practice benchmark.

Best Practices 105

Best Practices Speed Mobile Google 105

Percona

MARCH 23, 2023

By caching hot datasets, indexes, and ongoing changes, InnoDB can provide faster response times and utilize disk IO in a much more optimal way. Benchmark before you decide. The optimal value can be decided after testing multiple settings, starting from eight is a good choice. Transparent huge pages (THP) disabled.

Performance 129

Performance Hardware Tuning Storage 129

Brendan Gregg

FEBRUARY 9, 2018

Much of my testing was on Linux 4.14.11 This overhead can be reduced by A) pcid, fully available in Linux 4.14, and B) Huge pages. - **Cache access pattern**: the overheads are exacerbated by certain access patterns that switch from caching well to caching a little less well. and 4.14.12 In more detail: ## 1. DTLB and 4.4%

Performance 72

Performance Benchmarking Cache Tuning 72

Percona

AUGUST 31, 2018

This parameter sets how much dedicated memory will be used by PostgreSQL for cache. If your working set of data can easily fit into your RAM, then you might want to increase the shared_buffer value to contain your entire database, so that the whole working set of data can reside in cache. wal_buffers. effective_cache_size.

Tuning 59

Tuning Database Performance Benchmarking 59

Percona

JANUARY 9, 2023

NOTE : All tests were applied for MySQL version 8.0.30, and in the background, I ran every query three to five times to make sure that all of them were fully cached in the buffer pool (for InnoDB) or by the filesystem (for MyISAM). But why we can’t just cache the actual number of the rows? sec) What flash speed we saw there!

Cache 80

Cache Engineering Storage Speed 80

CSS - Tricks

JUNE 5, 2020

The service categorized all the optimizations in three groups consisting of several “Content,” “Delivery,” and “Cache” optimizations. In my benchmarks, Brotli:11 takes several hundred milliseconds to compress a single minified jQuery file. We only cache hot files in memory at edge servers. Luckily we already had that in place.

Cache 80

Cache Website Servers Open Source 80

Alex Russell

MARCH 6, 2021

A then-representative $200USD device had 4-8 slow (in-order, low-cache) cores, ~2GiB of RAM, and relatively slow MLC NAND flash storage. Using a global ASP as a benchmark can further mislead thanks to the distorting effect of ultra-high-end prices rising while shipment volumes stagnate. The Moto G4 , for example.

Performance 127

Performance Network Cache Metrics 127

Rigor

DECEMBER 19, 2019

Test at Every Stage of Development. Synthetic monitoring can be used to test websites and web applications in pre-production, while real user monitoring can only be used in production. AB Test the Performance Impact of Third Parties. AB Test the Performance Impact of Third Parties. Benchmark Against Competitors.

Monitoring 40

Monitoring Benchmarking Website Traffic 40

Alex Russell

APRIL 29, 2021

As an engineer on a browser team, I'm privy to the blow-by-blow of various performance projects, benchmark fire drills, and the ways performance marketing (deeply) impacts engineering priorities. With each team, benchmarks lost are understood as bugs. All modern browsers are fast, Chromium and Safari/WebKit included. Lower is better.

Media 145

Media Games Education Engineering 145

Smashing Magazine

JUNE 1, 2022

You’ve tested and retested the site for errors. You can adjust what browser is used, the kind of network connection to employ, the locations to test from, whether or not the browser’s cache is empty or full, how frequently to take the measurements, and more. Testing The Impact Of Specific Requests. Large preview ).

Website 133

Website Design Network Testing 133

Brendan Gregg

FEBRUARY 8, 2018

Much of my testing was on Linux 4.14.11 This overhead can be reduced by A) pcid, fully available in Linux 4.14, and B) Huge pages. - **Cache access pattern**: the overheads are exacerbated by certain access patterns that switch from caching well to caching a little less well. and 4.14.12 In more detail: ## 1. DTLB and 4.4%

Performance 40

Performance Benchmarking Cache Tuning 40

Smashing Magazine

JUNE 26, 2019

Instead, I suggest that web designers use another Google testing tool called Test My Site. Test My Site is a mobile page speed testing tool from Think with Google. Source: Test My Site ) ( Large preview ). All you need to do is enter your domain name into the field and let the test run. Minification.

Website 111

Website Speed Mobile Design 111