All Things Distributed

NOVEMBER 21, 2018

Verifying benchmark claims. I picked these examples because they aren't operations that show up in standard data warehousing benchmarks, yet are meaningful parts of customer workloads. Verifying benchmark claims. I've noticed a troubling trend in vendor benchmarking claims over the past year.

Cloud 116

Cloud Benchmarking Performance AWS 116

Dynatrace

OCTOBER 2, 2023

Limits of a lift-and-shift approach A traditional lift-and-shift approach, where teams migrate a monolithic application directly onto hardware hosted in the cloud, may seem like the logical first step toward application transformation. Use SLAs, SLOs, and SLIs as performance benchmarks for newly migrated microservices.

Architecture 245

Architecture Artificial Intelligence Cloud Open Source 245

Dynatrace

NOVEMBER 11, 2020

Dynatrace OneAgent deployment and life-cycle management are already widely considered to be industry benchmarks for reliability and efficiency. Dynatrace news. OneAgents can be deployed via a single command execution or a double-click. Advanced mode – Don’t worry about remembering the syntax of installation parameters.

Best Practices 210

Best Practices Storage Java Benchmarking 210

Dynatrace

NOVEMBER 22, 2022

Five-nines availability: The ultimate benchmark of system availability. Traditionally, teams achieve this high level of uptime using a combination of high-capacity hardware, system redundancy, and failover models. But is five nines availability attainable? Each decimal point closer to 100 equals higher uptime.

Infrastructure 195

Infrastructure Availability Systems Retail 195

The Morning Paper

NOVEMBER 3, 2019

For the rest of us, if you really need that extra performance (maybe what you get out-of-the-box or with minimal tuning is good enough for your use case) then you can upgrade hardware and/or pay for a commercial license of a tuned distributed (RHEL). A second takeaway is this: security has a cost! Measuring the kernel. Headline results.

Performance 108

Performance Benchmarking Tuning Hardware 108

Percona

NOVEMBER 3, 2023

PostgreSQL Cluster One coordinator node citus-coord-01 Three worker nodes citus1 citus2 citus3 Hardware AWS Instance Ubuntu Server 20.04, SSD volume type 64-bit (x86) c5.xlarge And now, execute the benchmark: -- execute the following on the coordinator node pgbench -c 20 -j 3 -T 60 -P 3 pgbench The results are not pretty.

Database 110

Database Benchmarking Latency C++ 110

The Morning Paper

SEPTEMBER 27, 2020

Furthermore, as hardware and compiler optimisations rapidly evolve, it is challenging even for a knowledgeable developer to keep up. The study is conducted using a suite of 7 real-world popular scientific applications, and two well-established benchmark suites: Miniaero solves the compressible Navier-Stokes equation. The applications.

Benchmarking 101

Benchmarking Hardware Programming Code 101

ACM Sigarch

OCTOBER 12, 2020

I suggest it’s long past time to move beyond C and SPEC benchmarks and our exclusive focus on “metal” languages. There are already standard benchmark suites for JavaScript performance in the browser, and we can include applications written in node.js (server-side JavaScript), Python web servers, and more.

C++ 108

C++ Benchmarking Hardware Architecture 108

HammerDB

OCTOBER 23, 2023

HammerDB uses stored procedures to achieve maximum throughput when benchmarking your database. HammerDB has always used stored procedures as a design decision because the original benchmark was implemented as close as possible to the example workload in the TPC-C specification that uses stored procedures.

Benchmarking 63

Benchmarking Database Network C++ 63

Adrian Cockcroft

SEPTEMBER 23, 2024

Most publications have simply reported the benchmark improvement claims, but if you stop to think about them, the numbers dont make sense based on a simplistic view of the technology changes. So first thing to understand is that the benchmark skips a generation and compares product that differs over about a two year interval.

Benchmarking 52

Benchmarking Energy Architecture Latency 52

Percona

MARCH 23, 2023

Hardware Memory The amount of RAM to be provisioned for database servers can vary greatly depending on the size of the database and the specific requirements of the company. Benchmark before you decide. have been released since then with some major changes. Transparent huge pages (THP) disabled. I hope this helps!

Performance 130

Performance Hardware Tuning Storage 130

HammerDB

DECEMBER 10, 2024

In this post, we revisit how to interpret transactional database performance metrics and give guidance on what levels of performance should be expected on up-to-date hardware and software in 2024. tpmC tpmC is the transactions per minute metric that is the measurement of the official TPC-C benchmark from the TPC-Council.

C++ 58

C++ Benchmarking Hardware Performance 58

John McCalpin

APRIL 25, 2023

I have a lot of historical data using my ReadOnly benchmark (as described in some of the earliest entries in this blog [link] A read-only access pattern removes the need to understand and explain the many complexities associated with the “streaming stores” typically used in the STREAM benchmark (e.g., Stay tuned!

Benchmarking 97

Benchmarking Cache Latency Tuning 97

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

Speed Curve

MARCH 7, 2022

These numbers should not be taken as a benchmark for your own site. You can see this by looking at the synthetic test result for Sears.com (again, available via our Industry Benchmarks ). In this recent test run from our Industry Page Speed Benchmarks , you can see that the Amazon home page ranks fastest in terms of Start Render.

Mobile 145

Mobile Google Benchmarking Metrics 145

Brendan Gregg

MARCH 16, 2024

It was also a virtual machine that lacked low-level hardware profiling capabilities, so I wasn't able to do cycle analysis to confirm that the 10% was entirely frame pointer-based. and we may have been flying close to the edge of hardware cache warmth, where adding a bit more instructions caused a big drop.

Java 137

Java Cache Google Hardware 137

Scalegrid

DECEMBER 6, 2023

This type of database offers scalability with no downtime along with giving businesses control over what resources they use through customization capabilities such as choosing hardware infrastructure options or building security measures around it. These advantages come at an expense.

Database 130

Database Cloud Hardware Storage 130

Percona

MARCH 27, 2023

Disclaimer : This blog post is meant to show a less-known problem but is not meant to be a serious benchmark. The percentage in degradation will vary depending on many factors {hardware, workload, number of tables, configuration, etc.}. Setup The setup consists of creating 10K tables with sysbench and adding 20 FKs to 20 tables.

Cache 109

Cache Hardware Servers Benchmarking 109

Scalegrid

JANUARY 25, 2024

Key metrics like throughput, request latency, and memory utilization are essential for assessing Redis health, with tools like the MONITOR command and Redis-benchmark for latency and throughput analysis and MEMORY USAGE/STATS commands for evaluating memory. It depends upon your application workload and its business logic.

Metrics 130

Metrics Monitoring Latency Cache 130

The Morning Paper

MAY 23, 2019

Looking across a set of eight Java benchmarks, we find that only two of them are array dominated, the rest having between 40% to 75% of the heap footprint allocated to objects, the vast majority of which are small. Consider a B-Tree node from the B-tree Java benchmark: Uncompressed, it’s memory layout looks like (a) below. Evaluation.

Cache 61

Cache Benchmarking Hardware Java 61

Scalegrid

JULY 13, 2020

Oracle support for hardware and software packages is typically available at 22% of their licensing fees. PostgreSQL support is available free from the community, and there are also many support providers available for advanced assistance. So Which Is Best?

Open Source 244

Open Source Tuning C++ Database 244

VoltDB

JULY 24, 2024

As part of our new support for ARM processors , we recently ran benchmarks on both Intel C7 and ARM c7g on AWS. The goal of these benchmarks was to both quantify performance differences between the two platforms and gain an understanding of their TCO. We used an in-house benchmark called voltdb-charglt.

AWS 52

AWS Benchmarking Hardware Latency 52

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. If a primary server fails, a backup server can take over and continue to serve requests.

Availability 114

Availability Database Open Source Hardware 114

Alex Russell

APRIL 29, 2021

As an engineer on a browser team, I'm privy to the blow-by-blow of various performance projects, benchmark fire drills, and the ways performance marketing (deeply) impacts engineering priorities. With each team, benchmarks lost are understood as bugs. is access to hardware devices. This is as it should be. Shape Detection.

Media 145

Media Games Education Engineering 145

HammerDB

JUNE 27, 2022

HammerDB is a software application for database benchmarking. It enables the user to measure database performance and make comparative judgements about database hardware and software. Databases are highly sophisticated software, and to design and run a fair benchmark workload is a complex undertaking. Derived Workloads.

Benchmarking 63

Benchmarking Open Source C++ Cache 63

SQL Performance

DECEMBER 17, 2019

This removes the burden of purchasing and maintaining your hardware, storage and networking infrastructure, while still giving you a very familiar experience with Windows and SQL Server itself. BTW, the "i" in the Standard_E64is_v3 naming means that the instance is isolated to hardware dedicated to a single customer.

Azure 72

Azure Virtualization Servers Storage 72

HammerDB

FEBRUARY 25, 2021

HammerDB is a load testing and benchmarking application for relational databases. However, it is crucial that the benchmarking application does not have inherent bottlenecks that artificially limits the scalability of the database. Basic Benchmarking Concepts. To benchmark a database we introduce the concept of a Virtual User.

Programming 68

Programming Benchmarking Virtualization C++ 68

The Morning Paper

MAY 27, 2019

Last week we saw the benefits of rethinking memory and pointer models at the hardware level when it came to object storage and compression ( Zippads ). The protections are hardware implemented and cannot be forged in software. At hardware reset the boot code is granted maximally permissive architectural capabilities.

C++ 61

C++ Hardware Virtualization Benchmarking 61

The Morning Paper

JUNE 11, 2019

FlexFlow is also given a device topology graph describing all the available hardware devices and their interconnections. Hardware connections between devices are modelled as special communication devices which can execute communication tasks. FlexFlow is evaluated over six real-world DNN benchmarks on two different GPU clusters.

Network 81

Network Strategy Hardware Benchmarking 81

Percona

JUNE 22, 2023

Indexing efficiency Monitoring indexing efficiency in MySQL involves analyzing query performance, using EXPLAIN statements, utilizing performance monitoring tools, reviewing error logs, performing regular index maintenance, and benchmarking/testing. This KPI is also directly related to Query Performance and helps improve it.

Performance 109

Performance Monitoring Traffic Database 109

Percona

AUGUST 22, 2023

Some of the most important elements include: No single point of failure (SPOF): You must eliminate any SPOF in the database environment, including any potential for an SPOF in physical or virtual hardware. Redundancy provides backups and safeguards against data loss in case of hardware failures. there cannot be high availability.

Availability 84

Availability Hardware Open Source Database 84

Alex Russell

MARCH 6, 2021

Hardware Past As Performance Prologue. Using a global ASP as a benchmark can further mislead thanks to the distorting effect of ultra-high-end prices rising while shipment volumes stagnate. But the hardware future is not evenly distributed, and web workloads aren't heavily parallel. Today, either method returns a similar answer.

Performance 127

Performance Network Metrics Cache 127

HammerDB

NOVEMBER 22, 2021

This enables the user to compare and contrast performance across different benchmark scenarios. Metrics view for benchmark. When a benchmark workload has completed, use the selection tool in the graph to select the metrics for a period of time of interest. PostgreSQL Graphical Metrics.

Metrics 63

Metrics Benchmarking C++ Database 63

HammerDB

DECEMBER 3, 2024

An often overlooked aspect of database benchmarking is that it should be used to stress test databases on all new hardware environments before they enter production. Copy Code Copied Use a different Browser A corrected hardware error has occurred. Copy Code Copied Use a different Browser Faulting application name: wish90.exe,

Performance 52

Performance Hardware Virtualization Benchmarking 52

Brendan Gregg

SEPTEMBER 25, 2021

As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. I love short benchmarks like this as I can disassemble the resulting binary and ensure that the compiled instructions match my expectations, and the compiler hasen't messed with it. ## 6.

Speed 103

Speed Java AWS Virtualization 103

HammerDB

JULY 6, 2024

In a recent project comparing systems for MariaDB performance, a user had originally been using a tool called sysbench-tpcc to compare hardware platforms before migrating to HammerDB. This is a brief post to highlight the metrics to use to do the comparison using a separate hardware platform for illustration purposes.

C++ 52

C++ Hardware Benchmarking Virtualization 52

The Morning Paper

JUNE 27, 2019

Systems researchers are doing an excellent job improving the performance of 5-year old benchmarks, but gradually making it harder to explore innovative machine learning research ideas.

Systems 87

Systems Programming Tuning Innovation 87