All Things Distributed

NOVEMBER 21, 2018

Verifying benchmark claims. Clearly, they're updating their systems far more frequently than they did on-premises, which changes the nature of engineering problems the team needs to prioritize. Verifying benchmark claims. I've noticed a troubling trend in vendor benchmarking claims over the past year.

Cloud 116

Cloud Benchmarking Performance AWS 116

The Morning Paper

NOVEMBER 3, 2019

For the rest of us, if you really need that extra performance (maybe what you get out-of-the-box or with minimal tuning is good enough for your use case) then you can upgrade hardware and/or pay for a commercial license of a tuned distributed (RHEL). A second takeaway is this: security has a cost! Measuring the kernel. Headline results.

Performance 108

Performance Benchmarking Tuning Hardware 108

The Morning Paper

JUNE 27, 2019

Machine learning systems are stuck in a rut Barham & Isard, HotOS’19. In this paper we argue that systems for numerical computing are stuck in a local basin of performance and programmability. Take a simple example: it would be really nice if we could have named dimensions instead of always having to work with indices.

Systems 87

Systems Programming Tuning Innovation 87

Percona

NOVEMBER 3, 2023

Rather than listing the concepts, function calls, etc, available in Citus, which frankly is a bit boring, I’m going to explore scaling out a database system starting with a single host. And now, execute the benchmark: -- execute the following on the coordinator node pgbench -c 20 -j 3 -T 60 -P 3 pgbench The results are not pretty.

Database 110

Database Benchmarking Latency C++ 110

The Morning Paper

SEPTEMBER 27, 2020

Furthermore, as hardware and compiler optimisations rapidly evolve, it is challenging even for a knowledgeable developer to keep up. The study is conducted using a suite of 7 real-world popular scientific applications, and two well-established benchmark suites: Miniaero solves the compressible Navier-Stokes equation. The applications.

Benchmarking 101

Benchmarking Hardware Programming Code 101

ACM Sigarch

OCTOBER 12, 2020

I suggest it’s long past time to move beyond C and SPEC benchmarks and our exclusive focus on “metal” languages. There are already standard benchmark suites for JavaScript performance in the browser, and we can include applications written in node.js (server-side JavaScript), Python web servers, and more.

C++ 108

C++ Benchmarking Hardware Architecture 108

Percona

MARCH 23, 2023

Hardware Memory The amount of RAM to be provisioned for database servers can vary greatly depending on the size of the database and the specific requirements of the company. Operating system Linux is the most common operating system for high-performance MySQL servers. Benchmark before you decide.

Performance 130

Performance Hardware Tuning Storage 130

HammerDB

OCTOBER 23, 2023

HammerDB uses stored procedures to achieve maximum throughput when benchmarking your database. HammerDB has always used stored procedures as a design decision because the original benchmark was implemented as close as possible to the example workload in the TPC-C specification that uses stored procedures. On MySQL, we saw a 1.5X

Benchmarking 63

Benchmarking Database Network C++ 63

Adrian Cockcroft

SEPTEMBER 23, 2024

Most publications have simply reported the benchmark improvement claims, but if you stop to think about them, the numbers dont make sense based on a simplistic view of the technology changes. So first thing to understand is that the benchmark skips a generation and compares product that differs over about a two year interval.

Benchmarking 52

Benchmarking Energy Architecture Latency 52

Scalegrid

DECEMBER 6, 2023

Understanding this DBaaS system might take some adjusting too similar just how traveling on cruises has its tempo which requires us to get used to optimally benefit from what it provides. The great thing about this is that it provides companies with an unprecedented level of freedom when configuring their system.

Database 130

Database Cloud Hardware Storage 130

Scalegrid

JANUARY 25, 2024

Key metrics like throughput, request latency, and memory utilization are essential for assessing Redis health, with tools like the MONITOR command and Redis-benchmark for latency and throughput analysis and MEMORY USAGE/STATS commands for evaluating memory. It depends upon your application workload and its business logic.

Metrics 130

Metrics Monitoring Latency Cache 130

John McCalpin

APRIL 25, 2023

For most high-end processors these values have remained in the range of 75% to 85% of the peak DRAM bandwidth of the system over the past 15-20 years — an amazing accomplishment given the increase in core count (with its associated cache coherence issues), number of DRAM channels, and ever-increasing pipelining of the DRAMs themselves.

Benchmarking 97

Benchmarking Cache Latency Tuning 97

HammerDB

DECEMBER 10, 2024

In this post, we revisit how to interpret transactional database performance metrics and give guidance on what levels of performance should be expected on up-to-date hardware and software in 2024. tpmC tpmC is the transactions per minute metric that is the measurement of the official TPC-C benchmark from the TPC-Council.

C++ 58

C++ Benchmarking Hardware Performance 58

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. Some disruption might occur, but it will be minimal. More in the following sub-section.)

Availability 114

Availability Database Open Source Hardware 114

Brendan Gregg

MARCH 16, 2024

The problem is that this system has a default libc that has been compiled without frame pointers, so any stack walking stops at the libc layer, producing a partial stack that's missing the application frames. This is pretty common and usually goes unnoticed as the flame graph looks ok at first glance. Just to name a couple of languages.

Java 137

Java Cache Google Hardware 137

Alex Russell

APRIL 29, 2021

As an engineer on a browser team, I'm privy to the blow-by-blow of various performance projects, benchmark fire drills, and the ways performance marketing (deeply) impacts engineering priorities. With each team, benchmarks lost are understood as bugs. All modern browsers are fast, Chromium and Safari/WebKit included. Media Session API.

Media 145

Media Games Education Engineering 145

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

VoltDB

JULY 24, 2024

As part of our new support for ARM processors , we recently ran benchmarks on both Intel C7 and ARM c7g on AWS. The goal of these benchmarks was to both quantify performance differences between the two platforms and gain an understanding of their TCO. We used an in-house benchmark called voltdb-charglt.

AWS 52

AWS Benchmarking Hardware Latency 52

Percona

JUNE 22, 2023

Indexing efficiency Monitoring indexing efficiency in MySQL involves analyzing query performance, using EXPLAIN statements, utilizing performance monitoring tools, reviewing error logs, performing regular index maintenance, and benchmarking/testing. This KPI is also directly related to Query Performance and helps improve it.

Performance 109

Performance Monitoring Traffic Database 109

The Morning Paper

MAY 23, 2019

Looking across a set of eight Java benchmarks, we find that only two of them are array dominated, the rest having between 40% to 75% of the heap footprint allocated to objects, the vast majority of which are small. Consider a B-Tree node from the B-tree Java benchmark: Uncompressed, it’s memory layout looks like (a) below. Evaluation.

Cache 61

Cache Benchmarking Hardware Java 61

Percona

AUGUST 22, 2023

We’ll wrap it up by suggesting high availability open source solutions, and we’ll introduce you to support options for ensuring continuous high performance from your systems. A basic high availability database system provides failover (preferably automatic) from a primary database node to redundant nodes within a cluster.

Availability 84

Availability Hardware Open Source Database 84

The Morning Paper

MAY 27, 2019

Last week we saw the benefits of rethinking memory and pointer models at the hardware level when it came to object storage and compression ( Zippads ). The protections are hardware implemented and cannot be forged in software. And this all has to work for whole-system executions, not just the C-language portion of user processes.

C++ 61

C++ Hardware Virtualization Benchmarking 61

HammerDB

JUNE 27, 2022

HammerDB is a software application for database benchmarking. It enables the user to measure database performance and make comparative judgements about database hardware and software. HammerDB has graphical and command line interfaces for the Windows and Linux operating systems. Why HammerDB was developed. HammerDB Licensing.

Benchmarking 63

Benchmarking Open Source C++ Cache 63

HammerDB

FEBRUARY 25, 2021

HammerDB is a load testing and benchmarking application for relational databases. On high-performance multi-core systems all the supported databases can return performance in the many millions of transactions per minute. Basic Benchmarking Concepts. To benchmark a database we introduce the concept of a Virtual User.

Programming 68

Programming Benchmarking Virtualization C++ 68

Brendan Gregg

SEPTEMBER 25, 2021

CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Microbenchmark os::javaTimeMillis() on both systems. Running this on the two systems saw similar results.

Speed 103

Speed Java AWS Virtualization 103

SQL Performance

DECEMBER 17, 2019

This removes the burden of purchasing and maintaining your hardware, storage and networking infrastructure, while still giving you a very familiar experience with Windows and SQL Server itself. You will still have to maintain your operating system, SQL Server and databases just like you would in an on-premises scenario.

Azure 72

Azure Virtualization Servers Storage 72

The Morning Paper

JUNE 11, 2019

FlexFlow is also given a device topology graph describing all the available hardware devices and their interconnections. Hardware connections between devices are modelled as special communication devices which can execute communication tasks. FlexFlow is evaluated over six real-world DNN benchmarks on two different GPU clusters.

Network 81

Network Strategy Hardware Benchmarking 81

HammerDB

DECEMBER 3, 2024

An often overlooked aspect of database benchmarking is that it should be used to stress test databases on all new hardware environments before they enter production. Copy Code Copied Use a different Browser A corrected hardware error has occurred. Copy Code Copied Use a different Browser Faulting application name: wish90.exe,

Performance 52

Performance Hardware Virtualization Benchmarking 52

Alex Russell

MARCH 6, 2021

Hardware Past As Performance Prologue. Using a global ASP as a benchmark can further mislead thanks to the distorting effect of ultra-high-end prices rising while shipment volumes stagnate. But the hardware future is not evenly distributed, and web workloads aren't heavily parallel. Today, either method returns a similar answer.

Performance 127

Performance Network Metrics Cache 127

HammerDB

JULY 6, 2024

In a recent project comparing systems for MariaDB performance, a user had originally been using a tool called sysbench-tpcc to compare hardware platforms before migrating to HammerDB. This is a brief post to highlight the metrics to use to do the comparison using a separate hardware platform for illustration purposes.

C++ 52

C++ Hardware Benchmarking Virtualization 52

HammerDB

APRIL 19, 2023

Therefore, before we attempt to measure our database performance, we should know the system or cloud instance to be tested in detail. Benchmarking the target Two of the more popular database benchmarks for MySQL are HammerDB and sysbench. Operating System: Ubuntu 22.04 Operating System: Ubuntu 22.04

Performance 55

Performance Benchmarking Cache Storage 55

VoltDB

JUNE 1, 2017

Hardware Optimizers” want to get the maximum utilization out of hardware. Telcos and Fortune 500 corporations used to spend years defining custom systems, down to the last cable. Private Clouds made of commodity hardware are perceived as the logical solution to this problem. The “Public Private Cloud” folks.

Hardware 56

Hardware Latency Virtualization Cloud 56

SQL Performance

AUGUST 27, 2019

It will also use less power than a two-socket Intel server, with a lower hardware cost, and potentially lower licensing costs (for things like VMware). The initial reviews and benchmarks for these processors have been very impressive: AMD EPYC 7002 Series Rome Delivers a Knockout. TPC-H Benchmark Results with SQL Server 2017.

Servers 52

Servers Benchmarking Virtualization Architecture 52

Abhishek Tiwari

DECEMBER 27, 2017

A recent performance benchmark completed by Intel and BlueData using the BigBench benchmarking kit has shown that the performance ratios for container-based Hadoop workloads on BlueData EPIC are equal to and in some cases, better than bare-metal Hadoop [7]. Performance.

Big Data 63

Big Data Storage Benchmarking Hardware 63

Percona

AUGUST 30, 2018

Because recognizing if the workload is read intensive or write intensive will impact your hardware choices, database configuration as well as what techniques you can apply for performance optimization and scalability. Let’s examine the TPC-C Benchmark from this point of view, or more specifically its implementation in Sysbench.

Benchmarking 49

Benchmarking Database Operating System Architecture 49

Alex Russell

MARCH 9, 2024

In both cases, the OS will task the browser team to heavily prioritise integrations with the latest OS and hardware features at the expense of more broadly useful capabilities — e.g. shipping "notch" CSS and "force touch" events while neglecting Push. native, OS-specific) platform and the hopefully weaker web platform.

Benchmarking 60

Benchmarking Strategy Internet Internet 60

Alex Russell

OCTOBER 22, 2017

Budgets are scaled to a benchmark network & device. Tools and CI systems help them monitor progress & prevent regressions. Deciding what benchmark to use for a performance budget is crucial. Some systems show median RTTs near ~100ms for 3G users. Performance budgets are set early in the life of the project.

Performance 74

Performance Network Benchmarking Mobile 74