Dynatrace

DECEMBER 27, 2022

Instead, they can ensure that services comport with the pre-established benchmarks. Using data from Dynatrace and its SLO wizard , teams can easily benchmark meaningful, user-based reliability measurements and establish error budgets to implement SLOs that meet business objectives and drive greater DevOps automation. Reliability.

Software 277

Software Software Benchmarking Latency 277

Dynatrace

MAY 23, 2024

ShuffleBench i s a benchmarking tool for evaluating the performance of modern stream processing frameworks. Stream processing systems, designed for continuous, low-latency processing, demand swift recovery mechanisms to tolerate and mitigate failures effectively. This significantly increases event latency.

Engineering 193

Engineering Tuning Latency Open Source 193

Scalegrid

JUNE 4, 2020

Compare Latency. lower latency compared to DigitalOcean for PostgreSQL. Now, let’s take a look at the throughput and latency performance of our comparison. Next, we are going to test and compare the latency performance between ScaleGrid and DigitalOcean for PostgreSQL. PostgreSQL DigitalOcean Latency Averages (ms).

Database 230

Database Latency Benchmarking Performance 230

High Scalability

SEPTEMBER 1, 2020

In this blog post, we compare Azure Database for MySQL vs. ScaleGrid MySQL on Azure so you can see which provider offers the best throughput and latency performance. We measure latency in ms 95th percentile latency.

Azure 137

Azure Database Benchmarking Performance 137

DZone

JUNE 2, 2019

Almost every time I present RSocket to an audience, there will be someone asking the question: "How does RSocket compare to gRPC?" " Today we are going to find out.

Benchmarking 279

Benchmarking Latency Java Scalability 279

HammerDB

OCTOBER 23, 2023

HammerDB uses stored procedures to achieve maximum throughput when benchmarking your database. HammerDB has always used stored procedures as a design decision because the original benchmark was implemented as close as possible to the example workload in the TPC-C specification that uses stored procedures. On MySQL, we saw a 1.5X

Benchmarking 62

Benchmarking Database Network C++ 62

Scalegrid

JANUARY 25, 2024

Key Takeaways Critical performance indicators such as latency, CPU usage, memory utilization, hit rate, and number of connected clients/slaves/evictions must be monitored to maintain Redis’s high throughput and low latency capabilities. It can achieve impressive performance, handling up to 50 million operations per second.

Metrics 130

Metrics Monitoring Latency Cache 130

Percona

NOVEMBER 3, 2023

Leveraging pgbench , which is a benchmarking utility that comes bundled with PostgreSQL, I will put the cluster through its paces by executing a series of DML operations. And now, execute the benchmark: -- execute the following on the coordinator node pgbench -c 20 -j 3 -T 60 -P 3 pgbench The results are not pretty.

Database 110

Database Benchmarking Latency C++ 110

VoltDB

JULY 24, 2024

As part of our new support for ARM processors , we recently ran benchmarks on both Intel C7 and ARM c7g on AWS. The goal of these benchmarks was to both quantify performance differences between the two platforms and gain an understanding of their TCO. We used an in-house benchmark called voltdb-charglt.

AWS 52

AWS Benchmarking Hardware Latency 52

Brendan Gregg

JUNE 30, 2018

These have inspired me to summarize another performance activity: evaluating benchmark accuracy. Accurate benchmarking rewards engineering investment that actually improves performance, but, unfortunately, inaccurate benchmarking is more common. If the benchmark reported 20k ops/sec, you should ask: why not 40k ops/sec?

Benchmarking 47

Benchmarking Latency Cache Network 47

HammerDB

OCTOBER 18, 2019

HammerDB doesn’t publish competitive database benchmarks, instead we always encourage people to be better informed by running their own. So over at Phoronix some database benchmarks were published showing PostgreSQL 12 Performance With AMD EPYC 7742 vs. Intel Xeon Platinum 8280 Benchmarks .

Benchmarking 63

Benchmarking Performance Hardware C++ 63

Scalegrid

OCTOBER 24, 2019

As organizations continue to migrate to the cloud, it’s important to get in front of performance issues, such as high latency, low throughput, and replication lag with higher distances between your users and cloud infrastructure. MySQL Performance Benchmark Configuration. MySQL on AWS Performance Test. Amazon RDS. Instance Type.

AWS 183

AWS Latency Performance Performance Testing 183

John McCalpin

APRIL 25, 2023

I have a lot of historical data using my ReadOnly benchmark (as described in some of the earliest entries in this blog [link] A read-only access pattern removes the need to understand and explain the many complexities associated with the “streaming stores” typically used in the STREAM benchmark (e.g., Stay tuned!

Benchmarking 97

Benchmarking Cache Latency Tuning 97

The Morning Paper

MARCH 10, 2020

Characterizing, modeling, and benchmarking RocksDB key-value workloads at Facebook , Cao et al., Or in the case of key-value stores, what you benchmark. So if you want to design a system that will offer good real-world performance, it’s really useful to have benchmarks that accurately represent real-world workloads.

Benchmarking 59

Benchmarking Storage Cache Open Source 59

Brendan Gregg

JUNE 29, 2018

These have inspired me to summarize another performance activity: evaluating benchmark accuracy. Accurate benchmarking rewards engineering investment that actually improves performance, but, unfortunately, inaccurate benchmarking is more common. If the benchmark reported 20k ops/sec, you should ask: why not 40k ops/sec?

Benchmarking 40

Benchmarking Latency Cache Network 40

Percona

DECEMBER 26, 2023

Querying the data While it is reasonable to create panels showing real-time load in order to explore better the types of queries that can be run against pg_stat_monitor, it is more practical to copy and query the data into tables after the benchmarking has completed its run. A script executing a benchmarking run: #!/bin/bash

Benchmarking 126

Benchmarking Metrics C++ Database 126

Percona

DECEMBER 11, 2023

DLVs are particularly advantageous for databases with large allocated storage, high I/O per second (IOPS) requirements, or latency-sensitive workloads. We performed a standard benchmarking test using the sysbench tool to compare the performance of a DLV instance vs a standard RDS MySQL instance, as shared in the following section.

AWS 103

AWS Benchmarking Performance Traffic 103

Dynatrace

MAY 5, 2021

Quality gates are benchmarks in the software delivery lifecycle that define specific, measurable, and achievable success criteria a service must meet before moving to the next phase of the software delivery pipeline. For example, improving latency by as little as 0.1 latency is the number one reason consumers abandon mobile sites.

Benchmarking 196

Benchmarking Latency Speed Software 196

Randon ASCII

JANUARY 12, 2022

Back in the day I wrote a lot of benchmarks in order to look for places where the actual performance of the CPU didn’t match what we expected. I wrote a lot of benchmarks. One benchmark I wrote measured the L2 cache latency. So, anyway. Standard stuff. So that’s interesting. Since the Xbox 360 CPU ran at 3.2 mm distance!

Cache 126

Cache Latency Benchmarking Hardware 126

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., A typical architecture diagram for one of these services looks like this: Suitably armed with a set of benchmark microservices applications, the investigation can begin! ASPLOS’19.

Open Source 61

Open Source Hardware Benchmarking Systems 61

Scalegrid

NOVEMBER 26, 2020

Redis is an advanced key-value store. In fact, it is the number one key value store and eighth most popular database in the world. It has high throughput and runs from memory, but also has the ability to persist data on disk. Redis is a great caching solution for highly demanding applications, and there are […].

Cache 130

Cache Azure Benchmarking Performance 130

n0derunner

AUGUST 20, 2020

The post Cross rack network latency in AWS appeared first on n0derunner. The bandwidth is 25GbE however, the response time between the hosts is so high that I need multiple streams to consume that bandwidth. Compared to my local on-prem lab I need many more streams to.

Latency 40

Latency Network AWS Design 40

Adrian Cockcroft

JANUARY 20, 2023

Here’s some predictions I’m making: Jack Dongarra’s efforts to highlight the low efficiency of the HPCG benchmark as an issue will influence the next generation of supercomputer architectures to optimize for sparse matrix computations. In early January a related paper was published by Satoshi Matsuoka et. petaflops, which is 0.8%

Architecture 52

Architecture Latency Benchmarking AWS 52

John McCalpin

APRIL 2, 2020

To show that I can criticize my own work as well, here I show that sustained memory bandwidth (using an approximation to the STREAM Benchmark ) is also inadequate as a single figure of metric. (It Building separate models for each of the benchmarks was required to get the correct asymptotic properties.

Benchmarking 59

Benchmarking Performance Latency Architecture 59

Scalegrid

NOVEMBER 25, 2019

ScyllaDB offers significantly lower latency which allows you to process a high volume of data with minimal delay. In fact, according to ScyllaDB’s performance benchmark report, their 99.9 percentile latency is up to 11X better than Cassandra on AWS EC2 bare metal. So this type of performance has to come at a cost, right?

Big Data 187

Big Data Database Open Source Azure 187

Speed Curve

FEBRUARY 5, 2024

Looking at the industry benchmarks for US retailers , four well-known sites have backend times that are approaching – or well beyond – that threshold. Pagespeed Benchmarks - US Retail - LCP When you examine a waterfall, it's pretty obvious that TTFB is the long pole in the tent, pushing out render times for the page.

Servers 57

Servers Cache Benchmarking Retail 57

Particular Software

SEPTEMBER 20, 2021

Some will claim that any type of RPC communication ends up being faster (meaning it has lower latency) than any equivalent invocation using asynchronous messaging. If you did such a benchmark, here’s an incomplete picture you might end up with: Graph of microbenchmark showing RPC is faster than messaging. Messaging doesn’t do that.

Benchmarking 97

Benchmarking Latency Servers Systems 97

The Netflix TechBlog

NOVEMBER 22, 2019

In this talk, we share how Netflix deploys systems to meet its demands, Ceph’s design for high availability, and results from our benchmarking. Netflix runs dozens of stateful services on AWS under strict sub-millisecond tail-latency requirements, which brings unique challenges.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

In this talk, we share how Netflix deploys systems to meet its demands, Ceph’s design for high availability, and results from our benchmarking. Netflix runs dozens of stateful services on AWS under strict sub-millisecond tail-latency requirements, which brings unique challenges.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

SEPTEMBER 2, 2020

Telltale provides Edgar with latency benchmarks that indicate if the individual trace’s latency is abnormal for this given service. Telltale’s anomaly analysis looks at historic behavior and can evaluate whether the latency experienced by this trace is anomalous. Is this an anomaly or are we dealing with a pattern?

Latency 298

Latency Transportation Engineering Traffic 298

Dynatrace

JUNE 27, 2022

In some cases, you will lack benchmarking capabilities. connectivity, access, user count, latency) of geographic regions. Because pre-production environments are used for testing before an application is released to end users, teams have no access to real-user data. RUM generates a lot of data. Synthetic monitoring drawbacks.

Best Practices 187

Best Practices Monitoring Wireless Traffic 187

Scalegrid

MARCH 28, 2024

Benchmarking Cache Speed Memcached is optimized for high read and write loads, making it highly efficient for rapid data access in a basic key-value store. Redis’s support for pipelining in a Redis server can significantly reduce network latency by batching command executions, making it beneficial for write-heavy applications.

Cache 130

Cache Storage Architecture Scalability 130

HammerDB

JULY 6, 2024

Throughput: events/s (eps): 8162.5668 time elapsed: 300.0356s total number of events: 2449061 Latency (ms): min: 0.35 Summary Of course the more benchmarks and workloads you run against a system, the more insights you can get. All benchmarks are valuable, however it is important to ensure that you deriving accurate results.

C++ 52

C++ Hardware Benchmarking Virtualization 52

The Netflix TechBlog

OCTOBER 19, 2020

If we had an ID for each streaming session then distributed tracing could easily reconstruct session failure by providing service topology, retry and error tags, and latency measurements for all service calls. Using simple lookup indices in Cassandra gives us the ability to maintain acceptable read latencies while doing heavy writes.

Infrastructure 236

Infrastructure Transportation Storage Open Source 236

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. I love short benchmarks like this as I can disassemble the resulting binary and ensure that the compiled instructions match my expectations, and the compiler hasen't messed with it. ## 6. include <sys/time.h>

Speed 103

Speed Java AWS Virtualization 103

Percona

APRIL 7, 2023

To illustrate this, I ran the Sysbench-TPCC synthetic benchmark against two different GCP instances running a freshly installed Percona Server for MySQL version 8.0.31 on CentOS 7, both of them spec’d with four vCPUs but with the second one (server B) having a tad over twice as much memory than the reference one (server A).

Tuning 139

Tuning Cache Servers Benchmarking 139

The Morning Paper

NOVEMBER 8, 2020

The initial version of Delos went into production after eight months using a ZooKeeper-backed Loglet implementation, and then four months later it was swapped out for a new custom-built NativeLoglet that gave a 10x improvement in end-to-end latency. For Facebook’s Delos, reconfiguration latencies of 10s of ms are ok.

Virtualization 126

Virtualization Latency Storage Systems 126