Dynatrace

MAY 5, 2021

Quality gates are benchmarks in the software delivery lifecycle that define specific, measurable, and achievable success criteria a service must meet before moving to the next phase of the software delivery pipeline. For example, improving latency by as little as 0.1 Enforcing benchmarks in real time.

Benchmarking 189

Benchmarking Latency Speed Software 189

Scalegrid

JANUARY 25, 2024

Key Takeaways Critical performance indicators such as latency, CPU usage, memory utilization, hit rate, and number of connected clients/slaves/evictions must be monitored to maintain Redis’s high throughput and low latency capabilities. It can achieve impressive performance, handling up to 50 million operations per second.

Metrics 130

Metrics Monitoring Latency Cache 130

Dynatrace

JUNE 27, 2022

Data collected on page load events, for example, can include navigation start (when performance begins to be measured), request start (right before the user makes a request from the server), and speed index metrics (measure page load speed). In some cases, you will lack benchmarking capabilities. RUM generates a lot of data.

Best Practices 181

Best Practices Monitoring Wireless Traffic 181

Percona

DECEMBER 26, 2023

Installation (example: CENTOS8, pg14) The simplest way to get pg_stat_monitor is to install it via Percona Distribution for PostgreSQL. A script executing a benchmarking run: #!/bin/bash Histogram : Visual representation is very helpful as it can help identify issues. And yes, it even works in PostgreSQL.

Benchmarking 127

Benchmarking Metrics C++ Database 127

The Netflix TechBlog

OCTOBER 19, 2020

a Netflix member via Twitter This is an example of a question our on-call engineers need to answer to help resolve a member issue?—?which Using simple lookup indices in Cassandra gives us the ability to maintain acceptable read latencies while doing heavy writes. which is difficult when troubleshooting distributed systems.

Infrastructure 239

Infrastructure Transportation Storage Open Source 239

HammerDB

OCTOBER 18, 2019

HammerDB doesn’t publish competitive database benchmarks, instead we always encourage people to be better informed by running their own. So over at Phoronix some database benchmarks were published showing PostgreSQL 12 Performance With AMD EPYC 7742 vs. Intel Xeon Platinum 8280 Benchmarks . 3823 2694 -- 0 4 4 2864 74.83

Benchmarking 63

Benchmarking Performance Hardware C++ 63

Brendan Gregg

JUNE 30, 2018

These have inspired me to summarize another performance activity: evaluating benchmark accuracy. Accurate benchmarking rewards engineering investment that actually improves performance, but, unfortunately, inaccurate benchmarking is more common. If the benchmark reported 20k ops/sec, you should ask: why not 40k ops/sec?

Benchmarking 47

Benchmarking Latency Cache Network 47

Percona

DECEMBER 11, 2023

DLVs are particularly advantageous for databases with large allocated storage, high I/O per second (IOPS) requirements, or latency-sensitive workloads. We performed a standard benchmarking test using the sysbench tool to compare the performance of a DLV instance vs a standard RDS MySQL instance, as shared in the following section.

AWS 104

AWS Benchmarking Performance Traffic 104

HammerDB

OCTOBER 23, 2023

HammerDB uses stored procedures to achieve maximum throughput when benchmarking your database. HammerDB has always used stored procedures as a design decision because the original benchmark was implemented as close as possible to the example workload in the TPC-C specification that uses stored procedures.

Benchmarking 63

Benchmarking Database Network C++ 63

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., A typical architecture diagram for one of these services looks like this: Suitably armed with a set of benchmark microservices applications, the investigation can begin! ASPLOS’19.

Open Source 61

Open Source Hardware Benchmarking Systems 61

The Netflix TechBlog

NOVEMBER 22, 2019

In this talk, we share how Netflix deploys systems to meet its demands, Ceph’s design for high availability, and results from our benchmarking. Netflix runs dozens of stateful services on AWS under strict sub-millisecond tail-latency requirements, which brings unique challenges. Thursday?—?December

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

In this talk, we share how Netflix deploys systems to meet its demands, Ceph’s design for high availability, and results from our benchmarking. Netflix runs dozens of stateful services on AWS under strict sub-millisecond tail-latency requirements, which brings unique challenges. Thursday?—?December

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Morning Paper

NOVEMBER 8, 2020

The initial version of Delos went into production after eight months using a ZooKeeper-backed Loglet implementation, and then four months later it was swapped out for a new custom-built NativeLoglet that gave a 10x improvement in end-to-end latency. For Facebook’s Delos, reconfiguration latencies of 10s of ms are ok.

Virtualization 126

Virtualization Latency Storage Systems 126

Brendan Gregg

JUNE 29, 2018

These have inspired me to summarize another performance activity: evaluating benchmark accuracy. Accurate benchmarking rewards engineering investment that actually improves performance, but, unfortunately, inaccurate benchmarking is more common. If the benchmark reported 20k ops/sec, you should ask: why not 40k ops/sec?

Benchmarking 40

Benchmarking Latency Cache Network 40

Percona

APRIL 7, 2023

To illustrate this, I ran the Sysbench-TPCC synthetic benchmark against two different GCP instances running a freshly installed Percona Server for MySQL version 8.0.31 For example, if the hot data can fit in 12G, then increasing the Buffer Pool to 26G won’t make much of a difference.

Tuning 139

Tuning Cache Servers Benchmarking 139

Percona

JUNE 22, 2023

Let’s dive in and learn how (and what) to effectively monitor MySQL performance, along with examples from PMM, by understanding the critical KPIs to watch for. This is not an exhaustive list but an example of what we can watch for. This KPI is also directly related to Query Performance and helps improve it.

Performance 109

Performance Monitoring Traffic Database 109

VoltDB

JULY 24, 2024

As part of our new support for ARM processors , we recently ran benchmarks on both Intel C7 and ARM c7g on AWS. The goal of these benchmarks was to both quantify performance differences between the two platforms and gain an understanding of their TCO. We used an in-house benchmark called voltdb-charglt.

AWS 52

AWS Benchmarking Hardware Latency 52

Speed Curve

FEBRUARY 5, 2024

Looking at the industry benchmarks for US retailers , four well-known sites have backend times that are approaching – or well beyond – that threshold. Pagespeed Benchmarks - US Retail - LCP When you examine a waterfall, it's pretty obvious that TTFB is the long pole in the tent, pushing out render times for the page.

Servers 60

Servers Cache Retail Benchmarking 60

Percona

JANUARY 24, 2023

For example, MySQL/InnoDB deals with this problem using a Doublewrite buffer from where a copy of the non-corrupt page can be obtained during the recovery. Lz4 is a good example. Individual processes generate WAL records, and latency is very crucial for transactions. PostgreSQL’s approach to the problem is slightly different.

Database 121

Database Benchmarking Open Source Latency 121

Scalegrid

JANUARY 12, 2024

Various forms can take shape when discussing workloads within the realm of cloud computing environments – examples include order management databases, collaboration tools, videoconferencing systems, virtual desktops, and disaster recovery mechanisms. What is an example of a workload? What is meant by the workload in computers?

Cloud 130

Cloud Virtualization Storage Efficiency 130

Percona

MARCH 23, 2023

Nowadays, solid-state drives (SSDs) or non-volatile memory express (NVMe) drives are preferred over traditional hard disk drives (HDDs) for database servers due to their faster read and write speeds, lower latency, and improved reliability. Benchmark before you decide.

Performance 130

Performance Hardware Tuning Storage 130

Alex Russell

MARCH 6, 2021

The Moto G4 , for example. Using a global ASP as a benchmark can further mislead thanks to the distorting effect of ultra-high-end prices rising while shipment volumes stagnate. Sadly, data on latency is harder to get, even from Google's perch, so progress there is somewhat more difficult to judge. A 2021 Global Baseline.

Performance 127

Performance Network Mobile Metrics 127

HammerDB

NOVEMBER 5, 2018

This post at an entry-level discusses the options you have to improve log throughput in your benchmark environment. . Additionally for the log disk component it is latency for an individual write that is crucial rather than the total I/O bandwidth. A good example of how tuning is an iterative process. Oracle Log File Sync.

Benchmarking 40

Benchmarking Database C++ Virtualization 40

Smashing Magazine

SEPTEMBER 28, 2022

On your first try, you can use it as a benchmark for optimizations later. Jamstack files usually use Markdown before being compiled to HTML, for example: author: Agustinus Theodorus title: ‘Title’ description: Description. The examples are from the MDN Docs. It is important to note how much data the client needs to download.

Cache 128

Cache Performance Servers Architecture 128

Speed Curve

MAY 1, 2023

A good practice is to: Look at your last 2-4 weeks of data for a given metric Identify the worst number Set your performance budget for that number In the example above, you can see a time series chart that shows Largest Contentful Paint times over a one-month period. Let's continue with the example above, where the worst LCP time was 8.64

Performance 98

Performance Metrics Media Google 98

Alex Russell

OCTOBER 22, 2017

Budgets are scaled to a benchmark network & device. If our example document wasn’t reliant on JavaScript to construct the <my-app> custom element, the contents of the document would likely be interactive as soon as enough CSS and content was available to render meaningfully. Construction of DOM. Global Ground-Truth.

Performance 74

Performance Network Benchmarking Mobile 74

Alex Russell

APRIL 29, 2021

As an engineer on a browser team, I'm privy to the blow-by-blow of various performance projects, benchmark fire drills, and the ways performance marketing (deeply) impacts engineering priorities. With each team, benchmarks lost are understood as bugs. For example, an area where Apple is absolutely killing it is in mobile CPU design.

Media 145

Media Games Education Engineering 145

n0derunner

SEPTEMBER 17, 2018

Creating a HCI benchmark to simulate multi-tennent workloads. In such a case we have a Bandwidth heavy workload profile (reporting) sharing with a Latency Sensitive workload (transactional). The DB Colocation test utilizes two properties of X-Ray not found in other benchmarking tools. Time based benchmark actions.

Performance Testing 40

Performance Testing Benchmarking Testing Performance 40

Speed Curve

SEPTEMBER 4, 2013

Why speed matters, examples of the impact saving a few seconds of load time has had on revenue and engagement. Bandwidth, latency and it's fundamental impact on the speed of the web. An overview of tools for measuring performance, uptime monitoring, real user monitoring and performance benchmarking. Drop that donut superman!

Speed 40

Speed Benchmarking Mobile Website 40

CSS - Tricks

APRIL 1, 2021

Google’s industry benchmarks from 2018 also provide a striking breakdown of how each second of loading affects bounce rates. Redirects are often pretty light in terms of the latency that they add to a website, but they are an easy first thing to check, and they can generally be removed with little effort. View the full example ).

Cache 92

Cache Social Media Media Website 92

Abhishek Tiwari

DECEMBER 27, 2017

A recent performance benchmark completed by Intel and BlueData using the BigBench benchmarking kit has shown that the performance ratios for container-based Hadoop workloads on BlueData EPIC are equal to and in some cases, better than bare-metal Hadoop [7]. Twitter Heron is another good example of this approach. Performance.

Big Data 63

Big Data Storage Benchmarking Hardware 63

HammerDB

JULY 6, 2024

HammerDB also runs natively on Windows and Linux with GUI, CLI and Web interfaces on multiple databases, but in this case the example will be on MariaDB on Linux with the CLI. 0 MariaDB tpm and a HammerDB example script as follows: Copy Code Copied Use a different Browser #!/bin/tclsh The scripts can be in Python or Tcl format.

C++ 52

C++ Hardware Benchmarking Virtualization 52

Tim Kadlec

APRIL 18, 2019

AT&T’s “5G E” is a great example. Once a new network does get rolled out, it takes years for carriers to optimize it to try and close in on the promised bandwidth and latency benchmarks. Compare that, for example, to recent data from Open Signal about actual speeds observed in India.

Network 61

Network Speed Internet Internet 61

KeyCDN

AUGUST 15, 2019

Before you begin tuning your website or application, you must first figure out which metrics matter most to your users and establish some achievable benchmarks. Bottlenecks can occur, for example, if you have a sudden surge in traffic that your servers are not equipped to handle. What is Performance Testing?

Testing Tools 55

Testing Tools Best Practices Performance Testing Testing 55

HammerDB

DECEMBER 5, 2020

For example HammerDB has not used tpmC terminology to report TPC-C based metrics instead using TPM and NOPM nomenclature. The HammerDB TPROC-C workload by design intended as CPU and memory intensive workload derived from TPC-C – so that we get to benchmark at maximum CPU performance at a much smaller database footprint.

C++ 40

C++ Benchmarking Virtualization Open Source 40

SQL Performance

APRIL 8, 2019

The pricing details for the East US region are here , as an example. I wrote about using CPU-Z to benchmark the Intel Xeon E5-2673 v3 processor in an Azure VM in this article. Figure 1: CPU-Z Benchmark Results for LS16v2. They feature low latency, local NVMe storage that can directly leverage the 128 PCIe 3.0

Azure 42

Azure Virtualization Storage Benchmarking 42

Alex Russell

JANUARY 30, 2024

For example, India's network environment has continued to evolve since the Reliance Jio revolution that drove 4G into the mainstream and pushed the price of a mobile megabyte down by ~90% on every subcontinental carrier. Representative examples from that time period include the Samsung Galaxy A51 and the Pixel 4a.

Performance 98

Performance Network Mobile Speed 98