Dynatrace

MAY 5, 2021

Quality gates are benchmarks in the software delivery lifecycle that define specific, measurable, and achievable success criteria a service must meet before moving to the next phase of the software delivery pipeline. According to Six Sigma Daily, poor testing leads to overruns amounting to up to 40% of an operation’s budget.

Benchmarking 193

Benchmarking Latency Speed Software 193

John McCalpin

APRIL 25, 2023

I have a lot of historical data using my ReadOnly benchmark (as described in some of the earliest entries in this blog [link] A read-only access pattern removes the need to understand and explain the many complexities associated with the “streaming stores” typically used in the STREAM benchmark (e.g., Stay tuned!

Benchmarking 97

Benchmarking Cache Latency Tuning 97

HammerDB

OCTOBER 18, 2019

HammerDB doesn’t publish competitive database benchmarks, instead we always encourage people to be better informed by running their own. So over at Phoronix some database benchmarks were published showing PostgreSQL 12 Performance With AMD EPYC 7742 vs. Intel Xeon Platinum 8280 Benchmarks . uname -a Linux ubuntu19 5.3.0-rc3-custom

Benchmarking 63

Benchmarking Performance Hardware C++ 63

Brendan Gregg

JUNE 29, 2018

A co-worker introduced me to Craig Hanson and Pat Crain's performance mantras, which neatly summarize much of what we do in performance analysis and tuning. These have inspired me to summarize another performance activity: evaluating benchmark accuracy. If the benchmark reported 20k ops/sec, you should ask: why not 40k ops/sec?

Benchmarking 40

Benchmarking Latency Cache Network 40

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

Percona

NOVEMBER 3, 2023

Leveraging pgbench , which is a benchmarking utility that comes bundled with PostgreSQL, I will put the cluster through its paces by executing a series of DML operations. And now, execute the benchmark: -- execute the following on the coordinator node pgbench -c 20 -j 3 -T 60 -P 3 pgbench The results are not pretty.

Database 108

Database Benchmarking Latency C++ 108

HammerDB

APRIL 19, 2023

Therefore, before we attempt to measure our database performance, we should know the system or cloud instance to be tested in detail. Benchmarking the target Two of the more popular database benchmarks for MySQL are HammerDB and sysbench. For the experiments in this blog, we did not tune the system. 4.22 %usr 38.40

Performance 54

Performance Benchmarking Cache Storage 54

Dynatrace

FEBRUARY 10, 2022

Static Application Security Testing (SAST) solutions are a traditional way of addressing this. A perfect OWASP benchmark score for injection attacks – 100% accuracy and zero false positives – impressively proves the precision of our approach. Unfortunately, they also introduce risk.

Traffic 240

Traffic Benchmarking Innovation Java 240

Dynatrace

OCTOBER 2, 2023

Because they’re separate, they allow for faster release cycles, greater scalability, and the flexibility to test new methodologies and technologies. However, the distributed system of a microservices architecture comes with its own cost: increased application complexity and convoluted testing. Migration is time-consuming and involved.

Architecture 243

Architecture Artificial Intelligence Cloud Open Source 243

The Morning Paper

NOVEMBER 3, 2019

Perhaps the most interesting lesson/reminder is this: it takes a lot of effort to tune a Linux kernel. Google’s data center kernel is carefully performance tuned for their workloads. A micro-benchmark suite, LEBench was then built around tee system calls responsible for most of the time spent in the kernel. Headline results.

Performance 108

Performance Benchmarking Tuning Hardware 108

HammerDB

OCTOBER 18, 2018

An essential part of database performance testing is viewing the statistics generated by the database during the test and in 2009 HammerDB introduced automatic AWR snapshot generation for Oracle for the TPC-C test. With this feature Oracle generates a wealth of performance data that can be reviewed once the test is complete.

Benchmarking 40

Benchmarking Monitoring Performance C++ 40

Scalegrid

JANUARY 25, 2024

Key metrics like throughput, request latency, and memory utilization are essential for assessing Redis health, with tools like the MONITOR command and Redis-benchmark for latency and throughput analysis and MEMORY USAGE/STATS commands for evaluating memory. It depends upon your application workload and its business logic.

Metrics 130

Metrics Monitoring Latency Cache 130

Scalegrid

OCTOBER 24, 2019

MySQL on AWS Performance Test. MySQL Performance Benchmark Configuration. MySQL Performance Test Scenarios and Results. Each scenario is run with varying number of sysbench client threads ranging from 50 to 400, and each test is run for a duration of 10 minutes. Amazon RDS. Instance Type. DB Instance r4.xlarge

AWS 183

AWS Latency Performance Performance Testing 183

Dynatrace

APRIL 8, 2021

If you haven’t done so already, providing a testing environment for developers to easily test their functions with AWS solves most of these challenges and makes the required tooling similar to what’s required for operating microservices. These served as our benchmark when creating our Lambda monitoring extension.

Lambda 231

Lambda AWS Serverless Monitoring 231

The Netflix TechBlog

MARCH 14, 2023

In addition, we were able to perform a handful of A/B tests to validate or negate our hypotheses for tuning the search experience. When onboarding embedding vector data we performed an extensive benchmarking to evaluate the available datastores. We will continue to share our work in this space, so stay tuned.

Media 296

Media Innovation Energy Architecture 296

Percona

MARCH 27, 2023

A lot of useful information can be retrieved from this schema, for example, table metadata and foreign key relations, but trying to query I_S can induce performance degradation if your server is under heavy load, as shown in the following example test. The same tests have been executed in Percona Server for MySQL 5.7

Cache 105

Cache Hardware Servers Benchmarking 105

Percona

MARCH 23, 2023

Benchmark before you decide. The optimal value can be decided after testing multiple settings, starting from eight is a good choice. If you see concurrency issues, you can tune this variable. Application tuning for InnoDB Make sure your application is prepared to handle deadlocks that may happen. I hope this helps!

Performance 128

Performance Hardware Tuning Storage 128

Dynatrace

APRIL 8, 2021

If you haven’t done so already, providing a testing environment for developers to easily test their functions with AWS solves most of these challenges and makes the required tooling similar to what’s required for operating microservices. These served as our benchmark when creating our Lambda monitoring extension.

Lambda 193

Lambda AWS Serverless Monitoring 193

Percona

NOVEMBER 3, 2023

Quality assurance: How do you plan to test? Have you built a testing environment? Have you tuned your environment? Testing made easy An equally critical aspect of the database migration process is testing the migrated database to ensure everything will function correctly and no data will be lost or corrupted.

Database 86

Database Open Source Benchmarking Strategy 86

Scalegrid

JULY 13, 2020

Compare ease of use across compatibility, extensions, tuning, operating systems, languages and support providers. These new applications are a great way for enterprise companies to test out PostgreSQL before migrating their entire infrastructure. Compare Ease of Use.

Open Source 244

Open Source Tuning C++ Database 244

n0derunner

JULY 23, 2019

In this video I migrate a Postgres DB running PGbench benchmark. The variation in the transaction rate is due to the benchmark itself, the transaction rate is not expected to be uniform. The Postgres DB is totally un-tuned and contains purely default settings. The DB is running on a Host which is CPU constrained.

Benchmarking 76

Benchmarking Storage Cache Tuning 76

KeyCDN

AUGUST 15, 2019

Web performance is a broad subject, and you’ll find no shortage of performance testing tips and tutorials all over the web. Before you begin tuning your website or application, you must first figure out which metrics matter most to your users and establish some achievable benchmarks. What is Performance Testing?

Testing Tools 55

Testing Tools Best Practices Performance Testing Testing 55

High Scalability

AUGUST 24, 2021

No more hassles of benchmarking and tuning algorithms or building and maintaining infrastructure for vector search. Learn how engineering teams are using products like StackHawk and Snyk to add security bug testing to their CI pipelines. Bridgecrew is the cloud security platform for developers. Stateful JavaScript Apps.

Education 100

Education DevOps Infrastructure Benchmarking 100

High Scalability

OCTOBER 27, 2021

No more hassles of benchmarking and tuning algorithms or building and maintaining infrastructure for vector search. Learn how engineering teams are using products like StackHawk and Snyk to add security bug testing to their CI pipelines. Bridgecrew is the cloud security platform for developers. Stateful JavaScript Apps.

Education 100

Education DevOps Infrastructure Benchmarking 100

HammerDB

FEBRUARY 25, 2021

HammerDB is a load testing and benchmarking application for relational databases. All the databases that HammerDB tests implement a form of MVCC (multi-version concurrency control). This post explains why HammerDB made the language decisions it made to make it the best performing and most usable database benchmarking software.

Programming 67

Programming Benchmarking Virtualization C++ 67

High Scalability

SEPTEMBER 29, 2021

No more hassles of benchmarking and tuning algorithms or building and maintaining infrastructure for vector search. Learn how engineering teams are using products like StackHawk and Snyk to add security bug testing to their CI pipelines. Bridgecrew is the cloud security platform for developers. Stateful JavaScript Apps.

Education 100

Education DevOps Infrastructure Benchmarking 100

High Scalability

SEPTEMBER 15, 2021

No more hassles of benchmarking and tuning algorithms or building and maintaining infrastructure for vector search. Learn how engineering teams are using products like StackHawk and Snyk to add security bug testing to their CI pipelines. Bridgecrew is the cloud security platform for developers. Stateful JavaScript Apps.

Education 100

Education DevOps Infrastructure Benchmarking 100

The Netflix TechBlog

OCTOBER 19, 2020

Our engineering teams tuned their services for performance after factoring in increased resource utilization due to tracing. In 2019 our stunning colleagues in the Cloud Database Engineering (CDE) team benchmarked EBS performance for our use case and migrated existing clusters to use EBS Elastic volumes. What’s next?

Infrastructure 236

Infrastructure Transportation Storage Open Source 236

HammerDB

NOVEMBER 5, 2018

If you are new to running Oracle, SQL Server, MySQL and PostgreSQL TPC-C workloads with HammerDB and have needed to investigate I/O performance the chances are that you have experienced waits on writing to the Redo, Transaction Log or WAL depending on the database you are testing. SQL> alter system flush buffer_cache; System altered.

Benchmarking 40

Benchmarking Database C++ Virtualization 40

Percona

DECEMBER 20, 2018

Linux OS Tuning for MySQL Database Performance. In this post we will review the most important Linux settings to adjust for performance tuning and optimization of a MySQL database server. We’ll note how some of the Linux parameter settings used OS tuning may vary according to different system types: physical, virtual or cloud.

Database 40

Database Tuning Performance AWS 40

Apica

MAY 10, 2019

Whatever size of company you are, performance monitoring and testing is a critical part of the success you will have. It is also worth noting that brand popularity doesn’t translate into more success if you are not testing load to confirm your streaming services will performs. Apica’s scale is enterprise-grade.

Testing 40

Testing Performance Social Media Wireless 40

Brendan Gregg

SEPTEMBER 25, 2021

There's also a test and println() in the loop to, hopefully, convince the compiler not to optimize-out an otherwise empty loop. This will slow this test a little.) In 2019 myself and others tested kvm-clock and found it was only about 20% slower than tsc. Trying it out: centos$ time java TimeBench. include <sys/time.h>

Speed 103

Speed Java AWS Virtualization 103

Brendan Gregg

FEBRUARY 9, 2018

In this post I'll look at the Linux kernel page table isolation (KPTI) patches that workaround Meltdown: what overheads to expect, and ways to tune them. Much of my testing was on Linux 4.14.11 I then analyzed performance during the benchmark ([active benchmarking]), and used other benchmarks to confirm findings.

Performance 72

Performance Benchmarking Cache Tuning 72

Percona

JANUARY 19, 2023

Example: Creating four simple tables to store strings but using different data types: db1 test> CREATE TABLE tb1 (id int auto_increment primary key, test_text char(200)); Query OK, 0 rows affected (0.11 sec) db1 test> CREATE TABLE tb2 (id int auto_increment primary key, test_text varchar(200)); Query OK, 0 rows affected (0.05

Open Source 91

Open Source Storage Database Big Data 91

IO River

NOVEMBER 15, 2023

Let's break down this Security Flywheel into its core components: ‍Research, Close Breaches, and Test. But hold your horses—before switching them to "block" mode, it's crucial to test them extensively. After you've researched, closed breaches, and tested, you start all over again. It's an ongoing, iterative process.

Traffic 52

Traffic Network Logistics Architecture 52

Rigor

JANUARY 13, 2020

This practical guide shows users how run tests & interpret results to gain a better and more thorough understanding of hidden features in WebPageTest. For UX designers, product managers, developers - essential concepts, methods, and techniques for digital design that have withstood the test of time. Web Performance Tuning.

Performance 75

Performance Social Media Website Website Performance 75

Brendan Gregg

FEBRUARY 8, 2018

In this post I'll look at the Linux kernel page table isolation (KPTI) patches that workaround Meltdown: what overheads to expect, and ways to tune them. Much of my testing was on Linux 4.14.11 I then analyzed performance during the benchmark ([active benchmarking]), and used other benchmarks to confirm findings.

Performance 40

Performance Benchmarking Cache Tuning 40