All Things Distributed

NOVEMBER 21, 2018

People often ask me if developing for the cloud is any different from developing on-premises software. Verifying benchmark claims. The biggest difference between developing for the cloud and developing on-premises software is that in the cloud, you have much better access to how your customers are using your services.

Cloud 115

Cloud Benchmarking Performance AWS 115

The Morning Paper

SEPTEMBER 27, 2020

Furthermore, as hardware and compiler optimisations rapidly evolve, it is challenging even for a knowledgeable developer to keep up. The authors develop a tool called FPSpy which they use to monitor the floating point operations of existing scientific applications. PARSEC is a set of benchmarks for multi-threaded programs.

Benchmarking 101

Benchmarking Hardware Programming Code 101

The Morning Paper

NOVEMBER 3, 2019

For the rest of us, if you really need that extra performance (maybe what you get out-of-the-box or with minimal tuning is good enough for your use case) then you can upgrade hardware and/or pay for a commercial license of a tuned distributed (RHEL). A second takeaway is this: security has a cost! Measuring the kernel. Headline results.

Performance 108

Performance Benchmarking Tuning Hardware 108

Percona

NOVEMBER 3, 2023

PostgreSQL Cluster One coordinator node citus-coord-01 Three worker nodes citus1 citus2 citus3 Hardware AWS Instance Ubuntu Server 20.04, SSD volume type 64-bit (x86) c5.xlarge And now, execute the benchmark: -- execute the following on the coordinator node pgbench -c 20 -j 3 -T 60 -P 3 pgbench The results are not pretty.

Database 114

Database Benchmarking Latency C++ 114

Scalegrid

JULY 13, 2020

In this article, we compare Oracle vs. PostgreSQL, outlining the differences in these SQL database costs, features, and ease of use for both developers and database administrators (DBA’s) alike. PostgreSQL is an open source object-relational database system with over 30 years of active development. At a glance – TLDR.

Open Source 244

Open Source Tuning C++ Database 244

Adrian Cockcroft

SEPTEMBER 23, 2024

Most publications have simply reported the benchmark improvement claims, but if you stop to think about them, the numbers dont make sense based on a simplistic view of the technology changes. So first thing to understand is that the benchmark skips a generation and compares product that differs over about a two year interval.

Benchmarking 52

Benchmarking Energy Architecture Latency 52

Alex Russell

APRIL 29, 2021

Apple forces developers of competing browsers to use their engine for all browsers on iOS , restricting their ability to deliver a better version of the web platform. They are, pound for pound, some of the best engine developers globally and genuinely want good things for the web. With each team, benchmarks lost are understood as bugs.

Media 145

Media Games Education Engineering 145

Scalegrid

DECEMBER 6, 2023

This model offers hassle-free database management as well as access to an extensive suite of services that reduce developer workloads and enhance security while providing operational agility. Understanding the Database as a Service Model With DBaaS, businesses can enjoy a comprehensive and fully managed cruise experience.

Database 130

Database Cloud Hardware Storage 130

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. If a primary server fails, a backup server can take over and continue to serve requests.

Availability 132

Availability Database Open Source Hardware 132

Brendan Gregg

MARCH 16, 2024

I ended up developing a fix for the JVM c2 compiler which Oracle reworked and added as the -XX:+PreserveFramePointer option in JDK8u60 (see my Java in Flames post for details [ PDF ]). This technique saves two instructions in the prologue and epilogue and makes one additional general-purpose register (%rbp) available."

Java 137

Java Cache Google Hardware 137

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

HammerDB

JUNE 27, 2022

HammerDB is a software application for database benchmarking. It enables the user to measure database performance and make comparative judgements about database hardware and software. Why HammerDB was developed. HammerDB development. Usage and industry adoption. Derived Workloads.

Benchmarking 63

Benchmarking Open Source C++ Cache 63

Percona

AUGUST 30, 2018

Because recognizing if the workload is read intensive or write intensive will impact your hardware choices, database configuration as well as what techniques you can apply for performance optimization and scalability. Let’s examine the TPC-C Benchmark from this point of view, or more specifically its implementation in Sysbench.

Benchmarking 72

Benchmarking Database Operating System Architecture 72

The Morning Paper

JUNE 27, 2019

Systems researchers are doing an excellent job improving the performance of 5-year old benchmarks, but gradually making it harder to explore innovative machine learning research ideas. Worse, the resulting brake on innovation in languages is in itself reducing the incentive for back-end developers to improve on the current situation.

Systems 87

Systems Programming Tuning Innovation 87

VoltDB

JUNE 1, 2017

Hardware Optimizers” want to get the maximum utilization out of hardware. These systems were designed to have a lifetime of half a decade or more, and rapidly changing hardware meant that the initial deployment had to be sized for 5-7 years out. Attendees could be broken down into several distinct groups. Very Well!”

Hardware 56

Hardware Latency Virtualization Cloud 56

Abhishek Tiwari

DECEMBER 27, 2017

faster development and deployment cycles. The good news is all of these challenges including performance can be tackled and in several cases, there are new developments to overcome them. To address this, the open source community is now trying to develop Kubernetes custom schedulers specifically optimised for big data workloads.

Big Data 63

Big Data Storage Benchmarking Hardware 63

Percona

JANUARY 19, 2023

There are a couple of blog posts from Yves that describe and benchmark MySQL compression: Compression Options in MySQL (Part 1) Compression Options in MySQL (Part 2) Archive or purge old or non-used data: Some companies have to retain data for multiple years either for compliance or for business requirements.

Open Source 111

Open Source Storage Database Big Data 111

Alex Russell

OCTOBER 22, 2017

One of the most surprising results has been the frequent occurrence of “ambush by JavaScript” : We need a new term for the business-opportunity wastage that modern front-end development has created. Budgets are scaled to a benchmark network & device. Deciding what benchmark to use for a performance budget is crucial.

Performance 74

Performance Network Benchmarking Mobile 74

Percona

MAY 1, 2023

It is primarily the responsibility of the database administrator or developer to tune PostgreSQL according to their system’s workload. Hardware optimization : You need to ensure that the CPU, memory, and storage components meet the performance requirements of the database workload. Why is PostgreSQL performance tuning important?

Tuning 52

Tuning Database Efficiency Performance 52

VoltDB

JUNE 1, 2017

Hardware Optimizers” want to get the maximum utilization out of hardware. These systems were designed to have a lifetime of half a decade or more, and rapidly changing hardware meant that the initial deployment had to be sized for 5-7 years out. Attendees could be broken down into several distinct groups. Very Well!”

Hardware 40

Hardware Latency Virtualization Cloud 40

KeyCDN

AUGUST 15, 2019

Before you begin tuning your website or application, you must first figure out which metrics matter most to your users and establish some achievable benchmarks. In the context of web development, performance testing entails using software tools to simulate how an application runs under specific circumstances.

Testing Tools 55

Testing Tools Best Practices Performance Testing Testing 55

Abhishek Tiwari

DECEMBER 13, 2017

More importantly, if this works out well, this could lead to a radical improvement in performance by leveraging hardware trends such as GPUs and TPUs. applied their approach of learning based model to B-Tree, Hash-map, and Bloom filter to develop corresponding learned models. Learned indexes.

Artificial Intelligence 40

Artificial Intelligence Hardware Google Benchmarking 40

The Morning Paper

MAY 14, 2019

Last time around we looked at the DeathStarBench suite of microservices-based benchmark applications and learned that microservices systems can be especially latency sensitive, and that hotspots can propagate through a microservices architecture in interesting ways. When available, it can use hardware level performance counters.

Big Data 45

Big Data Cloud Performance Hardware 45

Percona

JULY 1, 2023

Understanding DBaaS DBaaS cloud services allow users to use databases without configuring physical hardware and infrastructure or installing software. Download our eBook, “ Enterprise Guide to Cloud Databases ” to help you make more informed decisions and avoid costly mistakes as you develop and execute your cloud strategy.

AWS 52

AWS Database Serverless Storage 52

Alex Russell

JANUARY 30, 2024

HTML, CSS, images, and fonts can all be parsed and run at near wire speeds on low-end hardware, but JavaScript is at least three times more expensive, byte-for-byte. It's clear that developers are out of touch with market ground-truth , but it's not obvious why. This was not a fast box. What does this mean for our target devices?

Performance 98

Performance Network Mobile Speed 98

SQL Server According to Bob

JANUARY 11, 2020

Example 1: ​​ Hardware failure (CPU board) Battery backup on the caching controller maintained the data. Important Always consult with your hardware manufacturer for proper stable media strategies. Mirroring can be implemented at a software or hardware level.

Servers 40

Servers Cache Media Hardware 40

Speed Curve

JANUARY 27, 2025

Developers are clearly out of touch with market ground-truth. These numbers should NOT be taken as a benchmark for your own site. Don't assume hardware and networks will mitigate page bloat Increased page size and complexity is not fully mitigated by faster devices and networks, or by our hard-working browsers.

Mobile 97

Mobile Best Practices Google Metrics 97

ACM Sigarch

OCTOBER 12, 2020

The focus of most published research in architecture is on applications implemented in high-performance, “ close-to-the-metal” languages essentially developed before computers got fast. I suggest it’s long past time to move beyond C and SPEC benchmarks and our exclusive focus on “metal” languages.

C++ 109

C++ Benchmarking Hardware Architecture 109

Randon ASCII

JANUARY 12, 2022

That meant I started having regular meetings with the hardware engineers who were working with IBM on the CPU which gave me even more expertise on this CPU, which was critical in helping me discover a design flaw in one of its instructions , and in helping game developers master this finicky beast. I wrote a lot of benchmarks.

Cache 126

Cache Latency Benchmarking Hardware 126

Alex Russell

MARCH 6, 2021

Meanwhile, developer behaviour offers little hope: Median mobile JavaScript payloads have only grown since 2016, now hovering above 400KiB of script transferred, or nearly 2.5MiB of uncompressed JS. Hardware Past As Performance Prologue. Compared to devices wealthy developers carry, the performance is night and (blinding) day.

Performance 127

Performance Network Mobile Metrics 127

Alex Russell

MARCH 9, 2024

Learning to tell the difference is helpful for browser project managers and engineers, but also working web developers who struggle to develop theories of change for affecting browser teams. This developer-enabling flywheel aims to liberate computing from any single OS, supporting an ephemeral services model of computing.

Benchmarking 60

Benchmarking Strategy Internet Internet 60

Adrian Cockcroft

JUNE 21, 2022

I became the Sun UK local specialist in performance and hardware, and as Sun transitioned from a desktop workstation company to sell high end multiprocessor servers I was helping customers find and fix scalability problems. We had specializations in hardware, operating systems, databases, graphics, etc.

Tuning 52

Tuning Benchmarking Engineering C++ 52

John McCalpin

JANUARY 22, 2018

Hardware performance counter results for a simple benchmark code calling Intel’s optimized DGEMM implementation for this processor (from the Intel MKL library) show that about 20% of the dynamic instruction count consists of instructions that are not packed SIMD operations (i.e.,

Latency 40

Latency Hardware Code Testing 40

John McCalpin

JANUARY 22, 2018

Hardware performance counter results for a simple benchmark code calling Intel’s optimized DGEMM implementation for this processor (from the Intel MKL library) show that about 20% of the dynamic instruction count consists of instructions that are not packed SIMD operations (i.e., addl $1, %eax vfmadd213pd %zmm16, %zmm17, %zmm29.

Latency 40

Latency Hardware Code Testing 40

ACM Sigarch

OCTOBER 25, 2018

Finally, the paper An Expanded Benchmarking of Beyond-CMOS Devices Based on Boolean and Neuromorphic Representative Circuits makes the case that some of these new technologies may potentially outperform CMOS on alternative computing paradigms such as non-boolean circuits based on cellular neural networks.

Architecture 69

Architecture Technology Technology Innovation 69

SQL Server According to Bob

JANUARY 11, 2020

url=/library/en-us/fileio/fs/sparse_files.asp ) ​​ on the ​​ Microsoft Developer Network ​​ (MSDN). ​​ Extended Data: ​​ “incorrect checksum (expected:​​ ## ; actual:​​ ## )” Contact your hardware manufacture for assistance.

Servers 40

Servers Cache Database Media 40

Speed Curve

JULY 3, 2023

Pervasively poor results are part of why responsible public sector organisations are forced to develop HTML-first, progressive enhancement guidance in stark opposition to the "frontend consensus". These numbers should not be taken as a benchmark for your own site. It's super important to understand longtail performance.

Mobile 52

Mobile Google Metrics Retail 52