Percona

NOVEMBER 3, 2023

Rather than listing the concepts, function calls, etc, available in Citus, which frankly is a bit boring, I’m going to explore scaling out a database system starting with a single host. In order to speed up the benchmark indexes must be added. The default number of shards generated for a given table is 32.

Database 114

Database Benchmarking Latency C++ 114

Dynatrace

SEPTEMBER 23, 2021

However, to be secure, containers must be properly isolated from each other and from the host system itself. Many good security tools provide that function, and benchmarks from the Center for Internet Security (CIS) are clear and prescriptive. Network scanners that see systems from the “outside” perspective.

Open Source 279

Open Source Benchmarking Best Practices Network 279

Scalegrid

DECEMBER 6, 2023

The choice of self-managed cloud databases vs DBaaS is a common debate among those who are looking for the best option that will cater to their particular needs. Database as a Service (DBaaS) and managed databases offer distinct advantages along with certain challenges.

Database 130

Database Cloud Hardware Storage 130

The Morning Paper

DECEMBER 5, 2019

Benchmarking spreadsheet systems Rahman et al., construct a set of benchmarks to try and understand what might be going on under the covers in Microsoft Excel, Google Sheets, and LibreOffice Calc. While a database is barely getting started at 20,000 rows, a spreadsheet could be hanging. Rahman et al.

Benchmarking 56

Benchmarking Systems Google Scalability 56

Dynatrace

JUNE 21, 2024

They collect data from multiple sources through real user monitoring , synthetic monitoring, network monitoring, and application performance monitoring systems. This includes monitoring components such as web servers, databases, application performance interfaces (APIs), content delivery networks, and third-party integrations.

Best Practices 264

Best Practices Monitoring Metrics Transportation 264

Percona

NOVEMBER 3, 2023

Sure, database migration is complex, particularly when you’re looking to migrate from a proprietary database to an open source one. Database migration is almost always time-consuming, tedious, and full of potential pitfalls. Database migration is complex Let’s start here. What’s your documentation plan?

Database 107

Database Open Source Benchmarking Strategy 107

Alex Podelko

APRIL 18, 2021

These two papers provide many more insights: Automated system performance testing at MongoDB , DBTest 2020 [ Video ]. The Use of Change Point Detection to Identify Software Performance Regressions in a Continuous Integration System , ICPE 2020 [ Video ]. The MongoDB Podcast, Ep. Both events would be on April 19, 2021.

Performance Testing 182

Performance Testing Testing Performance Education 182

Dynatrace

JULY 31, 2024

The resulting outages wreaked havoc on customer experiences and left IT professionals scrambling to quickly find and repair affected systems. Dynatrace offers various out-of-the-box features and applications to provide a high-density overview of system health for all hosts and related metrics in a single view.

Airlines 258

Airlines Monitoring Healthcare Traffic 258

Dynatrace

FEBRUARY 10, 2022

Compared to intrusion detection systems (IDS/IPS), WAFs are focused on the application traffic. For most enterprises, using a RASP solution would mean running multiple agents on their production systems, potentially creating risk due to incompatibilities. WAFs protect the network perimeter and monitor, filter, or block HTTP traffic.

Traffic 246

Traffic Benchmarking Innovation Java 246

HammerDB

SEPTEMBER 24, 2024

How Postgres Workload Reports Help Optimize Database Operations The EnterpriseDB blog post can be found here, How Postgres Workload Reports Help Optimize Database Operations. The key findings of the article were as follows: This server had a HammerDB benchmark running against it.

Benchmarking 68

Benchmarking Performance Metrics Database 68

HammerDB

OCTOBER 23, 2023

HammerDB uses stored procedures to achieve maximum throughput when benchmarking your database. HammerDB has always used stored procedures as a design decision because the original benchmark was implemented as close as possible to the example workload in the TPC-C specification that uses stored procedures. On MySQL, we saw a 1.5X

Benchmarking 63

Benchmarking Database Network C++ 63

The Morning Paper

JUNE 16, 2019

Towards multiverse databases Marzoev et al., The central idea behind multiverse databases is to push the data access and privacy rules into the database itself. With multiverse databases, each user sees a consistent “parallel universe” database containing only the data that user is allowed to see.

Database 90

Database Cache Benchmarking Efficiency 90

Dynatrace

OCTOBER 2, 2023

Because monolithic applications combine database, client-side interfaces, and server-side application elements in a single executable, they’re difficult to understand, even for their own administrators. In fact, it can be difficult to make code changes that won’t disrupt the entire system.

Architecture 278

Architecture Artificial Intelligence Cloud Open Source 278

Percona

DECEMBER 26, 2023

This PoC demonstrates how to install and configure pg_stat_monitor in order to extract useful and actionable metrics from a PostgreSQL database and display them on a Grafana dashboard. Grafana database backend: Prometheus version 2.15.2+d A script executing a benchmarking run: #!/bin/bash

Benchmarking 141

Benchmarking Metrics C++ Database 141

High Scalability

SEPTEMBER 28, 2018

Never inflict a distributed system on yourself unless you have too." MrTonyD : I was writing production code over 30 years ago (C, OS, database). JavaScript benchmark. seconds with the system. Hey, it's HighScalability time: @danielbryantuk : "A LAMP stack is a good thing. mipsytipsy #CloudNativeLondon.

Internet 35

Internet Internet Scalability Blockchain 35

Percona

AUGUST 31, 2018

It has default settings for all of the database parameters. It is primarily the responsibility of the database administrator or developer to tune PostgreSQL according to their system’s workload. It is important to pay attention to performance when writing database queries. PostgreSQL’s Tuneable Parameters.

Tuning 79

Tuning Database Performance Benchmarking 79

Percona

DECEMBER 11, 2023

Here, we will discuss a notable new feature in Amazon RDS, the Dedicated Log Volume (DLV), that has been introduced to boost database performance. A Dedicated Log Volume (DLV) is a specialized storage volume designed to house database transaction logs separately from the volume containing the database tables.

AWS 117

AWS Benchmarking Performance Traffic 117

Scalegrid

OCTOBER 24, 2019

AWS is the #1 cloud provider for open-source database hosting, and the go-to cloud for MySQL deployments. While many AWS users default to their managed database solution, Amazon RDS, there are alternatives available that can improve your MySQL performance on AWS through advanced customization options and unlimited EC2 instance type support.

AWS 183

AWS Latency Performance Performance Testing 183

Percona

APRIL 6, 2023

PostgreSQL is a popular open source relational database management system many organizations use to store and manage their data. However, as the size of your database grows, it can become challenging to manage and optimize its performance. Two benchmarks from users can be found here: [1] [2] 4.

Cache 138

Cache Open Source Benchmarking Database 138

HammerDB

OCTOBER 18, 2019

HammerDB doesn’t publish competitive database benchmarks, instead we always encourage people to be better informed by running their own. ” Usually when benchmark results are surprising it is a major hint that something could be misconfigured and that certainly seems the case here, so what could it be?

Benchmarking 63

Benchmarking Performance Hardware C++ 63

The Netflix TechBlog

OCTOBER 19, 2020

which is difficult when troubleshooting distributed systems. Troubleshooting a session in Edgar When we started building Edgar four years ago, there were very few open-source distributed tracing systems that satisfied our needs. Investigating a video streaming failure consists of inspecting all aspects of a member account.

Infrastructure 238

Infrastructure Transportation Storage Open Source 238

Percona

JUNE 22, 2023

As a MySQL database administrator, keeping a close eye on the performance of your MySQL server is crucial to ensure optimal database operations. A monitoring tool like Percona Monitoring and Management (PMM) is a popular choice among open source options for effectively monitoring MySQL performance.

Performance 136

Performance Monitoring Traffic Database 136

Scalegrid

JANUARY 25, 2024

Redis® is an in-memory database that provides blazingly fast performance. This makes it a compelling alternative to disk-based databases when performance is a concern. Redis returns a big list of database metrics when you run the info command on the Redis shell. This blog post lists the important database metrics to monitor.

Metrics 130

Metrics Monitoring Latency Cache 130

The Morning Paper

MARCH 10, 2020

Characterizing, modeling, and benchmarking RocksDB key-value workloads at Facebook , Cao et al., Or in the case of key-value stores, what you benchmark. So if you want to design a system that will offer good real-world performance, it’s really useful to have benchmarks that accurately represent real-world workloads.

Benchmarking 59

Benchmarking Storage Cache Open Source 59

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

Percona

MARCH 23, 2023

Hardware Memory The amount of RAM to be provisioned for database servers can vary greatly depending on the size of the database and the specific requirements of the company. Storage The type of storage and disk used for database servers can have a significant impact on performance and reliability. Benchmark before you decide.

Performance 144

Performance Hardware Tuning Storage 144

Percona

APRIL 7, 2023

To illustrate this, I ran the Sysbench-TPCC synthetic benchmark against two different GCP instances running a freshly installed Percona Server for MySQL version 8.0.31 That’s a heritage of the LAMP model when the same server would host both the database and the web server. MySQL (B) 2517529 2610323 389048 5516900 194140 11523.48

Tuning 145

Tuning Cache Servers Benchmarking 145

Percona

MARCH 17, 2023

These updates are designed to keep databases running at peak performance and simplify database operations. But as companies grow and see more demand for their databases, we need to ensure that PMM also remains scalable so you don’t need to worry about its performance while tending to the rest of your environment.

Monitoring 117

Monitoring Scalability Database Cache 117

Particular Software

SEPTEMBER 20, 2021

Why RPC is “faster” It’s tempting to simply write a micro-benchmark test where we issue 1000 requests to a server over HTTP and then repeat the same test with asynchronous messages. If you did such a benchmark, here’s an incomplete picture you might end up with: Graph of microbenchmark showing RPC is faster than messaging.

Benchmarking 97

Benchmarking Latency Servers Systems 97

Brendan Gregg

MAY 22, 2021

- What observability does that database have? Means: Let me look at the system without changing it.) _Experimental_ tools change the state of the system to understand it. For example, benchmarks. Means: What metrics and logs does it have?) - Let me try some observability first.

Benchmarking 110

Benchmarking Metrics Speed Database 110

HammerDB

JULY 8, 2024

A frequently asked question with HammerDB is when a user is using the TPROC-C workload to test database failure and failover scenarios, by deliberately killing connections or shutting down the database during a workload and then restarting it. Is a TPROC-C workload valid if you have restarted the database?

Database 52

Database Benchmarking Virtualization C++ 52

n0derunner

JUNE 28, 2019

Optionally change password (the password prompted is the one from bitnami_credentials for the postgres database user). In this case I name the db pgbench-sf10 for “Scale Factor 10” Scale Factors are how the size of the database is determined. <span pgbench-sf10 is the database schema to use.

Benchmarking 40

Benchmarking Virtualization Database Systems 40

Percona

JANUARY 24, 2023

Such “torn pages” are corruptions from the database point of view. This is not a problem for PostgreSQL alone; every database software needs to deal with this problem. In a system already on the brink of too much WAL generation, the uncompressed WAL can trigger many more checkpoints, resulting in even more WAL generation.

Database 142

Database Benchmarking Open Source Latency 142

The Morning Paper

NOVEMBER 8, 2020

While ultimately this new system should be able to take advantage of the latest advances in consensus for improved performance, that’s not realistic given a 6-9 month in-production target. It’s such a powerful idea that I can imagine distributed systems implementers everywhere adopting it from now on. What does the VirtualLog give us?

Virtualization 126

Virtualization Latency Storage Systems 126

Percona

AUGUST 30, 2018

One of the common ways to classify database workloads is whether it is “read intensive” or “write intensive”. Because recognizing if the workload is read intensive or write intensive will impact your hardware choices, database configuration as well as what techniques you can apply for performance optimization and scalability.

Benchmarking 73

Benchmarking Database Operating System Architecture 73

Scalegrid

MARCH 28, 2024

Benchmarking Cache Speed Memcached is optimized for high read and write loads, making it highly efficient for rapid data access in a basic key-value store. Advanced Redis Features Showdown Big data center concept, cloud database, server power station of the future. Managed Database-as-a-Service (DBaaS) solutions like ScaleGrid.io

Cache 130

Cache Storage Architecture Scalability 130

Scalegrid

JANUARY 12, 2024

Simply put, it’s the set of computational tasks that cloud systems perform, such as hosting databases, enabling collaboration tools, or running compute-intensive algorithms. Such demanding use cases place a great value on systems capable of fast and reliable execution, a need that spans across various industry segments.

Cloud 130

Cloud Virtualization Storage Efficiency 130