Percona

NOVEMBER 2, 2023

Upgrading to the newest release of MongoDB is the key to unlocking its full potential, but it’s not as simple as clicking a button; it requires meticulous planning, precise execution, and a deep understanding of the upgrade process. You should also review your hardware resources, how you use MongoDB, and any custom configurations.

Best Practices 93

Best Practices Hardware Tuning Scalability 93

Percona

AUGUST 29, 2018

In this post, we will discuss some important kernel parameters that can affect database server performance and how these should be tuned. SHMMAX is a kernel parameter used to define the maximum size of a single shared memory segment a Linux process can allocate. A page is a chunk of RAM that is allocated to a process.

Tuning 59

Tuning Database Servers Processing 59

The Netflix TechBlog

JANUARY 13, 2022

We have now moved to a more systematic approach where unknown errors are fed into a Machine Learning process that performs clustering to propose new regular expressions for commonly occurring errors. In the future, we are looking to automate this process. Expand Pensive with Machine Learning classifiers.

Big Data 241

Big Data Infrastructure Metrics Games 241

Dynatrace

OCTOBER 2, 2023

Limits of a lift-and-shift approach A traditional lift-and-shift approach, where teams migrate a monolithic application directly onto hardware hosted in the cloud, may seem like the logical first step toward application transformation. Use SLAs, SLOs, and SLIs as performance benchmarks for newly migrated microservices.

Architecture 245

Architecture Artificial Intelligence Cloud Open Source 245

Scalegrid

JULY 13, 2020

Compare ease of use across compatibility, extensions, tuning, operating systems, languages and support providers. of PostgreSQL users are currently in the process of migrating to the RDBMS, according to the 2019 PostgreSQL Trends Report , an astounding percentage considering this is the 4th most popular database in the world.

Open Source 244

Open Source Tuning C++ Database 244

Abhishek Tiwari

SEPTEMBER 15, 2024

This allows NASA's engineers to fine-tune every aspect of the rover's behavior, optimizing for reliability rather than rapid development or ease of use. They employ rigorous development processes, including multiple layers of review and testing that would make most software companies' heads spin.

Engineering 52

Engineering Social Media Hardware C++ 52

Scalegrid

AUGUST 30, 2024

RabbitMQ augments its users’ security and experience by simplifying the processes involved in granting authorizations. This process follows authentication and determines the permissible actions for a user. By adopting OAuth 2.0, This streamlines managing access rights for users within the service.

Transportation 130

Transportation Virtualization Strategy Storage 130

Percona

OCTOBER 18, 2023

It’s a complex process involving various factors and meticulous planning. Today, we’ll be taking a deep dive into the intricacies of database migration, along with specific solutions to help make the process easier. Evaluating your hardware requirements is another vital aspect of resource allocation.

Open Source 98

Open Source Database Hardware Strategy 98

Dynatrace

MAY 1, 2020

This is especially the case with microservices and applications created around multiple tiers, where cheaper hardware alternatives play a significant role in the infrastructure footprint. Network measurements with per-interface and per-process resolution. Network metrics are also collected for detected processes.

Java 134

Java Hardware Metrics Tuning 134

Dynatrace

AUGUST 12, 2020

With Azure Functions, engineers don’t have to worry about provisioning and maintaining underlying hardware; they simply upload their code, and it’s up and running seconds later. You can find out which functions experience the highest failure rate or processing time and which of them are executed the most. So stay tuned!

Serverless 242

Serverless Azure Monitoring Lambda 242

Dynatrace

NOVEMBER 15, 2021

Logs can include data about user inputs, system processes, and hardware states. Log monitoring is a process by which developers and administrators continuously observe logs as they’re being recorded. Log analytics is the process of evaluating and interpreting log data so teams can quickly detect and resolve issues.

Analytics 222

Analytics Monitoring Artificial Intelligence DevOps 222

All Things Distributed

MARCH 19, 2018

Bill Simmons, CTO of Dataxu, states, "We process 3 million ad requests a second - 100,000 features per request. In other words, processing the 10th gigabyte and 1000th gigabyte is conceptually the same. To seamlessly switch between CPU and GPU machines, we use Apache MXNet to interface with the underlying hardware.

Scalability 146

Scalability Hardware AWS Tuning 146

The Morning Paper

NOVEMBER 3, 2019

Perhaps the most interesting lesson/reminder is this: it takes a lot of effort to tune a Linux kernel. Google’s data center kernel is carefully performance tuned for their workloads. On the exact same hardware, the benchmark suite is then used to test 36 Linux release versions from 3.0 Headline results.

Performance 108

Performance Benchmarking Tuning Hardware 108

The Netflix TechBlog

AUGUST 30, 2021

Complementing the hardware is the software on the RAE and in the cloud, and bridging the software on both ends is a bi-directional control plane. The challenge, then, is to be able to ingest and process these events in a scalable manner, i.e., scaling with the number of devices, which will be the focus of this blog post.

Latency 219

Latency Traffic Transportation Cloud 219

Percona

AUGUST 27, 2018

assigning to a specific CPU) is a manageable resource, represented by the concept of “virtual CPU” as a term that includes CPU cores, hyperthreads, hardware threads, and so forth. Good examples are: ETL processes for data archiving, reporting, data consolidation and so on. Currently, CPU affinity (i.e., What is the possible usage?

Tuning 46

Tuning Virtualization Testing Servers 46

Scalegrid

JANUARY 25, 2024

Effective management of memory stores with policies like LRU/LFU proactive monitoring of the replication process and advanced metrics such as cache hit ratio and persistence indicators are crucial for ensuring data integrity and optimizing Redis’s performance. This plays a crucial role in supervising the replication process.

Metrics 130

Metrics Monitoring Latency Cache 130

Dynatrace

AUGUST 12, 2020

With Azure Functions, engineers don’t have to worry about provisioning and maintaining underlying hardware; they simply upload their code, and it’s up and running seconds later. You can find out which functions experience the highest failure rate or processing time and which of them are executed the most. So stay tuned!

Serverless 145

Serverless Azure Monitoring Lambda 145

Percona

NOVEMBER 3, 2023

About the cluster Following a step-by-step process, the objective is to create a four-node cluster consisting of: PostgreSQL version 15 Citus extension (I’ll be using version 11, but there are newer ones available.) psql pgbench <<_eof1_ qecho adding node citus3.

Database 110

Database Benchmarking Latency C++ 110

Percona

DECEMBER 27, 2023

Most organizations are embracing DevSecOps, a term that covers processes and tooling enabling security to be integrated into the application development life cycle rather than treated as a separate process. It comprises numerous organizations from various sectors, including software, hardware, nonprofit, public, and academic.

Cloud 85

Cloud Open Source Strategy Best Practices 85

O'Reilly

SEPTEMBER 19, 2023

Doubly so as hardware improved, eating away at the lower end of Hadoop-worthy work. Google goes a step further in offering compute instances with its specialized TPU hardware. You can download these models to use out of the box, or employ minimal compute resources to fine-tune them for your particular task.

Hardware 101

Hardware Storage Big Data Blockchain 101

DZone

AUGUST 16, 2019

It’s not just a simple tweak you can turn on/off; it’s a long-time process that touches almost every single item in your stack, including both hardware and software sides of the system. Application scalability is the potential of an application to grow in time, being able to efficiently handle more and more requests per minute (RPM).

Scalability 131

Scalability Efficiency Hardware Software 131

O'Reilly

NOVEMBER 28, 2023

Users and Nonusers AI adoption is in the process of becoming widespread, but it’s still not universal. Until AI reaches 100%, it’s still in the process of adoption. Automating the process of building complex prompts has become common, with patterns like retrieval-augmented generation (RAG) and tools like LangChain.

Open Source 111

Open Source Google Artificial Intelligence Infrastructure 111

Percona

JANUARY 4, 2024

Flexible location : Data files can reside within the MySQL data directory or an independent location, enabling finer control over storage management and performance tuning. mysql> SHOW VARIABLES LIKE 'innodb_directories'; + --+ -+ | Variable_name | Value | + --+ -+ | innodb_directories | | + --+ -+ 1 row in set (0.00

Storage 94

Storage Engineering Database Open Source 94

Dynatrace

OCTOBER 22, 2019

Ultimately, it leads to a state where your system won’t be able to process more data even if you add more hardware. Now, let’s look at a Cassandra process group and see if we can find any CPU-hungry threads and thread groups. Such behavior not only limits speed but also your ability to increase throughput by adding resources.

Java 104

Java Scalability Hardware Architecture 104

HammerDB

APRIL 19, 2023

In the context of MySQL performance evaluation, it simulates a typical online transaction processing (OLTP) workload on your MySQL database. The OLTP workload simulates a typical online transaction processing workload, where multiple clients execute transactions on a database concurrently. Instead, use the default settings. and 8.0.32

Performance 54

Performance Benchmarking Cache Storage 54

Adrian Cockcroft

NOVEMBER 18, 2024

However, some face challenges such as data availability, manual data collection processes, and a lack of data standardization. It’s possible to get energy data in real time from NVIDIA GPUs (because NVIDIA provides it) but not from AWS hardware. Raman Pujani, Solutions Architect, AWS NOTE: This is an interesting new topic.

AWS 98

AWS Energy Lambda Government 98

Percona

APRIL 17, 2023

The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. systemctl stop tuned $ systemctl disable tuned Dirty ratio The dirty_ratio is the percentage of total system memory that can hold dirty pages.

Best Practices 52

Best Practices Design Tuning Database 52

The Morning Paper

NOVEMBER 10, 2019

Snap’s architecture is a composition of recent ideas in user-space networking, in-service upgrades, centralized resource accounting, programmable packet processing, kernel-bypass, RDMA functionality, and optimized co-design of transport, congestion control and routing. It reminds me of ZeroMQ. Snap’s control plane is orchestrated via RPCs.

Network 92

Network Transportation Latency Entertainment 92

The Morning Paper

MAY 21, 2019

Using zswap means that no new hardware solutions are required, enabling rapid deployment across clusters. ML-based auto-tuning. This model is used by a Gaussian Process (GP) Bandit machine learning model to guide the parameter search towards an optimal point with a minimal number of trials.

Software 78

Software Software Google Hardware 78

Alex Podelko

OCTOBER 20, 2016

System’s configuration is not given anymore and often can’t be easily mapped to hardware. As already mentioned, performance testing is rather a performance engineering process (with tuning, optimization, troubleshooting and fixing multi-user issues) eventually bringing the system to the proper state rather than just testing.

Performance Testing 100

Performance Testing Architecture Testing Performance 100

John McCalpin

APRIL 25, 2023

This metric is interesting because we don’t always have the luxury of parallelizing every application we run, and our operating systems almost always process each call (e.g., Stay tuned! This post is about a secondary performance characteristic — sustained memory bandwidth for a single thread running on a single core.

Benchmarking 97

Benchmarking Cache Latency Tuning 97

O'Reilly

OCTOBER 11, 2022

There seems to be broad agreement that hyperautomation is the combination of Robotic Process Automation with AI. We’ll see it in the processing of the thousands of documents businesses handle every day. We can certainly apply the slogan to many, if not all, clerical tasks–and even to the automation process itself.

Games 118

Games Healthcare Processing Retail 118

HammerDB

OCTOBER 18, 2019

cpupower frequency-info analyzing CPU 0: driver: intel_pstate CPUs which run at the same hardware frequency: 0 CPUs which need to have their frequency coordinated by software: 0 maximum transition latency: Cannot determine or is not supported. hardware limits: 1000 MHz - 4.00 hardware limits: 1000 MHz - 4.00

Benchmarking 63

Benchmarking Performance Hardware C++ 63

Adrian Cockcroft

JUNE 2, 2023

FSD has a sense of purpose, a planning capability, has real time agency and responds to its environment via an ego model, predicting the behavior of pedestrians and other road users, and is being tuned to drive in a very human way, so that other road users interact with it as a predicable normal driver.

Social Media 98

Social Media Innovation Open Source Entertainment 98

SQL Performance

MARCH 17, 2020

Back in 2014, I wrote an article called Performance Tuning the Whole Query Plan. The Sort only has 19 rows to process, so it consumes only 1ms or so. The parallel column store aggregate push down result of 57 million rows processed in 7ms (using 40ms of CPU) is remarkable, especially considering the hardware.

Servers 86

Servers Tuning Database Efficiency 86

Percona

AUGUST 5, 2023

This means that multiple partitions can be processed simultaneously, making better use of available hardware resources and further enhancing query performance. Special considerations are needed to ensure these processes still work seamlessly after partitioning. Documentation : Always be documenting!

Strategy 40

Strategy Storage Database Best Practices 40

Dynatrace

NOVEMBER 20, 2019

The IBM Z platform is a range of mainframe hardware solutions that are quite frequently used in large computing shops. Typically, these shops run the z/OS operating system, but more recently, it’s not uncommon to see the Z hardware running special versions of Linux distributions. Stay tuned for more announcements on this topic.

Availability 32

Availability Hardware Java Tuning 32