All Things Distributed

MARCH 19, 2018

Amazon SageMaker training supports powerful container management mechanisms that include spinning up large numbers of containers on different hardware with fast networking and access to the underlying hardware, such as GPUs. Post-training model tuning and rich states. This can all be done without touching a single line of code.

Scalability 146

Scalability Hardware AWS Tuning 146

Brendan Gregg

SEPTEMBER 25, 2021

As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Measuring the speed of time Is there already a microbenchmark for os::javaTimeMillis()? Theory (A) is most likely based on the frame widths in the flame graph. But I'm not completely sure.

Speed 40

Speed Java AWS Virtualization 40

The Morning Paper

NOVEMBER 3, 2019

Perhaps the most interesting lesson/reminder is this: it takes a lot of effort to tune a Linux kernel. Google’s data center kernel is carefully performance tuned for their workloads. On the exact same hardware, the benchmark suite is then used to test 36 Linux release versions from 3.0 Headline results.

Performance 108

Performance Benchmarking Tuning Hardware 108

Dynatrace

AUGUST 12, 2020

As companies strive to innovate and deliver faster, modern software architecture is evolving at near the speed of light. With Azure Functions, engineers don’t have to worry about provisioning and maintaining underlying hardware; they simply upload their code, and it’s up and running seconds later. So stay tuned! Dynatrace news.

Serverless 145

Serverless Azure Monitoring Lambda 145

Scalegrid

JANUARY 25, 2024

Effective monitoring of key performance indicators plays a crucial role in maintaining this optimal speed of operation. Throughput Ensuring optimal performance and efficient handling of many queries is crucial for Redis, as it offers exceptional speed and minimal delay. It could also indicate a potential issue, say, an expensive query.

Metrics 130

Metrics Monitoring Latency Cache 130

Dynatrace

NOVEMBER 15, 2021

Logs can include data about user inputs, system processes, and hardware states. Log analysis can reveal potential bottlenecks and inefficient configurations so teams can fine-tune system performance. “Logging” is the practice of generating and storing logs for later analysis. Optimized system performance.

Analytics 222

Analytics Monitoring Artificial Intelligence DevOps 222

Percona

DECEMBER 27, 2023

Consequently, they might miss out on the benefits of integrating security into the SDLC, such as enhanced efficiency, speed, and quality in software delivery. It comprises numerous organizations from various sectors, including software, hardware, nonprofit, public, and academic.

Cloud 85

Cloud Open Source Strategy Best Practices 85

Percona

JANUARY 4, 2024

Flexible location : Data files can reside within the MySQL data directory or an independent location, enabling finer control over storage management and performance tuning. Balancing I/O load: Distribute tables across multiple general tablespaces located on different disks to avoid I/O bottlenecks and improve query execution speed.

Storage 94

Storage Engineering Database Open Source 94

The Morning Paper

NOVEMBER 10, 2019

” That’s 4-8x the speed of evolution and feedback cycles. To get that release speed, Snap needs to be a user space solution. The ability to rapidly deploy new versions of Pony Express significantly aided development and tuning of congestion control.

Network 92

Network Transportation Latency Entertainment 92

SQL Performance

APRIL 27, 2020

Gen 5 is the primary hardware option now for most regions since Gen 4 is aging out. New Hardware Configuration for Provisioned Compute Tier. The Gen4/Gen5 hardware configurations are considered "balanced memory and compute." These introduced the general-purpose and business-critical tiers with Gen 4 and Gen 5 processors.

Azure 55

Azure Database Serverless Hardware 55

Percona

NOVEMBER 3, 2023

PostgreSQL Cluster One coordinator node citus-coord-01 Three worker nodes citus1 citus2 citus3 Hardware AWS Instance Ubuntu Server 20.04, SSD volume type 64-bit (x86) c5.xlarge In order to speed up the benchmark indexes must be added. Redundancy can potentially decrease overall performance.

Database 110

Database Benchmarking Latency C++ 110

HammerDB

APRIL 19, 2023

GHz 4th Generation Intel Xeon Scalable processors (code-named Sapphire Rapids) Up to 20% higher compute performance than z1d instances Up to 50 Gbps of networking speed Up to 40 Gbps of bandwidth to the Amazon Elastic Block Store (EBS) We can also verify these capabilities by running some simple benchmarks on the different subsystems.

Performance 54

Performance Benchmarking Cache Storage 54

Dynatrace

OCTOBER 22, 2019

Such behavior not only limits speed but also your ability to increase throughput by adding resources. Ultimately, it leads to a state where your system won’t be able to process more data even if you add more hardware. Also, it’s distributed across many threads, which indicates that this is a general lock across all those threads.

Java 104

Java Scalability Hardware Architecture 104

O'Reilly

NOVEMBER 28, 2023

Even with cloud-based foundation models like GPT-4, which eliminate the need to develop your own model or provide your own infrastructure, fine-tuning a model for any particular use case is still a major undertaking. That pricing won’t be sustainable, particularly as hardware shortages drive up the cost of building infrastructure.

Open Source 111

Open Source Google Artificial Intelligence Infrastructure 111

Sutter's Mill

NOVEMBER 11, 2023

Instead, you want a library that is tuned for your target hardware architecture and ready for par_unseq vectorized algorithms, for blazing speed. If you want to do efficient linear algebra, you don’t want to write your own code by hand; that would be slow. This is that library.

C++ 126

C++ Lambda Network Programming 126

The Morning Paper

MAY 21, 2019

Using zswap means that no new hardware solutions are required, enabling rapid deployment across clusters. ML-based auto-tuning. The big advantage of the ML based approach is that it can continuously adapt to changes in the workload and WSC configuration without needing constant manual tuning. Evaluation.

Software 78

Software Software Google Hardware 78

Percona

AUGUST 5, 2023

Each partition holds data that falls within a specific range, optimizing data handling and query speed. This version also notably integrates native backing for range and list partitioning of spatial indexes, amplifying geospatial query speed for substantial datasets. Additionally, MySQL 8.0 Documentation : Always be documenting!

Strategy 40

Strategy Storage Database Best Practices 40

HammerDB

OCTOBER 18, 2019

cpupower frequency-info analyzing CPU 0: driver: intel_pstate CPUs which run at the same hardware frequency: 0 CPUs which need to have their frequency coordinated by software: 0 maximum transition latency: Cannot determine or is not supported. hardware limits: 1000 MHz - 4.00 hardware limits: 1000 MHz - 4.00

Benchmarking 63

Benchmarking Performance Hardware C++ 63

Adrian Cockcroft

JUNE 2, 2023

My talk was on Innovation and Tipping Points, the first half was based on some content I’ve given before on how to get out of the way of innovation by speeding up time to value or idea to implementation.

Social Media 98

Social Media Innovation Open Source Entertainment 98

SQL Performance

MARCH 17, 2020

Back in 2014, I wrote an article called Performance Tuning the Whole Query Plan. This machine has four i7 CPUs (hyperthreaded to 8) with a base speed of 2.4GHz. The parallel column store aggregate push down result of 57 million rows processed in 7ms (using 40ms of CPU) is remarkable, especially considering the hardware.

Servers 86

Servers Tuning Database Efficiency 86

Adrian Cockcroft

NOVEMBER 18, 2024

Speed is critical; generative AI and cutting-edge advanced cloud computing are important tools to accelerate the build and deployment of climate solutions. It’s possible to get energy data in real time from NVIDIA GPUs (because NVIDIA provides it) but not from AWS hardware.

AWS 98

AWS Energy Lambda Government 98

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

VoltDB

JUNE 19, 2017

While current network speeds may be enough to meet the latency requirements of 4G applications, 5G will necessitate a change, if only because the continental US is ~60ms wide, meaning that a datacenter on one coast communicating with another datacenter on the opposite coast will be too slow for 5G. These have to communicate with each other.

Latency 40

Latency Retail Virtualization Hardware 40

VoltDB

JUNE 19, 2017

While current network speeds may be enough to meet the latency requirements of 4G applications, 5G will necessitate a change, if only because the continental US is ~60ms wide, meaning that a datacenter on one coast communicating with another datacenter on the opposite coast will be too slow for 5G. These have to communicate with each other.

Latency 40

Latency Retail Virtualization Hardware 40

SQL Performance

JUNE 21, 2019

While hardware such as intelligent SANs, Solid State Disk, and other advancements have helped speed things up, wasted space in index can translate to wasted space in the buffer pool as well as wasting more I/O. If you have big physical hardware with defaults, then you should look at optimizing MAXDOP. SQL Server Agent Alerts.

Servers 49

Servers Azure Hardware Database 49

KeyCDN

AUGUST 15, 2019

Before you begin tuning your website or application, you must first figure out which metrics matter most to your users and establish some achievable benchmarks. When the word “performance” is heard, most people immediately think of speed. What is Performance Testing?

Testing Tools 55

Testing Tools Best Practices Performance Testing Testing 55

Percona

AUGUST 29, 2023

Columnar storage of tables can compress data, speeding up scans and supporting fast projections, both on regular and distributed tables. Depending on the configuration, one can tune a hardware RAID for either performance or redundancy. The same can be said for Citus data sharding.

C++ 84

C++ Database Storage Testing 84

SQL Server According to Bob

JANUARY 11, 2020

Many high-end disk subsystems provide high-speed cache facilities to reduce the latency of read and write operations. Example 1: ​​ Hardware failure (CPU board) Battery backup on the caching controller maintained the data. Important Always consult with your hardware manufacturer for proper stable media strategies.

Servers 40

Servers Cache Media Hardware 40

HammerDB

OCTOBER 12, 2018

As is also the case this limitation is at the database level (especially the storage engine) rather than the hardware level. driver: intel_pstate CPUs which run at the same hardware frequency: 0 . hardware limits: 1000 MHz - 3.80 hardware limits: 1000 MHz - 3.80 current CPU frequency: Unable to call hardware .

Best Practices 40

Best Practices Scalability Performance C++ 40

SQL Performance

MARCH 8, 2021

This can make it difficult to draw sound performance-tuning conclusions. This uses hardware, typically a crystal oscillator, that produces ticks at a very high constant rate regardless of processor speed, power settings, or anything of that nature. The clock keeps running at the same rate even during sleep.

Servers 95

Servers Tuning Architecture Performance 95

Brendan Gregg

SEPTEMBER 5, 2017

Linux has been adding tracing technologies over the years: kprobes (kernel dynamic tracing), uprobes (user-level dynamic tracing), tracepoints (static tracing), and perf_events (profiling and hardware counters). Outside of EC2, many other providers are deploying on KVM.

Virtualization 75

Virtualization AWS Engineering Hardware 75

Dynatrace

OCTOBER 28, 2021

Once established, chaos engineering becomes an effective way to fine tune service-level indicators and objectives, improve alerting, and build more efficient dashboards, so you know you are collecting all the data you need to accurately observe and analyze your environment. Speeds incident response. Improves customer satisfaction.

Engineering 238

Engineering Entertainment Cloud Infrastructure 238

Dynatrace

OCTOBER 26, 2020

With the rich set of features in Dynatrace for diagnostics (check out my Advanced Diagnostics with Dynatrace YouTube Tutorial ) it speeds up analysis and diagnostics for Christian significantly. So stay tuned. If you want to replicate Christians work – here are the software and hardware specs: Hardware.

Innovation 161

Innovation Metrics Hardware Games 161

Smashing Magazine

AUGUST 22, 2021

A Primer on Speed. Discussing performance and “speed” can quickly get complex, because many underlying aspects contribute to a web-page loading “slowly”. It is physically limited by the speed of light or, practically, how fast signals can travel in wires or in the open air. also “only” take two round trips ((b) is rarely shown).

Performance 107

Performance Network Latency Servers 107

SQL Server According to Bob

JANUARY 11, 2020

ReadFile WriteFile ReadFileScatter WriteFileGather GetOverlappedResult ​​ For extended details on the 823 error, see ​​ Error message 823 may indicate hardware problems or system problems ​​ ( [link] i crosoft.com/default.aspx?scid=kb ​​ Contact your hardware manufacture for assistance.

Servers 40

Servers Cache Database Media 40

High Scalability

NOVEMBER 25, 2019

To add elasticity, reliability and durability, these data centers are connected to Google Cloud platform using high speed, secure Google Interconnect network. Eventually, we resorted to caching the events in memory for a short duration and also tuning the GC settings on those nodes as we are doing a lot of young generation collections.

Architecture 52

Architecture Cache Azure Storage 52