O'Reilly

NOVEMBER 28, 2023

Even with cloud-based foundation models like GPT-4, which eliminate the need to develop your own model or provide your own infrastructure, fine-tuning a model for any particular use case is still a major undertaking. That pricing won’t be sustainable, particularly as hardware shortages drive up the cost of building infrastructure.

Open Source 135

Open Source Google Artificial Intelligence Infrastructure 135

HammerDB

OCTOBER 18, 2019

cpupower frequency-info analyzing CPU 0: driver: intel_pstate CPUs which run at the same hardware frequency: 0 CPUs which need to have their frequency coordinated by software: 0 maximum transition latency: Cannot determine or is not supported. hardware limits: 1000 MHz - 4.00 hardware limits: 1000 MHz - 4.00

Benchmarking 63

Benchmarking Performance Hardware C++ 63

HammerDB

FEBRUARY 25, 2021

To benchmark a database we introduce the concept of a Virtual User. We could use processes, however given we may want to create hundreds or thousands of virtual users multithreading is the best approach to implement a Virtual User. Basic Benchmarking Concepts. The Python GIL. Tcl Multithreading in parallel.

Programming 68

Programming Benchmarking Virtualization C++ 68

SQL Performance

APRIL 27, 2020

Fast forward a few years after Azure SQL Database was released to when Azure SQL Managed Instance was in public preview, and "vCores" (virtual cores) were announced for Azure SQL Database. Gen 5 is the primary hardware option now for most regions since Gen 4 is aging out. New Hardware Configuration for Provisioned Compute Tier.

Azure 55

Azure Database Serverless Hardware 55

HammerDB

APRIL 19, 2023

Regardless of whether the computing platform to be evaluated is on-prem, containerized, virtualized, or in the cloud, it is crucial to consider several essential factors. Please refer to this tuning guide to tune the system for HammerDB: Open Source Database Tuning Guide on 3rd Generation Intel® Xeon® Scalable Processors Based Platform.

Performance 55

Performance Benchmarking Cache Storage 55

Brendan Gregg

SEPTEMBER 5, 2017

Linux has been adding tracing technologies over the years: kprobes (kernel dynamic tracing), uprobes (user-level dynamic tracing), tracepoints (static tracing), and perf_events (profiling and hardware counters). What happens if processes really do try to populate all that virtual memory?

Virtualization 75

Virtualization AWS Engineering Hardware 75

VoltDB

JUNE 19, 2017

With the 5G revolution, operators will need to manage hundreds of edge deployments, and maintain the physical space and hardware to achieve 1ms of latency. In fact, 5G has plenty of valid use cases, one of which is virtual reality. This requires 1 ms network latency. These types of applications justify the cost of 5G.

Latency 40

Latency Retail Virtualization Hardware 40

VoltDB

JUNE 19, 2017

With the 5G revolution, operators will need to manage hundreds of edge deployments, and maintain the physical space and hardware to achieve 1ms of latency. In fact, 5G has plenty of valid use cases, one of which is virtual reality. This requires 1 ms network latency. These types of applications justify the cost of 5G.

Latency 40

Latency Retail Virtualization Hardware 40

The Agile Manager

JUNE 30, 2015

Virtual data centers, real-time algorithmic pricing, and new media are simply larger versions of that same phenomenon. Operations and execution matter to the bottom line, but ultimately dance to the tune called by finance. Is every company destined to be a software company?

Software 40

Software Software Innovation Hardware 40

Dotcom-Montior

NOVEMBER 11, 2020

Serverless computing can be a huge benefit to organizations that don’t have the necessary resources or teams to manage physical resources, like servers/hardware, and all the maintenance and licensing that goes along with that, allowing them to focus on developing their code and applications. Benefits of a Serverless Model.

Serverless 57

Serverless Monitoring Lambda Latency 57

Percona

APRIL 17, 2023

The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. systemctl stop tuned $ systemctl disable tuned Dirty ratio The dirty_ratio is the percentage of total system memory that can hold dirty pages.

Best Practices 52

Best Practices Design Tuning Database 52

SQL Performance

JUNE 21, 2019

While hardware such as intelligent SANs, Solid State Disk, and other advancements have helped speed things up, wasted space in index can translate to wasted space in the buffer pool as well as wasting more I/O. If you are mostly virtualized on machines with 8 or fewer logical processors with a default MAXDOP, you're probably in OK.

Servers 49

Servers Azure Hardware Database 49

Abhishek Tiwari

JULY 12, 2018

A data pipeline is a software which runs on hardware. The software is error-prone and hardware failures are inevitable. If tuned for performance, there is a good change reliability is compromised - and vice versa. In some cases, this can be enhanced by combining data virtualization techniques with microservices architecture.

Latency 63

Latency Analytics Scalability Engineering 63

HammerDB

OCTOBER 12, 2018

As is also the case this limitation is at the database level (especially the storage engine) rather than the hardware level. driver: intel_pstate CPUs which run at the same hardware frequency: 0 . hardware limits: 1000 MHz - 3.80 hardware limits: 1000 MHz - 3.80 current CPU frequency: Unable to call hardware .

Best Practices 40

Best Practices Scalability Performance C++ 40

HammerDB

JANUARY 5, 2019

As the chart shows because we know that both HammerDB and the implementation of the TPC-C workload scales then we can determine that with this particular database engine both the software and hardware scales as well. If you only test your own application (and if you have more than one application which one will you use for benchmarking?)

Benchmarking 40

Benchmarking Database Social Media Scalability 40

Brendan Gregg

SEPTEMBER 25, 2021

CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Note that Ubuntu also has a frame to show entry into vDSO (virtual dynamic shared object). But I'm not completely sure.

Speed 40

Speed Java AWS Virtualization 40

SQL Server According to Bob

JANUARY 11, 2020

Example 1: ​​ Hardware failure (CPU board) Battery backup on the caching controller maintained the data. Important Always consult with your hardware manufacturer for proper stable media strategies. For specific information on I/O tuning and balancing, you will find more details in the following document.

Servers 40

Servers Cache Media Hardware 40

Adrian Cockcroft

NOVEMBER 13, 2023

In the simplest case, you have a growing workload, and you optimize it to run more efficiently so that you don’t need to buy or rent additional hardware, so your carbon footprint stays the same, but the carbon per transaction or operation is going down. I’ve written before about how to tune out retry storms.

Energy 52

Energy Cloud Traffic Transportation 52

Adrian Cockcroft

JUNE 21, 2022

I became the Sun UK local specialist in performance and hardware, and as Sun transitioned from a desktop workstation company to sell high end multiprocessor servers I was helping customers find and fix scalability problems. We had specializations in hardware, operating systems, databases, graphics, etc. that a lot of people used.

Tuning 52

Tuning Benchmarking Engineering C++ 52

SQL Server According to Bob

JANUARY 11, 2020

ReadFile WriteFile ReadFileScatter WriteFileGather GetOverlappedResult ​​ For extended details on the 823 error, see ​​ Error message 823 may indicate hardware problems or system problems ​​ ( [link] i crosoft.com/default.aspx?scid=kb ​​ Contact your hardware manufacture for assistance.

Servers 40

Servers Cache Database Media 40

HammerDB

DECEMBER 10, 2024

In this post, we revisit how to interpret transactional database performance metrics and give guidance on what levels of performance should be expected on up-to-date hardware and software in 2024. Results in the 10’s of millions are not uncommon with the most advanced hardware, software and expertise.

C++ 58

C++ Benchmarking Hardware Performance 58