Brendan Gregg

SEPTEMBER 5, 2017

What follows are topics that may be of interest to anyone looking to migrate their systems and skillset: scan these to find topics that interest you. ## ZFS ZFS is available for Linux via the [zfsonlinux] and [OpenZFS] projects, and more recently was included in Canonical's Ubuntu Linux distribution: Ubuntu Xenial 16.04 LTS (April 2016).

Virtualization 75

Virtualization AWS Engineering Hardware 75

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance.

Performance 103

Performance Latency Cache Virtualization 103

Dynatrace

JUNE 15, 2023

If your application runs on servers you manage, either on-premises or on a private cloud, you’re responsible for securing the application as well as the operating system, network infrastructure, and physical hardware. What are some key characteristics of securing cloud applications?

Cloud 189

Cloud Open Source Architecture Monitoring 189

Brendan Gregg

NOVEMBER 28, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance. I'd expect between 0.1%

Virtualization 40

Virtualization AWS Hardware Storage 40

Alex Russell

MARCH 6, 2021

TL;DR: A lot has changed since 2017 when we last estimated a global baseline resource per-page resource budget of 130-170KiB. To update our global baseline from 2017, we want to update our priors on a few dimensions: The evolved device landscape. Hardware Past As Performance Prologue. The Moto G4 , for example. Hard Reset.

Performance 127

Performance Network Metrics Cache 127

SQL Performance

JANUARY 23, 2020

The queues component of our methodology comes from Performance Monitor counters, which provide a view of system performance from a resource standpoint.". However, some seem to have missed Davidson's point regarding the importance of resources and rely almost entirely on waits to present a picture of query performance and system health.

Tuning 115

Tuning Servers Monitoring Hardware 115

Brendan Gregg

SEPTEMBER 25, 2021

CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Microbenchmark os::javaTimeMillis() on both systems. Running this on the two systems saw similar results.

Speed 103

Speed Java AWS Virtualization 103

All Things Distributed

DECEMBER 12, 2018

In April 2017, Amazon Web Services announced that it would launch a new AWS infrastructure region Region in Sweden. We help Supercell to quickly develop, deploy, and scale their games to cope with varying numbers of gamers accessing the system throughout the course of the day. Our AWS Europe (Stockholm) Region is open for business now.

AWS 120

AWS Cloud Games Serverless 120

Brendan Gregg

JULY 4, 2021

This was a chance to talk about other things I've been working on, such as the present and future of hardware performance. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book. Note that my predictions in this talk may be wrong, but they should be thought-provoking. Ford, et al., “TCP

Performance 52

Performance Latency Hardware Storage 52

Alex Russell

APRIL 29, 2021

After 20 years of neck-in-neck competition, often starting from common code lineages, there just isn't that much left to wring out of the system. Consistent improvement is the name of the game, and it can still have positive impacts, particularly as users lean on the system more heavily over time. Media Session API. Background Sync.

Media 145

Media Games Education Engineering 145

Sutter's Mill

FEBRUARY 13, 2017

” This contains updated and new material that reflects the latest C++ standards and compilers, with a focus to using modern C++11/14/17 effectively on modern hardware and memory architectures. On April 25-27, I’ll be in Stockholm (Kista) giving a three-day seminar on “High-Performance and Low-Latency C++.”

Latency 48

Latency C++ Hardware Performance 48

SQL Performance

AUGUST 27, 2019

It will also use less power than a two-socket Intel server, with a lower hardware cost, and potentially lower licensing costs (for things like VMware). TPC-H Benchmark Results with SQL Server 2017. This system has one AMD EPYC 7502P 32-core processor and 512GB of RAM. The price per QphH for this system is 0.34

Servers 52

Servers Benchmarking Virtualization Architecture 52

Brendan Gregg

AUGUST 8, 2017

Linux load averages are "system load averages" that show the running thread (task) demand on the system as an average number of running plus waiting threads. This measures demand, which can be greater than what the system is currently processing. then your system is idle. - cat /proc/loadavg. 42/3411 43603. 42/3411 43603.

Latency 111

Latency Metrics C++ Systems 111

O'Reilly Software

APRIL 4, 2018

Are there inherent time relationships in the messages that need to be preserved as they travel across the system? As Tyler Akiadu, from Google, explained in his Strata NY 2017 presentation, “ Foundations of streaming SQL ”: “Streams are the in-motion form of data, both bounded and unbounded.” Clean and reprocess it? At least once?

Architecture 80

Architecture Scalability Google Operating System 80

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance.

Performance 52

Performance Latency Cache Virtualization 52

Percona

JULY 7, 2023

Also, in general terms, a high availability PostgreSQL solution must cover four key areas: Infrastructure: This is the physical or virtual hardware database systems rely on to run. Can you afford the necessary hardware, software, and operational costs of maintaining a PostgreSQL HA solution? there cannot be high availability.

Availability 88

Availability Open Source Architecture Database 88

Alex Russell

JUNE 19, 2020

Perhaps there's a better solution, but I've been iterating on content and templates by firing up a linux terminal on my 2017 Pixelbook and starting the built-in 11ty filewatcher and browser sync tools. Details about build hardware, OS, and template configuration are particularly useful.

Cache 55

Cache Hardware Speed Cloud 55

Percona

SEPTEMBER 1, 2023

This blog was originally published in October 2017 and was updated in September 2023. Database architects working with MongoDB encounter specific challenges related to database systems and system growth. Sharding is a preferred approach for database systems facing substantial growth and needing high availability.

Best Practices 76

Best Practices Traffic Database Servers 76

SQL Performance

MARCH 17, 2020

It comes set to SQL Server 2008 compatibility (level 100), but we will start with a more modern setting of SQL Server 2017 (level 140): ALTER DATABASE StackOverflow2013 SET COMPATIBILITY_LEVEL = 140 ; The tests were performed on my laptop using SQL Server 2019 CU 2. This runs in 115ms using the same amount of CPU time. Final Thoughts.

Servers 86

Servers Tuning Database Efficiency 86

Alex Russell

OCTOBER 22, 2017

— Alex Russell (@slightlylate) October 4, 2017. Tools and CI systems help them monitor progress & prevent regressions. Some systems show median RTTs near ~100ms for 3G users. Given the conflicted data we see across our other systems, this seems about right as a baseline. Maybe "ambush by JS"? First Load.

Performance 74

Performance Network Benchmarking Mobile 74

Alex Russell

FEBRUARY 21, 2023

Recall that Cupertino manages the actual work of Safari engineers through Apple-internal systems (previously named "Radar" ), making public bug reports a sort of parallel track; once an issue is imported from a public bug to a private tracker, it's more likely to get developer attention.

Energy 90

Energy Games Engineering Design 90

SQL Performance

JULY 16, 2019

A close monitoring of the hardware enthusiast community, including many of the most respected hardware analysts and reviewers paints an even more dire picture about Intel in the server processor space. This made it easier for database professionals to make the case for a hardware upgrade, and made the typical upgrade more worthwhile.

Servers 46

Servers Hardware Architecture Retail 46

Alex Russell

JANUARY 30, 2024

HTML, CSS, images, and fonts can all be parsed and run at near wire speeds on low-end hardware, but JavaScript is at least three times more expensive, byte-for-byte. So what did $650, give or take, buy in late 2017 or early 2018? was a system properly localised? but which blessedly sports 8GB of RAM. Equally advertised?),

Performance 98

Performance Network Mobile Speed 98

The Morning Paper

JANUARY 19, 2020

STELLA: report from the SNAFU-catchers workshop on coping with complexity , Woods 2017, Coping with Complexity workshop. “Coping with complexity” is about as good a three-word summary of the systems and software challenges facing us over the next decade as I can imagine. A digression on complexity budgets.

C++ 50

C++ Systems Software Software 50

Adrian Cockcroft

DECEMBER 28, 2017

I wanted a system that still works manually and during network outages, and didn’t really want to have a separate hub to gateway the signal. they launched in October 2017, and were founded by people with experience at Nest (thermostats) and August (locks). Eventually I discovered a new option called Noon ( noonhome.com )?—?they

IoT 40

IoT Hardware Energy Network 40

Brendan Gregg

SEPTEMBER 25, 2021

CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Microbenchmark os::javaTimeMillis() on both systems. Running this on the two systems saw similar results.

Speed 40

Speed Java AWS Virtualization 40

John McCalpin

JANUARY 22, 2018

Introduction: In December 2017, my colleague Damon McDougall (now at AMD) asked for help in porting the fused multiply-add example code from a Colfax report ( [link] ) to the Xeon Phi x200 (Knights Landing) processors here at TACC. A peculiar throughput limitation on Intel’s Xeon Phi x200 (Knights Landing). cmpl $1000000000, %eax.

Latency 40

Latency Hardware Code Testing 40

Percona

AUGUST 15, 2023

This blog was originally published in February 2017 and was updated in August 2023. MySQL replication provides high availability, load balancing, and data redundancy, enhancing system reliability. Scaling and Load Balancing (Optional): Implement load balancing and failover mechanisms if you have multiple replicas.

Servers 52

Servers Database Availability Traffic 52

SQL Server According to Bob

DECEMBER 18, 2018

Durability: “In database systems , durability is the ACID property which guarantees transactions that have committed will survive permanently. For example, if a flight booking reports that a seat has successfully been booked, then the seat will remain booked even if the system crashes.” – [link]. Starting with the Linux 4.18

Servers 90

Servers Media Cache Storage 90

CSS Wizardry

APRIL 2, 2018

Here are my top five most-played tracks of 2017’s 70,000 minutes: However, after recently discussing one of my all-time favourite tracks with a friend, and, bizarrely enough, with Nu:Tone himself, I decided that I wanted to start taking my listening a little more seriously. At home, I’m used to just streaming Spotify through an Amazon Echo.

Website 109

Website Media Hardware Monitoring 109

Smashing Magazine

JANUARY 21, 2021

After the latest redesign in late 2017, it was Ilya Pukhalski on the JavaScript side of things (part-time), Michael Riethmueller on the CSS side of things (a few hours a week), and yours truly, playing mind games with critical CSS and trying to juggle a few too many things. Moving From Automated Critical CSS Back To Manual Critical CSS.

Performance 111

Performance Cache Mobile Network 111

Smashing Magazine

JANUARY 7, 2019

On the other hand, we have hardware constraints on memory and CPU due to JavaScript parsing times (we’ll talk about them in detail later). Gatsby.js (React), Preact CLI , and PWA Starter Kit provide reasonable defaults for fast loading out of the box on average mobile hardware. But this consideration needs to be deliberate.

Performance 105

Performance Cache Metrics Network 105