Brendan Gregg

SEPTEMBER 5, 2017

Linux has been adding tracing technologies over the years: kprobes (kernel dynamic tracing), uprobes (user-level dynamic tracing), tracepoints (static tracing), and perf_events (profiling and hardware counters). In a test environment, I've seen several more Linux panics in the past three years.

Virtualization 75

Virtualization AWS Engineering Hardware 75

Alex Russell

MARCH 6, 2021

TL;DR: A lot has changed since 2017 when we last estimated a global baseline resource per-page resource budget of 130-170KiB. To update our global baseline from 2017, we want to update our priors on a few dimensions: The evolved device landscape. Hardware Past As Performance Prologue. The Moto G4 , for example. Hard Reset.

Performance 127

Performance Network Mobile Metrics 127

Brendan Gregg

FEBRUARY 28, 2023

Make sure your system can handle next-generation DRAM,” [link] Nov 2011 - [Hruska 12] Joel Hruska, “The future of CPU scaling: Exploring options on the cutting edge,” [link] Feb 2012 - [Gregg 13] Brendan Gregg, “Blazing Performance with Flame Graphs,” [link] 2013 - [Shimpi 13] Anand Lal Shimpi, “Seagate to Ship 5TB HDD in 2014 using Shingled Magnetic (..)

Performance 103

Performance Latency Cache Google 103

SQL Performance

JANUARY 23, 2020

Query Store 2017 to the Rescue. In SQL Server 2017 and above, Query Store captures query-level waits in addition to query resource consumption. Since CPU and IO consumption translate directly to server hardware and cloud spend, this is significant. Erin Stellato did a great post on Query Store waits here.

Tuning 115

Tuning Servers Monitoring Hardware 115

All Things Distributed

DECEMBER 12, 2018

In April 2017, Amazon Web Services announced that it would launch a new AWS infrastructure region Region in Sweden. If the solution works as envisioned, Telenor Connexion can easily deploy it to production and scale as needed without an investment in hardware. Our AWS Europe (Stockholm) Region is open for business now.

AWS 119

AWS Cloud Games Serverless 119

Percona

JANUARY 17, 2019

On multi-core machines – which is the majority of the hardware nowadays – and in the cloud, we have multiple cores available for use. Here is a summary of the queries: Simple queries: select count(*) from ontime where flightdate > '2017-01-01'. With faster disks (i.e. AWS Aurora (based on MySQL 5.6)

Cache 72

Cache C++ AWS Airlines 72

Brendan Gregg

JULY 4, 2021

This was a chance to talk about other things I've been working on, such as the present and future of hardware performance. The video is on [youtube]: The slides are [here] or as a [PDF]: first prev next last / permalink/zoom I work on many areas of performance, but recently I've had a lot of demand to talk about BPF.

Performance 52

Performance Latency Hardware Storage 52

Tim Kadlec

JANUARY 9, 2019

I recently profiled a page on a Pixel 2 (released in 2017), and an Alcatel 1x (released in 2018). Hardware gets better, sure. The web’s growth is being pushed forward primarily by low-cost, underpowered Android devices that frequently struggle with today’s web. The two devices represent very different ends of the spectrum.

Performance 111

Performance Energy Internet Internet 111

Sutter's Mill

FEBRUARY 13, 2017

” This contains updated and new material that reflects the latest C++ standards and compilers, with a focus to using modern C++11/14/17 effectively on modern hardware and memory architectures. On April 25-27, I’ll be in Stockholm (Kista) giving a three-day seminar on “High-Performance and Low-Latency C++.”

Latency 48

Latency C++ Hardware Performance 48

Brendan Gregg

SEPTEMBER 25, 2021

As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. html [60s checklist]: /Articles/Netflix_Linux_Perf_Analysis_60s.pdf [re:Invent talk]: [link] [recommendation]: [link] [Nitro]: /blog/2017-11-29/aws-ec2-virtualization-2017.html

Speed 103

Speed Java AWS Virtualization 103

Alex Russell

APRIL 29, 2021

WebGL 2 launched for other platforms on Chrome and Firefox in 2017. is access to hardware devices. This allows customisation and use of specialised features without custom, proprietary software for niche hardware. Some commenters appear to confuse unlike hardware for differences in software. Shape Detection.

Media 145

Media Games Education Engineering 145

SQL Performance

AUGUST 27, 2019

It will also use less power than a two-socket Intel server, with a lower hardware cost, and potentially lower licensing costs (for things like VMware). TPC-H Benchmark Results with SQL Server 2017. TPC-E Benchmark Results with SQL Server 2017. AMD Rome Second Generation EPYC Review: 2x 64-core Benchmarked.

Servers 52

Servers Benchmarking Virtualization Architecture 52

Percona

SEPTEMBER 1, 2023

This blog was originally published in October 2017 and was updated in September 2023. Vertical scaling is also often discussed, which involves increasing the resources of a single server, which can have limitations in hardware capabilities and become costly as demands grow. An example is running MongoDB on Mesos.

Best Practices 98

Best Practices Traffic Database Servers 98

Brendan Gregg

FEBRUARY 28, 2023

Make sure your system can handle next-generation DRAM,” [link] , Nov 2011 [Hruska 12] Joel Hruska, “The future of CPU scaling: Exploring options on the cutting edge,” [link] , Feb 2012 [Gregg 13] Brendan Gregg, “Blazing Performance with Flame Graphs,” [link] , 2013 [Shimpi 13] Anand Lal Shimpi, “Seagate to Ship 5TB HDD in 2014 using Shingled Magnetic (..)

Performance 52

Performance Latency Cache Google 52

Alex Russell

JUNE 19, 2020

Perhaps there's a better solution, but I've been iterating on content and templates by firing up a linux terminal on my 2017 Pixelbook and starting the built-in 11ty filewatcher and browser sync tools. Details about build hardware, OS, and template configuration are particularly useful.

Cache 55

Cache Hardware Speed Cloud 55

Percona

JULY 7, 2023

Also, in general terms, a high availability PostgreSQL solution must cover four key areas: Infrastructure: This is the physical or virtual hardware database systems rely on to run. Can you afford the necessary hardware, software, and operational costs of maintaining a PostgreSQL HA solution? there cannot be high availability.

Availability 98

Availability Open Source Architecture Database 98

SQL Performance

JULY 16, 2019

A close monitoring of the hardware enthusiast community, including many of the most respected hardware analysts and reviewers paints an even more dire picture about Intel in the server processor space. This made it easier for database professionals to make the case for a hardware upgrade, and made the typical upgrade more worthwhile.

Servers 46

Servers Hardware Architecture Retail 46

O'Reilly Software

APRIL 4, 2018

As Tyler Akiadu, from Google, explained in his Strata NY 2017 presentation, “ Foundations of streaming SQL ”: “Streams are the in-motion form of data, both bounded and unbounded.” It enables unbounded scalability as more commodity or specialized hardware can be seamlessly added to existing clusters.

Architecture 80

Architecture Scalability Google Operating System 80

SQL Performance

MARCH 17, 2020

It comes set to SQL Server 2008 compatibility (level 100), but we will start with a more modern setting of SQL Server 2017 (level 140): ALTER DATABASE StackOverflow2013 SET COMPATIBILITY_LEVEL = 140 ; The tests were performed on my laptop using SQL Server 2019 CU 2. The serial aggregate push down result of 13ms is equally impressive.

Servers 86

Servers Tuning Database Efficiency 86

ACM Sigarch

FEBRUARY 23, 2018

Richard Thaler won the 2017 Nobel prize in Economics for his work on Behavioral Economics. Hardware engineers design and implement solutions in RTL, while software engineers attempt to solve the problem either at the OS or application level. We believed existing hardware and OS protocols protected the processor.

Architecture 47

Architecture Cache Hardware Virtualization 47

Alex Russell

OCTOBER 22, 2017

— Alex Russell (@slightlylate) October 4, 2017. This, in turn, drives the single most important trend in setting the global web performance budget hardware baseline: the next billion users will largely come online when they can afford to. We now have everything we need to create a ballpark perf budget for a product in 2017.

Performance 74

Performance Network Benchmarking Mobile 74

Brendan Gregg

AUGUST 8, 2017

They are demand on the system, albeit for software resources rather than hardware resources. ## Decomposing Linux load averages Can the Linux load average value be fully decomposed into components? Yes, I'd say so. Those threads are in the middle of doing work, and happen to block on a lock. They aren't idle. 3 tar termb$ iostat -x 60. [.]

Latency 111

Latency Metrics C++ Systems 111

Alex Russell

JANUARY 30, 2024

HTML, CSS, images, and fonts can all be parsed and run at near wire speeds on low-end hardware, but JavaScript is at least three times more expensive, byte-for-byte. So what did $650, give or take, buy in late 2017 or early 2018? but which blessedly sports 8GB of RAM.

Performance 98

Performance Network Mobile Speed 98

Rigor

MARCH 20, 2018

Instead of focusing on hardware and infrastructure first, technical teams should first ensure that they first have visibility on the thing that drives the business: their customer experience. 38% of all sites measured in Sept 2017 (~500K) are more than 75% 3rd party content.

Monitoring 40

Monitoring Retail Ecommerce Infrastructure 40

Adrian Cockcroft

DECEMBER 28, 2017

they launched in October 2017, and were founded by people with experience at Nest (thermostats) and August (locks). Hardware installation was a lot of work but not too frustrating, I did it in about two days over the holidays. Eventually I discovered a new option called Noon ( noonhome.com )?—?they

IoT 40

IoT Hardware Energy Network 40

John McCalpin

JANUARY 22, 2018

A peculiar throughput limitation on Intel’s Xeon Phi x200 (Knights Landing) Introduction: In December 2017, my colleague Damon McDougall (now at AMD) asked for help in porting the fused multiply-add example code from a Colfax report ( [link] ) to the Xeon Phi x200 (Knights Landing) processors here at TACC.

Latency 40

Latency Hardware Code Testing 40

John McCalpin

JANUARY 22, 2018

Introduction: In December 2017, my colleague Damon McDougall (now at AMD) asked for help in porting the fused multiply-add example code from a Colfax report ( [link] ) to the Xeon Phi x200 (Knights Landing) processors here at TACC. A peculiar throughput limitation on Intel’s Xeon Phi x200 (Knights Landing). cmpl $1000000000, %eax.

Latency 40

Latency Hardware Code Testing 40

The Morning Paper

JANUARY 19, 2020

STELLA: report from the SNAFU-catchers workshop on coping with complexity , Woods 2017, Coping with Complexity workshop. Today’s choice is a report from a 2017 workshop convened with that title, and recommended to me by John Allspaw – thank you John! How do participants do that?

C++ 50

C++ Systems Software Software 50

Brendan Gregg

SEPTEMBER 25, 2021

As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. html [60s checklist]: /Articles/Netflix_Linux_Perf_Analysis_60s.pdf [re:Invent talk]: [link] [recommendation]: [link] [Nitro]: /blog/2017-11-29/aws-ec2-virtualization-2017.html

Speed 40

Speed Java AWS Virtualization 40

Percona

AUGUST 5, 2023

This blog was originally published in July 2017 and was updated in August 2023. This means that multiple partitions can be processed simultaneously, making better use of available hardware resources and further enhancing query performance. It’s a pretty common question around here, so let’s see what we can do about that.

Strategy 40

Strategy Storage Database Best Practices 40

Percona

AUGUST 15, 2023

This blog was originally published in February 2017 and was updated in August 2023. Failover ensures that if the primary MySQL server becomes unavailable due to hardware failure or another issue, the system seamlessly switches to a standby replica. One approach is the implementation of failover mechanisms.

Servers 52

Servers Database Availability Traffic 52

Brendan Gregg

NOVEMBER 29, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance. I'd expect between 0.1%

Virtualization 110

Virtualization AWS Hardware Storage 110

SQL Server According to Bob

DECEMBER 18, 2018

Durability is a cornerstone of any database system and starting with SQL Server 2017 on Linux Cumulative Update 6 (CU6), SQL Server on Linux enables “Forced Flush” behavior as described in this article , improving durability on non-Fua optimized systems. “Be Linux may need similar utilities to control various hardware cache installations.

Servers 90

Servers Media Cache Storage 90

Brendan Gregg

NOVEMBER 28, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance. I'd expect between 0.1%

Virtualization 40

Virtualization AWS Hardware Storage 40

Alex Russell

FEBRUARY 21, 2023

From outright misstatements about a competitor's security, to claims that performance differences in hardware show Safari is faster, to [geographic brinksmanship](/2022/02/minimum-standards/), the confident bluster hasn't gone down particularly well.

Energy 90

Energy Games Engineering Design 90

CSS Wizardry

APRIL 2, 2018

Here are my top five most-played tracks of 2017’s 70,000 minutes: However, after recently discussing one of my all-time favourite tracks with a friend, and, bizarrely enough, with Nu:Tone himself, I decided that I wanted to start taking my listening a little more seriously. At home, I’m used to just streaming Spotify through an Amazon Echo.

Website 111

Website Media Hardware Monitoring 111

Smashing Magazine

JANUARY 21, 2021

After the latest redesign in late 2017, it was Ilya Pukhalski on the JavaScript side of things (part-time), Michael Riethmueller on the CSS side of things (a few hours a week), and yours truly, playing mind games with critical CSS and trying to juggle a few too many things. Moving From Automated Critical CSS Back To Manual Critical CSS.

Performance 111

Performance Cache Mobile Network 111