Brendan Gregg

SEPTEMBER 25, 2021

As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Measuring the speed of time Is there already a microbenchmark for os::javaTimeMillis()? Other EC2 instance types, such as C5 or M5, use the AWS Nitro Hypervisor. But I'm not completely sure.

Speed 103

Speed Java AWS Virtualization 103

Dynatrace

NOVEMBER 15, 2021

Driving this growth is the increasing adoption of hyperscale cloud providers (AWS, Azure, and GCP) and containerized microservices running on Kubernetes. Logs can include data about user inputs, system processes, and hardware states. In fact, the global log management market is expected to grow from 1.9 billion in 2020 to $4.1

Analytics 264

Analytics Monitoring DevOps Artificial Intelligence 264

Dynatrace

AUGUST 12, 2020

As companies strive to innovate and deliver faster, modern software architecture is evolving at near the speed of light. With Azure Functions, engineers don’t have to worry about provisioning and maintaining underlying hardware; they simply upload their code, and it’s up and running seconds later. Dynatrace news.

Serverless 217

Serverless Azure Monitoring Lambda 217

Dynatrace

NOVEMBER 22, 2022

Cloud service providers, such as Amazon Web Services (AWS) , can offer infrastructure with five-nines availability by deploying in multiple availability zones and replicating data between regions. Instead, to speed up response times, applications are now processing most data at the network’s perimeter, closest to the data’s origin.

Infrastructure 246

Infrastructure Availability Systems Retail 246

All Things Distributed

MARCH 19, 2018

At AWS, we continue to strive to enable builders to build cutting-edge technologies faster in a secure, reliable, and scalable fashion. Now, thousands of customers are trying Amazon SageMaker and building ML models on top of their data lakes in AWS. In machine learning, more is usually more. Acceleration and distribution.

Scalability 129

Scalability Hardware AWS Tuning 129

Dynatrace

JUNE 30, 2020

In my role as DevOps and Autonomous Cloud Activist at Dynatrace, I get to talk to a lot of organizations and teams, and advise them on how to speed up delivery while also increasing the delivery in order to minimize the impact on operations. Dynatrace news.

Lambda 205

Lambda Monitoring Cloud DevOps 205

All Things Distributed

JULY 14, 2015

DynamoDB Streams is the enabling technology behind two other features announced today: cross-region replication maintains identical copies of DynamoDB tables across AWS regions with push-button ease, and triggers execute AWS Lambda functions on streams, allowing you to respond to changing data conditions. DynamoDB Streams.

Database 158

Database Lambda AWS IoT 158

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 121

Performance Latency Hardware Storage 121

Dynatrace

AUGUST 5, 2019

In this role, I am leading a global team that works closely with our strategic partners such as AWS, Microsoft, Google, Pivotal, Red Hat and others. Lift & Shift is where you basically just move physical or virtual hosts to the cloud – essentially you just run your host on somebody else’s hardware.

Cloud 38

Cloud Traffic Database Network 38

All Things Distributed

NOVEMBER 15, 2016

As I mentioned, we live in a world where massive volumes of data are being generated, every day, from connected devices, websites, mobile apps, and customer applications running on top of AWS infrastructure. QuickSight is a cloud-powered BI service built from the ground up to address the big data challenges around speed, complexity, and cost.

Analytics 126

Analytics Availability Media Social Media 126

All Things Distributed

OCTOBER 7, 2015

In AWS’ quest to enable the best data storage options for engineers, we have built several innovative database solutions like Amazon RDS, Amazon RDS for Aurora, Amazon DynamoDB, and Amazon Redshift. QuickSight is a cloud-native BI service built from the ground up to address the big data challenges around speed, complexity, and cost.

Cloud 114

Cloud Big Data AWS Analytics 114

All Things Distributed

JULY 13, 2010

During my academic career, I spent many years working on HPC technologies such as user-level networking interfaces, large scale high-speed interconnects, HPC software stacks, etc. There is no more need for hardware tinkering to keep the clusters up and running (I spent many nights doing this; there is no glory in it). until today.

Cloud 98

Cloud AWS Automotive Latency 98

All Things Distributed

MARCH 11, 2015

AWS is enabling innovations in areas such as healthcare, automotive, life sciences, retail, media, energy, robotics that it is mind boggling and humbling. For example many of the Internet of Things innovations that we have seen come to life in the past years on AWS all have a significant analytics components to it.

Analytics 109

Analytics Cloud Healthcare Retail 109

All Things Distributed

APRIL 5, 2012

Empowering innovation is at the heart of everything we do at Amazon Web Services (AWS). I often get to meet, discuss, and learn from innovators how they are using AWS to deliver transformative applications to their users, customers and partners. Troy: We moved our service from internal servers to AWS. the recoverability of data.

Innovation 112

Innovation AWS Education Network 112

KeyCDN

FEBRUARY 22, 2023

The goal of WebAssembly is to execute at native speeds by taking advantage of common hardware features available on a variety of platforms. With cloud-based infrastructure, organizations can easily scale their web applications to handle increased traffic or demand without the need for expensive hardware upgrades.

Artificial Intelligence 111

Artificial Intelligence Development Serverless Website 111

Brendan Gregg

SEPTEMBER 25, 2021

As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Measuring the speed of time Is there already a microbenchmark for os::javaTimeMillis()? Other EC2 instance types, such as C5 or M5, use the AWS Nitro Hypervisor. But I'm not completely sure.

Speed 52

Speed Java AWS Virtualization 52

Brendan Gregg

NOVEMBER 28, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. I'd expect between 0.1% small (thanks @cperciva ). ## 3.

Virtualization 40

Virtualization AWS Hardware Storage 40

Scalegrid

JUNE 14, 2024

By employing techniques like indexing, query optimization, denormalization, and proper hardware configuration in MySQL, data retrieval operations can be significantly improved. Optimizing Data Models Optimizing data models in MySQL and Power BI is crucial for enhancing database performance and achieving faster data analysis and reporting.

Database 130

Database Azure Efficiency Servers 130

The Morning Paper

MARCH 3, 2020

It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. For Physalia, and for AWS more generally, the guiding principle is minimise the blast radius. NSDI’20.

Database 106

Database AWS Network Design 106

Brendan Gregg

SEPTEMBER 25, 2021

As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Measuring the speed of time Is there already a microbenchmark for os::javaTimeMillis()? Other EC2 instance types, such as C5 or M5, use the AWS Nitro Hypervisor. But I'm not completely sure.

Speed 40

Speed Java AWS Virtualization 40

Brendan Gregg

FEBRUARY 28, 2023

## References I've reproduced the references from my SREcon22 keynote below, so you can click on links: - [Gregg 08] Brendan Gregg, “ZFS L2ARC,” [link] Jul 2008 - [Gregg 10] Brendan Gregg, “Visualizations for Performance Analysis (and More),” [link] 2010 - [Greenberg 11] Marc Greenberg, “DDR4: Double the speed, double the latency?

Performance 103

Performance Latency Cache Virtualization 103

Percona

NOVEMBER 3, 2023

PostgreSQL Cluster One coordinator node citus-coord-01 Three worker nodes citus1 citus2 citus3 Hardware AWS Instance Ubuntu Server 20.04, SSD volume type 64-bit (x86) c5.xlarge In order to speed up the benchmark indexes must be added. The “wal_level” is set at logical.

Database 114

Database Benchmarking Latency C++ 114

VoltDB

MAY 14, 2024

As a result, IT teams picked hardware somewhat blindly but with a strong bias towards oversizing for the sake of expanding the budget, leading to systems running at 10-15% of maximum capacity. Prototypes, experiments, and tests Development and testing historically involved end-of-life or ‘spare’ hardware. When is the cloud a bad idea?

Latency 52

Latency Availability Cloud Hardware 52

VoltDB

JUNE 1, 2017

Hardware Optimizers” want to get the maximum utilization out of hardware. These systems were designed to have a lifetime of half a decade or more, and rapidly changing hardware meant that the initial deployment had to be sized for 5-7 years out. Attendees could be broken down into several distinct groups.

Hardware 56

Hardware Latency Virtualization Cloud 56

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 52

Performance Latency Hardware Storage 52

O'Reilly

NOVEMBER 28, 2023

That pricing won’t be sustainable, particularly as hardware shortages drive up the cost of building infrastructure. How will AI adopters react when the cost of renting infrastructure from AWS, Microsoft, or Google rises? And there are many other applications for machine-generated text: AI is good at summarizing documents.

Open Source 137

Open Source Google Artificial Intelligence Infrastructure 137

Adrian Cockcroft

AUGUST 9, 2022

So right from the beginning, I’m happy to spend some time getting back up to speed and developing some of my ideas around new hardware capabilities. One is general technology advice on the state of the art in development practices, along the lines of the Cloud for CEOs booklet I published for AWS in 2019.

IoT 52

IoT Best Practices AWS Media 52

All Things Distributed

DECEMBER 20, 2017

Breuninger, a fashion department store chain steeped in tradition, has recognized this and relies on a self-developed e-commerce platform in the AWS Cloud. We need mechanisms that enable the mass production of data using software and hardware capabilities. These mechanisms need to be lean, seamless and effective.

Artificial Intelligence 70

Artificial Intelligence Social Media Logistics AWS 70

Testsigma

MAY 19, 2021

Thinking back on how SDLC started and what it is today, the only reasons for its success can be accounted to efficiency, speed and most importantly automation – DevOps and cloud-based solutions can be considered major contributors here (after all DevOps is 41% less time-consuming than traditional ops ). . Sign up Now.

DevOps 59

DevOps Cloud Artificial Intelligence Infrastructure 59

Brendan Gregg

SEPTEMBER 5, 2017

Linux has been adding tracing technologies over the years: kprobes (kernel dynamic tracing), uprobes (user-level dynamic tracing), tracepoints (static tracing), and perf_events (profiling and hardware counters). But there's another factor at play: jobs are also migrating from both Solaris and Linux to cloud jobs instead, specifically AWS.

Virtualization 75

Virtualization AWS Engineering Hardware 75

VoltDB

JUNE 1, 2017

Hardware Optimizers” want to get the maximum utilization out of hardware. These systems were designed to have a lifetime of half a decade or more, and rapidly changing hardware meant that the initial deployment had to be sized for 5-7 years out. Attendees could be broken down into several distinct groups.

Hardware 40

Hardware Latency Virtualization Cloud 40

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

Percona

JULY 26, 2023

To make this process work more efficiently and ensure a smooth failover, it is important to have the same hardware configuration on all the nodes of the replica set. Indexing can help to speed up read queries, but it comes with an extra cost of storage, and they will slow down write operations.

Database 98

Database Servers Storage Strategy 98

Brendan Gregg

FEBRUARY 28, 2023

References I've reproduced the references from my SREcon22 keynote below, so you can click on links: [Gregg 08] Brendan Gregg, “ZFS L2ARC,” [link] , Jul 2008 [Gregg 10] Brendan Gregg, “Visualizations for Performance Analysis (and More),” [link] , 2010 [Greenberg 11] Marc Greenberg, “DDR4: Double the speed, double the latency?

Performance 52

Performance Latency Cache Virtualization 52

HammerDB

APRIL 19, 2023

For example, if you are buying the latest Amazon memory-optimized EC2 instance (R7iz), the AWS page ( [link] ) tells us the following: Up to 3.9 on identical hardware, with identical settings, but at different load levels. For example, if we want to evaluate moving our OLTP applications from MySQL 8.0.27 and 8.0.32 HammerDB 4.5

Performance 55

Performance Benchmarking Cache Storage 55

Dynatrace

OCTOBER 28, 2021

In 2009, the purveyor of online videos migrated to AWS cloud infrastructure to deliver its entertainment to a growing audience. A disruption spanning hardware, networks, and cloud infrastructure can require input and participation from network and infrastructure architects, risk experts, security teams, and even procurement officers.

Engineering 264

Engineering Entertainment Cloud Infrastructure 264

Smashing Magazine

SEPTEMBER 3, 2021

It can be hard to visualize the huge network of hardware that allows you to send a request for a page to a server and then receive a response back. The good news is that, as developers, we can do an awful lot about it. As a result of this, my view of the Internet for a long time was a little ephemeral, a sort of mirage. Taking Action.

Website 140

Website Internet Internet Energy 140