The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., The paper examines the implications of microservices at the hardware, OS and networking stack, cluster management, and application framework levels, as well as the impact of tail latency.

Open Source 61

Open Source Hardware Benchmarking Systems 61

Randon ASCII

JANUARY 12, 2022

That meant I started having regular meetings with the hardware engineers who were working with IBM on the CPU which gave me even more expertise on this CPU, which was critical in helping me discover a design flaw in one of its instructions , and in helping game developers master this finicky beast. So, anyway. I wrote a lot of benchmarks.

Cache 126

Cache Latency Benchmarking Hardware 126

John McCalpin

AUGUST 1, 2018

According to Dr. Bandwidth, performance analysis has two recurring themes: How fast should this code (or “simple” variations on this code) run on this hardware? The user environment defines the mapping of MPI ranks to hardware resources (cores, sockets, nodes). The MPI runtime library.

Hardware 40

Hardware Transportation Performance Latency 40

The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. This avoids thrashing caches too much for B and evens out the pressure on the L3 caches of the machine.

Cache 256

Cache Latency Airlines Logistics 256

Scalegrid

FEBRUARY 8, 2024

Key Takeaways Distributed storage systems benefit organizations by enhancing data availability, fault tolerance, and system scalability, leading to cost savings from reduced hardware needs, energy consumption, and personnel. By implementing data replication strategies, distributed storage systems achieve greater.

Storage 130

Storage Systems Big Data Azure 130

The Morning Paper

OCTOBER 4, 2020

We are standing on the eve of the 5G era… 5G, as a monumental shift in cellular communication technology, holds tremendous potential for spurring innovations across many vertical industries, with its promised multi-Gbps speed, sub-10 ms low latency, and massive connectivity. Throughput and latency. The short answer is no.

Energy 130

Energy Latency Performance Network 130

Brendan Gregg

JULY 4, 2021

This was a chance to talk about other things I've been working on, such as the present and future of hardware performance. The video is on [youtube]: The slides are on [slideshare] or as a [PDF]: I work on many areas of performance, but recently I've had a lot of demand to talk about BPF. Ford, et al., “TCP

Performance 121

Performance Latency Hardware Storage 121

ACM Sigarch

MAY 31, 2023

There are three common mechanisms to access remote memory: modifying applications, modifying virtual memory, and hardware-level cache coherence support. even lowered the latency by introducing a multi-headed device that collapses switches and memory controllers. About CXL hardware availability with academia.

Latency 52

Latency Hardware Cache Architecture 52

Adrian Cockcroft

MARCH 17, 2020

The opening paragraph above is the same as my previous discussion focused on hardware, software and operational failure modes , but we are now in the middle of a pandemic, so I’m going to adapt the discussion of hazards and failure modes to our current situation. Book: Engineering a Safer World by Nancy G. What Happens Next?

Healthcare 52

Healthcare Government Airlines Systems 52

Dynatrace

SEPTEMBER 30, 2021

It requires purchasing, powering, and configuring physical hardware, training and retaining the staff capable of servicing and securing the machines, operating a data center, and so on. They need enough hardware to serve their anticipated volume and keep things running smoothly without buying too much or too little. Reduced cost.

Cloud 175

Cloud Traffic Best Practices Hardware 175

Adrian Cockcroft

NOVEMBER 18, 2024

In this lightning talk, learn how customers are using AWS to perform millions of calculations on real-time grid data to execute the scenario analysis, simulations, and operational planning necessary to operate a dynamic power grid. Patricia Carroll, Sr. Sustainability Specialist, AWS SUS210 ?

AWS 98

AWS Energy Lambda Government 98

Percona

JUNE 22, 2023

long_query_time: Defines the threshold for query execution time, and queries taking longer than this threshold are considered slow and logged for further analysis innodb_buffer_pool_size: Sets the size of the InnoDB buffer pool. The point we’re making here is they are critical for MySQL Performance.

Performance 108

Performance Monitoring Traffic Database 108

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 103

Performance Latency Cache Virtualization 103

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. This was a weird problem to think about: Time itself had now become a resource and target of performance analysis. I'm including this step as a reminder for anyone following this kind of analysis. But I'm not completely sure.

Speed 103

Speed Java AWS Virtualization 103

The Morning Paper

JULY 4, 2019

Moreover, just like an A/B test, we’ll be collecting metrics while the experiment is underway and performing statistical analysis at the end to interpret the results. degraded hardware, transient networking problem) or, more often, because of some change deployed by Netflix engineers that did not have the intended effect.

Latency 77

Latency Engineering Metrics Traffic 77

Brendan Gregg

JULY 4, 2021

This was a chance to talk about other things I've been working on, such as the present and future of hardware performance. The video is on [youtube]: The slides are [here] or as a [PDF]: first prev next last / permalink/zoom I work on many areas of performance, but recently I've had a lot of demand to talk about BPF. Ford, et al., “TCP

Performance 52

Performance Latency Hardware Storage 52

Percona

NOVEMBER 9, 2023

Your workloads, encapsulated in containers, can be deployed freely across different clouds or your own hardware. Education : Universities often use Kubernetes for projects that require substantial resources because it scales computing clusters for research, data analysis, and simulations.

Efficiency 107

Efficiency Cloud Healthcare Open Source 107

Percona

SEPTEMBER 1, 2023

This results in expedited query execution, reduced resource utilization, and more efficient exploitation of the available hardware resources. This reduction in latency ensures that applications and websites provide a more rapid and responsive user experience. Query plan analysis can also provide valuable insights.

Tuning 52

Tuning Database Performance Hardware 52

Brendan Gregg

AUGUST 18, 2019

For example, iostat(1), or a monitoring agent, may tell you your average disk latency, but not the distribution of this latency. bpftrace is suited for this kind of analysis: decomposing metrics into distributions or per-event logs, and creating new metrics for visibility into blind spots. Block I/O latency as a histogram.

Latency 57

Latency C++ Cache Programming 57

Dynatrace

OCTOBER 1, 2021

In these modern environments, every hardware, software, and cloud infrastructure component and every container, open-source tool, and microservice generates records of every activity. Observability relies on telemetry derived from instrumentation that comes from the endpoints and services in your multi-cloud computing environments.

Metrics 363

Metrics Open Source Monitoring Cloud 363

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

The Morning Paper

MAY 21, 2019

This boils down to a single digit µs latency toleration in the tail for far memory, and in addition to security and privacy concerns, rules out remote memory solutions. Thus we’re fundamentally trading (de)-compression latency at access time for the ability to pack more data in memory. ML-based auto-tuning.

Software 78

Software Software Google Hardware 78

VoltDB

JUNE 26, 2024

In addition to hardware and software expenses, costs also include the infrastructure needed to support these systems — like sensors, IoT devices, upgraded network capabilities, and robust cybersecurity measures.

IoT 52

IoT Analytics Artificial Intelligence Energy 52

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. This was a weird problem to think about: Time itself had now become a resource and target of performance analysis. I'm including this step as a reminder for anyone following this kind of analysis. in total.

Speed 52

Speed Java AWS Virtualization 52

The Morning Paper

MAY 14, 2019

Last time around we looked at the DeathStarBench suite of microservices-based benchmark applications and learned that microservices systems can be especially latency sensitive, and that hotspots can propagate through a microservices architecture in interesting ways. on end-to-end latency) and less than 0.15% on throughput.

Big Data 45

Big Data Cloud Performance Hardware 45

CSS - Tricks

JULY 25, 2019

Over the past couple of years, it has become the go-to free performance analysis tool. Estimated Input Latency. Estimated Input Latency. It’s time to come to terms that your customers aren’t using the same powerful hardware as you. What is Google Lighthouse? They are: Time to Interactive ( TTI ). Speed Index.

Google 72

Google Engineering Speed Mobile 72

HammerDB

OCTOBER 23, 2023

Note that for all tests, we used the local loopback address and port to provide the lowest possible network latency between client and server and also so we don’t have any concerns about bandwidth limitations. Database information and performance schemas The best approach for database performance analysis is to take a top-down approach.

Benchmarking 62

Benchmarking Database Network C++ 62

Dotcom-Montior

DECEMBER 8, 2021

Software services still require physical devices and hardware for them to function. An organization’s response to an incident, whether we are talking about downtime, security breaches or cyber-attacks, or even prolonged latency and repeated errors, is critical to the continued success of the business and trust from the customer or end user.

Social Media 90

Social Media Monitoring Latency DevOps 90

John McCalpin

JANUARY 22, 2018

Each of the two vector units can issue one FMA instruction per cycle, assuming that there are enough independent accumulators to tolerate the 6-cycle dependent-operation latency. This is an uninspiring fraction of peak performance that would normally suggest significant inefficiencies in either the hardware or software.

Latency 40

Latency Hardware Code Testing 40

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. This was a weird problem to think about: Time itself had now become a resource and target of performance analysis. I'm including this step as a reminder for anyone following this kind of analysis. But I'm not completely sure.

Speed 40

Speed Java AWS Virtualization 40

Adrian Cockcroft

NOVEMBER 11, 2019

This discussion focuses on hardware, software and operational failure modes. Collecting some critical metrics at one second intervals, with a total observability latency of ten seconds or less matches the human attention span much better. Try to measure your mean time to respond (MTTR) for incidents.

Latency 52

Latency Systems Engineering Hardware 52

Adrian Cockcroft

NOVEMBER 11, 2019

This discussion focuses on hardware, software and operational failure modes. Collecting some critical metrics at one second intervals, with a total observability latency of ten seconds or less matches the human attention span much better. Try to measure your mean time to respond (MTTR) for incidents.

Latency 53

Latency Systems Engineering Hardware 53

All Things Distributed

NOVEMBER 15, 2010

For example, the most fundamental abstraction trade-off has always been latency versus throughput. Modern CPUs strongly favor lower latency of operations with clock cycles in the nanoseconds and we have built general purpose software architectures that can exploit these low latencies very well. General Purpose GPU programming.

AWS 130

AWS Programming Latency Architecture 130

Brendan Gregg

AUGUST 8, 2017

They are demand on the system, albeit for software resources rather than hardware resources. ## Decomposing Linux load averages Can the Linux load average value be fully decomposed into components? Latency was acceptable and no one complained. Yes, I'd say so. They aren't idle. Load averages measured in a modern tool.

Latency 111

Latency Metrics C++ Systems 111

Alex Russell

MARCH 6, 2021

Hardware Past As Performance Prologue. Regardless, the overall story for hardware progress remains grim, particularly when we recall how long device replacement cycles are: Tap for a larger version. Sadly, data on latency is harder to get, even from Google's perch, so progress there is somewhat more difficult to judge.

Performance 127

Performance Network Cache Metrics 127

Smashing Magazine

AUGUST 3, 2021

Different browsers running on different platforms and hardware, respecting our user preferences and browsing modes (Safari Reader/ assistive technologies), being served to geo-locations with varying latency and intermittency increase the likeness of something not working as intended. More after jump!

Network 145

Network Engineering Availability Monitoring 145

O'Reilly Software

APRIL 4, 2018

Those were the days when “connected” meant having some web presence, “interactions” were measured in number of clicks, and the analysis happened in batch overnight processes. The data shape will dictate capacity planning, tuning of the backbone, and scalability analysis for individual components. At least once? At most once?

Architecture 80

Architecture Scalability Google Operating System 80