Dynatrace

OCTOBER 1, 2021

In these modern environments, every hardware, software, and cloud infrastructure component and every container, open-source tool, and microservice generates records of every activity. Observability relies on telemetry derived from instrumentation that comes from the endpoints and services in your multi-cloud computing environments.

Metrics 363

Metrics Open Source Monitoring Cloud 363

The Morning Paper

OCTOBER 4, 2020

We are standing on the eve of the 5G era… 5G, as a monumental shift in cellular communication technology, holds tremendous potential for spurring innovations across many vertical industries, with its promised multi-Gbps speed, sub-10 ms low latency, and massive connectivity. Throughput and latency. The short answer is no.

Energy 130

Energy Latency Performance Network 130

Scalegrid

JANUARY 25, 2024

These can help you ensure your system’s health and quickly perform root cause analysis of any performance-related issue you might be encountering. Understanding Redis Performance Indicators Redis is designed to handle high traffic and low latency with its in-memory data store and efficient data structures.

Metrics 130

Metrics Monitoring Latency Cache 130

Scalegrid

DECEMBER 21, 2023

Identifying key Redis® metrics such as latency, CPU usage, and memory metrics is crucial for effective Redis monitoring. To monitor Redis® instances effectively, collect Redis metrics focusing on cache hit ratio, memory allocated, and latency threshold.

Strategy 130

Strategy Monitoring Latency DevOps 130

Dynatrace

AUGUST 5, 2019

It covers these key areas: Technology & Dependency Analysis. Resource consumption & traffic analysis. While most of our cloud & platform partners have their own dependency analysis tooling, most of them focus on basic dependency detection based on network connection analysis between hosts.

Cloud 31

Cloud Traffic Database Network 31

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., The paper examines the implications of microservices at the hardware, OS and networking stack, cluster management, and application framework levels, as well as the impact of tail latency.

Open Source 61

Open Source Hardware Benchmarking Systems 61

Dynatrace

SEPTEMBER 30, 2021

It requires purchasing, powering, and configuring physical hardware, training and retaining the staff capable of servicing and securing the machines, operating a data center, and so on. They need enough hardware to serve their anticipated volume and keep things running smoothly without buying too much or too little. Reduced cost.

Cloud 175

Cloud Traffic Best Practices Strategy 175

Brendan Gregg

JULY 4, 2021

This was a chance to talk about other things I've been working on, such as the present and future of hardware performance. The video is on [youtube]: The slides are on [slideshare] or as a [PDF]: I work on many areas of performance, but recently I've had a lot of demand to talk about BPF. Ford, et al., “TCP

Performance 121

Performance Latency Hardware Storage 121

Highly Scalable

SEPTEMBER 18, 2012

Historically, NoSQL paid a lot of attention to tradeoffs between consistency, fault-tolerance and performance to serve geographically distributed systems, low-latency or highly available applications. A database should accommodate itself to different data distributions, cluster topologies and hardware configurations. Data Placement.

Database 213

Database Latency C++ Scalability 213

All Things Distributed

NOVEMBER 15, 2010

For example, the most fundamental abstraction trade-off has always been latency versus throughput. Modern CPUs strongly favor lower latency of operations with clock cycles in the nanoseconds and we have built general purpose software architectures that can exploit these low latencies very well. General Purpose GPU programming.

AWS 127

AWS Programming Latency Architecture 127

Scalegrid

FEBRUARY 8, 2024

Key Takeaways Distributed storage systems benefit organizations by enhancing data availability, fault tolerance, and system scalability, leading to cost savings from reduced hardware needs, energy consumption, and personnel. By implementing data replication strategies, distributed storage systems achieve greater.

Storage 130

Storage Systems Big Data Azure 130

VoltDB

DECEMBER 11, 2024

By bringing computation closer to the data source, edge-based deployments reduce latency, enhance real-time capabilities, and optimize network bandwidth. Use hardware-based encryption and ensure regular over-the-air updates to maintain device security. Increased latency during peak loads. Data interception during transit.

IoT 52

IoT Energy Logistics Latency 52

John McCalpin

AUGUST 1, 2018

According to Dr. Bandwidth, performance analysis has two recurring themes: How fast should this code (or “simple” variations on this code) run on this hardware? The user environment defines the mapping of MPI ranks to hardware resources (cores, sockets, nodes). The MPI runtime library.

Hardware 40

Hardware Transportation Performance Latency 40

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. This was a weird problem to think about: Time itself had now become a resource and target of performance analysis. I'm including this step as a reminder for anyone following this kind of analysis. But I'm not completely sure.

Speed 103

Speed Java AWS Virtualization 103

The Morning Paper

JULY 4, 2019

Moreover, just like an A/B test, we’ll be collecting metrics while the experiment is underway and performing statistical analysis at the end to interpret the results. degraded hardware, transient networking problem) or, more often, because of some change deployed by Netflix engineers that did not have the intended effect.

Latency 77

Latency Engineering Metrics Traffic 77

Percona

JUNE 22, 2023

long_query_time: Defines the threshold for query execution time, and queries taking longer than this threshold are considered slow and logged for further analysis innodb_buffer_pool_size: Sets the size of the InnoDB buffer pool. The point we’re making here is they are critical for MySQL Performance.

Performance 109

Performance Monitoring Traffic Database 109

Adrian Cockcroft

MARCH 17, 2020

The opening paragraph above is the same as my previous discussion focused on hardware, software and operational failure modes , but we are now in the middle of a pandemic, so I’m going to adapt the discussion of hazards and failure modes to our current situation. Book: Engineering a Safer World by Nancy G. What Happens Next?

Healthcare 52

Healthcare Government Airlines Systems 52

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 103

Performance Latency Cache Virtualization 103

Brendan Gregg

AUGUST 8, 2017

They are demand on the system, albeit for software resources rather than hardware resources. ## Decomposing Linux load averages Can the Linux load average value be fully decomposed into components? Latency was acceptable and no one complained. Yes, I'd say so. They aren't idle. Load averages measured in a modern tool.

Latency 111

Latency Metrics C++ Systems 111

The Morning Paper

MAY 21, 2019

This boils down to a single digit µs latency toleration in the tail for far memory, and in addition to security and privacy concerns, rules out remote memory solutions. Thus we’re fundamentally trading (de)-compression latency at access time for the ability to pack more data in memory. ML-based auto-tuning.

Software 78

Software Software Google Hardware 78

Percona

NOVEMBER 9, 2023

Your workloads, encapsulated in containers, can be deployed freely across different clouds or your own hardware. Education : Universities often use Kubernetes for projects that require substantial resources because it scales computing clusters for research, data analysis, and simulations.

Efficiency 109

Efficiency Cloud Healthcare Open Source 109

Brendan Gregg

AUGUST 18, 2019

For example, iostat(1), or a monitoring agent, may tell you your average disk latency, but not the distribution of this latency. bpftrace is suited for this kind of analysis: decomposing metrics into distributions or per-event logs, and creating new metrics for visibility into blind spots. Block I/O latency as a histogram.

Latency 57

Latency C++ Cache Programming 57

ACM Sigarch

MAY 31, 2023

There are three common mechanisms to access remote memory: modifying applications, modifying virtual memory, and hardware-level cache coherence support. even lowered the latency by introducing a multi-headed device that collapses switches and memory controllers. About CXL hardware availability with academia.

Latency 52

Latency Hardware Cache Architecture 52

Smashing Magazine

AUGUST 3, 2021

Different browsers running on different platforms and hardware, respecting our user preferences and browsing modes (Safari Reader/ assistive technologies), being served to geo-locations with varying latency and intermittency increase the likeness of something not working as intended. More after jump!

Network 145

Network Engineering Availability Monitoring 145

Alex Russell

MARCH 6, 2021

Hardware Past As Performance Prologue. Regardless, the overall story for hardware progress remains grim, particularly when we recall how long device replacement cycles are: Tap for a larger version. Sadly, data on latency is harder to get, even from Google's perch, so progress there is somewhat more difficult to judge.

Performance 127

Performance Network Metrics Cache 127

CSS - Tricks

JULY 25, 2019

Over the past couple of years, it has become the go-to free performance analysis tool. Estimated Input Latency. Estimated Input Latency. It’s time to come to terms that your customers aren’t using the same powerful hardware as you. What is Google Lighthouse? They are: Time to Interactive ( TTI ). Speed Index.

Google 72

Google Engineering Speed Mobile 72

Brendan Gregg

JULY 4, 2021

This was a chance to talk about other things I've been working on, such as the present and future of hardware performance. The video is on [youtube]: The slides are [here] or as a [PDF]: first prev next last / permalink/zoom I work on many areas of performance, but recently I've had a lot of demand to talk about BPF. Ford, et al., “TCP

Performance 52

Performance Latency Hardware Storage 52

Alex Russell

APRIL 29, 2021

For heavily latency-sensitive use-cases like WebXR, this is a critical component in delivering a good experience. is access to hardware devices. This allows customisation and use of specialised features without custom, proprietary software for niche hardware. Offscreen Canvas. TextEncoderStream & TextDecoderStream.

Media 145

Media Games Education Engineering 145

Dotcom-Montior

DECEMBER 8, 2021

Software services still require physical devices and hardware for them to function. An organization’s response to an incident, whether we are talking about downtime, security breaches or cyber-attacks, or even prolonged latency and repeated errors, is critical to the continued success of the business and trust from the customer or end user.

Social Media 90

Social Media Monitoring Latency DevOps 90

O'Reilly Software

APRIL 4, 2018

Those were the days when “connected” meant having some web presence, “interactions” were measured in number of clicks, and the analysis happened in batch overnight processes. The data shape will dictate capacity planning, tuning of the backbone, and scalability analysis for individual components. At least once? At most once?

Architecture 80

Architecture Scalability Google Operating System 80

The Morning Paper

MAY 14, 2019

Last time around we looked at the DeathStarBench suite of microservices-based benchmark applications and learned that microservices systems can be especially latency sensitive, and that hotspots can propagate through a microservices architecture in interesting ways. on end-to-end latency) and less than 0.15% on throughput.

Big Data 45

Big Data Cloud Performance Hardware 45

Alex Russell

OCTOBER 22, 2017

It simulates a link with a 400ms RTT and 400-600Kbps of throughput (plus latency variability and simulated packet loss). Simulated packet loss and variable latency, however, can make benchmarking extremely difficult and slow. Our baseline, then, should probably trade lower throughput/higher-latency for packet loss.

Performance 74

Performance Network Benchmarking Mobile 74

Brendan Gregg

SEPTEMBER 5, 2017

Here's some output from my zfsdist tool, in bcc/BPF, which measures ZFS latency as a histogram on Linux: # zfsdist. Tracing ZFS operation latency. My rock solid experience with Ubuntu is on an LTS release. ## Crash Dump Analysis It can be done. Many new tools can now be written, and the main toolkit we're working on is [bcc].

Virtualization 75

Virtualization AWS Engineering Hardware 75

Adrian Cockcroft

NOVEMBER 11, 2019

This discussion focuses on hardware, software and operational failure modes. Collecting some critical metrics at one second intervals, with a total observability latency of ten seconds or less matches the human attention span much better. Try to measure your mean time to respond (MTTR) for incidents.

Latency 53

Latency Systems Engineering Hardware 53

John McCalpin

JANUARY 22, 2018

Each of the two vector units can issue one FMA instruction per cycle, assuming that there are enough independent accumulators to tolerate the 6-cycle dependent-operation latency. This is an uninspiring fraction of peak performance that would normally suggest significant inefficiencies in either the hardware or software.

Latency 40

Latency Hardware Code Testing 40

Percona

SEPTEMBER 1, 2023

This results in expedited query execution, reduced resource utilization, and more efficient exploitation of the available hardware resources. This reduction in latency ensures that applications and websites provide a more rapid and responsive user experience. Query plan analysis can also provide valuable insights.

Tuning 52

Tuning Database Performance Hardware 52

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. This was a weird problem to think about: Time itself had now become a resource and target of performance analysis. I'm including this step as a reminder for anyone following this kind of analysis. in total.

Speed 52

Speed Java AWS Virtualization 52