All Things Distributed

JULY 14, 2015

In just three short years, Amazon DynamoDB has emerged as the backbone for many powerful Internet applications such as AdRoll , Druva , DeviceScape , and Battlecamp. In traditional database architectures, database engines often run a small search engine or data warehouse engines on the same hardware as the database.

Database 158

Database Lambda AWS IoT 158

Sutter's Mill

FEBRUARY 13, 2017

Tue-Thu Apr 25-27: High-Performance and Low-Latency C++ (Stockholm). On April 25-27, I’ll be in Stockholm (Kista) giving a three-day seminar on “High-Performance and Low-Latency C++.”

Latency 48

Latency C++ Hardware Performance 48

All Things Distributed

NOVEMBER 15, 2010

For example, the most fundamental abstraction trade-off has always been latency versus throughput. Modern CPUs strongly favor lower latency of operations with clock cycles in the nanoseconds and we have built general purpose software architectures that can exploit these low latencies very well. General Purpose GPU programming.

AWS 125

AWS Programming Latency Architecture 125

The Morning Paper

JANUARY 30, 2020

Edge servers are the middle ground – more compute power than a mobile device, but with latency of just a few ms. Since we’re talking about mobile applications, we have to assume a changing environment over time, including the possibility of losing internet connectivity altogether. The Mobile Web Worker (MWW) System.

Mobile 104

Mobile Cloud Latency Games 104

All Things Distributed

JULY 13, 2010

In particular this has been true for applications based on algorithms - often MPI-based - that depend on frequent low-latency communication and/or require significant cross sectional bandwidth. There is no more need for hardware tinkering to keep the clusters up and running (I spent many nights doing this; there is no glory in it).

Cloud 98

Cloud AWS Automotive Latency 98

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Colleagues/Internet I love using [Linux performance tools]. But I'm not completely sure.

Speed 103

Speed Java AWS Virtualization 103

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 103

Performance Latency Cache Virtualization 103

Dotcom-Montior

NOVEMBER 24, 2021

For example, you can think of a cell phone network as a type of distributed system, consisting of a network of internet-connected devices that share resources workload. Software and hardware components are autonomous and execute tasks concurrently. Today, there are a variety of architectures and systems in use. Peer-to-Peer.

Systems 74

Systems Monitoring Hardware Network 74

The Morning Paper

NOVEMBER 14, 2019

Taiji: managing global user traffic for large-scale internet services at the edge Xu et al., The ability of a datacenter to handle traffic changes over time as capacity is added or removed, and hardware upgraded The routing needs to be able to tolerate failures without making the situation worse. SOSP’19.

Traffic 42

Traffic Internet Internet Latency 42

VoltDB

JUNE 1, 2017

Hardware Optimizers” want to get the maximum utilization out of hardware. These systems were designed to have a lifetime of half a decade or more, and rapidly changing hardware meant that the initial deployment had to be sized for 5-7 years out. Latency Optimizers” – need support for very large federated deployments.

Hardware 56

Hardware Latency Virtualization Cloud 56

Alex Russell

APRIL 29, 2021

In almost every area, Apple's low-quality implementation of features WebKit already supports requires workarounds not necessary for Firefox (Gecko) or Chrome/Edge/Brave/Samsung Internet (Blink). For heavily latency-sensitive use-cases like WebXR, this is a critical component in delivering a good experience. Converging Views.

Media 145

Media Games Education Engineering 145

Highly Scalable

AUGUST 20, 2013

This system has been designed to supplement and succeed the existing Hadoop-based system that had too high latency of data processing and too high maintenance costs. For example, consider a system that calculates average purchase value in the internet shop for each hour. Daily average cannot be obtained from 24 hourly average values.

Big Data 154

Big Data Processing Lambda Database 154

Brendan Gregg

JULY 4, 2021

This was a chance to talk about other things I've been working on, such as the present and future of hardware performance. The video is on [youtube]: The slides are [here] or as a [PDF]: first prev next last / permalink/zoom I work on many areas of performance, but recently I've had a lot of demand to talk about BPF. Ford, et al., “TCP

Performance 52

Performance Latency Hardware Storage 52

O'Reilly

JANUARY 16, 2024

software” rather than “hardware” in our brains). Unpredictable wait times : Wait times (latency) for ChatGPT’s responses are unpredictable, and there aren’t audio cues to help me establish an expectation for how long I need to wait before it responds.

Internet 111

Internet Internet Entertainment Design 111

VoltDB

JUNE 1, 2017

Hardware Optimizers” want to get the maximum utilization out of hardware. These systems were designed to have a lifetime of half a decade or more, and rapidly changing hardware meant that the initial deployment had to be sized for 5-7 years out. Latency Optimizers” – need support for very large federated deployments.

Hardware 40

Hardware Latency Virtualization Cloud 40

Alex Russell

JANUARY 30, 2024

HTML, CSS, images, and fonts can all be parsed and run at near wire speeds on low-end hardware, but JavaScript is at least three times more expensive, byte-for-byte. Many critiques are possible, both of the target (five seconds for first load), the sample population (worldwide internet users), and of the methodology (informed reckons).

Performance 98

Performance Network Mobile Speed 98

Alex Russell

JULY 14, 2021

Modern browsers like Chrome and Samsung Internet support a long list of features that make web apps more powerful and keep users safer. Hardware access APIs, notably: Geolocation. Samsung Internet set as the default browser and loads web pages from links in the app. PWA Feature Detector. Web OTP (for easier/faster sign-in).

Google 134

Google Mobile Engineering Internet 134

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Colleagues/Internet I love using Linux performance tools. But I'm not completely sure.

Speed 52

Speed Java AWS Virtualization 52

Testsigma

JANUARY 30, 2021

With the rapidly increasing use of smartphones and ease of access to the internet across the globe, testing has spread across vast platforms. For example, if you are using internet banking via a Mobile Web application, it will not allow you to save cards or mark any transaction as favourite. What are Mobile Web Applications?

Mobile 52

Mobile Testing Website Internet 52

KeyCDN

JULY 11, 2019

Using an image CDN, such as KeyCDN, can significantly reduce the latency of your image delivery. This is crucial due to mobile devices requiring additional optimizations because they typically have less powerful hardware and a slower network connection when compared to desktop devices. Mbps ( Opensignal ).

Speed 52

Speed Website Mobile Latency 52

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

VoltDB

APRIL 25, 2024

While Wi-Fi theoretically can achieve 5G-like speeds, it falls short in providing the consistent performance and reliability that 5G offers, including low latency, higher speeds, and increased bandwidth. Additionally, frequent handoffs between access points can lead to delays and connection drops.

Network 52

Network IoT Wireless Infrastructure 52

Tim Kadlec

SEPTEMBER 25, 2014

Another interesting note was how significant the impact of hardware has on the timing. Those markets are going to dominate internet growth over the next few years, and affordability is a more necessary feature than a souped up device. Google had a great post a few years back about how they reduced startup latency for Gmail.

Latency 41

Latency Google Hardware Servers 41

Brendan Gregg

SEPTEMBER 5, 2017

Here's some output from my zfsdist tool, in bcc/BPF, which measures ZFS latency as a histogram on Linux: # zfsdist. Tracing ZFS operation latency. The odd time we hit them, we'll take the "oops message" – a dump of the kernel stack trace and other details from the system log – and search the Internet.

Virtualization 75

Virtualization AWS Engineering Hardware 75

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Colleagues/Internet I love using [Linux performance tools]. But I'm not completely sure.

Speed 40

Speed Java AWS Virtualization 40

High Scalability

SEPTEMBER 14, 2018

SCM slots between DRAM and flash in terms of latency, cost, and density. Thus, despite both quoting 11 nines of durability against hardware failures, S3 is durable against failures that B2 is not, and is thus better. Because of that big servers and other memory systems need to have another kind of memory in the hierarchy.

Internet 30

Internet Internet Scalability Education 30

Highly Scalable

SEPTEMBER 18, 2012

Historically, NoSQL paid a lot of attention to tradeoffs between consistency, fault-tolerance and performance to serve geographically distributed systems, low-latency or highly available applications. A database should accommodate itself to different data distributions, cluster topologies and hardware configurations. Data Placement.

Database 213

Database Latency C++ Scalability 213

Smashing Magazine

AUGUST 22, 2021

This is because HTTP/3 and QUIC mainly help deal with the somewhat uncommon yet potentially high-impact problems that can arise on today’s Internet. Because we are dealing with network protocols here, we will mainly look at network aspects, of which two are most important: latency and bandwidth. Congestion Control.

Performance 109

Performance Network Latency Servers 109

Smashing Magazine

AUGUST 3, 2021

Different browsers running on different platforms and hardware, respecting our user preferences and browsing modes (Safari Reader/ assistive technologies), being served to geo-locations with varying latency and intermittency increase the likeness of something not working as intended. More after jump!

Network 145

Network Engineering Availability Code 145

Smashing Magazine

MAY 20, 2020

This metric is important, but quite vague because it can include anything — starting from server rendering time and ending up with latency problems. For example, for an internet shop, it may be a page with a product list, product details page, shopping cart, checkout, and so on. So make a competitors list. But how can you do it?

Performance 112

Performance Metrics Best Practices Code 112

Smashing Magazine

JANUARY 6, 2020

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Designed for the modern web, it responds to actual congestion, rather than packet loss like TCP does, it is significantly faster , with higher throughput and lower latency — and the algorithm works differently.

Performance 112

Performance Cache Servers Network 112

Smashing Magazine

JANUARY 7, 2019

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. On the other hand, we have hardware constraints on memory and CPU due to JavaScript parsing times (we’ll talk about them in detail later). Parsing and executing times vary significantly depending on the hardware of a device.

Performance 111

Performance Cache Network Metrics 111

Smashing Magazine

JANUARY 11, 2021

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Designed for the modern web, it responds to actual congestion, rather than packet loss like TCP does, it is significantly faster , with higher throughput and lower latency — and the algorithm works differently.

Performance 145

Performance Cache Media Metrics 145

Adrian Cockcroft

NOVEMBER 18, 2024

Learn how remote sensing, Internet of Things, and AI technologies on AWS can be used to detect and quantify methane sources, offering a cost-effective and efficient approach to scalable environmental monitoring. It’s possible to get energy data in real time from NVIDIA GPUs (because NVIDIA provides it) but not from AWS hardware.

AWS 98

AWS Energy Lambda Government 98