VoltDB

MAY 14, 2024

Balancing Low Latency, High Availability and Cloud Choice Cloud hosting is no longer just an option — it’s now, in many cases, the default choice. As a result, IT teams picked hardware somewhat blindly but with a strong bias towards oversizing for the sake of expanding the budget, leading to systems running at 10-15% of maximum capacity.

Latency 52

Latency Availability Cloud Hardware 52

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., The paper examines the implications of microservices at the hardware, OS and networking stack, cluster management, and application framework levels, as well as the impact of tail latency.

Open Source 61

Open Source Hardware Benchmarking Systems 61

All Things Distributed

JULY 14, 2015

In traditional database architectures, database engines often run a small search engine or data warehouse engines on the same hardware as the database. No matter which mechanism you choose to use, we make the stream data available to you instantly (latency in milliseconds) and how fast you want to apply the changes is up to you.

Database 156

Database Lambda AWS IoT 156

Sutter's Mill

FEBRUARY 13, 2017

Tue-Thu Apr 25-27: High-Performance and Low-Latency C++ (Stockholm). On April 25-27, I’ll be in Stockholm (Kista) giving a three-day seminar on “High-Performance and Low-Latency C++.”

Latency 48

Latency C++ Hardware Performance 48

Scalegrid

JANUARY 25, 2024

Key Takeaways Critical performance indicators such as latency, CPU usage, memory utilization, hit rate, and number of connected clients/slaves/evictions must be monitored to maintain Redis’s high throughput and low latency capabilities. It can achieve impressive performance, handling up to 50 million operations per second.

Metrics 130

Metrics Monitoring Latency Cache 130

Sutter's Mill

FEBRUARY 17, 2025

Relatedly, P1494R4 Partial program correctness by Davis Herring adds the idea of observable checkpoints that limit the ability of undefined behavior to perform time-travel optimizations. Note: This is the second time contracts has been voted into draft standard C++. It was briefly part of draft C++20, but was then removed for further work.

C++ 66

C++ Programming Code Google 66

The Morning Paper

JANUARY 28, 2020

Shredder is " a low-latency multi-tenant cloud store that allows small units of computation to be performed directly within storage nodes. " If you want a lightweight, fast-starting, easy to program for, embeddable application runtime that also offers isolation, then a natural choice is V8 isolates. High performance.

Serverless 99

Serverless Storage Latency Cloud 99

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. The call for participation ends on March 2nd 23:59 SGT! Ford, et al., “TCP

Performance 103

Performance Latency Cache Virtualization 103

All Things Distributed

DECEMBER 12, 2018

They can run applications in Sweden, serve end users across the Nordics with lower latency, and leverage advanced technologies such as containers, serverless computing, and more. In 2013, AWS launched the AWS Activate program to provide Nordic startups access to guidance and one-on-one time with AWS experts.

AWS 119

AWS Cloud Games Serverless 119

Dotcom-Montior

NOVEMBER 24, 2021

With the rapid advancements in web application technologies, programming languages, cloud computing services, microservices, hybrid environments, etc., This complexity is “hidden” to the end user, like how an API (Application Programming Interface) operates, whether that is an actual user or another computer. Concurrency.

Systems 74

Systems Monitoring Hardware Network 74

Percona

NOVEMBER 9, 2023

Your workloads, encapsulated in containers, can be deployed freely across different clouds or your own hardware. Role-Based Access Control (RBAC) : RBAC manages permissions to ensure that only individuals, programs, or processes with the proper authorization can utilize particular resources.

Efficiency 117

Efficiency Cloud Healthcare Open Source 117

Smashing Magazine

AUGUST 3, 2021

Different browsers running on different platforms and hardware, respecting our user preferences and browsing modes (Safari Reader/ assistive technologies), being served to geo-locations with varying latency and intermittency increase the likeness of something not working as intended. More after jump! Responding to Errors.

Network 145

Network Engineering Availability Code 145

Brendan Gregg

AUGUST 8, 2017

90491 N|rnberg (Germany) Consulting+Networking+Programming+etc'ing 42. They are demand on the system, albeit for software resources rather than hardware resources. ## Decomposing Linux load averages Can the Linux load average value be fully decomposed into components? Latency was acceptable and no one complained.

Latency 111

Latency Metrics C++ Systems 111

Brendan Gregg

AUGUST 18, 2019

For example, iostat(1), or a monitoring agent, may tell you your average disk latency, but not the distribution of this latency. For smaller environments, it can be of more use helping eliminate latency outliers. The probe is BEGIN , a special probe that runs at the beginning of the program (like awk). There's no filter.

Latency 57

Latency C++ Cache Programming 57

ACM Sigarch

MAY 31, 2023

using Compute Express Link or CXL), organizing memory components for optimal performance, adapting system software traditionally designed for homogeneous memory systems, and developing memory abstractions and programming constructs for HCM management. Figure 2: Latency characteristics of memory technologies (source: Maruf et al.,

Latency 52

Latency Hardware Cache Architecture 52

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. Was there some other program consuming CPU, like a misbehaving Ubuntu service that wasn't in CentOS? As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI.

Speed 103

Speed Java AWS Virtualization 103

The Morning Paper

DECEMBER 10, 2019

. …software operating on persistent data structures requires "global" pointers that remain valid after a process terminates, while hardware requires that a diverse set of devices all have the same mappings they need for bulk transfers to and from memory, and that they be able to do so for a potentially heterogeneous memory system.

Hardware 52

Hardware Virtualization Operating System Programming 52

Alex Russell

APRIL 29, 2021

Provides support for "unread counts", e.g. for email and chat programs. For heavily latency-sensitive use-cases like WebXR, this is a critical component in delivering a good experience. is access to hardware devices. Some commenters appear to confuse unlike hardware for differences in software. Media Session API.

Media 145

Media Games Education Engineering 145

John McCalpin

AUGUST 1, 2018

According to Dr. Bandwidth, performance analysis has two recurring themes: How fast should this code (or “simple” variations on this code) run on this hardware? MPI is a commonly used standard to implement message-passing programs on computer clusters. The MPI runtime library. in ways that are seldom transparent.

Hardware 40

Hardware Transportation Performance Latency 40

John McCalpin

AUGUST 1, 2018

According to Dr. Bandwidth, performance analysis has two recurring themes: How fast should this code (or “simple” variations on this code) run on this hardware? MPI is a commonly used standard to implement message-passing programs on computer clusters. The MPI runtime library. in ways that are seldom transparent.

Hardware 40

Hardware Transportation Performance Latency 40

The Morning Paper

DECEMBER 8, 2019

On the last morning of the conference Daniel Bittman presented some of the work being done in the context of the Twizzler OS project to explore new programming models for NVM. The starting point is a set of three asumptions for an NVM-based programming model: Compared to traditional persistent media, NVM is fast.

Hardware 56

Hardware Programming Media Storage 56

Sutter's Mill

JUNE 21, 2012

Now welcome to the hardware jungle. I should have remembered that describing a PC as a “heterogeneous cluster in a box” is a big red button for people, in particular because “cluster” implies “parts can fail and program should continue.” — The free lunch is over. The slides are available here.

Latency 40

Latency Transportation Hardware Education 40

O'Reilly Software

APRIL 4, 2018

A message-oriented implementation requires an efficient messaging backbone that facilitates the exchange of data in a reliable and secure way with the lowest latency possible. The low-level streaming implementations of the mentioned engines require specialized knowledge in order to program new applications.

Architecture 80

Architecture Scalability Google Operating System 80

Alex Russell

JUNE 20, 2020

3] Oh, and it should be imperatively programmed with Lisp-in-C's-clothing. Recall that browsers arose atop platforms that universally provided a host of services by the late 90's: system fonts (to support layout programs, including WYSIWYG editing). multi-tasking & concurrent programming. high-color image raster.

Games 64

Games Hardware Java Mobile 64

O'Reilly

JANUARY 16, 2024

I even contributed my own hot take last year with my O’Reilly Radar article Real-Real-World Programming with ChatGPT.) software” rather than “hardware” in our brains). What more is left to say by now? Well, I bet very few of those people have actually chatted with ChatGPT.

Internet 114

Internet Internet Entertainment Design 114

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. It was a great privilege. That's about 24 hours from now!

Performance 52

Performance Latency Cache Virtualization 52

O'Reilly

JULY 20, 2021

Amazon’s Ring partnership with one in ten US police departments troubles many privacy groups because it creates a vast surveillance program. Until we acknowledge that hardware put in a home is different from a cloud service, we will never get it right. What if you don’t want to be a part of the police state? Lots of problems, now what?

Google 134

Google Games Technology Technology 134

John McCalpin

JANUARY 22, 2018

Each of the two vector units can issue one FMA instruction per cycle, assuming that there are enough independent accumulators to tolerate the 6-cycle dependent-operation latency. This is an uninspiring fraction of peak performance that would normally suggest significant inefficiencies in either the hardware or software.

Latency 40

Latency Hardware Code Testing 40

John McCalpin

JANUARY 22, 2018

Each of the two vector units can issue one FMA instruction per cycle, assuming that there are enough independent accumulators to tolerate the 6-cycle dependent-operation latency. This is an uninspiring fraction of peak performance that would normally suggest significant inefficiencies in either the hardware or software.

Latency 40

Latency Hardware Code Testing 40

Alex Russell

JULY 14, 2021

Hardware access APIs, notably: Geolocation. This might not be objectionable in programs that also offer themselves as browsers, but the WebView IAB sleight of hand is to act as a browser when users least expect it, but never to cop to the power and privacy implications of the awesome responsibilities that real-boy browsers solemnly accept.

Google 134

Google Mobile Engineering Internet 134

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. Was there some other program consuming CPU, like a misbehaving Ubuntu service that wasn't in CentOS? I've shared many posts about superpower observability tools, but often humble hacking is just as effective. in total.

Speed 52

Speed Java AWS Virtualization 52

VoltDB

JUNE 26, 2024

In addition to hardware and software expenses, costs also include the infrastructure needed to support these systems — like sensors, IoT devices, upgraded network capabilities, and robust cybersecurity measures.

IoT 52

IoT Analytics Artificial Intelligence Energy 52

John McCalpin

NOVEMBER 5, 2016

In the latest (October 2016) revision of Intel’s Instruction Extensions Programming Reference , Intel has disclosed a fairly dramatic departure from these “traditional” approaches. With 2 FMA units that have 5-cycle latency, the code must implement at least 2*5=10 independent accumulators in order to avoid stalls.

Cache 40

Cache C++ Latency Hardware 40

Alex Russell

JANUARY 30, 2024

HTML, CSS, images, and fonts can all be parsed and run at near wire speeds on low-end hardware, but JavaScript is at least three times more expensive, byte-for-byte. If you or your company are able to generate a credible worldwide latency estimate in the higher percentiles for next year's update, please get in touch.

Performance 98

Performance Network Mobile Speed 98

The Morning Paper

SEPTEMBER 12, 2019

SQL provides a declarative programming interface, below which the system itself can figure out the most effective execution plans based on data size and statistics, layout, compute hardware etc. Be careful what you ask for (materialize). Recursive learning in SQL.

Network 44

Network Database Programming Hardware 44

SQL Server According to Bob

JANUARY 11, 2020

Many high-end disk subsystems provide high-speed cache facilities to reduce the latency of read and write operations. Example 1: ​​ Hardware failure (CPU board) Battery backup on the caching controller maintained the data. Important Always consult with your hardware manufacturer for proper stable media strategies.

Servers 40

Servers Cache Media Hardware 40

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. Was there some other program consuming CPU, like a misbehaving Ubuntu service that wasn't in CentOS? As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI.

Speed 40

Speed Java AWS Virtualization 40