The Netflix TechBlog

FEBRUARY 9, 2021

We need to be able to easily determine what imagery is present for a given platform, region, and language. Server-generated assets, since client-side generation would require the retrieval of many individual images, which would increase latency and time-to-render. The imagery needs to be localized.

Engineering 174

Engineering Storage Latency Entertainment 174

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., Microservices fundamentally change a lot of assumptions current cloud systems are designed with, and present both opportunities and challenges when optimizing for quality of service (QoS) and utilization.

Open Source 61

Open Source Hardware Benchmarking Systems 61

Scalegrid

JANUARY 25, 2024

Key Takeaways Critical performance indicators such as latency, CPU usage, memory utilization, hit rate, and number of connected clients/slaves/evictions must be monitored to maintain Redis’s high throughput and low latency capabilities. Similarly, an increased throughput signifies an intensive workload on a server and a larger latency.

Metrics 130

Metrics Monitoring Latency Cache 130

Sutter's Mill

FEBRUARY 13, 2017

Tue-Thu Apr 25-27: High-Performance and Low-Latency C++ (Stockholm). On April 25-27, I’ll be in Stockholm (Kista) giving a three-day seminar on “High-Performance and Low-Latency C++.”

Latency 48

Latency C++ Hardware Performance 48

Percona

NOVEMBER 3, 2023

PostgreSQL Cluster One coordinator node citus-coord-01 Three worker nodes citus1 citus2 citus3 Hardware AWS Instance Ubuntu Server 20.04, SSD volume type 64-bit (x86) c5.xlarge And now, execute the benchmark: -- execute the following on the coordinator node pgbench -c 20 -j 3 -T 60 -P 3 pgbench The results are not pretty.

Database 110

Database Benchmarking Latency C++ 110

Scalegrid

DECEMBER 21, 2023

Identifying key Redis® metrics such as latency, CPU usage, and memory metrics is crucial for effective Redis monitoring. To monitor Redis® instances effectively, collect Redis metrics focusing on cache hit ratio, memory allocated, and latency threshold. Providing them with clear insights into their system’s performance overall.

Strategy 130

Strategy Monitoring Latency DevOps 130

Scalegrid

FEBRUARY 8, 2024

Key Takeaways Distributed storage systems benefit organizations by enhancing data availability, fault tolerance, and system scalability, leading to cost savings from reduced hardware needs, energy consumption, and personnel. By implementing data replication strategies, distributed storage systems achieve greater.

Storage 130

Storage Systems Big Data Azure 130

VoltDB

DECEMBER 11, 2024

By bringing computation closer to the data source, edge-based deployments reduce latency, enhance real-time capabilities, and optimize network bandwidth. Use hardware-based encryption and ensure regular over-the-air updates to maintain device security. Increased latency during peak loads.

IoT 52

IoT Energy Logistics Latency 52

Percona

NOVEMBER 2, 2023

Improved performance : MongoDB continually fine-tunes its database engine, resulting in faster query execution and reduced latency. You should also review your hardware resources, how you use MongoDB, and any custom configurations.

Best Practices 94

Best Practices Hardware Tuning Scalability 94

Dotcom-Montior

MAY 12, 2020

Websites are now more than just the storage and retrieval of information to present content to users. Network latency. Hardware resources. Network Latency. Network latency can be affected due to. Present-day applications make more much use of the database. Hardware Resources. Connection time.

Monitoring 63

Monitoring Entertainment Hardware Traffic 63

The Morning Paper

JUNE 13, 2019

HotOS’19 is presenting me with something of a problem as there are so many interesting looking papers in the proceedings this year it’s going to be hard to cover them all! The following figure highlights how just one of these variables, batch size, impacts throughput and latency on ResNet50. HotOS’19.

Hardware 58

Hardware Latency Serverless Energy 58

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 103

Performance Latency Cache Virtualization 103

John McCalpin

DECEMBER 6, 2016

The Xeon Phi x200 (Knights Landing) has a lot of modes of operation (selected at boot time), and the latency and bandwidth characteristics are slightly different for each mode. This reduces the number of “hops” required for request/response/coherence messages on the mesh, and should reduce both latency and contention.

Latency 40

Latency Cache Testing Systems 40

Percona

MAY 2, 2023

However, it’s important to note that the optimal value may vary depending on your specific workload and hardware configuration. The answer does not consider the queue or latency of the sample, which could indicate a disk with issues. 16) and monitoring the server’s performance. The answer could be better.

Social Media 126

Social Media Database Servers Cache 126

Alex Russell

MARCH 6, 2021

Hardware Past As Performance Prologue. This 2GiB RAM, Android 9 stalwart features the all-too classic lines of a Quad-core A53 (1.4GHz, small mercies) CPU, tastefully presented in a charming 5.5" Sadly, data on latency is harder to get, even from Google's perch, so progress there is somewhat more difficult to judge.

Performance 127

Performance Network Metrics Cache 127

Dotcom-Montior

NOVEMBER 24, 2021

A three-tier system is a software application architecture that consists of a presentation layer, application layer, and data, or core, layer. Software and hardware components are autonomous and execute tasks concurrently. This also includes latency, or the time it takes for data or a request to get through a network.

Systems 74

Systems Monitoring Hardware Network 74

Alex Russell

APRIL 29, 2021

For heavily latency-sensitive use-cases like WebXR, this is a critical component in delivering a good experience. Helps developers present better, more contextual options and prompts, reducing user annoyance and "prompt spam" Screen Wakelock. is access to hardware devices. Offscreen Canvas. Permissions API.

Media 145

Media Games Education Engineering 145

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. A quick check of basic performance statistics showed over 30% higher CPU consumption. in total.

Speed 103

Speed Java AWS Virtualization 103

HammerDB

OCTOBER 18, 2019

cpupower frequency-info analyzing CPU 0: driver: intel_pstate CPUs which run at the same hardware frequency: 0 CPUs which need to have their frequency coordinated by software: 0 maximum transition latency: Cannot determine or is not supported. hardware limits: 1000 MHz - 4.00 hardware limits: 1000 MHz - 4.00

Benchmarking 63

Benchmarking Performance Hardware C++ 63

ACM Sigarch

MAY 31, 2023

However, building and utilizing HCM presents challenges, including interconnecting various memory technologies (e.g., There are three common mechanisms to access remote memory: modifying applications, modifying virtual memory, and hardware-level cache coherence support. About CXL hardware availability with academia.

Latency 52

Latency Hardware Cache Architecture 52

The Morning Paper

MARCH 17, 2020

Based on these findings, the authors present four guidelines to get the best performance out of this memory today. higher latency and lower bandwidth)… We have found the actual behavior of Optane DIMMs to be more complicated and nuanced than the "slower, persistent DRAM" label would suggest. Optane DIMMs are here!

Scalability 59

Scalability Latency Cache Media 59

CSS - Tricks

JULY 25, 2019

Lighthouse records metrics from the browser, applies a scoring model to them, and presents an overall performance score. Estimated Input Latency. Estimated Input Latency. It’s time to come to terms that your customers aren’t using the same powerful hardware as you. In PageSpeed 5.0, In PageSpeed 5.0, Speed Index.

Google 72

Google Engineering Speed Mobile 72

Brendan Gregg

JULY 4, 2021

This was a chance to talk about other things I've been working on, such as the present and future of hardware performance. The video is on [youtube]: The slides are [here] or as a [PDF]: first prev next last / permalink/zoom I work on many areas of performance, but recently I've had a lot of demand to talk about BPF. Ford, et al., “TCP

Performance 52

Performance Latency Hardware Storage 52

O'Reilly Software

APRIL 4, 2018

Fast forward to the present day and we find ourselves in a world where the number of connected devices is constantly increasing. A message-oriented implementation requires an efficient messaging backbone that facilitates the exchange of data in a reliable and secure way with the lowest latency possible.

Architecture 80

Architecture Scalability Google Operating System 80

The Morning Paper

MAY 28, 2019

The goal is to produce a low-energy hardware classifier for embedded applications doing local processing of sensor data. The resulting system can integrate seamlessly into a scikit-learn based development process, and dramatically reduces the total energy usage required for classification with very low latency. Introducing race logic.

Energy 52

Energy Hardware Efficiency Architecture 52

Dotcom-Montior

DECEMBER 8, 2021

Software services still require physical devices and hardware for them to function. An organization’s response to an incident, whether we are talking about downtime, security breaches or cyber-attacks, or even prolonged latency and repeated errors, is critical to the continued success of the business and trust from the customer or end user.

Social Media 90

Social Media Monitoring Latency DevOps 90

The Morning Paper

DECEMBER 8, 2019

On the last morning of the conference Daniel Bittman presented some of the work being done in the context of the Twizzler OS project to explore new programming models for NVM. Therefore any programming abstraction must be low latency and the kernel needs to be kept off the path of persistent data access as much as possible.

Hardware 56

Hardware Programming Media Storage 56

John McCalpin

JANUARY 22, 2018

Dr. Damon McDougall gave a short presentation on this study at the IXPUG 2018 Fall Conference ( pdf ) — I originally wrote these notes to help organize my thoughts as we were preparing the IXPUG presentation, and later decided that the extra details contained here are interesting enough for me to post it.

Latency 40

Latency Hardware Code Testing 40

Alex Russell

JULY 14, 2021

Furthermore, the content developer is unlikely to find limits presented by the WebView to be unwelcome or unreasonably immutable (via collaboration with the app developer). Hardware access APIs, notably: Geolocation. Instead of breaking content, WebViews are likely to facilitate it in these scenarios faithfully. Web Bluetooth.

Google 134

Google Mobile Engineering Internet 134

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Alex Russell

JUNE 20, 2020

In each quantum of time, hardware and OS vendors press ahead, adding features. As OS and hardware deployed base integrate these components, the set of what most computers can do is expanded. This is often determined by hardware integration and device replacement rates.

Games 64

Games Hardware Java Media 64

O'Reilly

JULY 20, 2021

Apple’s FaceID uses many levels of presentation attack detection (also known as “anti-spoofing”): it verifies your eyes are open and you are looking at the screen, and it uses a depth sensor to make sure it isn’t “seeing” a photo. Until we acknowledge that hardware put in a home is different from a cloud service, we will never get it right.

Google 122

Google Games Technology Technology 122

Alex Russell

JANUARY 30, 2024

HTML, CSS, images, and fonts can all be parsed and run at near wire speeds on low-end hardware, but JavaScript is at least three times more expensive, byte-for-byte. If you or your company are able to generate a credible worldwide latency estimate in the higher percentiles for next year's update, please get in touch.

Performance 98

Performance Network Mobile Speed 98

Adrian Cockcroft

NOVEMBER 11, 2019

This discussion focuses on hardware, software and operational failure modes. Collecting some critical metrics at one second intervals, with a total observability latency of ten seconds or less matches the human attention span much better. There is no need to retry and no extra time taken when a failure is present.

Latency 53

Latency Systems Engineering Hardware 53

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. A quick check of basic performance statistics showed over 30% higher CPU consumption. in total.

Speed 52

Speed Java AWS Virtualization 52

Adrian Cockcroft

NOVEMBER 11, 2019

This discussion focuses on hardware, software and operational failure modes. Collecting some critical metrics at one second intervals, with a total observability latency of ten seconds or less matches the human attention span much better. There is no need to retry and no extra time taken when a failure is present.

Latency 52

Latency Systems Engineering Hardware 52

Brendan Gregg

SEPTEMBER 5, 2017

Here's some output from my zfsdist tool, in bcc/BPF, which measures ZFS latency as a histogram on Linux: # zfsdist. Tracing ZFS operation latency. Just from a quick search, see this presentation PDF , which digs into oops message components. Many new tools can now be written, and the main toolkit we're working on is [bcc].

Virtualization 75

Virtualization AWS Engineering Hardware 75