Sutter's Mill

FEBRUARY 13, 2017

Tue-Thu Apr 25-27: High-Performance and Low-Latency C++ (Stockholm). On April 25-27, I’ll be in Stockholm (Kista) giving a three-day seminar on “High-Performance and Low-Latency C++.” If you’re interested in attending, please check out the links, and I look forward to meeting and re-meeting many of you there.

Latency 48

Latency C++ Hardware Performance 48

The Morning Paper

JUNE 23, 2019

Generally to cache data (including non-persistent data that never sees a backing store), to share non-persistent data across application services (e.g. ” Even re-reading that today, the letter of the law there is surprisingly strict to me: you can use the local memory space or filesystem as a brief single transaction cache, but no more.

Cache 79

Cache Latency Google Network 79

The Morning Paper

OCTOBER 26, 2020

It’s limited by the laws of physics in terms of end-to-end latency. We saw earlier that there is end-user pressure to replace batch systems with much lower latency online systems. We are observing significant demand from users in terms of avoiding batch telemetry pipelines altogether. Emphasis mine ). Emphasis mine ).

Cloud 104

Cloud Big Data Latency Architecture 104

The Morning Paper

OCTOBER 6, 2019

Prediction serving latency matters. Lesson 4: prediction serving latency matters. In a experiment introducing synthetic latency, Booking.com found that an increase of about 30% in latency cost about 0.5% Even mathematically simple models have the potential of introducing relevant latency.

Latency 102

Latency Metrics Cache Design 102

Percona

MARCH 23, 2023

These guidelines work well for a wide range of applications, though the optimal settings, of course, depend on the workload. By caching hot datasets, indexes, and ongoing changes, InnoDB can provide faster response times and utilize disk IO in a much more optimal way. have been released since then with some major changes.

Performance 144

Performance Hardware Tuning Storage 144

CSS - Tricks

APRIL 1, 2021

Redirects are often pretty light in terms of the latency that they add to a website, but they are an easy first thing to check, and they can generally be removed with little effort. I’m going to update my referenced URL to the new site to help decrease latency that adds drag to the initial page load. Text-based assets. KB to 11.2

Cache 94

Cache Social Media Media Website 94

The Morning Paper

FEBRUARY 23, 2020

Caching of query results on the other hand, looks like a good business model, at large enough scale these might amount to pretty much the same thing). How’s that going to work given what we know about the throughput and latency of blockchains, and the associated mining costs?" An embodiment for structured data for IoT.

Blockchain 94

Blockchain Internet Internet IoT 94

All Things Distributed

OCTOBER 2, 2017

" Of course, no technology change happens in isolation, and at the same time NoSQL was evolving, so was cloud computing. Performant – DynamoDB consistently delivers single-digit millisecond latencies even as your traffic volume increases.

Internet 111

Internet Internet AWS Performance 111

Percona

MAY 15, 2023

This, of course, is unless I can organize my products by country as well, which is a bit unusual nowadays but not impossible. One example could be using an RDBMS for most of the Online transaction processing ( OLTP) data shared by country and having the products as distributed memory cache with a different technology.

Traffic 144

Traffic Scalability Database Servers 144

Scalegrid

FEBRUARY 8, 2024

Durability Availability Fault tolerance These combined outcomes help minimize latency experienced by clients spread across different geographical regions. Opting for synchronous replication within distributed storage brings about reinforced consistency and integrity of data, but also bears higher expenses than other forms of replicating data.

Storage 130

Storage Systems Big Data Azure 130

KeyCDN

SEPTEMBER 12, 2019

The file size of your images of course is very important, but SEO and social media also play an important part in helping your website perform and convert better. KeyCDN’s Cache Enabler plugin is fully compatible the HTML attributes that make images responsive. jpg 480 KB 407 KB 43 KB 89% jpg-to-webp-2.jpg

Social Media 106

Social Media Media Google Website 106

Smashing Magazine

SEPTEMBER 6, 2021

This approach was touted to be better for fine-grained caching because each subresource could be cached individually and the full bundle didn’t need to be redownloaded if one of them changed. Finally, not inlining resources has an added latency cost because the file needs to be requested. Large preview ).

Network 120

Network Servers Cache Traffic 120

Smashing Magazine

AUGUST 20, 2021

Platforms such as Snipcart , CommerceLayer , headless Shopify , and Stripe enable you to manage products in a friendly UI while taking advantage of the benefits of Jamstack: Amazon’s famous study reported that for every 100ms in latency, they lose 1% of sales. Of course the template approach is cheaper.

Ecommerce 142

Ecommerce Website Government Internet 142

Percona

JULY 17, 2023

Alternatives to MongoDB Enterprise There are plenty of alternatives, but we’re not going to cover them all here, of course. Redis can handle a high volume of operations per second, making it useful for running applications that require low latency. Such organizations might seek a more straightforward alternative.

Open Source 98

Open Source Database Scalability Software 98

Alex Russell

OCTOBER 22, 2017

It simulates a link with a 400ms RTT and 400-600Kbps of throughput (plus latency variability and simulated packet loss). Simulated packet loss and variable latency, however, can make benchmarking extremely difficult and slow. Our baseline, then, should probably trade lower throughput/higher-latency for packet loss.

Performance 74

Performance Network Benchmarking Mobile 74

Smashing Magazine

AUGUST 9, 2021

You’ve probably heard things like: “HTTP/3 is much faster than HTTP/2 when there is packet loss”, or “HTTP/3 connections have less latency and take less time to set up”, and probably “HTTP/3 can send data more quickly and can send more resources in parallel”. This is why we have a distinction between HTTP (without TLS) and HTTPS (with TLS).

Transportation 145

Transportation Internet Internet Network 145

Alex Russell

APRIL 29, 2021

For heavily latency-sensitive use-cases like WebXR, this is a critical component in delivering a good experience. An extension to Service Workers that enables browsers to present users with cached content when offline. Offscreen Canvas. Improves the smoothness of 3D and media applications by moving rendering work to a separate thread.

Media 145

Media Games Education Engineering 145

The Morning Paper

DECEMBER 8, 2019

Therefore any programming abstraction must be low latency and the kernel needs to be kept off the path of persistent data access as much as possible. The beauty of persistent memory is that we can use memory layouts for persistent data (with some considerations for volatile caches etc. in front of that memory , as we saw last week).

Hardware 56

Hardware Programming Media Storage 56

The Morning Paper

JANUARY 23, 2020

1:18pm a key observation was made that an API call to populate the homepage sidebar saw a huge jump in latency. There’s much more colour around these in the full thesis report of course). Members of the team begin diagnosing the issue using the #sysops and #warroom internal IRC channels. " – wikipedia.

Internet 53

Internet Internet Cache Engineering 53

IO River

NOVEMBER 2, 2023

A CDN (Content Delivery Network) is a network of geographically distributed servers that brings web content closer to where end users are located, to ensure high availability, optimized performance and low latency. Multi-CDN is the practice of employing a number of CDN providers simultaneously.

Best Practices 52

Best Practices Strategy Traffic Virtualization 52

n0derunner

SEPTEMBER 17, 2018

In such a case we have a Bandwidth heavy workload profile (reporting) sharing with a Latency Sensitive workload (transactional). The key thing to observe is the impact on the latency sensitive (OLTP) workload. The “Data” disks are doing both reads (from DB cache misses) and writes committed transactions.

Performance Testing 40

Performance Testing Benchmarking Testing Performance 40

SQL Performance

APRIL 8, 2019

The L3 cache size is 64MB. Of course, if I were buying an AMD-based server for on-premises SQL Server use right now, I would try to get the newer, frequency-optimized AMD EPYC 7371 processor. The L3 cache size is 64MB. They feature low latency, local NVMe storage that can directly leverage the 128 PCIe 3.0 Memory (GiB).

Azure 42

Azure Virtualization Storage Benchmarking 42

IO River

NOVEMBER 2, 2023

A CDN (Content Delivery Network) is a network of geographically distributed servers that brings web content closer to where end users are located, to ensure high availability, optimized performance and low latency. Multi-CDN is the practice of employing a number of CDN providers simultaneously.

Best Practices 40

Best Practices Strategy Traffic Virtualization 40

KeyCDN

FEBRUARY 14, 2019

A CDN will pull the GIF files from your origin server and cache them. This results in a reduction in distance travelled and therefore latency, as well as reduces the load on your origin server. Of course, web optimization is always about weighing costs and benefits.

Speed 50

Speed Website Servers Latency 50

The Symphonia

MAY 22, 2018

Of course publishing it on Martin Fowler’s site was always going to get it to a wider audience (thanks Martin!), I also rewrote the section on Startup Latency since Cold Starts are one of the big “FUD” areas of Serverless. Because of course it did. Finally, of course, there’s the community section.

Serverless 40

Serverless Architecture Lambda Azure 40

The Morning Paper

SEPTEMBER 12, 2019

A pipeline breaker occurs when the output of one operator must be materialized to disk or transferred over the network, as opposed to being directly communicated from operator to operator via CPU cache, or, in the worst case, via RAM. Once a library of UDFs have been built up of course, they could be reused across computations.

Network 44

Network Database Programming Hardware 44

Highly Scalable

SEPTEMBER 18, 2012

Historically, NoSQL paid a lot of attention to tradeoffs between consistency, fault-tolerance and performance to serve geographically distributed systems, low-latency or highly available applications. Read/Write latency. Read/Write requests are processes with a minimal latency. Data Placement. Read/Write scalability.

Database 213

Database Latency C++ Scalability 213

All Things Distributed

MAY 13, 2012

With just one click you can enable content to be distributed to the customer with low latency and high-reliability. Of course non-AWS origins are also permitted. Query String based Caching: the ability to include query string parameters as part of the objects cache key. Persistent Connection to Origins.

Cache 97

Cache Latency AWS Website 97

Scalegrid

JULY 29, 2020

Also, note the test here was actually perfectly crafted for Pgpool-II – since when N > 32, the number of clients and number of children processes were the same, and hence, each reconnection was guaranteed to find a cached process. Patterns of data access would play a role, as would the latencies involved based on your architecture.

Benchmarking 246

Benchmarking Database Performance Testing Availability 246

High Scalability

JULY 20, 2018

That means multiple data indirections mean multiple cache misses. Mark LaPedus : MRAM, a next-generation memory type, is being touted as a replacement for embedded flash and cache applications. Cliff Click : The JVM is very good at eliminating the cost of code abstraction, but not the cost of data abstraction.

Internet 121

Internet Internet Scalability Automotive 121

Smashing Magazine

AUGUST 22, 2021

Because we are dealing with network protocols here, we will mainly look at network aspects, of which two are most important: latency and bandwidth. Latency can be roughly defined as the time it takes to send a packet from point A (say, the client) to point B (the server). Two-way latency is often called round-trip time (RTT).

Performance 109

Performance Network Latency Servers 109

Alex Russell

MARCH 6, 2021

A then-representative $200USD device had 4-8 slow (in-order, low-cache) cores, ~2GiB of RAM, and relatively slow MLC NAND flash storage. Not as much as we'd like, of course, but the worldwide baseline has changed enormously. There are differences, of course, but not where it counts. The Moto G4 , for example.

Performance 127

Performance Network Mobile Metrics 127

The Morning Paper

MAY 12, 2019

The paper examines the implications of microservices at the hardware, OS and networking stack, cluster management, and application framework levels, as well as the impact of tail latency. Smaller microservices demonstrated much better instruction-cache locality than their monolithic counterparts. Hardware implications.

Open Source 61

Open Source Hardware Benchmarking Systems 61

Smashing Magazine

JANUARY 11, 2021

Build Optimizations JavaScript modules, module/nomodule pattern, tree-shaking, code-splitting, scope-hoisting, Webpack, differential serving, web worker, WebAssembly, JavaScript bundles, React, SPA, partial hydration, import on interaction, 3rd-parties, cache. This improves page load time and caching during navigations.

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

JANUARY 6, 2020

This might be very different for your company, of course, but that’s a close enough approximation of a majority of customers out there. Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Thanks to Tim Kadlec, Henri Helvetica and Alex Russel for the pointers!

Performance 112

Performance Cache Servers Network 112

Smashing Magazine

JANUARY 7, 2019

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Of course, your data might show that your customers are not on these devices, but perhaps they simply don’t show up in your analytics because your service is inaccessible to them due to slow performance.

Performance 111

Performance Cache Network Metrics 111