All Things Distributed

APRIL 27, 2011

We use high-performance transactions systems, complex rendering and object caching, workflow and queuing systems, business intelligence and data analytics, machine learning and pattern recognition, neural networks and probabilistic decision making, and a wide variety of other techniques. Driving Storage Costs Down for AWS Customers.

Technology 129

Technology Technology AWS Storage 129

Percona

JANUARY 9, 2023

NOTE : All tests were applied for MySQL version 8.0.30, and in the background, I ran every query three to five times to make sure that all of them were fully cached in the buffer pool (for InnoDB) or by the filesystem (for MyISAM). But why we can’t just cache the actual number of the rows?

Cache 106

Cache Engineering Storage Speed 106

All Things Distributed

JUNE 21, 2017

Today, I'm excited to announce the general availability of Amazon DynamoDB Accelerator (DAX) , a fully managed, highly available, in-memory cache that can speed up DynamoDB response times from milliseconds to microseconds, even at millions of requests per second. DynamoDB was the first service at AWS to use SSD storage.

Speed 95

Speed Cache Latency AWS 95

ACM Sigarch

NOVEMBER 4, 2019

In particular, she highlighted her transformative MIT’78 VLSI System Design Course she designed and taught as a Visiting Professor of EECS at MIT. The best paper runner-up was “ Dynamic Multi-Resolution Data Storage ”. . Goodman, and “Speculative Cache Ways: On-Demand Cache Resource Allocation” published at MICRO 1999 by David H.

Hardware 18

Hardware Architecture Programming Innovation 18

Percona

DECEMBER 23, 2022

I wrote this post on MyRocks because I believe it is the most interesting new MySQL storage engine to have appeared over the last few years. I decided to use a virtual machine with two CPU cores, four GB of memory, and storage limited to a maximum of 1000 IOPs of 16KB. I emulated these limits using the KVM iotune settings in my lab. <iotune>

Storage 56

Storage Cache C++ Virtualization 56

All Things Distributed

OCTOBER 2, 2017

" Of course, no technology change happens in isolation, and at the same time NoSQL was evolving, so was cloud computing. The Dynamo paper was well-received and served as a catalyst to create the category of distributed database technologies commonly known today as "NoSQL."

Internet 111

Internet Internet AWS Performance 111

Percona

MAY 15, 2023

This operation is quite expensive but our database can run it in a few milliseconds or less, thanks to several optimizations that allow the node to execute most of them in memory with no or little access to mass storage. Of course, we are still talking about a low number of rows and running threads but the gain is there.

Traffic 144

Traffic Scalability Database Servers 144

The Morning Paper

JUNE 23, 2019

Coupled with stateless application servers to execute business logic and a database-like system to provide persistent storage, they form a core component of popular data center service archictectures. Oh, you mean a cache? Yes, a bit like those 2nd-level caches we were talking about earlier, e.g. Ehcache from 2003 onwards.

Cache 79

Cache Latency Google Network 79

The Morning Paper

OCTOBER 26, 2020

These systems however adopt a cloud-based, centralised architecture that does not include any "edge computing" component – they typically assum an external, independent data ingestion pipeline that directs edge streams to cloud storage endpoints such as Kafka or Event Hubs.

Cloud 104

Cloud Big Data Latency Architecture 104

Randon ASCII

SEPTEMBER 8, 2019

The fact that this shows up as CPU time suggests that the reads were all hitting in the system cache and the CPU time was the kernel overhead (note ntoskrnl.exe on the first sampled call stack) of grabbing data from the cache. Now that we suspect file I/O it’s necessary to go to Graph Explorer-> Storage-> File I/O.

Latency 79

Latency Cache Programming Operating System 79

SQL Performance

OCTOBER 7, 2020

Its raison d’être is to cache result rows from a plan subtree, then replay those rows on subsequent iterations if any correlated loop parameters are unchanged. Table-valued functions use a table variable, which can be used to cache and replay results in suitable circumstances. Spools are the least costly way to cache partial results.

Servers 106

Servers Cache Azure Performance 106

The Morning Paper

JUNE 16, 2019

The challenging thing of course, is efficiently maintaining all of these parallel universes. If we do that naively though, we’re going to end up with a lot of universes to store and maintain and the storage requirements alone will be prohibitive. Expressing privacy policies.

Database 90

Database Cache Benchmarking Efficiency 90

The Morning Paper

FEBRUARY 23, 2020

Our approach differs substantially by (1) providing economic incentives for data to be contributed and integrated into existing schemas, (2) offering a SQL interface instead of graph based approaches, (3) including the computational and storage infrastructure in the architectural vision. Coordinators that don’t want to pay contractors?

Blockchain 94

Blockchain Internet Internet IoT 94

Smashing Magazine

SEPTEMBER 20, 2021

And of course, scrapers could scrape your site to look for security vulnerabilities or exposed contact or sales lead details. Search Engine And Web Archive Cached Results. Another common category of imposter domains are domains used by search engines for delivering cached results or archived versions of page views. Ad Scraping.

Website 108

Website Analytics Google Cache 108

Smashing Magazine

OCTOBER 29, 2019

Here’s what Google suggests: PageSpeed Insights demonstrates how much storage and bandwidth websites stand to save with WebP. That’s why it’s no surprise that it’s developed a built-in WebP caching and image processing solution that helps developers more easily deliver the right file formats to visitors. What Is WebP Caching?

Website 75

Website Speed Cache Google 75

Percona

JULY 17, 2023

Alternatives to MongoDB Enterprise There are plenty of alternatives, but we’re not going to cover them all here, of course. Storing large datasets can be a challenge, as Redis’ storage capacity is limited by available RAM. Also, Redis is designed primarily for key-value storage and lacks advanced querying capabilities.

Open Source 98

Open Source Database Scalability Software 98

The Morning Paper

FEBRUARY 20, 2020

… based on interactions with enterprise customers, we expect that storage and inference of ML models will be subject to the same scrutiny and performance requirements of sensitive/mission-critical operational data. There are limitations to this model of course. It can’t handle loops for example (an analysis of 4.6M

Processing 72

Processing Hardware Database Servers 72

The Morning Paper

DECEMBER 8, 2019

The beauty of persistent memory is that we can use memory layouts for persistent data (with some considerations for volatile caches etc. Traditional pointers address a memory location (often virtual of course). in front of that memory , as we saw last week). At least, the nature of pointers that we want to make persistent.

Hardware 56

Hardware Programming Media Storage 56

Smashing Magazine

OCTOBER 22, 2019

Of course, there are the SEO benefits of images, too. Instead, you can integrate your existing image server (on your web host) or external storage service (like S3) with ImageKit. However, once you integrate your images or image storage with ImageKit, the tool will take control of your image sizing.

Mobile 73

Mobile Media Website Storage 73

SQL Performance

APRIL 8, 2019

Back on December 5, 2017, Microsoft announced that they were using AMD EPYC 7551 processors in their storage-optimized Lv2-Series virtual machines. The L3 cache size is 64MB. The L3 cache size is 64MB. They feature low latency, local NVMe storage that can directly leverage the 128 PCIe 3.0 lanes for I/O connectivity.

Azure 42

Azure Virtualization Storage Benchmarking 42

Alex Russell

APRIL 29, 2021

Chrome has missed several APIs for 3+ years: Storage Access API. An extension to Service Workers that enables browsers to present users with cached content when offline. It of course is personally frustrating to not be able to deliver these improvement for developers who wish to reach iOS users — which is all developers.

Media 145

Media Games Education Engineering 145

Brendan Gregg

APRIL 14, 2022

I've also used and helped develop many other technologies for debugging, primarily perf, Ftrace, eBPF (bcc and bpftrace), PMCs, MSRs, Intel vTune, and of course, flame graphs and heat maps. This diverse environment has always provided me with interesting things to explore, to understand, analyze, debug, and improve.

Java 52

Java Cloud Cache AWS 52

n0derunner

SEPTEMBER 17, 2018

As with traditional storage, applications are writing to a shared storage environment which is necessary to support VM movement. It is the shared storage that often causes performance issues for data bases which are otherwise separated across nodes. The idea here is to simulate the two main storage workloads of a DB.

Performance Testing 40

Performance Testing Benchmarking Testing Performance 40

Percona

MAY 1, 2023

Hardware optimization : You need to ensure that the CPU, memory, and storage components meet the performance requirements of the database workload. Connection pooling: Minimizing connection overhead and improving response times for frequently accessed data by implementing mechanisms for connection pooling and caching strategies.

Tuning 52

Tuning Database Efficiency Performance 52

Percona

JUNE 22, 2023

Consider costs : Multiple factors will, of course, affect how much you should budget. Depending on your setup, costs can include: Hardware devices (servers, storage devices, network switches, etc.) That will minimize problems that can occur when nodes share access to and the ability to modify the same memory or storage.

Availability 132

Availability Database Open Source Hardware 132

SQL Performance

OCTOBER 20, 2022

I’m not going to demonstrate it for space reasons, but if you change the column data type to the deprecated ntext type (which defaults to off-row LOB storage) or use sp_tableoption to store the nvarchar(max) data off-row, locks will be held for longer. This is true, of course, but there’s a bit more to say.

Testing 91

Testing Servers Cache Engineering 91

Alex Russell

OCTOBER 22, 2017

Add onto that the yawning chasm between low-end and high-end device performance thanks to chip design factors like cache sizes, and it can be difficult to know where to set a device baseline. Time required to read bytes from disk (it’s not zero, even on flash-based storage!). Time to execute and run our code.

Performance 74

Performance Network Benchmarking Mobile 74

Speed Curve

FEBRUARY 25, 2024

Guest profiles also start with empty caches, empty cookie stores, empty browser storage, etc. These may get populated during testing, but we can clear them at any time via Application > Storage > Clear Site Data in DevTools. Opening a guest profile in Chrome 2.

Analytics 94

Analytics Processing Google Mobile 94

Percona

JUNE 4, 2023

MariaDB retains compatibility with MySQL, offers support for different programming languages, including Python, PHP, Java, and Perl, and works with all major open source storage engines such as MyRocks, Aria, and InnoDB. Stock MySQL has provided several storage engines beyond just InnoDB (the default) and MyISAM. Supported Engines.

Open Source 52

Open Source Servers Storage Scalability 52

IO River

NOVEMBER 2, 2023

Whether you're scaling storage solutions like S3 buckets, compute resources like EKS clusters, or content delivery mechanisms via CDNs, Terraform offers a streamlined approach.  ‍Of course, the latter. Beyond just VM instances, this scalability extends to other aspects of your infrastructure.

Open Source 52

Open Source DevOps AWS Infrastructure 52

IO River

NOVEMBER 2, 2023

Whether you're scaling storage solutions like S3 buckets, compute resources like EKS clusters, or content delivery mechanisms via CDNs, Terraform offers a streamlined approach. Of course, the latter. Transitioning between CDN providers or even changing CDN configurations can be tricky.

Open Source 40

Open Source DevOps AWS Infrastructure 40

Highly Scalable

SEPTEMBER 18, 2012

Network partitions of course can lead to violation of this guarantee. (G, Permanent redirection means that the client is able to cache the mapping between the shard and the node. This redirect is a one-time and should not be cached. In this article, we, of course, consider only a couple of applied techniques.

Database 213

Database Latency C++ Scalability 213

High Scalability

JULY 20, 2018

That means multiple data indirections mean multiple cache misses. Mark LaPedus : MRAM, a next-generation memory type, is being touted as a replacement for embedded flash and cache applications. Cliff Click : The JVM is very good at eliminating the cost of code abstraction, but not the cost of data abstraction.

Internet 121

Internet Internet Scalability Automotive 121

Alex Russell

MARCH 6, 2021

A then-representative $200USD device had 4-8 slow (in-order, low-cache) cores, ~2GiB of RAM, and relatively slow MLC NAND flash storage. Not as much as we'd like, of course, but the worldwide baseline has changed enormously. There are differences, of course, but not where it counts. The Moto G4 , for example.

Performance 127

Performance Network Mobile Metrics 127

Smashing Magazine

JANUARY 15, 2019

An obvious metric here is CPU usage, but memory usage and other forms of data storage also play their part. I, for one, have typically added Google Analytics to every site I manage as a matter of course. I predominantly use Nginx, and I have a particular fondness for FastCGI cache and have found it to be especially efficient.

Website Performance 78

Website Performance Website Energy Performance 78

Smashing Magazine

JANUARY 11, 2021

Build Optimizations JavaScript modules, module/nomodule pattern, tree-shaking, code-splitting, scope-hoisting, Webpack, differential serving, web worker, WebAssembly, JavaScript bundles, React, SPA, partial hydration, import on interaction, 3rd-parties, cache. This improves page load time and caching during navigations.

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

JANUARY 6, 2020

This might be very different for your company, of course, but that’s a close enough approximation of a majority of customers out there. Sean Larkin has a free course on Webpack: The Core Concepts and Jeffrey Way has released a fantastic free course on Webpack for everyone. Use progressive enhancement as a default.

Performance 112

Performance Cache Servers Network 112