The Morning Paper

MARCH 8, 2020

This paper presents Snowflake design and implementation along with a discussion on how recent changes in cloud infrastructure (emerging hardware, fine-grained billing, etc.) The caching use case may be the most familiar, but in fact it’s not the primary purpose of the ephemeral storage service. joins) during query processing.

Storage 112

Storage Engineering Cache Serverless 112

Scalegrid

FEBRUARY 8, 2024

Key Takeaways Distributed storage systems benefit organizations by enhancing data availability, fault tolerance, and system scalability, leading to cost savings from reduced hardware needs, energy consumption, and personnel. They maintain fault tolerance and redundancy by replicating this information throughout various nodes in the system.

Storage 130

Storage Systems Big Data Azure 130

Brendan Gregg

FEBRUARY 28, 2023

Make sure your system can handle next-generation DRAM,” [link] Nov 2011 - [Hruska 12] Joel Hruska, “The future of CPU scaling: Exploring options on the cutting edge,” [link] Feb 2012 - [Gregg 13] Brendan Gregg, “Blazing Performance with Flame Graphs,” [link] 2013 - [Shimpi 13] Anand Lal Shimpi, “Seagate to Ship 5TB HDD in 2014 using Shingled Magnetic (..)

Performance 103

Performance Latency Cache Virtualization 103

The Morning Paper

DECEMBER 10, 2019

This is a companion paper to the " persistent problem " piece that we looked at earlier this week, going a little deeper into the object pointer representation choices and the mapping of a virtual object space into physical address spaces. Both abstractions must be implemented in a way that is efficient using existing hardware.

Hardware 52

Hardware Virtualization Operating System Programming 52

HammerDB

APRIL 19, 2023

Regardless of whether the computing platform to be evaluated is on-prem, containerized, virtualized, or in the cloud, it is crucial to consider several essential factors. By default, HammerDB is designed to take advantage of database system caching mechanisms such as buffer caches, query caches, or statement caches.

Performance 54

Performance Benchmarking Cache Storage 54

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. Without enough infrastructure (physical or virtualized servers, networking, etc.),

Availability 110

Availability Database Open Source Hardware 110

The Morning Paper

APRIL 14, 2019

The paper sets out what we can do in software given today’s hardware, and along the way also highlights areas where cooperation from hardware will be needed in the future. cache) can be partitioned across domains; for those that are instead time-multiplexed, we have to flush them during domain switches. Threat scenarios.

Hardware 44

Hardware Cache Latency Speed 44

SQL Performance

APRIL 27, 2020

Fast forward a few years after Azure SQL Database was released to when Azure SQL Managed Instance was in public preview, and "vCores" (virtual cores) were announced for Azure SQL Database. Gen 5 is the primary hardware option now for most regions since Gen 4 is aging out. New Hardware Configuration for Provisioned Compute Tier.

Azure 55

Azure Database Serverless Hardware 55

Brendan Gregg

FEBRUARY 28, 2023

Make sure your system can handle next-generation DRAM,” [link] , Nov 2011 [Hruska 12] Joel Hruska, “The future of CPU scaling: Exploring options on the cutting edge,” [link] , Feb 2012 [Gregg 13] Brendan Gregg, “Blazing Performance with Flame Graphs,” [link] , 2013 [Shimpi 13] Anand Lal Shimpi, “Seagate to Ship 5TB HDD in 2014 using Shingled Magnetic (..)

Performance 52

Performance Latency Cache Virtualization 52

The Morning Paper

DECEMBER 8, 2019

Byte-addressable non-volatile memory,) NVM will fundamentally change the way hardware interacts, the way operating systems are designed, and the way applications operate on data. The beauty of persistent memory is that we can use memory layouts for persistent data (with some considerations for volatile caches etc. What about security?

Hardware 56

Hardware Programming Media Storage 56

SQL Server According to Bob

JANUARY 11, 2020

Stable media is commonly physical disk storage, but other devices and certain caching facilities qualify as well. Many high-end disk subsystems provide high-speed cache facilities to reduce the latency of read and write operations. This cache is often supported by a battery-powered backup facility.

Servers 40

Servers Cache Media Hardware 40

ACM Sigarch

FEBRUARY 23, 2018

Virtualization, for instance, was being addressed by IBM in the 1960s. Both virtualization and power burst onto the architecture community seemingly out of nowhere even though there was a clear historical basis and trend for both. We believed existing hardware and OS protocols protected the processor.

Architecture 47

Architecture Cache Hardware Virtualization 47

Percona

APRIL 17, 2023

Operating System (OS) settings Swappiness Swappiness is a Linux kernel setting that influences the behavior of the Virtual Memory manager when it needs to allocate a swap, ranging from 0-100. Make sure the drives are mounted with noatime and also if the drives are behind a RAID controller with appropriate battery-backed cache.

Best Practices 52

Best Practices Design Tuning Database 52

Brendan Gregg

AUGUST 18, 2019

bpftrace uses BPF (Berkeley Packet Filter), an in-kernel execution engine that processes a virtual instruction set. hardware Hardware counter-based instrumentation. There are also two modes visible, one between 1 and 2 milliseconds, and another between 8 and 16 milliseconds: this sounds like cache hits and cache misses.

Latency 57

Latency C++ Cache Programming 57

KeyCDN

JANUARY 23, 2020

A wide range of users with different operating systems, browsers, hardware configurations and other variables provides a wide sample size that helps developers discover as many issues as possible. This helps developers decide when to increase server disk space and power or whether or not using a virtual cloud server is optimal.

Strategy 72

Strategy Metrics Monitoring Servers 72

Alex Russell

APRIL 29, 2021

Now in development in WebKit after years of radio silence, WebXR APIs provide Augmented Reality and Virtual Reality input and scene information to web applications. An extension to Service Workers that enables browsers to present users with cached content when offline. is access to hardware devices. Content Indexing.

Media 145

Media Games Education Engineering 145

SQL Performance

JUNE 21, 2019

While hardware such as intelligent SANs, Solid State Disk, and other advancements have helped speed things up, wasted space in index can translate to wasted space in the buffer pool as well as wasting more I/O. If you are mostly virtualized on machines with 8 or fewer logical processors with a default MAXDOP, you're probably in OK.

Servers 49

Servers Azure Hardware Database 49

The Morning Paper

APRIL 2, 2019

In this context it means there are no external dependencies on e.g. secrets, trusted hardware modules, or special instructions (e.g. Disabling caches, virtual memory, and the TLB (this can be done verifiably as shown in theorem 6 in section IV.E). The verifier could also run as a co-processor connected to the main system bus.

Software 40

Software Software Programming Hardware 40

ACM Sigarch

NOVEMBER 1, 2019

This blog post gives a glimpse of the computer systems research papers presented at the USENIX Annual Technical Conference (ATC) 2019, with an emphasis on systems that use new hardware architectures. GAIA proposed to expand the OS page cache into accelerator memory. ATC ’19 was refreshingly different. Heterogeneous ISA.

Architecture 12

Architecture Hardware Cache Storage 12

Randon ASCII

AUGUST 16, 2018

The interesting part of the call stack above is NtQueryVirtualMemory , which is used to scan process memory, and is called by the suggestively named GetProcessVaData , where Va probably stands for Virtual Address. The CFG memory block is best thought of a cache with bounded size. Well, that’s not quite true. MiB of CFG memory, and 59.2

Programming 75

Programming Virtualization Code Processing 75

All Things Distributed

JANUARY 18, 2012

This is not just predictability of median performance and latency, but also at the end of the distribution (the 99.9th percentile), so we could provide acceptable performance for virtually every customer. To achieve all of these goals, we needed to do groundbreaking work.

Scalability 163

Scalability Database Ecommerce Latency 163

SQL Server According to Bob

DECEMBER 18, 2018

Device level flushing may have an impact on your I/O caching, read ahead or other behaviors of the storage system. FILE_FLAG_NO_BUFFERING is the Win32, CreateFile API flags and attributes setting to bypass file system cache. FILE_FLAG_NO_BUFFERING is the Win32, CreateFile API flags and attributes setting to bypass file system cache.

Servers 90

Servers Media Cache Storage 90

SQL Server According to Bob

JANUARY 11, 2020

Time of Last Access The time of last access is a caching ​​ algorithm ​​ that enables ​​ cache ​​ entries to be ordered by their ​​ access times.

Servers 40

Servers Cache Database Media 40

Smashing Magazine

JANUARY 11, 2021

Build Optimizations JavaScript modules, module/nomodule pattern, tree-shaking, code-splitting, scope-hoisting, Webpack, differential serving, web worker, WebAssembly, JavaScript bundles, React, SPA, partial hydration, import on interaction, 3rd-parties, cache. This improves page load time and caching during navigations.

Performance 145

Performance Cache Media Metrics 145