The Morning Paper

NOVEMBER 8, 2020

Back in 2017 the engineering team at Facebook had a problem. replacing Paxos with Raft), or they could be shims over external storage systems. A minimal Loglet needs to provide totally ordered, durable storage via the shared log API. In Facebook’s implementation of NativeLoglet, seal simply sets a bit on a quorum of servers.

Virtualization 126

Virtualization Latency Storage Systems 126

Brendan Gregg

NOVEMBER 28, 2017

In this configuration, the AMI and boot is paravirt (PV), the kernel is making hypercalls instead of privileged instructions, and the system is using paravirt network and storage drivers. But not all workloads: some are network bound (proxies) and storage bound (databases). ## 5. The AMI and boot are now HVM.

Virtualization 40

Virtualization AWS Hardware Storage 40

SQL Performance

AUGUST 27, 2019

On August 7, 2019, AMD finally unveiled their new 7nm EPYC 7002 Series of server processors, formerly code-named "Rome" at the AMD EPYC Horizon Event in San Francisco. This is the second generation EPYC server processor that uses the same Zen 2 architecture as the AMD Ryzen 3000 Series desktop processors.

Servers 52

Servers Benchmarking Virtualization Architecture 52

SQL Performance

AUGUST 23, 2019

In traditional row-mode execution plans, SQL Server may introduce a Bitmap operator as part of performing early semi join reduction before a parallel hash or merge join. There have been major improvements since the first appearance of the batch mode execution engine in SQL Server 2012. Background. The Query Optimizer. Bitmap Choice.

Servers 75

Servers Engineering Efficiency Retail 75

SQL Performance

SEPTEMBER 5, 2019

I briefly mentioned that batch mode data is normalized in my last article Batch Mode Bitmaps in SQL Server. You will need SQL Server 2016 (or later) and Developer Edition (or equivalent) to reproduce the results shown here. This table uses columnstore for its primary storage to produce batch mode execution later on.

Performance 81

Performance C++ Storage Servers 81

Alex Russell

MARCH 6, 2021

TL;DR: A lot has changed since 2017 when we last estimated a global baseline resource per-page resource budget of 130-170KiB. A then-representative $200USD device had 4-8 slow (in-order, low-cache) cores, ~2GiB of RAM, and relatively slow MLC NAND flash storage. The Moto G4 , for example. Here begins our 2021 adventure. Hard Reset.

Performance 127

Performance Network Metrics Cache 127

SQL Performance

MARCH 17, 2020

This follow-up post revisits the question for SQL Server 2019, using a larger number of rows. It has 32GB RAM, with 24GB available to the SQL Server 2019 instance. It would be nice if SQL Server could push the aggregation down into the scan and just return distinct values from the column store directly. Test Environment.

Servers 86

Servers Tuning Database Efficiency 86

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on.

Performance 52

Performance Latency Hardware Storage 52

Percona

JULY 7, 2023

In general terms, to achieve HA in PostgreSQL, there must be: Redundancy: To ensure data redundancy and provide continuous performance when a primary server fails, multiple copies of the database reside in replica servers. When the primary server fails, a standby server takes over as the new primary.

Availability 88

Availability Open Source Architecture Database 88

Percona

AUGUST 17, 2023

StackOverflow statistics show that 26% of developers preferred it in 2017, 34% in 2019, and 40% in 2021. PostgreSQL has powerful and advanced features, including asynchronous replication, full-text searches of the database, and native support for JSON-style storage, key-value storage, and XML.

Open Source 83

Open Source Healthcare Social Media Database 83

SQL Performance

FEBRUARY 3, 2020

The downside to the latter is that, in SQL Server 2017, you cannot run this online… but you will be able to in 2019. If you want to maximize compression with zero disruption , you can approach 90% storage reduction without any disruption at all, using page compression online.

Speed 113

Speed Processing Servers Storage 113

Percona

JUNE 4, 2023

This blog post was originally published in November 2017 and was updated in June 2023. In this blog, we’ll provide a comparison between MariaDB vs. MySQL (including Percona Server for MySQL ). MariaDB Server, on the other hand, is a fork of MySQL 5.5.

Open Source 52

Open Source Servers Storage Scalability 52

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory.

Performance 52

Performance Latency Cache Virtualization 52

SQL Performance

APRIL 23, 2019

In SQL Server 2012, grouped (vector) aggregation was able to use parallel batch-mode execution, but only for the partial (per-thread) aggregate. SQL Server 2014 added the ability to perform parallel batch-mode grouped aggregation within a single Hash Match Aggregate operator. Columnstore storage. Introduction.

Servers 67

Servers Testing Metrics Storage 67

SQL Performance

MAY 1, 2020

In a recent tip , I described a scenario where a SQL Server 2016 instance seemed to be struggling with checkpoint times. I was a bit perplexed by this issue, since the system was certainly no slouch — plenty of cores, 3TB of memory, and XtremIO storage. How It Works: When is the FlushCache message added to SQL Server Error Log?

C++ 58

C++ Database Servers Storage 58

Percona

JANUARY 17, 2019

now has a version which will support parallelism for SELECT queries (utilizing the read capacity of storage nodes underneath the Aurora cluster). I will compare AWS Aurora with MySQL (Percona Server) 5.6 84.1 | | version_comment | Percona Server (GPL), Release 84.1, MySQL on ec2.

Cache 48

Cache C++ AWS Airlines 48

Percona

SEPTEMBER 1, 2023

This blog was originally published in October 2017 and was updated in September 2023. Sharding in MongoDB is a technique used to distribute a database horizontally across multiple nodes or servers, known as “shards.” MongoDB distributes data across these shard servers to ensure an even distribution.

Best Practices 76

Best Practices Traffic Database Servers 76

SQL Performance

APRIL 8, 2019

Back on December 5, 2017, Microsoft announced that they were using AMD EPYC 7551 processors in their storage-optimized Lv2-Series virtual machines. These AMD EPYC processors have a number of advantages for SQL Server workloads, as I will explain in this article. AMD EPYC 7551 Details. lanes for I/O connectivity.

Azure 42

Azure Virtualization Storage Benchmarking 42

Particular Software

MARCH 15, 2021

For NServiceBus systems, our SQL Persistence package allows you to use whatever flavor of SQL works best for you, supporting dialects for Microsoft SQL Server, MySQL, PostgreSQL, and Oracle. SQL Server Always Encrypted SQL Persistence 6.1 The other was added in October 2017 and is compatible with PostgreSQL. SQL Persistence 6.1

Transportation 52

Transportation Azure Database Servers 52

SQL Server According to Bob

FEBRUARY 13, 2020

​​​​ Another example would be backup to Azure Storage using the rest interface to read and ​​ write data to/from Azure Blob Storage. ​​ Using the shared memory region, the data and events are exchanged between the client and server VDI instance pairing.

Servers 40

Servers Availability Transportation Database 40

Alex Russell

OCTOBER 22, 2017

— Alex Russell (@slightlylate) October 4, 2017. Late-loading JavaScript can cause “server-side rendered” pages to fail in infuriating ways. The server sends it as a stream of bytes and when the browser encounters each of the sub-resources referenced in the document, it requests them. First Load.

Performance 74

Performance Network Benchmarking Mobile 74

The Morning Paper

JANUARY 19, 2020

STELLA: report from the SNAFU-catchers workshop on coping with complexity , Woods 2017, Coping with Complexity workshop. Today’s choice is a report from a 2017 workshop convened with that title, and recommended to me by John Allspaw – thank you John! Take a trivial example with three components A, B, and C.

C++ 50

C++ Systems Software Software 50

Enprowess

JANUARY 12, 2022

Other benefits: It has other benefits like a Quicker launch to the market, Easier distribution, saving device power and storage, seamless maintenance, and updating. Twitter Lite PWA : It was integrated as the standard User Interface in 2017. Blockchain technology is an encrypted database storage system. Famous PWA Use Examples.

Blockchain 59

Blockchain IoT Development Serverless 59

Percona

AUGUST 5, 2023

This blog was originally published in July 2017 and was updated in August 2023. Otherwise, the storage engine does a scatter-gather and queries ALL partitions in a UNION that is not concurrent. This method distributes data evenly across partitions to achieve balanced storage and optimal query performance.

Strategy 40

Strategy Storage Database Best Practices 40

O'Reilly

JULY 25, 2023

To provide some coherence to the music, I decided to use Taylor Swift songs since her discography covers the time span of most papers that I typically read: Her main albums were released in 2006, 2008, 2010, 2012, 2014, 2017, 2019, 2020, and 2022. This choice also inspired me to call my project Swift Papers.

Programming 98

Programming Code Design Benchmarking 98

SQL Server According to Bob

DECEMBER 31, 2018

How It Works: XEvent Output and Visualization SQL Server Management Studio Provides–“XE Profiler” Use the SSMS XEvent Profiler. Using SQL Server Management Studio (SSMS) and storing the events in a table requires reading the events, streaming to table storage followed by an order by event sequence query. TSQL Sample Session.

Efficiency 40

Efficiency Code Servers Cache 40

SQL Server According to Bob

DECEMBER 18, 2018

SQL Server relies on Forced-Unit-Access (Fua) I/O subsystem capabilities to provide data durability, detailed in the following documents: SQL Server 2000 I/O Basic and SQL Server I/O Basics, Chapter 2. Be sure to deploy SQL Server 2017 CU6 or newer for best data durability and performance results. “.

Servers 90

Servers Media Cache Storage 90

Smashing Magazine

JANUARY 7, 2019

Is it worth exploring tree-shaking, scope hoisting, code-splitting, and all the fancy loading patterns with intersection observer, server push, clients hints, HTTP/2, service workers and — oh my — edge workers? Long FMP usually indicates JavaScript blocking the main thread, but could be related to back-end/server issues as well.

Performance 105

Performance Cache Metrics Network 105

Percona

JANUARY 14, 2019

To simulate text messages I have used ~3 billion of reddit comments (10 years from 2007 to 2017), downloaded from pushshift.io. In a partitioned massively parallel database system, the storage format and sorting algorithm may not be optimized for that operation as we are reading multiple partitions in parallel.

Database 40

Database Analytics Blockchain Healthcare 40