All Things Distributed

OCTOBER 2, 2017

Today marks the 10 year anniversary of Amazon's Dynamo whitepaper , a milestone that made me reflect on how much innovation has occurred in the area of databases over the last decade and a good reminder on why taking a customer obsessed approach to solving hard problems can have lasting impact beyond your original expectations.

Internet 110

Internet Internet AWS Performance 110

The Morning Paper

NOVEMBER 8, 2020

Back in 2017 the engineering team at Facebook had a problem. replacing Paxos with Raft), or they could be shims over external storage systems. A minimal Loglet needs to provide totally ordered, durable storage via the shared log API. Once the database was restored to five replicas, we reconfigured back. The NativeLoglet.

Virtualization 126

Virtualization Latency Storage Systems 126

Percona

AUGUST 17, 2023

PostgreSQL is open source relational database management software. StackOverflow statistics show that 26% of developers preferred it in 2017, 34% in 2019, and 40% in 2021. In another survey, using multiple metrics for overall popularity, PostgreSQL ranks as the fourth most popular database management system ( DB-Engines, March 2023 ).

Open Source 98

Open Source Healthcare Social Media Database 98

Brendan Gregg

NOVEMBER 28, 2017

In this configuration, the AMI and boot is paravirt (PV), the kernel is making hypercalls instead of privileged instructions, and the system is using paravirt network and storage drivers. But not all workloads: some are network bound (proxies) and storage bound (databases). ## 5. The AMI and boot are now HVM.

Virtualization 40

Virtualization AWS Hardware Storage 40

Percona

JULY 7, 2023

Unfortunately, using certain open source database software as part of an HA architecture can present significant challenges. This blog highlights considerations for keeping your own PostgreSQL databases highly available and healthy. The same changes made in the primary database are made in the replicas.

Availability 98

Availability Open Source Architecture Database 98

Alex Russell

MARCH 6, 2021

TL;DR: A lot has changed since 2017 when we last estimated a global baseline resource per-page resource budget of 130-170KiB. A then-representative $200USD device had 4-8 slow (in-order, low-cache) cores, ~2GiB of RAM, and relatively slow MLC NAND flash storage. The Moto G4 , for example. Here begins our 2021 adventure. Hard Reset.

Performance 127

Performance Network Mobile Metrics 127

Percona

JANUARY 17, 2019

now has a version which will support parallelism for SELECT queries (utilizing the read capacity of storage nodes underneath the Aurora cluster). I’m using the “Airlines On-Time Performance” database from [link] (You can find the scripts I used here: [link] ). SSD) we can’t utilize the full potential of IOPS with just one thread.

Cache 72

Cache C++ AWS Airlines 72

Percona

SEPTEMBER 1, 2023

This blog was originally published in October 2017 and was updated in September 2023. Database architects working with MongoDB encounter specific challenges related to database systems and system growth. Database architects working with MongoDB encounter specific challenges related to database systems and system growth.

Best Practices 98

Best Practices Traffic Database Servers 98

SQL Server According to Bob

MAY 19, 2019

SQL Server will ship Azure SQL Database Edge: [link]. For example, Azure SQL Database Edge can already use TSQL Predict Machine Learning (ML) and Column Storage. The reduction effort started when we shipped SQL Server 2017 ( [link].) SQL Server 2017. Ghost Record Cleanup. Lock Manager. Parallel Queries.

IoT 61

IoT Servers Development Cache 61

SQL Performance

MARCH 17, 2020

I will be using the 50GB Stack Overflow 2013 database , but any large table with a low number of distinct values would do. The Stack Overflow 2013 database comes without nonclustered indexes to minimize download time. Not everyone will be able to move to column store storage quickly, and it won't always be the right solution anyway.

Servers 86

Servers Tuning Database Efficiency 86

SQL Performance

MAY 1, 2020

I was a bit perplexed by this issue, since the system was certainly no slouch — plenty of cores, 3TB of memory, and XtremIO storage. Still, if you stack a bunch of high-transaction databases on there, checkpoint processing can get pretty sluggish. Change the Target Recovery Time of a Database. databases AS d.

C++ 58

C++ Database Servers Storage 58

SQL Performance

FEBRUARY 3, 2020

I was smart and took a backup of the original source, and created a procedure to revert the database back to its initial state. The downside to the latter is that, in SQL Server 2017, you cannot run this online… but you will be able to in 2019.

Speed 113

Speed Processing Servers Storage 113

Percona

JUNE 4, 2023

This blog post was originally published in November 2017 and was updated in June 2023. Before we dive into the differences between MariaDB and MySQL, we will provide a thorough examination of each relational database management system (RDBMS). What is MariaDB? Enhanced security is another advantage MariaDB.

Open Source 52

Open Source Servers Storage Scalability 52

SQL Performance

AUGUST 27, 2019

Single-Socket Database Servers. TPC-H Benchmark Results with SQL Server 2017. HPE has already submitted a new official TPC-H result on SQL Server 2017 for a single-socket, HPE Proliant DL325 Gen10 1U server that was 743,750 QphH@1000GB. TPC-E Benchmark Results with SQL Server 2017.

Servers 52

Servers Benchmarking Virtualization Architecture 52

Particular Software

MARCH 15, 2021

As popular as NoSQL databases have become, you’d be hard-pressed to find a successful business that isn’t running some flavor of SQL somewhere. Unfortunately, that name is not a legal identifier which meant the scripts would not work with SQL*Plus, which is one of the more popular tools used to automate scripts against an Oracle database.

Transportation 52

Transportation Azure Database Servers 52

SQL Performance

APRIL 8, 2019

Back on December 5, 2017, Microsoft announced that they were using AMD EPYC 7551 processors in their storage-optimized Lv2-Series virtual machines. Both of these Intel processors are special bespoke models that are not in the Intel ARK database. Since then, Microsoft has changed the naming of this series to Lsv2. Memory (GiB).

Azure 42

Azure Virtualization Storage Benchmarking 42

Percona

AUGUST 5, 2023

This blog was originally published in July 2017 and was updated in August 2023. Partitioning is a way in which a database (MySQL in this case) splits its actual data down into separate tables but still gets treated as a single table by the SQL layer. So, What is MySQL Partitioning? Additionally, MySQL 8.0

Strategy 40

Strategy Storage Database Best Practices 40

SQL Performance

APRIL 23, 2019

Columnstore storage. To understand this, it is necessary to first review how columnstore storage works at a high level: A compressed row group contains a column segment for each column. Value encoding can reduce the number of bits required for storage by translating raw values using a base offset and magnitude modifier.

Servers 67

Servers Testing Metrics Storage 67

Alex Russell

APRIL 29, 2021

Chrome has missed several APIs for 3+ years: Storage Access API. WebGL 2 launched for other platforms on Chrome and Firefox in 2017. The data captured by MDN Browser Compatibility Data Respository and the caniuse database is often partial and sometimes incorrect. Where Chrome Has Lagged.

Media 145

Media Games Education Engineering 145

Enprowess

JANUARY 12, 2022

Other benefits: It has other benefits like a Quicker launch to the market, Easier distribution, saving device power and storage, seamless maintenance, and updating. Twitter Lite PWA : It was integrated as the standard User Interface in 2017. Blockchain technology is an encrypted database storage system.

Blockchain 59

Blockchain IoT Development Serverless 59

SQL Server According to Bob

FEBRUARY 13, 2020

​​​​ Another example would be backup to Azure Storage using the rest interface to read and ​​ write data to/from Azure Blob Storage. ​​​​ A utility would issue the dbcc freeze to stop the I/O activity for the database.

Servers 40

Servers Availability Transportation Database 40

O'Reilly

JULY 25, 2023

To provide some coherence to the music, I decided to use Taylor Swift songs since her discography covers the time span of most papers that I typically read: Her main albums were released in 2006, 2008, 2010, 2012, 2014, 2017, 2019, 2020, and 2022. This choice also inspired me to call my project Swift Papers.

Programming 98

Programming Code Design Benchmarking 98

SQL Server According to Bob

DECEMBER 18, 2018

Durability: “In database systems , durability is the ACID property which guarantees transactions that have committed will survive permanently. Be sure to deploy SQL Server 2017 CU6 or newer for best data durability and performance results. “. Microsoft SQL Server Database Engine Input/Output Requirements. Description.

Servers 90

Servers Media Cache Storage 90

Smashing Magazine

JANUARY 7, 2019

Depending on how much dynamic data you have, you might be able to "outsource" some part of the content to a static site generator , pushing it to a CDN and serving a static version from it, thus avoiding database requests. An interesting way of avoiding parsing costs is to use binary templates that Ember has introduced in 2017.

Performance 111

Performance Cache Network Metrics 111

Percona

JANUARY 14, 2019

What if we use ClickHouse (which is a columnar analytical database) as our main datastore? Well, typically, an analytical database is not a replacement for a transactional or key/value datastore. Although such databases can be very efficient with counts and averages, some queries will be slow or simply non existent. Processed 4.15

Database 48

Database Analytics Blockchain Healthcare 48