Percona

FEBRUARY 2, 2023

Recall that logical replication works by using the PUB/SUB mode, where individual tables are published and are then subscribed by remotely connected databases/tables. The challenge, of course, is reconstituting the logical replication process as quickly as possible, ideally without any data loss.

Open Source 117

Open Source Games Tuning Servers 117

Scalegrid

JANUARY 19, 2024

Key Takeaways Rollbacks in MongoDB are triggered by disruptions in the replication process due to primary node crashes, network partitions, or other failures, which can lead to substantial data loss and inconsistencies. To traditional relational databases, where rollbacks are less likely to cause data loss, MongoDB differs significantly.

Database 130

Database Network Servers Monitoring 130

SQL Performance

MARCH 20, 2020

In SQL Server 2016, STRING_SPLIT solved a long-missing gap in a language that, admittedly, was not intended for complicated string processing. For years before SQL Server 2016 (and for years since), we've written our own versions, improved them over time, and even argued about whose was fastest. Thanks for listening!

Database 109

Database Servers C++ AWS 109

Percona

JANUARY 24, 2023

Some of the built-in features ( wal_compression ) have been there since 2016, and almost all backup tools do the WAL compression before taking it to the backup repository. Such “torn pages” are corruptions from the database point of view. Individual processes generate WAL records, and latency is very crucial for transactions.

Database 142

Database Benchmarking Open Source Latency 142

Alex Russell

MARCH 6, 2021

Back in 2016, I gave a talk outlining the causes and effects of the terrible performance of web apps built using popular tools on the fastest-growing device segment: low-end to mid-range Android phones. Advances in browser content processing. The cheapest (high volume) Androids perform like 2012/2013 iPhones, respectively.

Performance 127

Performance Network Mobile Metrics 127

SQL Performance

JUNE 9, 2021

That is, ones that are created as an object in the database, and stay there permanently unless dropped. In my examples I’ll use a sample database called TSQLV5. A table could be a base table defined as an object in the database, or it could be a table returned by an expression—more specifically, a table expression.

Database 140

Database Code Design Development 140

Alex Podelko

OCTOBER 20, 2016

I am looking forward to share my thoughts on ‘Reinventing Performance Testing’ at the imPACt performance and capacity conference by CMG held on November 7-10, 2016 in La Jolla, CA. I decided to publish a few parts here to see if anything triggers a discussion. It would be published as separate posts: – Introduction (a short teaser).

Performance Testing 100

Performance Testing Architecture Testing Performance 100

SQL Performance

AUGUST 14, 2019

In my examples I'll use a sample database called TSQLV5. You can find the script that creates and populates this database here , and its ER diagram here. The performance penalty is relevant only when the window function is optimized with row-mode processing operators. Figure 1: Plan for Query 1, row-mode processing.

Best Practices 108

Best Practices Servers Database Azure 108

Percona

AUGUST 18, 2023

Why not just create another database on the same instance? We split databases by function/team to give each team full autonomy over their schema, And if someone screws up, it breaks their cluster, not all databases. So you put multiple MySQL servers on a single machine instead of multiple databases inside one MySQL instance.

Programming 98

Programming Servers Database Open Source 98

SQL Performance

DECEMBER 9, 2020

I mainly experimented with different table value constructor cardinalities, with serial versus parallel processing, and with row mode versus batch mode processing. You can create supporting tables in the user database if needed. The plan is serial, and all operators in the plan use row mode processing by default.

C++ 114

C++ Servers Testing Processing 114

Percona

SEPTEMBER 19, 2023

This type of backup is suitable for large, important databases that need to be recovered quickly when problems occur. Physical backups are the backups that consist of raw copies of the directories and files that store database contents. Copyright (c) 2016, 2023, Oracle and/or its affiliates. Type 'help' or '?' X, but got no.

C++ 124

C++ Servers Storage Speed 124

SQL Performance

MAY 1, 2020

In a recent tip , I described a scenario where a SQL Server 2016 instance seemed to be struggling with checkpoint times. Still, if you stack a bunch of high-transaction databases on there, checkpoint processing can get pretty sluggish. Change the Target Recovery Time of a Database. writes/sec average throughput: 46.96

C++ 58

C++ Database Servers Storage 58

Percona

APRIL 12, 2023

They came up with a horizontally scalable NoSQL database. Instead of relational (SQL) databases defined primarily through a hierarchy of related sets via tables and columns, their non-relational structure used a system of collections and documents. 2016: The company adds service-loaded MongoDB Professional to its mix.

Open Source 98

Open Source Programming Database Servers 98

SQL Performance

JUNE 21, 2019

This article will expand on my previous article and point out how these apply to SQL Server , Azure SQL Database , and Azure SQL Managed Instance. When looking at backups, I check for recovery model and the current history of backups for each database. Azure SQL Database and Azure Managed Instance have managed backups.

Servers 49

Servers Azure Hardware Database 49

O'Reilly Software

APRIL 4, 2018

We live in the era of the connected experience, where our daily interactions with the world can be digitized, collected, processed, and analyzed to generate valuable insights. Accumulating all this data to process overnight is not an option anymore. Do we need to process each record individually? Process tolerance.

Architecture 80

Architecture Scalability Google Operating System 80

O'Reilly

FEBRUARY 4, 2025

Tim OReilly, Managing the Bots That Are Managing the Business , MIT Sloan Management Review , May 21, 2016 In each of these waves, old skills became obsolescentstill useful but no longer essentialand new ones became the key to success. All of this happens through a process that Bessen calls learning by doing.

Programming 145

Programming Google Infrastructure Internet 145

SQL Performance

OCTOBER 14, 2020

In my examples I’ll continue using the sample databases TSQLV5 and PerformanceV5. In Part 4 of the series, which focused on optimization of derived tables, I described a process of unnesting/substitution of table expressions. You can find the script that creates and populates TSQLV5 here , and its ER diagram here. Employees ; GO.

C++ 52

C++ Servers Code Efficiency 52

Brendan Gregg

NOVEMBER 29, 2017

AWS EC2 uses a different image type and boot process for PV and HVM, as described on the [Linux AMI Virtualization Types] page. But not all workloads: some are network bound (proxies) and storage bound (databases). ## 5. This was extended to instance storage devices for the x1.32xlarge in 2016. The first was c3.

Virtualization 110

Virtualization AWS Hardware Storage 110

VoltDB

AUGUST 27, 2024

Volt Active Data (Volt) is a sophisticated real-time data platform intricately designed with multiple critical components, including high-speed data processing, in-memory storage, and ACID-compliant transactions. These exported records will be written to an external system (such as another database, CSV files, or another streaming platform).

Testing 52

Testing Database Network Systems 52

SQL Server According to Bob

NOVEMBER 8, 2016

SQL Server 2016 Service Pack 1 (all SKUs) , in combination with Windows Server 2016 (All SKUs) or Windows 10 Client introduces non-volatile memory support for the tail of the log file (LDF) which can significantly increase transaction throughput. Create / Alter Database … LOG ON. Tail Of Log Caching.

Cache 40

Cache Servers Media Storage 40

Adrian Cockcroft

JANUARY 29, 2023

I presented this analysis of response time distributions talk in 2016 — at Microxchg in Berlin ( video ). For high traffic systems, processing the individual response times for each request may be too much work. I’ve been thinking about this for a long time. > system.time(wait1 <- normalmixEM(waiting, mu=c(50,80), lambda=.5,

Lambda 98

Lambda Latency Cache C++ 98

SQL Performance

JULY 9, 2019

The ISO/IEC 9075:2016 standard (SQL:2016) defines a feature called nested window functions. For example, suppose that you want to query the Sales.OrderValues view in the TSQLV5 sample database, and return for each customer and order date, the daily total of the order values, and the running total until the current day.

Servers 83

Servers Availability Database Code 83

SQL Performance

JULY 16, 2019

From 2007 until 2016, Intel was able to successfully execute their Tick-Tock release strategy, where they would introduce a new processor microarchitecture roughly every two years (a Tock release). This made it easier for database professionals to make the case for a hardware upgrade, and made the typical upgrade more worthwhile.

Servers 46

Servers Hardware Architecture Retail 46

SQL Server According to Bob

JANUARY 26, 2017

Transparent Data Encryption (TDE) is a feature that was introduced in SQL Server 2008 (and is also available for Azure SQL Database, Azure SQL Data Warehouse, and Parallel Data Warehouse) with the purpose of encrypting your data at rest. That is to ensure your database is encrypted at the file level.

Servers 40

Servers Database Azure Cache 40

Adrian Cockcroft

JANUARY 31, 2023

I’d helped eBay recover from capacity related outages in 1999 and had setup their capacity planning processes. Many years later I re-wrote the simulator in Go and had some more fun with the concepts at Gophercon 2016. At the time eBay was one of the largest online businesses and was developing patterns that later became widely adopted.

Google 52

Google Transportation Programming Innovation 52

SQL Server According to Bob

APRIL 21, 2017

I recently visited a customer onsite and presented to them topics on SQL Server 2016. One question I got went like this “I’ve tried to restore a database on SQL Server using the WITH STATS option. We now have a new way of instrumenting the backup/restore process for any database or transaction log. 10 percent processed.

Servers 40

Servers Database Processing Virtualization 40

SQL Server According to Bob

APRIL 25, 2017

I recently visited a customer onsite and presented to them topics on SQL Server 2016. One question I got went like this “I’ve tried to restore a database on SQL Server using the WITH STATS option. We now have a new way of instrumenting the backup/restore process for any database or transaction log. 10 percent processed.

Servers 40

Servers Database Processing Virtualization 40

SQL Performance

DECEMBER 9, 2020

I mainly experimented with different table value constructor cardinalities, with serial versus parallel processing, and with row mode versus batch mode processing. You can create supporting tables in the user database if needed. The plan is serial, and all operators in the plan use row mode processing by default.

C++ 61

C++ Servers Testing Processing 61

SQL Performance

FEBRUARY 22, 2021

Our first warnings are usually spotted on a dashboard that plots log reader latency against transaction duration (I'll explain the points in time I labeled t 0 and t 1 shortly): They determined, let's say at time t 0 , that a certain session had an open transaction blocking the log reader process.

Latency 57

Latency Servers Monitoring Systems 57

Particular Software

OCTOBER 3, 2017

This article was originally published on the NDC 2016 Blog. These events can then be used to trigger other downstream business processes. In this model, the software system follows the natural business process. Repeat this process until you've captured all the important actions as events your monolith is performing.

Architecture 49

Architecture Database Code Systems 49

Alex Russell

MAY 9, 2022

Effective managers understand that products require processes to manage, yet front-end discourse assumes that switching frameworks will introduce a golden age. When sibling teams are brought in to integrate late in the process, attention to the cumulative experience may suffer. How did it get away from the team so quickly?

Performance 99

Performance Latency Metrics Engineering 99

Percona

JUNE 4, 2023

Introduction: MariaDB vs. MySQL The goal of this blog post is to evaluate, at a higher level, MariaDB vs. MySQL vs. Percona Server for MySQL side-by-side to better inform the decision making process. It is largely an unofficial response to published comments from the MariaDB Corporation. What is MariaDB?

Open Source 52

Open Source Servers Storage Scalability 52

SQL Performance

APRIL 23, 2019

This eliminated unnecessary row-mode processing, and removed the need for an exchange. SQL Server 2016 introduced serial batch mode processing and aggregate pushdown. The execution plan shows the result of fast-path pushdown processing as ‘locally aggregated rows’ with no corresponding row output from the scan.

Servers 67

Servers Testing Metrics Storage 67

Smashing Magazine

JANUARY 15, 2019

The Green Web Foundation maintains an ever-growing database of web hosts who are either wholly powered by renewable energy or are at least committed to being carbon neutral. For the more adventurous/technical, the top (table of processes) command provides similar metrics on most Unix-like operating systems such as macOS and Ubuntu.

Website Performance 78

Website Performance Website Energy Performance 78

Alex Russell

APRIL 29, 2021

At the time of the last Confluence run, the gap had stretched to nearly 1000 APIs, doubling since 2016. Helps media apps on the web save battery when doing video processing. Coordination APIs allow applications to save memory and processing power (albeit, most often in desktop and tablet form-factors). Compression Streams.

Media 145

Media Games Education Engineering 145

SQL Performance

SEPTEMBER 2, 2021

A lot of things change over the course of a few major versions of our favorite database platform. SQL Server 2016 brought us STRING_SPLIT , a native function that eliminates the need for many of the custom solutions we’ve needed before. STRING_SPLIT() in SQL Server 2016 : Follow-Up #1. It’s fast, too, but it’s not perfect.

C++ 46

C++ Servers Testing Performance 46

The Symphonia

DECEMBER 6, 2017

We don’t recommend using this as a regular process for production use, but it might come in handy at development time. Serverless Aurora promises to be the SQL Database to partner with Lambda that we’ve been hoping for. Also allows for creating new files in line. Step Functions. And again, this is a problem.

Serverless 40

Serverless Lambda AWS Traffic 40