Brendan Gregg

DECEMBER 31, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. A video of the talk is on youtube : The slides are on slideshare : I love this talk as I get to share more about what the Performance and Operating Systems team at Netflix does, rather than just my work.

Tuning 53

Tuning AWS Best Practices Network 53

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 103

Performance Latency Cache Virtualization 103

Brendan Gregg

DECEMBER 30, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. A video of the talk is on youtube : The slides are on slideshare : I love this talk as I get to share more about what the Performance and Operating Systems team at Netflix does, rather than just my work.

Tuning 52

Tuning AWS Best Practices Network 52

Brendan Gregg

SEPTEMBER 5, 2017

What follows are topics that may be of interest to anyone looking to migrate their systems and skillset: scan these to find topics that interest you. ## ZFS ZFS is available for Linux via the [zfsonlinux] and [OpenZFS] projects, and more recently was included in Canonical's Ubuntu Linux distribution: Ubuntu Xenial 16.04 LTS (April 2016).

Virtualization 75

Virtualization AWS Engineering Hardware 75

All Things Distributed

MAY 19, 2017

We decided to use our inventive powers to design and build a new database engine that would give database systems such as MySQL and PostgreSQL reliability and performance at scale, at a level that could serve even the most demanding OLTP applications.

Database 89

Database Design Cloud Storage 89

The Morning Paper

NOVEMBER 8, 2020

Back in 2017 the engineering team at Facebook had a problem. While ultimately this new system should be able to take advantage of the latest advances in consensus for improved performance, that’s not realistic given a 6-9 month in-production target. replacing Paxos with Raft), or they could be shims over external storage systems.

Virtualization 126

Virtualization Latency Storage Systems 126

Brendan Gregg

NOVEMBER 28, 2017

In this configuration, the AMI and boot is paravirt (PV), the kernel is making hypercalls instead of privileged instructions, and the system is using paravirt network and storage drivers. But not all workloads: some are network bound (proxies) and storage bound (databases). ## 5. The AMI and boot are now HVM.

Virtualization 40

Virtualization AWS Hardware Storage 40

All Things Distributed

OCTOBER 2, 2017

With these requirements in mind, and a willingness to question the status quo, a small group of distributed systems experts came together and designed a horizontally scalable distributed database that would scale out for both reads and writes to meet the long-term needs of our business. This was the genesis of the Amazon Dynamo database.

Internet 111

Internet Internet AWS Performance 111

Percona

MARCH 30, 2023

Further, open source databases can be modified in infinite ways, enabling institutions to meet their specific needs for data storage, retrieval, and processing. Non-relational databases: Instead of tables, non-relational (NoSQL) databases use document-based data storage, column-oriented storage, and graph databases.

Open Source 107

Open Source Database Storage Scalability 107

Percona

AUGUST 17, 2023

StackOverflow statistics show that 26% of developers preferred it in 2017, 34% in 2019, and 40% in 2021. In another survey, using multiple metrics for overall popularity, PostgreSQL ranks as the fourth most popular database management system ( DB-Engines, March 2023 ).

Open Source 98

Open Source Healthcare Social Media Database 98

All Things Distributed

DECEMBER 12, 2018

In April 2017, Amazon Web Services announced that it would launch a new AWS infrastructure region Region in Sweden. We help Supercell to quickly develop, deploy, and scale their games to cope with varying numbers of gamers accessing the system throughout the course of the day. Our AWS Europe (Stockholm) Region is open for business now.

AWS 119

AWS Cloud Games Serverless 119

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 52

Performance Latency Hardware Storage 52

Percona

JULY 7, 2023

Also, in general terms, a high availability PostgreSQL solution must cover four key areas: Infrastructure: This is the physical or virtual hardware database systems rely on to run. StackOverflow statistics show that 26% of developers preferred it in 2017, 34% in 2019, and 40% in 2021. Failover is essential to minimizing downtime.

Availability 98

Availability Open Source Architecture Database 98

SQL Server According to Bob

MAY 19, 2019

For example, Azure SQL Database Edge can already use TSQL Predict Machine Learning (ML) and Column Storage. The reduction effort started when we shipped SQL Server 2017 ( [link].) Partitioning allows SQL Server to scale to the largest systems with record-setting performance. SQL Server 2017. IO Request Caches.

IoT 61

IoT Servers Development Cache 61

SQL Performance

AUGUST 27, 2019

TPC-H Benchmark Results with SQL Server 2017. HPE has already submitted a new official TPC-H result on SQL Server 2017 for a single-socket, HPE Proliant DL325 Gen10 1U server that was 743,750 QphH@1000GB. This system has one AMD EPYC 7502P 32-core processor and 512GB of RAM. The price per QphH for this system is 0.34

Servers 52

Servers Benchmarking Virtualization Architecture 52

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Percona

SEPTEMBER 1, 2023

This blog was originally published in October 2017 and was updated in September 2023. Database architects working with MongoDB encounter specific challenges related to database systems and system growth. Sharding is a preferred approach for database systems facing substantial growth and needing high availability.

Best Practices 98

Best Practices Traffic Database Servers 98

SQL Performance

MARCH 17, 2020

It comes set to SQL Server 2008 compatibility (level 100), but we will start with a more modern setting of SQL Server 2017 (level 140): ALTER DATABASE StackOverflow2013 SET COMPATIBILITY_LEVEL = 140 ; The tests were performed on my laptop using SQL Server 2019 CU 2. This runs in 115ms using the same amount of CPU time. Final Thoughts.

Servers 86

Servers Tuning Database Efficiency 86

Percona

JUNE 4, 2023

This blog post was originally published in November 2017 and was updated in June 2023. Before we dive into the differences between MariaDB and MySQL, we will provide a thorough examination of each relational database management system (RDBMS). What is MariaDB? What is MySQL?

Open Source 52

Open Source Servers Storage Scalability 52

SQL Performance

MAY 1, 2020

I was a bit perplexed by this issue, since the system was certainly no slouch — plenty of cores, 3TB of memory, and XtremIO storage. Everything was on SQL Server 2017, so why was this setting so prevalent? writes/sec average throughput: 46.96 Here is a sample of the results: Partial results from CMS query.

C++ 58

C++ Database Servers Storage 58

SQL Performance

APRIL 8, 2019

Back on December 5, 2017, Microsoft announced that they were using AMD EPYC 7551 processors in their storage-optimized Lv2-Series virtual machines. They feature low latency, local NVMe storage that can directly leverage the 128 PCIe 3.0 Microsoft handles the storage account management for you when you use Azure Managed Disks.

Azure 42

Azure Virtualization Storage Benchmarking 42

Brendan Gregg

APRIL 14, 2022

offer letter logo (2014) flame graphs (2014) eBPF tools (2014-2019) PMC analysis (2017) my pandemic-abandoned desk (2020); office wall I joined Netflix in 2014, a company at the forefront of cloud computing with an attractive work culture. Netflix has been the best job of my career so far, and I'll miss my colleagues and the culture.

Java 52

Java Cloud Cache AWS 52

Alex Russell

APRIL 29, 2021

After 20 years of neck-in-neck competition, often starting from common code lineages, there just isn't that much left to wring out of the system. Consistent improvement is the name of the game, and it can still have positive impacts, particularly as users lean on the system more heavily over time. Where Chrome Has Lagged.

Media 145

Media Games Education Engineering 145

Alex Russell

OCTOBER 22, 2017

— Alex Russell (@slightlylate) October 4, 2017. Tools and CI systems help them monitor progress & prevent regressions. Some systems show median RTTs near ~100ms for 3G users. Given the conflicted data we see across our other systems, this seems about right as a baseline. Maybe "ambush by JS"? First Load.

Performance 74

Performance Network Benchmarking Mobile 74

Particular Software

MARCH 15, 2021

For NServiceBus systems, our SQL Persistence package allows you to use whatever flavor of SQL works best for you, supporting dialects for Microsoft SQL Server, MySQL, PostgreSQL, and Oracle. The same can be said for any system that uses SQL to store data. The other was added in October 2017 and is compatible with PostgreSQL.

Transportation 52

Transportation Azure Database Servers 52

The Morning Paper

JANUARY 19, 2020

STELLA: report from the SNAFU-catchers workshop on coping with complexity , Woods 2017, Coping with Complexity workshop. “Coping with complexity” is about as good a three-word summary of the systems and software challenges facing us over the next decade as I can imagine. A digression on complexity budgets.

C++ 50

C++ Systems Software Software 50

Enprowess

JANUARY 12, 2022

Other benefits: It has other benefits like a Quicker launch to the market, Easier distribution, saving device power and storage, seamless maintenance, and updating. Twitter Lite PWA : It was integrated as the standard User Interface in 2017. IoT tracking systems. Blockchain technology is an encrypted database storage system.

Blockchain 59

Blockchain IoT Development Serverless 59

SQL Performance

APRIL 23, 2019

Columnstore storage. To understand this, it is necessary to first review how columnstore storage works at a high level: A compressed row group contains a column segment for each column. Value encoding can reduce the number of bits required for storage by translating raw values using a base offset and magnitude modifier.

Servers 67

Servers Testing Metrics Storage 67

SQL Server According to Bob

DECEMBER 31, 2018

Using SQL Server Management Studio (SSMS) and storing the events in a table requires reading the events, streaming to table storage followed by an order by event sequence query. Large traces can encounter the 32-bit SSMS memory limitations. CREATE EVENT SESSION [EventSequence] ON SERVER ADD EVENT sqlserver. event_sequence , sqlserver.

Efficiency 40

Efficiency Code Servers Cache 40

SQL Server According to Bob

DECEMBER 18, 2018

Durability: “In database systems , durability is the ACID property which guarantees transactions that have committed will survive permanently. For example, if a flight booking reports that a seat has successfully been booked, then the seat will remain booked even if the system crashes.” – [link]. Starting with the Linux 4.18

Servers 90

Servers Media Cache Storage 90

Alex Russell

MARCH 6, 2021

TL;DR: A lot has changed since 2017 when we last estimated a global baseline resource per-page resource budget of 130-170KiB. A then-representative $200USD device had 4-8 slow (in-order, low-cache) cores, ~2GiB of RAM, and relatively slow MLC NAND flash storage. The Moto G4 , for example. Here begins our 2021 adventure. Hard Reset.

Performance 127

Performance Network Mobile Metrics 127

CSS Wizardry

APRIL 2, 2018

If I go down this path, I’ll need to start considering many other things such as storage, backups, compatible media players, and maybe even dedicated hardware. This is usually in the form of Spotify offline playlists, but over some decent quality earphones ( see below ). At home, I’m used to just streaming Spotify through an Amazon Echo.

Website 109

Website Media Hardware Monitoring 109

Tasktop

JUNE 25, 2020

When I joined Tasktop back in October of 2017, Tasktop was doing really well. It connects to 60+ tools to unlock the information within them, while seamlessly supporting the inevitable changes and disruptions in your environment (tool migrations, API changes, new security standards and policies, system outages, etc.).

Metrics 52

Metrics Education Innovation Software 52

O'Reilly

JULY 25, 2023

To provide some coherence to the music, I decided to use Taylor Swift songs since her discography covers the time span of most papers that I typically read: Her main albums were released in 2006, 2008, 2010, 2012, 2014, 2017, 2019, 2020, and 2022. This choice also inspired me to call my project Swift Papers.

Programming 98

Programming Code Design Benchmarking 98

Smashing Magazine

JANUARY 7, 2019

You could go as far as evaluating a framework (or any JavaScript library) on Sacha Greif’s 12-point scale scoring system by exploring features, accessibility, stability, performance, package ecosystem, community, learning curve, documentation, tooling, track record, team, compatibility, security for example. Are web fonts optimized?

Performance 111

Performance Cache Network Metrics 111

Percona

JANUARY 14, 2019

To simulate text messages I have used ~3 billion of reddit comments (10 years from 2007 to 2017), downloaded from pushshift.io. In a partitioned massively parallel database system, the storage format and sorting algorithm may not be optimized for that operation as we are reading multiple partitions in parallel. Conclusion.

Database 47

Database Analytics Blockchain Healthcare 47