All Things Distributed

JANUARY 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 18 January 2012 07:00 AM. The original Dynamo design was based on a core set of strong distributed systems principles resulting in an ultra-scalable and highly reliable database system. All Things Distributed. Comments ().

Scalability 162

Scalability Database Ecommerce Latency 162

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 121

Performance Latency Hardware Storage 121

All Things Distributed

MAY 8, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 08 May 2012 02:00 PM. of administrative tasks such as OS and database software patching, storage management, and implementing reliable backup and disaster recovery solutions. All Things Distributed. Comments ().

Cloud 94

Cloud Development AWS Servers 94

All Things Distributed

MARCH 5, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 05 March 2012 02:01 PM. AWS today announced a substantial price drop from March 1, 2012 for many of the Amazon EC2, Amazon RDS, and Amazon ElastiCache instances types around the world. All Things Distributed. Comments ().

AWS 92

AWS Innovation Cache Scalability 92

All Things Distributed

AUGUST 24, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 24 August 2012 04:00 PM. The AWS team launched this week Amazon Glacier , a cold storage archive service at the very low price point of $0.01 Back-to-Basics Weekend Reading - The 5 Minute Rule. Comments (). per GB/month.

Storage 86

Storage Hardware AWS Data Engineering 86

All Things Distributed

DECEMBER 27, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 27 December 2012 12:00 PM. S3 is not only a highly reliable and available storage service but also one of the most powerful web serving engines that exists today. All Things Distributed. My Best Christmas Present â?? Comments ().

Website 102

Website Traffic Storage Scalability 102

Brendan Gregg

NOVEMBER 29, 2017

In this configuration, the AMI and boot is paravirt (PV), the kernel is making hypercalls instead of privileged instructions, and the system is using paravirt network and storage drivers. But not all workloads: some are network bound (proxies) and storage bound (databases). ## 5. The AMI and boot are now HVM.

Virtualization 110

Virtualization AWS Hardware Storage 110

All Things Distributed

SEPTEMBER 25, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 25 September 2012 06:00 PM. Amazon RDS Provisioned IOPS is ideal for mission-critical online transaction processing (OLTP) workloads that require a high performance storage option with consistent IOPS, within a narrow band of tolerance.

Cloud 95

Cloud AWS Storage Database 95

All Things Distributed

JULY 16, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 16 July 2012 09:00 AM. General registration opens up on July 25, 2012, however active AWS customers will get a chance to jump the line and start registering on July 20. All Things Distributed. Register for AWS re: Invent. Comments ().

AWS 69

AWS Big Data Media Storage 69

All Things Distributed

FEBRUARY 15, 2013

Werner Vogels weblog on building scalable and robust distributed systems. Amazon Redshift uses local attached storage to deliver high IO performance. This combination of in-cluster replication and continuous backup to Amazon S3 ensures you have a highly durable system. This is all entirely transparent to the running system.

Design 87

Design AWS Storage Systems 87

All Things Distributed

OCTOBER 8, 2014

The best part is that we are also significantly expanding the free tier many of you already enjoy by increasing the storage to 25 GB and throughput to 200 million requests per month. More than a decade ago, Amazon embarked on a mission to build a distributed system that challenged conventional methods of data storage and querying.

Availability 123

Availability Performance Scalability AWS 123

All Things Distributed

OCTOBER 2, 2017

With these requirements in mind, and a willingness to question the status quo, a small group of distributed systems experts came together and designed a horizontally scalable distributed database that would scale out for both reads and writes to meet the long-term needs of our business. This was the genesis of the Amazon Dynamo database.

Internet 110

Internet Internet AWS Performance 110

All Things Distributed

SEPTEMBER 14, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 14 September 2012 05:00 PM. That goes especially for the interaction between applications and storage engines, and between applications and databases. All Things Distributed. Back-to-the-Future Weekend Reading - CryptDB. Comments ().

Operating System 68

Operating System Storage Scalability Database 68

All Things Distributed

APRIL 5, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 06 April 2012 06:00 AM. All Things Distributed. Customer Conversations - How Intuit and Edmodo Innovate using Amazon RDS. Comments ().

Innovation 112

Innovation AWS Education Network 112

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 103

Performance Latency Cache Virtualization 103

All Things Distributed

MARCH 20, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 20 March 2012 09:00 PM. AWS Elastic Beanstalk now supports PHP applications (in addition to Java) and the ability to deploy through the popular Git version control system. All Things Distributed. A Thousand Platforms. Comments ().

AWS 84

AWS Scalability Java Storage 84

Percona

JUNE 6, 2023

This blog was originally published in January 2012 and was updated in June 2023. Full backups are most suitable for critical systems or sensitive data that cannot afford any loss or downtime, allowing for a complete recovery of data in the event of data corruption, hacking, system failures, or natural disasters.

Storage 70

Storage Strategy Network Efficiency 70

O'Reilly

SEPTEMBER 19, 2023

It progressed from “raw compute and storage” to “reimplementing key services in push-button fashion” to “becoming the backbone of AI work”—all under the umbrella of “renting time and storage on someone else’s computers.” ” (It will be easier to fit in the overhead storage.)

Hardware 100

Hardware Storage Big Data Blockchain 100

All Things Distributed

AUGUST 16, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 16 August 2012 10:00 AM. All Things Distributed. Total Cost of Ownership and the Return on Agility. Comments ().

AWS 98

AWS Hardware Traffic Best Practices 98

All Things Distributed

JUNE 21, 2017

DynamoDB has come a long way in the 5 years since we announced its availability in January 2012. DynamoDB was the first service at AWS to use SSD storage. You can add DAX to your existing DynamoDB applications with just a few clicks in the AWS Management Console – no application rewrites required.

Speed 95

Speed Cache Latency AWS 95

Alex Russell

JULY 14, 2021

The predominant desktop situation is relatively straightforward: Browsers handle links, and non-browsers defer loading http and https URLs to the system, which in turn invokes the default browser. Instead, they load content referred by their hosting native app in system-provided WebViews. The Baseline Scenario #.

Google 134

Google Mobile Engineering Internet 134

Alex Russell

MARCH 6, 2021

A then-representative $200USD device had 4-8 slow (in-order, low-cache) cores, ~2GiB of RAM, and relatively slow MLC NAND flash storage. The cheapest (high volume) Androids perform like 2012/2013 iPhones, respectively. low-end Androids have finally caught up to the iPhone 5 from 2012. The Moto G4 , for example.

Performance 127

Performance Network Mobile Metrics 127

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 52

Performance Latency Hardware Storage 52

Percona

JUNE 4, 2023

Before we dive into the differences between MariaDB and MySQL, we will provide a thorough examination of each relational database management system (RDBMS). While originally designed to be a drop-in replacement for MySQL, it evolved into its own distinct database management system and is now maintained and supported by the MariaDB Foundation.

Open Source 52

Open Source Servers Storage Scalability 52

SQL Server According to Bob

JUNE 3, 2016

Use SQL Server Management Studio (SSMS) or your favorite query editor to connect to a SQL Server 2012 or 2014 instance. Note: You may need to execute the dbcc a second time so buffer cache is hot, eliminating I/O sub-system variants. 32GB RAM, 4 Core Hyper-threaded enabled 2.8Ghz, SSD Storage. or newer release. SQL Server.

Hardware 40

Hardware Servers Cache Software Engineering 40

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Brendan Gregg

NOVEMBER 28, 2017

In this configuration, the AMI and boot is paravirt (PV), the kernel is making hypercalls instead of privileged instructions, and the system is using paravirt network and storage drivers. But not all workloads: some are network bound (proxies) and storage bound (databases). ## 5. The AMI and boot are now HVM.

Virtualization 40

Virtualization AWS Hardware Storage 40

SQL Performance

APRIL 23, 2019

In SQL Server 2012, grouped (vector) aggregation was able to use parallel batch-mode execution, but only for the partial (per-thread) aggregate. Columnstore storage. To understand this, it is necessary to first review how columnstore storage works at a high level: A compressed row group contains a column segment for each column.

Servers 67

Servers Testing Metrics Storage 67

Smashing Magazine

NOVEMBER 8, 2018

In this article, I will describe this latter solution, based on a WordPress application storing files on Amazon Web Services (AWS) Simple Storage Service (S3) (a cloud object storage solution to store and retrieve data), operating through the AWS SDK. Conclusion.

AWS 45

AWS Servers Storage Cloud 45

ScaleOut Software

MAY 15, 2014

For example, the IMDG must be able to efficiently create millions of objects in each server to make use of its huge storage capacity. We believe that installing our software should be as straightforward as we can make it, requiring minimal knowledge of the host operating system and the fewest possible explicit configuration settings.

Cache 40

Cache Servers Network Design 40

O'Reilly

JULY 25, 2023

To provide some coherence to the music, I decided to use Taylor Swift songs since her discography covers the time span of most papers that I typically read: Her main albums were released in 2006, 2008, 2010, 2012, 2014, 2017, 2019, 2020, and 2022. This choice also inspired me to call my project Swift Papers.

Programming 98

Programming Code Design Benchmarking 98

All Things Distributed

DECEMBER 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. The Back-to-Basics Readings of 2012. By Werner Vogels on 18 December 2012 10:00 PM. I am pretty sure some if not all of these papers deserved to be elected to the hall of fame of best papers in distributed systems. All Things Distributed.

Operating System 131

Operating System Cache AWS Scalability 131

Percona

JANUARY 14, 2019

In a partitioned massively parallel database system, the storage format and sorting algorithm may not be optimized for that operation as we are reading multiple partitions in parallel. ClickHouse is a great massively parallel analytical system. blockade','arizona'] ? ? protests','occupy','romney','weiner','protesters'] ? ?

Database 40

Database Analytics Blockchain Efficiency 40