All Things Distributed

AUGUST 24, 2012

By Werner Vogels on 24 August 2012 04:00 PM. The AWS team launched this week Amazon Glacier , a cold storage archive service at the very low price point of $0.01 The Five-Minute Rule Ten Years Later, and Other Computer Storage Rules of Thumb , Jim Gray and Goetz Graefe, ACM SIGMOD Record 26 (4): 63â??68, Comments ().

Storage 87

Storage Hardware AWS Data Engineering 87

All Things Distributed

MAY 8, 2012

By Werner Vogels on 08 May 2012 02:00 PM. of administrative tasks such as OS and database software patching, storage management, and implementing reliable backup and disaster recovery solutions. Amazon RDS currently supports SQL Server 2008 R2 and plans to add support for SQL Server 2012 later this year. All Things Distributed.

Cloud 94

Cloud Development AWS Servers 94

All Things Distributed

JULY 19, 2012

By Werner Vogels on 19 July 2012 12:00 AM. Magnetic disks are rapidly starting to exhibit tape-like properties and with modern workloads being increasingly random, they are becoming less and less suitable as a storage system. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems. Comments ().

Cloud 116

Cloud Performance AWS Virtualization 116

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on.

Performance 121

Performance Latency Hardware Storage 121

All Things Distributed

DECEMBER 27, 2012

By Werner Vogels on 27 December 2012 12:00 PM. S3 is not only a highly reliable and available storage service but also one of the most powerful web serving engines that exists today. Root Domain Support for Amazon S3 Website Hosting. Comments ().

Website 102

Website Traffic Storage Scalability 102

All Things Distributed

SEPTEMBER 25, 2012

By Werner Vogels on 25 September 2012 06:00 PM. Following the huge success of being able to provision a consistent, user-requested I/O rate for DynamoDB and Elastic Block Store (EBS), the AWS Database Services team has now released Provisioned IOPS, a new high performance storage option for the Amazon Relational Database Service (Amazon RDS).

Cloud 95

Cloud AWS Storage Database 95

Brendan Gregg

NOVEMBER 29, 2017

In this configuration, the AMI and boot is paravirt (PV), the kernel is making hypercalls instead of privileged instructions, and the system is using paravirt network and storage drivers. But not all workloads: some are network bound (proxies) and storage bound (databases). ## 5. The AMI and boot are now HVM.

Virtualization 110

Virtualization AWS Hardware Storage 110

All Things Distributed

JANUARY 18, 2012

By Werner Vogels on 18 January 2012 07:00 AM. In response, we began to develop a collection of storage and database technologies to address the demanding scalability and reliability requirements of the Amazon.com ecommerce platform. s pricing is simple and predictable: Storage is $1 per GB per month. Amazon DynamoDB â??

Scalability 162

Scalability Database Ecommerce Latency 162

All Things Distributed

JULY 16, 2012

By Werner Vogels on 16 July 2012 09:00 AM. There are sessions in many different categories: Architecture, Big Data, HPC, Computer & Networking, Storage, Databases, Security, Tools & Languages, Media Sharing & Content Delivery, Managing AWS Resources, Enterprise IT, Mobile, Start-up, and more. All Things Distributed.

AWS 69

AWS Big Data Media Storage 69

All Things Distributed

OCTOBER 8, 2014

The best part is that we are also significantly expanding the free tier many of you already enjoy by increasing the storage to 25 GB and throughput to 200 million requests per month. More than a decade ago, Amazon embarked on a mission to build a distributed system that challenged conventional methods of data storage and querying.

Availability 124

Availability Performance Scalability AWS 124

All Things Distributed

OCTOBER 2, 2017

With these goals in mind, In January, 2012 we launched Amazon DynamoDB , our cloud-based NoSQL database service designed from the ground up to support extreme scale, with the security, availability, performance and manageability needed to run mission-critical workloads. Manageable – The service would need to be easy to manage and operate.

Internet 111

Internet Internet AWS Performance 111

All Things Distributed

FEBRUARY 15, 2013

As you may remember from our announcement at re: Invent in November 2012, Amazon Redshift is a fast and powerful, fully managed, petabyte-scale data warehouse service that delivers fast query performance at less than one tenth the cost of most traditional data warehouse systems. Amazon Redshift and Designing for Resilience. Comments ().

Design 87

Design AWS Storage Systems 87

All Things Distributed

SEPTEMBER 14, 2012

By Werner Vogels on 14 September 2012 05:00 PM. That goes especially for the interaction between applications and storage engines, and between applications and databases. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems. Back-to-the-Future Weekend Reading - CryptDB. Comments ().

Operating System 68

Operating System Storage Scalability Database 68

O'Reilly

SEPTEMBER 19, 2023

It progressed from “raw compute and storage” to “reimplementing key services in push-button fashion” to “becoming the backbone of AI work”—all under the umbrella of “renting time and storage on someone else’s computers.” ” (It will be easier to fit in the overhead storage.)

Hardware 134

Hardware Storage Big Data Blockchain 134

All Things Distributed

SEPTEMBER 6, 2013

Due to the exponential growth of the biology and informatics fields, Unilever needs to maintain this new program within a highly-scalable environment that supports parallel computation and heavy data storage demands. Tom Tom – Founded in 1991, TomTom is a leading provider of navigation and location-based products and services.

Cloud 102

Cloud Energy AWS Healthcare 102

All Things Distributed

MARCH 20, 2012

By Werner Vogels on 20 March 2012 09:00 PM. re seeking ultimate flexibility, AWS allows you to interact with services such as Amazon Elastic Compute Cloud ( Amazon EC2 ) and Amazon Simple Storage Service ( Amazon S3 ) directly and to piece these services together in a building block fashion. All Things Distributed. Comments ().

AWS 84

AWS Scalability Java Storage 84

All Things Distributed

APRIL 5, 2012

By Werner Vogels on 06 April 2012 06:00 AM. We consulted directly with Amazon and learned that the storage and the DB Server size affected I/O throughput – after altering our size we dropped our load time to 1 hour which was within expectations relative to native database. Comments ().

Innovation 112

Innovation AWS Education Network 112

All Things Distributed

AUGUST 16, 2012

By Werner Vogels on 16 August 2012 10:00 AM. An apples to apples comparison of the costs associated with running various usage patterns on-premises and with AWS requires more than a simple comparison of hardware expense versus always-on utility pricing for compute and storage. All Things Distributed. Comments ().

AWS 99

AWS Hardware Traffic Best Practices 99

All Things Distributed

MAY 15, 2014

We are rapidly entering into an era where massive computing power, digital storage and global network connections can be deployed by anyone as quickly and easily as turning on the lights. This is an extended version of an article that appeared in the Guardian today.

Cloud 112

Cloud AWS Innovation Government 112

Tim Kadlec

JANUARY 9, 2019

Ballooning bandwidth and storage have fostered complacency that we can do without. In a 2012 paper, The American Council for an Energy-Efficient Economy estimated the internet uses 5 kWh on average to support every GB of data. Performance is conservation. Again, this isn’t hyperbole. Let’s run with that for a second.

Performance 111

Performance Energy Internet Internet 111

Brendan Gregg

FEBRUARY 28, 2023

Titus, the Netflix container management platform, is now open source,” [link] Apr 2018 - [Cutress 19] Dr. [link] 2021 - [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] Apr 2021 - [Ghigoff 21] Yoann Ghigoff, et al., "BMC:

Performance 103

Performance Latency Cache Virtualization 103

Percona

JUNE 6, 2023

This blog was originally published in January 2012 and was updated in June 2023. Increased Storage Requirements : One of the disadvantages of full backups is the increased storage requirements due to the fact that they capture a complete copy of all data and files. What is an incremental backup? What is an incremental backup?

Storage 70

Storage Strategy Network Efficiency 70

SQL Performance

MAY 16, 2019

For SQL Server 2012 and earlier, this means 5 extra bytes per row are included in the data size calculation: One byte for an internal bit flag, and four bytes for the uniquifier (used in the calculation even for unique indexes, which do not store a uniquifier ). . [ SQL Server 2012. fn_dblog ( NULL , NULL ) AS FD WHERE.

Cache 67

Cache Servers Testing Storage 67

All Things Distributed

JUNE 21, 2017

DynamoDB has come a long way in the 5 years since we announced its availability in January 2012. DynamoDB was the first service at AWS to use SSD storage. You can add DAX to your existing DynamoDB applications with just a few clicks in the AWS Management Console – no application rewrites required.

Speed 95

Speed Cache Latency AWS 95

SQL Server According to Bob

SEPTEMBER 26, 2016

When we released Always On Availability Groups in SQL Server 2012 as a new and powerful way to achieve high availability, hardware environments included NUMA machines with low-end multi-core processors and SATA and SAN drives for storage (some SSDs).

Availability 40

Availability Servers Hardware Benchmarking 40

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on.

Performance 52

Performance Latency Hardware Storage 52

SQL Performance

MAY 1, 2019

For SQL Server 2012 and earlier , the transition point for this particular table is 898 rows. The way the calculation is performed is slightly different in SQL Server 2012 and earlier compared with SQL Server 2014 and later. In SQL Server 2012 and earlier, the calculation is performed by sqllang!OptimizerUtil::ComputeRowLength.

Servers 47

Servers Database Testing Performance 47

SQL Server According to Bob

JUNE 3, 2016

Use SQL Server Management Studio (SSMS) or your favorite query editor to connect to a SQL Server 2012 or 2014 instance. 32GB RAM, 4 Core Hyper-threaded enabled 2.8Ghz, SSD Storage. The DBCC CheckDB demonstration loads a table and demonstrates the performance improvement. Paste the script below in a new query window. or newer release.

Hardware 40

Hardware Servers Cache Software Engineering 40

Brendan Gregg

NOVEMBER 28, 2017

In this configuration, the AMI and boot is paravirt (PV), the kernel is making hypercalls instead of privileged instructions, and the system is using paravirt network and storage drivers. But not all workloads: some are network bound (proxies) and storage bound (databases). ## 5. The AMI and boot are now HVM.

Virtualization 40

Virtualization AWS Hardware Storage 40

Percona

JUNE 4, 2023

MariaDB retains compatibility with MySQL, offers support for different programming languages, including Python, PHP, Java, and Perl, and works with all major open source storage engines such as MyRocks, Aria, and InnoDB. GA 11 April 2012 5.5.23 MariaDB Server includes many storage engines beyond the default InnoDB.

Open Source 52

Open Source Servers Storage Scalability 52

Alex Russell

JULY 14, 2021

Here, native apps are doing work related to their core function; storage and tracking of user data are squarely within the four corners of the app's natural responsibilities. From at least 2012, Apple has deigned to allow "competing browsers" in its App Store.

Google 134

Google Mobile Engineering Internet 134

Brendan Gregg

FEBRUARY 28, 2023

Titus, the Netflix container management platform, is now open source,” [link] , Apr 2018 [Cutress 19] Dr. [link] , 2021 [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] , Apr 2021 [Ghigoff 21] Yoann Ghigoff, et al.,

Performance 52

Performance Latency Cache Virtualization 52

SQL Performance

AUGUST 23, 2019

There have been major improvements since the first appearance of the batch mode execution engine in SQL Server 2012. This article is about batch mode bitmaps, which have a very different implementation. The details given here apply to SQL Server 2017 — the most recently released version at the time of writing.

Servers 75

Servers Engineering Efficiency Retail 75

Smashing Magazine

NOVEMBER 8, 2018

In this article, I will describe this latter solution, based on a WordPress application storing files on Amazon Web Services (AWS) Simple Storage Service (S3) (a cloud object storage solution to store and retrieve data), operating through the AWS SDK. Conclusion.

AWS 45

AWS Servers Storage Cloud 45

SQL Performance

APRIL 23, 2019

In SQL Server 2012, grouped (vector) aggregation was able to use parallel batch-mode execution, but only for the partial (per-thread) aggregate. Columnstore storage. To understand this, it is necessary to first review how columnstore storage works at a high level: A compressed row group contains a column segment for each column.

Servers 67

Servers Testing Metrics Storage 67

ScaleOut Software

MAY 15, 2014

For example, the IMDG must be able to efficiently create millions of objects in each server to make use of its huge storage capacity. High availability apparently is not available on Windows Server 2008R2 Standard Edition and requires Enterprise Edition, which can cost about $2,800 more per server, or you must upgrade to Windows Server 2012.)

Cache 40

Cache Servers Network Design 40

All Things Distributed

DECEMBER 18, 2012

The Back-to-Basics Readings of 2012. By Werner Vogels on 18 December 2012 10:00 PM. Aug 24 - The Five-Minute Rule Ten Years Later, and Other Computer Storage Rules of Thumb , Jim Gray and Goetz Graefe, ACM SIGMOD Record 26 (4): 63â??68, All Things Distributed. Comments (). Goetz Graefe, ACM Queue 6(4): 40-52 (2008).

Operating System 131

Operating System Cache AWS Scalability 131