All Things Distributed

OCTOBER 2, 2017

As we began growing the AWS business, we realized that external customers might find our Dynamo database just as useful as we found it within Amazon.com. So, we set out to build a fully hosted AWS database service based upon the original Dynamo design.

Internet 110

Internet Internet AWS Performance 110

All Things Distributed

JANUARY 6, 2016

In November, Amazon Web Services announced that it would launch a new AWS infrastructure region in South Korea. For example, Samsung Electronic Printing used AWS to deploy its Printing Apps Center in a way that didn’t require them to invest up-front capital and kept total costs quite low.

AWS 99

AWS Cloud Games Latency 99

High Scalability

JULY 20, 2018

A typical example of modern "microservices-inspired" Java application would function along these lines: Netflix : We observed during experimentation that RAM random read latencies were rarely higher than 1 microsecond whereas typical SSD random read speeds are between 100–500 microseconds. There are a few more quotes.

Internet 121

Internet Internet Scalability Automotive 121

High Scalability

AUGUST 17, 2018

coryodaniel : Rewrote an #AWS APIGateway & #lambda service that was costing us about $16000 / month in #elixir. 12 million requests / hour with sub-second latency, ~300GB of throughput / day. Keep on reading for many more quotes hot off the internet. Its running in 3 nodes that cost us about $150 / month. myelixirstatus !#Serverless.No

Internet 105

Internet Internet Scalability Games 105

All Things Distributed

JANUARY 18, 2012

a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Today is a very exciting day as we release Amazon DynamoDB , a fast, highly reliable and cost-effective NoSQL database service designed for internet scale applications. Amazon DynamoDB offers low, predictable latencies at any scale. Comments ().

Scalability 162

Scalability Database Ecommerce Latency 162

All Things Distributed

MARCH 2, 2011

Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo) Region. Today Amazon Web Services is expanding its world-wide coverage with the launch of a new AWS Region located in Tokyo, Japan. The advanced Asia Pacific network infrastructure also makes the AWS Tokyo Region a viable low-latency option for customers from South Korea.

AWS 92

AWS Cloud Games Latency 92

The Netflix TechBlog

SEPTEMBER 10, 2024

Where aws ends and the internet begins is an exercise left to the reader. Dynomite is a Netflix open source wrapper around Redis that provides a few additional features like auto-sharding and cross-region replication, and it provided Pushy with low latency and easy record expiry, both of which are critical for Pushy’s workload.

Latency 230

Latency Cache Tuning Efficiency 230

The Netflix TechBlog

FEBRUARY 18, 2022

While a mobile device is almost always connected to the internet and reachable, a smart TV is only online while in use. Scaling Policies To address the thundering herd problem and to keep latencies under acceptable thresholds, the cluster scale-up policies are configured to be more aggressive than the scale-down policies.

Systems 334

Systems Traffic Architecture Mobile 334

Adrian Cockcroft

MAY 6, 2023

Then they tried to scale it to cope with high traffic and discovered that some of the state transitions in their step functions were too frequent, and they had some overly chatty calls between AWS lambda functions and S3. which provides this as a service and where the chief architect and CTO are both ex-Netflix colleagues of mine.

Serverless 145

Serverless Lambda Best Practices Traffic 145

All Things Distributed

JUNE 21, 2018

In fact, this is been proven by our customers as Amazon Aurora remains the fastest growing service in AWS history. We are increasingly seeing customers wanting to build Internet-scale applications that require diverse data models. The opposite is true. What we experienced at Amazon.com was using a database beyond its intended purpose.

Database 167

Database AWS Games Latency 167

All Things Distributed

DECEMBER 5, 2010

DNS is one of the fundamental building blocks of internet applications and was high on the wish list of our customers for some time already. Route 53 has the business properties that you have come to expect from an AWS service: fully self-service and programmable, with transparent pay-as-you-go pricing and no minimum usage commitments.

Cloud 112

Cloud Internet Internet AWS 112

All Things Distributed

JULY 14, 2015

In just three short years, Amazon DynamoDB has emerged as the backbone for many powerful Internet applications such as AdRoll , Druva , DeviceScape , and Battlecamp. You can enable the DynamoDB Streams feature for a table with just a few clicks using the AWS Management Console, or you can use the DynamoDB API. DynamoDB Streams.

Database 158

Database Lambda AWS IoT 158

All Things Distributed

OCTOBER 16, 2019

But they usually have little to no internet connection, making the challenge of exploring environments inhospitable for humans seem even more impossible. The answer to this question is actually on your phone, your smartwatch, and billions of other places on earth—it's the Internet of Things (IoT).

IoT 120

IoT Healthcare Internet Internet 120

All Things Distributed

NOVEMBER 15, 2010

For example, the most fundamental abstraction trade-off has always been latency versus throughput. Modern CPUs strongly favor lower latency of operations with clock cycles in the nanoseconds and we have built general purpose software architectures that can exploit these low latencies very well. Where to go from here?

AWS 125

AWS Programming Latency Architecture 125

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., Ford, et al., “TCP on Upcoming Sapphire Rapids CPUs,” [link] Oct 2020 - [Liu 20] Linda Liu, “Samsung QVO vs EVO vs PRO: What’s the Difference?

Performance 121

Performance Latency Hardware Storage 121

All Things Distributed

JULY 13, 2010

In particular this has been true for applications based on algorithms - often MPI-based - that depend on frequent low-latency communication and/or require significant cross sectional bandwidth. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Countdown to What is Next in AWS.

Cloud 98

Cloud AWS Automotive Latency 98

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. Colleagues/Internet I love using [Linux performance tools]. But I also love solving issues quickly, and sometimes that means just asking colleagues or searching the Internet.

Speed 103

Speed Java AWS Virtualization 103

All Things Distributed

APRIL 9, 2015

Details on the AWS Blog. AWS has been offering a range of storage solutions: objects, block storage, databases, archiving, etc. When we designed Amazon EFS we decided to build along the AWS principles: Elastic, scalable, highly available, consistent performance, secure, and cost-effective. Details on the AWS Blog.

Lambda 104

Lambda Cloud IoT AWS 104

All Things Distributed

OCTOBER 12, 2016

Three years ago, as part of our AWS Fast Data journey we introduced Amazon ElastiCache for Redis , a fully managed in-memory data store that operates at sub-millisecond latency. This allows for faster failover times while minimizing latency. The client keeps a map of Redis nodes, which is updated in case of failover.

Scalability 102

Scalability Cache Analytics AWS 102

All Things Distributed

JUNE 21, 2017

You can add DAX to your existing DynamoDB applications with just a few clicks in the AWS Management Console – no application rewrites required. Based on this experience and learning, we built DynamoDB to be a fast, highly scalable NoSQL database to meet the needs of Internet-scale applications. We are major users of DynamoDB.

Speed 95

Speed Cache Latency AWS 95

All Things Distributed

JULY 11, 2011

As a part of that process, we also realized that there were a number of latency sensitive or location specific use cases like Hadoop, HPC, and testing that would be ideal for Spot. To get started using Spot or for more details visit the Amazon EC2 Spot Instance web page, the AWS developer blog , and the EC2 Release Notes. Contact Info.

AWS 70

AWS Storage Cloud Big Data 70

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 103

Performance Latency Cache Virtualization 103

Scalegrid

JUNE 7, 2024

Its compatibility with MQTT, known for being a compact messaging protocol, Demonstrates its adaptability for use in Internet of Things (IoT) contexts. While ensuring that messages are durable brings several advantages, it’s important to note that it doesn’t significantly degrade performance regarding throughput or latency.

IoT 130

IoT Software Architecture Architecture Scalability 130

All Things Distributed

FEBRUARY 24, 2010

Achieving strict consistency can come at a cost in update or read latency, and may result in lower throughput. Amazon S3 and Amazon SimpleDB are examples of AWS services that are designed using these high-availability principles using an eventual consistency model. Lowest read latency. Higher read latency. No stale reads.

AWS 63

AWS Latency Database Scalability 63

All Things Distributed

NOVEMBER 19, 2010

Understanding Throughput-Oriented Architectures - background article in CACM on massively parallel and throughput vs latency oriented architectures. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications.

AWS 62

AWS Cloud Benchmarking Storage 62

Smashing Magazine

AUGUST 20, 2021

I had my website with funny photos and links to favorite websites live on the internet, and better yet, I could edit directly on the server. It’s safe to say WordPress, the platform now powering 40% of the internet, won that battle, but MovableType paved the way for Jamstack CMSs in the future. But, when it worked, it was magical.

Ecommerce 142

Ecommerce Website Government Internet 142

All Things Distributed

DECEMBER 12, 2013

Moreover, a GSI''s performance is designed to meet DynamoDB''s single digit millisecond latency - you can add items to a Users table for a gaming app with tens of millions of users with UserId as the primary key, but retrieve them based on their home city, with no reduction in query performance.

Games 108

Games Scalability Database Retail 108

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. Colleagues/Internet I love using Linux performance tools. But I also love solving issues quickly, and sometimes that means just asking colleagues or searching the Internet.

Speed 52

Speed Java AWS Virtualization 52

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., Ford, et al., “TCP on Upcoming Sapphire Rapids CPUs,” [link] Oct 2020 - [Liu 20] Linda Liu, “Samsung QVO vs EVO vs PRO: What’s the Difference?

Performance 52

Performance Latency Hardware Storage 52

Scalegrid

JANUARY 12, 2024

With extensive computational resources at their disposal alongside massive pools of information, developers can utilize these powerful tools to train ML models efficiently or run AI algorithms effectively by accessing stored datasets from anywhere through the internet connection provided by most reputable providers’ hosting services.

Cloud 130

Cloud Virtualization Storage Efficiency 130

VoltDB

JUNE 1, 2017

Latency Optimizers” – need support for very large federated deployments. 5G expects a latency of 1ms , which considering that the speed of light means the data center can’t be more than 186 miles away, or 93 miles for a round trip, assuming an instant response. The “Public Private Cloud” folks.

Hardware 56

Hardware Latency Virtualization Cloud 56

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. Colleagues/Internet I love using [Linux performance tools]. But I also love solving issues quickly, and sometimes that means just asking colleagues or searching the Internet.

Speed 40

Speed Java AWS Virtualization 40

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Brendan Gregg

SEPTEMBER 5, 2017

Here's some output from my zfsdist tool, in bcc/BPF, which measures ZFS latency as a histogram on Linux: # zfsdist. Tracing ZFS operation latency. The odd time we hit them, we'll take the "oops message" – a dump of the kernel stack trace and other details from the system log – and search the Internet.

Virtualization 75

Virtualization AWS Engineering Hardware 75

VoltDB

JUNE 1, 2017

Latency Optimizers” – need support for very large federated deployments. 5G expects a latency of 1ms , which considering that the speed of light means the data center can’t be more than 186 miles away, or 93 miles for a round trip, assuming an instant response. The “Public Private Cloud” folks.

Hardware 40

Hardware Latency Virtualization Cloud 40

All Things Distributed

JUNE 20, 2017

Today, I am very excited to announce our plans to open a new AWS Region in Hong Kong! The new region will give Hong Kong-based businesses, government organizations, non-profits, and global companies with customers in Hong Kong, the ability to leverage AWS technologies from data centers in Hong Kong.

AWS 126

AWS Logistics Cloud Social Media 126

All Things Distributed

NOVEMBER 5, 2015

Yesterday, AWS evangelist Jeff Barr wrote that AWS will be opening a region in South Korea in early 2016 that will be our 5th region in Asia Pacific. The AWS UK region will be our third in the European Union (EU), and we're shooting to have it ready by the end of 2016 (or early 2017).

AWS 167

AWS Retail Entertainment IoT 167