High Scalability

SEPTEMBER 8, 2018

RISELabs , those wonderfully innovative folks over at Berkeley, have uplifted their Anna datatabase —a shared-nothing, thread-per-core architecture to achieve lightning-fast speeds by avoiding all coordination mechanisms—to become cloud-aware. No, I don’t think that is because AWS is earning a 355x margin on DynamoDB!

Storage 199

Storage Performance AWS Cloud 199

Dynatrace

OCTOBER 4, 2022

A data lakehouse features the flexibility and cost-efficiency of a data lake with the contextual and high-speed querying capabilities of a data warehouse. Data lakehouses ingest large structured and unstructured data volumes at a very high speed in their raw, native form. Data lakehouses deliver the query response with minimal latency.

Artificial Intelligence 246

Artificial Intelligence Storage Analytics Government 246

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. Measuring the speed of time Is there already a microbenchmark for os::javaTimeMillis()? Aftermath I provided details to AWS and Canonical, and then moved onto the other performance issues as part of the migration.

Speed 103

Speed Java AWS Virtualization 103

All Things Distributed

MARCH 2, 2011

Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo) Region. Today Amazon Web Services is expanding its world-wide coverage with the launch of a new AWS Region located in Tokyo, Japan. The advanced Asia Pacific network infrastructure also makes the AWS Tokyo Region a viable low-latency option for customers from South Korea.

AWS 92

AWS Cloud Games Latency 92

The Netflix TechBlog

SEPTEMBER 24, 2021

Uploading and downloading data always come with a penalty, namely latency. Figure 3: Video Processing with Index and Virtual Assembly Using virtual assembly greatly improves the latency performance of the ProRes 422 HQ proxy generation by removing one round trip of cloud downloading and cloud uploading by the physical assembler.

Cloud 242

Cloud Media Storage Cache 242

The Netflix TechBlog

NOVEMBER 3, 2022

In that scenario, the system would need to deal with the data propagation latency directly, for example, by use of timeouts or client-originated update tracking mechanisms. We started seeing increased response latencies and leader servers running at dangerously high utilization.

Cache 233

Cache Latency Traffic Systems 233

The Netflix TechBlog

SEPTEMBER 10, 2024

Where aws ends and the internet begins is an exercise left to the reader. Dynomite is a Netflix open source wrapper around Redis that provides a few additional features like auto-sharding and cross-region replication, and it provided Pushy with low latency and easy record expiry, both of which are critical for Pushy’s workload.

Latency 234

Latency Cache Tuning Efficiency 234

All Things Distributed

JULY 14, 2015

DynamoDB Streams is the enabling technology behind two other features announced today: cross-region replication maintains identical copies of DynamoDB tables across AWS regions with push-button ease, and triggers execute AWS Lambda functions on streams, allowing you to respond to changing data conditions. DynamoDB Streams.

Database 158

Database Lambda AWS IoT 158

All Things Distributed

JUNE 21, 2017

Today, I'm excited to announce the general availability of Amazon DynamoDB Accelerator (DAX) , a fully managed, highly available, in-memory cache that can speed up DynamoDB response times from milliseconds to microseconds, even at millions of requests per second. DynamoDB was the first service at AWS to use SSD storage.

Speed 95

Speed Cache Latency AWS 95

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., Ford, et al., “TCP on Upcoming Sapphire Rapids CPUs,” [link] Oct 2020 - [Liu 20] Linda Liu, “Samsung QVO vs EVO vs PRO: What’s the Difference?

Performance 121

Performance Latency Hardware Storage 121

The Netflix TechBlog

MARCH 6, 2019

Netflix operates in multiple AWS regions. In addition to improving download speed, this is useful for cutting down on cross-region transfer costs when many workers will be processing the same data? While large buffer sizes speed up sequential data access, they can slow down “sparse” data access?—?that Regional caching? —?Netflix

Media 218

Media Storage Processing Cache 218

Dynatrace

MAY 17, 2023

It is available for the major OS and cloud platforms (for example, Windows, Linux, Solaris, AWS, Azure, and more) and only requires the deployment of a single service to monitor its environment. This alone can already greatly help in identifying slow query hot spots and speed up your platform by making sure queries are optimized.

Metrics 243

Metrics Database Monitoring Network 243

All Things Distributed

MAY 13, 2012

With just one click you can enable content to be distributed to the customer with low latency and high-reliability. Of course non-AWS origins are also permitted. This is in addition to the existing optimizations of routing viewers to the edge location with lowest latency for that user, and also persistent connections with the clients.

Cache 97

Cache Latency AWS Website 97

VoltDB

MAY 14, 2024

Balancing Low Latency, High Availability and Cloud Choice Cloud hosting is no longer just an option — it’s now, in many cases, the default choice. For example, AWS offers ‘three nines’, but only if your application runs with triple redundancy in three separate availability zones in the same Amazon data center. Why are they refusing?

Latency 52

Latency Availability Cloud Hardware 52

Brendan Gregg

MAY 8, 2021

An average of 434 ms is awful, and a small queue size (aqu-sz) indicates it's a problem with the disk and not the workload applied. From these outputs I try to determine if the problem is: - **The workload**: High-latency disk I/O is commonly caused by the workload applied. Note the sdb latencies range from 32 ms to over 2 seconds!

Performance 133

Performance Latency Speed Systems 133

All Things Distributed

SEPTEMBER 25, 2017

Today, I am excited to announce plans for Amazon Web Services (AWS) to bring an infrastructure Region to the Middle East! Based in Bahrain, this will be the first Region for AWS in the Middle East. This Region will consist of three Availability Zones at launch, and it will provide even lower latency to users across the Middle East.

Cloud 119

Cloud Education Energy Government 119

All Things Distributed

JULY 13, 2010

During my academic career, I spent many years working on HPC technologies such as user-level networking interfaces, large scale high-speed interconnects, HPC software stacks, etc. When instances are placed in a cluster they have access to low latency, non-blocking 10 Gbps networking when communicating the other instances in the cluster.

Cloud 98

Cloud AWS Automotive Latency 98

High Scalability

JULY 20, 2018

A typical example of modern "microservices-inspired" Java application would function along these lines: Netflix : We observed during experimentation that RAM random read latencies were rarely higher than 1 microsecond whereas typical SSD random read speeds are between 100–500 microseconds.

Internet 121

Internet Internet Scalability Automotive 121

The Morning Paper

FEBRUARY 6, 2020

On the Cloudburst design teams’ wish list: A running function’s ‘hot’ data should be kept physically nearby for low-latency access. Cross-function communication should work at wire speed. A low-latency autoscaling KVS can serve as both global storage and a DHT-like overlay network. A closing thought.

Serverless 98

Serverless Lambda Cache Latency 98

All Things Distributed

OCTOBER 2, 2017

As we began growing the AWS business, we realized that external customers might find our Dynamo database just as useful as we found it within Amazon.com. So, we set out to build a fully hosted AWS database service based upon the original Dynamo design.

Internet 111

Internet Internet AWS Performance 111

All Things Distributed

OCTOBER 25, 2013

Many of you know Thorsten von Eicken as the founder of Rightscale , the company that has helped numerous organizations find their way onto AWS. The lack of low-latency made that distributed systems (e.g. database replication, fault tolerance protocols) could not benefit from these advances at the network level.

Network 77

Network Latency Operating System Speed 77

All Things Distributed

APRIL 9, 2015

At Amazon we have hundreds of teams using machine learning and by making use of the Machine Learning Service we can significantly speed up the time they use to bring their technologies into production. Details on the AWS Blog. AWS has been offering a range of storage solutions: objects, block storage, databases, archiving, etc.

Lambda 104

Lambda Cloud IoT AWS 104

Simform

JULY 13, 2022

AWS Lambda provides various benefits such as scalability, cost-efficiency, high availability, and more. But it also introduces cold starts and latency, decelerating your applications’ performance. This blog discusses how Lambda provisioned concurrency reduces cold starts and improves the speed and performance of your applications.

Lambda 52

Lambda Serverless AWS Performance 52

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. Measuring the speed of time Is there already a microbenchmark for os::javaTimeMillis()? Aftermath I provided details to AWS and Canonical, and then moved onto the other performance issues as part of the migration.

Speed 52

Speed Java AWS Virtualization 52

Percona

NOVEMBER 3, 2023

PostgreSQL Cluster One coordinator node citus-coord-01 Three worker nodes citus1 citus2 citus3 Hardware AWS Instance Ubuntu Server 20.04, SSD volume type 64-bit (x86) c5.xlarge In order to speed up the benchmark indexes must be added. psql pgbench <<_eof1_ qecho adding node citus3.

Database 114

Database Benchmarking Latency C++ 114

The Morning Paper

MARCH 3, 2020

It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. For Physalia, and for AWS more generally, the guiding principle is minimise the blast radius. NSDI’20.

Database 106

Database AWS Network Design 106

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 103

Performance Latency Cache Virtualization 103

All Things Distributed

NOVEMBER 21, 2017

Redis's microsecond latency has made it a de facto choice for caching. Four years ago, as part of our AWS fast data journey, we introduced Amazon ElastiCache for Redis , a fully managed, in-memory data store that operates at microsecond latency. Whether it is gaming, adtech, travel, or retail—speed wins, it's simple.

Games 96

Games Retail Latency Education 96

Dynatrace

AUGUST 5, 2019

In this role, I am leading a global team that works closely with our strategic partners such as AWS, Microsoft, Google, Pivotal, Red Hat and others. Remember: This is a critical aspect as you do not want to migrate a service and suddenly introduce high latency or costs to a system that you forgot about having a dependency with!

Cloud 38

Cloud Traffic Database Network 38

Adrian Cockcroft

NOVEMBER 18, 2019

AWS Developer Relations on how the shift from Robot Operating System (ROS) 1 to ROS 2 will change the landscape for all robot lovers. OPN205-R Contributing to the AWS Construct Library (repeats) Using and loving the AWS Cloud Development Kit and want to help make it better? Alejandra Olvera-Novack?—?AWS

Open Source 40

Open Source AWS Lambda Serverless 40

Adrian Cockcroft

NOVEMBER 18, 2019

AWS Developer Relations on how the shift from Robot Operating System (ROS) 1 to ROS 2 will change the landscape for all robot lovers. OPN205-R Contributing to the AWS Construct Library (repeats) Using and loving the AWS Cloud Development Kit and want to help make it better? Alejandra Olvera-Novack?—?AWS

Open Source 40

Open Source AWS Lambda Serverless 40

Scalegrid

MARCH 14, 2024

It provides significant advantages that include: Offering scalability to support business expansion Speeding up the execution of business plans Stimulating innovation throughout the company Boosting organizational flexibility, enabling quick adaptation to changing market conditions and competitive pressures.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. Measuring the speed of time Is there already a microbenchmark for os::javaTimeMillis()? Aftermath I provided details to AWS and Canonical, and then moved onto the other performance issues as part of the migration.

Speed 40

Speed Java AWS Virtualization 40

All Things Distributed

NOVEMBER 29, 2017

Though the AWS Cloud gives you access to the storage and processing power required for ML, the process for building, training, and deploying ML models has unique challenges that often block successful use of this powerful new technology. At AWS, we believe in giving choices, so Amazon SageMaker removes that problem.

Tuning 75

Tuning AWS Scalability Infrastructure 75

Smashing Magazine

AUGUST 3, 2023

Largest Contentful Paint (LCP) LCP measures the perceived load speed of a webpage from a user’s perspective. The shorter the TTFB, the better the perceived speed of the site from the user’s perspective. Addressing Many Pages With Rare Visits Adopting the AWS CloudFront CDN significantly improved our website’s performance.

Performance 78

Performance Cache Traffic Metrics 78

All Things Distributed

DECEMBER 12, 2013

Moreover, a GSI''s performance is designed to meet DynamoDB''s single digit millisecond latency - you can add items to a Users table for a gaming app with tens of millions of users with UserId as the primary key, but retrieve them based on their home city, with no reduction in query performance. What was the highest ratio of wins vs. losses?

Games 109

Games Scalability Database Retail 109

Adrian Cockcroft

JANUARY 20, 2023

Clouds using Ethernet that are multipath optimized using libfabric and features like EFA on AWS are going to be increasingly competitive, and Ethernet will replace other interconnects between racks. AWS has invested in optimizing Ethernet for HPC via the Elastic Fabric Adaptor (EFA) option, and the l ibfabric library.

Architecture 52

Architecture Latency Benchmarking AWS 52