All Things Distributed

JULY 14, 2015

DynamoDB Streams is the enabling technology behind two other features announced today: cross-region replication maintains identical copies of DynamoDB tables across AWS regions with push-button ease, and triggers execute AWS Lambda functions on streams, allowing you to respond to changing data conditions. DynamoDB Streams.

Database 156

Database Lambda AWS IoT 156

The Netflix TechBlog

AUGUST 29, 2023

A brief history of IPC at Netflix Netflix was early to the cloud, particularly for large-scale companies: we began the migration in 2008, and by 2010, Netflix streaming was fully run on AWS. There is a downside to fetching this data on-demand: this adds latency to the first request to a cluster.

Traffic 229

Traffic Latency Cloud C++ 229

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. There's no Java stack—there should be a tower of green Java methods—instead there's only a single green frame or two. This is how Java flame graphs looked at the time. 30.14% in the middle of the flame graph.

Speed 103

Speed Java AWS Virtualization 103

High Scalability

JULY 20, 2018

crabbone : This is the prism through which Java programmers view the world. The truth about it is that Java only gets you a good bang for your buck just a wee bit before it hits OOM. MRAM works in consumer applications, but it’s still unclear if it will ever meet the temperature requirements for automotive.

Internet 121

Internet Internet Scalability Automotive 121

The Netflix TechBlog

DECEMBER 21, 2020

By Anupom Syam Background At Netflix, our current data warehouse contains hundreds of Petabytes of data stored in AWS S3 , and each day we ingest and create additional Petabytes. These principles reduce resource usage by being more efficient and effective while lowering the end-to-end latency in data processing.

Storage 212

Storage Latency Efficiency Data Engineering 212

All Things Distributed

MARCH 11, 2013

I spent a lot of time talking to AWS developers, many working in the gaming and mobile space, and most of them have been finding Node.js allows these developers to handle a large number of concurrent connections with low latencies. Today, AWS Elastic Beanstalk just added support for Node.js Who is using Elastic Beanstalk?

AWS 80

AWS Mobile Games Java 80

All Things Distributed

APRIL 9, 2015

Details on the AWS Blog. AWS has been offering a range of storage solutions: objects, block storage, databases, archiving, etc. When we designed Amazon EFS we decided to build along the AWS principles: Elastic, scalable, highly available, consistent performance, secure, and cost-effective. Details on the AWS Blog.

Lambda 102

Lambda Cloud IoT AWS 102

All Things Distributed

JUNE 21, 2017

You can add DAX to your existing DynamoDB applications with just a few clicks in the AWS Management Console – no application rewrites required. DynamoDB was the first service at AWS to use SSD storage. These high-throughput, low-latency requirements need caching, not as a consideration, but as a best practice.

Speed 94

Speed Cache Latency AWS 94

The Morning Paper

MARCH 3, 2020

It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. For Physalia, and for AWS more generally, the guiding principle is minimise the blast radius. NSDI’20.

Database 106

Database AWS Network Design 106

All Things Distributed

NOVEMBER 8, 2012

For example, AWS customers use SQS for asynchronous communication pipelines, buffer queues for databases, asynchronous work queues, and moving latency out of highly responsive requests paths. In addition to Long Polling, we are also launching richer client functionality in the Java SDK.

Efficiency 82

Efficiency Cloud Games Scalability 82

The Netflix TechBlog

DECEMBER 17, 2019

There are services at Netflix that use RDBMS kind of databases such as MySQL or PostgreSQL via AWS RDS. Passive instances across regions are also possible, though it is recommended to operate in the same region as the database host in order to keep the change capture latencies low. The destination may be a datastore or an external API.

Database 221

Database Traffic Transportation Open Source 221

The Netflix TechBlog

DECEMBER 17, 2019

There are services at Netflix that use RDBMS kind of databases such as MySQL or PostgreSQL via AWS RDS. Passive instances across regions are also possible, though it is recommended to operate in the same region as the database host in order to keep the change capture latencies low. The destination may be a datastore or an external API.

Database 206

Database Traffic Transportation Open Source 206

The Morning Paper

MAY 12, 2019

The suite is built using popular OSS applications and representative technologies, deliberately using a mix of languages (C/C++, Java, Javascript, node.js, Python, Ruby, Go, Scala, …) and both RESTful and RPC (Thrift, gRPC) style service interfaces. The bottom line shows the tail latency impact in the microservices-based applications.

Open Source 61

Open Source Hardware Benchmarking Systems 61

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. There's no Java stack—there should be a tower of green Java methods—instead there's only a single green frame or two. This is how Java flame graphs looked at the time. This will slow this test a little.)

Speed 52

Speed Java AWS Virtualization 52

Brendan Gregg

AUGUST 29, 2021

1072-aws (xxx) 12/18/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 5.03 biolatency From [bcc], this eBPF tool shows a latency histogram of disk I/O. 1072-aws (xxx) 12/19/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 12.25 avg-cpu: %user %nice %system %iowait %steal %idle 14.81

Cache 78

Cache C++ AWS Java 78

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. There's no Java stack—there should be a tower of green Java methods—instead there's only a single green frame or two. This is how Java flame graphs looked at the time. 30.14% in the middle of the flame graph.

Speed 40

Speed Java AWS Virtualization 40

cdemi

DECEMBER 4, 2016

Apache Kafka - High-Throughput, Low-Latency, Uses Apache ZooKeeper for Distribution, Written in Scala and Java. Amazon Simple Queue Service - The Go-To choice if you're already on AWS, Reliable, Simple, Flexible, Scalable, Secure, Inexpensive.

Design 47

Design Azure Scalability Java 47

O'Reilly Software

MARCH 7, 2018

Created in 2007, and described as "a versatile open source integration framework based on known enterprise integration patterns," it is a very popular Java library for system integration, offering implementations of most (if not all) of the standard enterprise integration patterns (EIP). AWS, Kafka, Google Cloud, Spring, ElasticSearch).

Transportation 72

Transportation Java Programming Architecture 72

VoltDB

JUNE 21, 2024

An awful lot of the available time will be spent cranking the handle of your AI decision engine, leaving little time for all the other stuff that has to happen. So if you’re in this boat with your applications, be sure to: Understand the needs of your audience as far as latency.

Speed 52

Speed Engineering Media Java 52

Brendan Gregg

AUGUST 29, 2021

1072-aws (xxx) 12/18/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 5.03 biolatency From [bcc], this eBPF tool shows a latency histogram of disk I/O. 1072-aws (xxx) 12/19/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 12.25 avg-cpu: %user %nice %system %iowait %steal %idle 14.81

Cache 40

Cache C++ AWS Systems 40