Percona

MAY 1, 2023

Want to save money on your AWS RDS bill? I’ll show you some MySQL settings to tune to get better performance, and cost savings, with AWS RDS. Default settings can help you get started quickly – but they can also cost you performance and a higher cloud bill at the end of the month.

AWS 135

AWS Hardware Storage Tuning 135

Dynatrace

MAY 17, 2023

More precisely, this team uses AWS Fault Injection Simulator (FIS) to run fault injection to improve the application’s performance and resiliency. In this case, the four golden signals (latency, traffic, errors, and saturation) are derived from span attributes and DQL metric queries via Dynatrace Grail™.

DevOps 246

DevOps Traffic Latency Best Practices 246

The Netflix TechBlog

AUGUST 22, 2019

Packer requires specific information for your baking environment and extensive AWS IAM permissions. In order to simplify the use of Packer for our software developers, we bundled Netflix-specific AWS environment information and helper scripts. This means changes can be tracked and reviewed like any other code change.

DevOps 210

DevOps AWS Tuning Infrastructure 210

The Netflix TechBlog

OCTOBER 27, 2020

The processed data is typically stored as data warehouse tables in AWS S3. The data warehouse is not designed to serve point requests from microservices with low latency. Therefore, we must efficiently move data from the data warehouse to a global, low-latency and highly-reliable key-value store.

Latency 252

Latency Storage Big Data Tuning 252

The Netflix TechBlog

SEPTEMBER 10, 2024

Where aws ends and the internet begins is an exercise left to the reader. Dynomite is a Netflix open source wrapper around Redis that provides a few additional features like auto-sharding and cross-region replication, and it provided Pushy with low latency and easy record expiry, both of which are critical for Pushy’s workload.

Latency 234

Latency Cache Tuning Efficiency 234

Scalegrid

SEPTEMBER 10, 2024

Here’s what you need to know: AWS Outposts & Philadelphia Local Zone Support Our customers asked, and we listened. We’re proud to introduce AWS Outposts support, allowing you to manage cloud infrastructure on-premises while maintaining full AWS integration. Stay tuned for more exciting updates in the months to come! <p>The

Latency 130

Latency AWS Storage Tuning 130

The Netflix TechBlog

AUGUST 13, 2020

You’re half awake and wondering, “Is there really a problem or is this just an alert that needs tuning? Telltale learns what constitutes typical health for an application, no alert tuning required. It usually has dependencies, talks to other services, and lives in different AWS regions. By Andrei U.,

Monitoring 219

Monitoring Tuning Traffic Metrics 219

The Netflix TechBlog

SEPTEMBER 24, 2021

Uploading and downloading data always come with a penalty, namely latency. Figure 3: Video Processing with Index and Virtual Assembly Using virtual assembly greatly improves the latency performance of the ProRes 422 HQ proxy generation by removing one round trip of cloud downloading and cloud uploading by the physical assembler.

Cloud 242

Cloud Media Storage Cache 242

The Netflix TechBlog

FEBRUARY 18, 2022

This separation allows us to tune system configuration and scaling policies independently for different event priorities and traffic patterns. Event Priority Based Clusters AWS Instance Clusters that subscribe to the corresponding queues with the same priority.

Systems 334

Systems Traffic Architecture Mobile 334

Scalegrid

NOVEMBER 4, 2024

Performance Benchmarking of PostgreSQL on ScaleGrid vs. AWS RDS Using Sysbench This article evaluates PostgreSQL’s performance on ScaleGrid and AWS RDS, focusing on versions 13, 14, and 15. Test Environment Setup Instance Types : We used similar cloud instances for AWS RDS and ScaleGrid to ensure a fair comparison.

Benchmarking 130

Benchmarking AWS Tuning Metrics 130

The Netflix TechBlog

OCTOBER 19, 2020

If we had an ID for each streaming session then distributed tracing could easily reconstruct session failure by providing service topology, retry and error tags, and latency measurements for all service calls. Our engineering teams tuned their services for performance after factoring in increased resource utilization due to tracing.

Infrastructure 238

Infrastructure Transportation Storage Open Source 238

The Netflix TechBlog

DECEMBER 21, 2020

By Anupom Syam Background At Netflix, our current data warehouse contains hundreds of Petabytes of data stored in AWS S3 , and each day we ingest and create additional Petabytes. These principles reduce resource usage by being more efficient and effective while lowering the end-to-end latency in data processing.

Storage 212

Storage Latency Efficiency Data Engineering 212

The Netflix TechBlog

AUGUST 29, 2023

A brief history of IPC at Netflix Netflix was early to the cloud, particularly for large-scale companies: we began the migration in 2008, and by 2010, Netflix streaming was fully run on AWS. There is a downside to fetching this data on-demand: this adds latency to the first request to a cluster.

Traffic 229

Traffic Latency Cloud C++ 229

Dynatrace

MAY 17, 2023

It is available for the major OS and cloud platforms (for example, Windows, Linux, Solaris, AWS, Azure, and more) and only requires the deployment of a single service to monitor its environment. OneAgent is the native telemetry data collector and monitoring solution of Dynatrace.

Metrics 243

Metrics Database Monitoring Network 243

All Things Distributed

OCTOBER 2, 2017

As we began growing the AWS business, we realized that external customers might find our Dynamo database just as useful as we found it within Amazon.com. So, we set out to build a fully hosted AWS database service based upon the original Dynamo design.

Internet 111

Internet Internet AWS Performance 111

All Things Distributed

APRIL 9, 2015

The Amazon ML console and API provide data and model visualization tools, as well as wizards to guide you through the process of creating machine learning models, measuring their quality and fine-tuning the predictions to match your application requirements. Details on the AWS Blog. Details on the AWS Blog. for a while already.

Lambda 104

Lambda Cloud IoT AWS 104

Percona

NOVEMBER 3, 2023

PostgreSQL Cluster One coordinator node citus-coord-01 Three worker nodes citus1 citus2 citus3 Hardware AWS Instance Ubuntu Server 20.04, SSD volume type 64-bit (x86) c5.xlarge And now, execute the benchmark: -- execute the following on the coordinator node pgbench -c 20 -j 3 -T 60 -P 3 pgbench The results are not pretty.

Database 114

Database Benchmarking Latency C++ 114

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. The change was obvious in the production graphs, showing a drop in write latencies: Once tested more broadly, it showed the write latencies dropped by 43%, delivering slightly better performance than on CentOS.

Speed 103

Speed Java AWS Virtualization 103

All Things Distributed

NOVEMBER 29, 2017

Though the AWS Cloud gives you access to the storage and processing power required for ML, the process for building, training, and deploying ML models has unique challenges that often block successful use of this powerful new technology. However, many developers find them difficult to build and deploy.

Tuning 75

Tuning AWS Scalability Infrastructure 75

The Netflix TechBlog

DECEMBER 17, 2019

There are services at Netflix that use RDBMS kind of databases such as MySQL or PostgreSQL via AWS RDS. Passive instances across regions are also possible, though it is recommended to operate in the same region as the database host in order to keep the change capture latencies low. The destination may be a datastore or an external API.

Database 221

Database Traffic Transportation Open Source 221

The Netflix TechBlog

DECEMBER 17, 2019

There are services at Netflix that use RDBMS kind of databases such as MySQL or PostgreSQL via AWS RDS. Passive instances across regions are also possible, though it is recommended to operate in the same region as the database host in order to keep the change capture latencies low. The destination may be a datastore or an external API.

Database 206

Database Traffic Transportation Open Source 206

Adrian Cockcroft

AUGUST 1, 2022

photo by Adrian I gave a talk at Monitorama in Portland Oregon in June, which set out the idea that carbon is just another metric to monitor, and that in a few years most of the monitoring and performance tuning tools are going to be reporting and optimizing for carbon alongside latency, throughput, availability and cost.

AWS 52

AWS Virtualization DevOps Latency 52

All Things Distributed

DECEMBER 12, 2013

Moreover, a GSI''s performance is designed to meet DynamoDB''s single digit millisecond latency - you can add items to a Users table for a gaming app with tens of millions of users with UserId as the primary key, but retrieve them based on their home city, with no reduction in query performance.

Games 109

Games Scalability Database Retail 109

Dotcom-Montior

NOVEMBER 11, 2020

those resources now belong to cloud providers, such as AWS Lambda, Google Cloud Platform, Microsoft Azure, and others. Developers don’t have to put in additional time to fine-tuning the system, or rely on other teams for support, as it’s done automatically with the cloud provider. Focus on Application Development.

Serverless 57

Serverless Monitoring Lambda Latency 57

Brendan Gregg

SEPTEMBER 5, 2017

Here's some output from my zfsdist tool, in bcc/BPF, which measures ZFS latency as a histogram on Linux: # zfsdist. Tracing ZFS operation latency. Both Xen and KVM have had many performance and security improvements, and workloads can now be tuned to run at almost bare metal speeds (say, a 3% loss or less). Hit Ctrl-C to end. ^C

Virtualization 75

Virtualization AWS Engineering Hardware 75

Percona

APRIL 17, 2023

The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. The CFQ works well for many general use cases but lacks latency guarantees. Spoiler alert: This post focuses on MongoDB 3.6.X tcp_fin_timeout = 30 net.ipv4.tcp_keepalive_intvl

Best Practices 52

Best Practices Design Tuning Database 52

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. The change was obvious in the production graphs, showing a drop in write latencies: Once tested more broadly, it showed the write latencies dropped by 43%, delivering slightly better performance than on CentOS.

Speed 40

Speed Java AWS Virtualization 40

Adrian Cockcroft

NOVEMBER 18, 2024

Photo by Adrian of my father’s “round tuit” which I’m hoping will inspire AWS to do something… There’s an old saying that any headline that ends in a question mark can be answered with a “no”. Learn from Nasdaq, whose AI-powered environmental, social, and governance (ESG) platform uses Amazon Bedrock and AWS Lambda.

AWS 98

AWS Energy Lambda Government 98