Scalegrid

OCTOBER 24, 2019

AWS is the #1 cloud provider for open-source database hosting, and the go-to cloud for MySQL deployments. As organizations continue to migrate to the cloud, it’s important to get in front of performance issues, such as high latency, low throughput, and replication lag with higher distances between your users and cloud infrastructure.

AWS 183

AWS Latency Performance Performance Testing 183

Dynatrace

JANUARY 26, 2021

VMware commercialized the idea of virtual machines, and cloud providers embraced the same concept with services like Amazon EC2, Google Compute, and Azure virtual machines. Serverless computing is a cloud-based, on-demand execution model where customers consume resources solely based on their application usage.

Serverless 246

Serverless Efficiency Lambda AWS 246

Scalegrid

NOVEMBER 20, 2019

95th Percentile Latency. The 95th percentile latency of queries was also 1.8 Stay tuned for my follow-on blog post with more details! Workload Throughput (Queries Per Second). Index Creation on Master. Rolling Index Creation. times higher when the index creation happened on the master server.

Best Practices 239

Best Practices Latency Tuning Database 239

Scalegrid

FEBRUARY 24, 2025

While clustering across wide-area networks (WANs) is discouraged due to latency issues, leased links can mitigate some connectivity challenges. When configuring a RabbitMQ cluster, consider the availability zones and cloud regions to ensure high availability. Each RabbitMQ node must be stopped before it can join an existing cluster.

Best Practices 147

Best Practices Traffic Strategy Efficiency 147

Dynatrace

APRIL 25, 2023

As companies accelerate digital transformation, they implement modern cloud technologies like serverless functions. According to Flexera , serverless functions are the number one technology evaluated by enterprises and one of the top five cloud technologies in use at enterprises. And serverless support is a core capability.

Serverless 246

Serverless Lambda Azure AWS 246

Dynatrace

MARCH 29, 2024

While Kubernetes is often considered the operating system of the cloud, the scale and complexity of Kubernetes cluster deployments are creating new challenges for IT teams. You can ask for the best configuration to reduce latency or improve the user experience.” Engineering teams are overwhelmed with stuff to do.”

Engineering 264

Engineering DevOps Operating System Open Source 264

The Netflix TechBlog

SEPTEMBER 10, 2024

Dynomite is a Netflix open source wrapper around Redis that provides a few additional features like auto-sharding and cross-region replication, and it provided Pushy with low latency and easy record expiry, both of which are critical for Pushy’s workload. As Pushy’s portfolio grew, we experienced some pain points with Dynomite.

Latency 234

Latency Cache Tuning Efficiency 234

Dynatrace

MAY 5, 2021

At Perform 2021 , Dynatrace’s Kristof Renders, Services Practice Manager for Autonomous Cloud Enablement, joined Sumit Nagal, Principal Engineer at Intuit, to demonstrate how service-level objectives (SLOs) and business-level objectives (BLOs) can “shift left.” For example, improving latency by as little as 0.1

Benchmarking 246

Benchmarking Latency Speed Software 246

The Netflix TechBlog

MARCH 1, 2021

It supports both high throughput services that consume hundreds of thousands of CPUs at a time, and latency-sensitive workloads where humans are waiting for the results of a computation. The subsystems all communicate with each other asynchronously via Timestone, a high-scale, low-latency priority queuing system. Warm capacity.

Serverless 235

Serverless Media Latency Social Media 235

Scalegrid

SEPTEMBER 10, 2024

Over the past few months, our releases have introduced several exciting updates, with a strong focus on geography and cloud expansion. We’re proud to introduce AWS Outposts support, allowing you to manage cloud infrastructure on-premises while maintaining full AWS integration. </p>

Latency 130

Latency AWS Storage Tuning 130

Dynatrace

DECEMBER 22, 2019

AWS offers a broad set of global, cloud-based services including computing, storage, networking, Internet of Things (IoT), and many others. Therefore, the ability to view a real-time map of your applications, services, and cloud resources is key to your success. Stay tuned for updates in Q1 2020. Dynatrace news. Requirements.

AWS 200

AWS Metrics IoT Storage 200

Scalegrid

MARCH 22, 2024

Thinking about going multi-cloud? A well-planned multi cloud strategy can seriously upgrade your business’s tech game, making you more agile. Key Takeaways Multi-cloud strategies have become increasingly popular due to the need for flexibility, innovation, and the avoidance of vendor lock-in.

Strategy 130

Strategy Cloud Government Innovation 130

The Netflix TechBlog

JANUARY 10, 2024

This architecture shift greatly reduced the processing latency and increased system resiliency. We expanded pipeline support to serve our studio/content-development use cases, which had different latency and resiliency requirements as compared to the traditional streaming use case. divide the input video into small chunks 2.

Processing 238

Processing Media Latency Innovation 238

Dynatrace

DECEMBER 22, 2019

AWS offers a broad set of global, cloud-based services including computing, storage, networking, Internet of Things (IoT), and many others. Therefore, the ability to view a real-time map of your applications, services, and cloud resources is key to your success. Stay tuned for updates in Q1 2020. Dynatrace news. Requirements.

AWS 182

AWS Metrics IoT Storage 182

The Netflix TechBlog

AUGUST 22, 2019

Though the majority of our services run on Linux Amazon Machine Images (AMIs), there are still many services critical to the Netflix Playback Experience running on Windows Elastic Compute Cloud (EC2) instances at scale. The canary stage will determine a score based on metrics such as CPU, threads, latency, and GC pauses.

DevOps 210

DevOps AWS Tuning Infrastructure 210

The Netflix TechBlog

AUGUST 29, 2023

A brief history of IPC at Netflix Netflix was early to the cloud, particularly for large-scale companies: we began the migration in 2008, and by 2010, Netflix streaming was fully run on AWS. Today we have a wealth of tools, both OSS and commercial, all designed for cloud-native environments.

Traffic 229

Traffic Latency Cloud C++ 229

The Netflix TechBlog

AUGUST 30, 2021

Complementing the hardware is the software on the RAE and in the cloud, and bridging the software on both ends is a bi-directional control plane. Since Kafka is a supported messaging platform at Netflix, a bridge is established between the two protocols to allow cloud-side services to communicate with the control plane.

Latency 222

Latency Traffic Transportation Cloud 222

Dynatrace

JULY 18, 2023

While infrastructure has historically been treated as a bottleneck where proper scaling and compute power are applied to improve performance, these aspects are now typically addressed by hyperscalers that offer cloud-based infrastructure and infrastructure as a service. You can read all about it in our Configuration as Code documentation.

Best Practices 246

Best Practices Code Infrastructure Latency 246

The Netflix TechBlog

FEBRUARY 18, 2022

This separation allows us to tune system configuration and scaling policies independently for different event priorities and traffic patterns. We thus assigned a priority to each use case and sharded event traffic by routing to priority-specific queues and the corresponding event processing clusters.

Systems 334

Systems Traffic Architecture Mobile 334

Dynatrace

APRIL 26, 2022

With DEM solutions, organizations can operate over on-premise network infrastructure or private or public cloud SaaS or IaaS offerings. STM generates traffic that replicates the typical path or behavior of a user on a network to measure performance for example, response times, availability, packet loss, latency, jitter, and other variables).

Monitoring 246

Monitoring Social Media IoT Metrics 246

Scalegrid

OCTOBER 17, 2019

While there is plenty of well-documented benefits to using a connection pooler, there are some arguments to be made against using one: Introducing a middleware in the communication inevitably introduces some latency. A middleware becomes a single point of failure. Should You Use a PostgreSQL Connection Pooler?

Architecture 200

Architecture Database Latency Servers 200

Dynatrace

DECEMBER 2, 2021

Cloud-native software and its supporting tools and infrastructure generate a diversity of metrics and data points every second that indicate a system’s state and performance. You can set SLOs based on individual indicators, such as batch throughput, request latency, and failures-per-second. How SLOs work. SLO best practices.

Metrics 246

Metrics Best Practices DevOps Infrastructure 246

The Netflix TechBlog

NOVEMBER 2, 2020

Failure can occur due to a myriad of reasons: misbehaving clients that trigger a retry storm, an under-scaled service in the backend, a bad deployment, a network blip, or issues with the cloud provider. Those two metrics are approximate indicators of failures and latency.

Traffic 261

Traffic Metrics Infrastructure Architecture 261

The Netflix TechBlog

OCTOBER 19, 2020

If we had an ID for each streaming session then distributed tracing could easily reconstruct session failure by providing service topology, retry and error tags, and latency measurements for all service calls. Our engineering teams tuned their services for performance after factoring in increased resource utilization due to tracing.

Infrastructure 238

Infrastructure Transportation Storage Open Source 238

Scalegrid

NOVEMBER 4, 2024

Introduction Purpose and Scope Cloud-hosted PostgreSQL solutions are increasingly popular among organizations seeking scalable, high-performance databases. It simulates high-concurrency environments, making it a go-to for performance testing of PostgreSQL across cloud platforms. You can access the benchmark here: [link]. per month.

Benchmarking 130

Benchmarking AWS Tuning Metrics 130

Percona

MARCH 23, 2023

Nowadays, solid-state drives (SSDs) or non-volatile memory express (NVMe) drives are preferred over traditional hard disk drives (HDDs) for database servers due to their faster read and write speeds, lower latency, and improved reliability. If you see concurrency issues, you can tune this variable. Setting oom_score_adj to -800.

Performance 144

Performance Hardware Tuning Storage 144

Dynatrace

MAY 17, 2023

It is available for the major OS and cloud platforms (for example, Windows, Linux, Solaris, AWS, Azure, and more) and only requires the deployment of a single service to monitor its environment. And that’s where Dynatrace OneAgent comes in. What is OneAgent?

Metrics 243

Metrics Database Monitoring Network 243

All Things Distributed

APRIL 9, 2015

The Amazon ML console and API provide data and model visualization tools, as well as wizards to guide you through the process of creating machine learning models, measuring their quality and fine-tuning the predictions to match your application requirements.

Lambda 104

Lambda Cloud IoT AWS 104

The Netflix TechBlog

NOVEMBER 2, 2021

Such coupling problems abound with our Reloaded architecture, and hence the Media Cloud Engineering and Encoding Technologies teams have been working together to develop a solution that addresses many of the concerns with our previous architecture. This enables us to use our scale to increase throughput and reduce latencies.

Media 178

Media Innovation Metrics Latency 178

Percona

MAY 1, 2023

Default settings can help you get started quickly – but they can also cost you performance and a higher cloud bill at the end of the month. I’ll show you some MySQL settings to tune to get better performance, and cost savings, with AWS RDS. Want to save money on your AWS RDS bill?

AWS 135

AWS Hardware Storage Tuning 135

All Things Distributed

OCTOBER 2, 2017

" Of course, no technology change happens in isolation, and at the same time NoSQL was evolving, so was cloud computing. The requirements for a fully hosted cloud database service needed to be at an even higher bar than what we had set for our Amazon internal system.

Internet 111

Internet Internet AWS Performance 111

Scalegrid

AUGUST 27, 2024

It is versatile enough for deployment in cloud-based infrastructures, on-premise data centers, or local setups, delivering a dependable and adaptable messaging framework. RabbitMQ excels at managing asynchronous processing and reducing latency while distributing workloads effectively across the system.

IoT 130

IoT Ecommerce Games Scalability 130

The Morning Paper

JULY 7, 2019

In addition to availability, our respondents focus most heavily on supporting the following data attributes: “accessibility, accuracy, authoritativeness, freshness, latency, structuredness, ontological typing, connectedness, and semantic joinability.” To address this, rigorous rollout processes are required.

Software Engineering 92

Software Engineering Engineering Software Software 92

All Things Distributed

DECEMBER 12, 2013

We launched DynamoDB last year to address the need for a cloud database that provides seamless scalability, irrespective of whether you are doing ten transactions or ten million transactions, while providing rock solid durability and availability. Now you can run queries on any item attributes (columns) in your DynamoDB table.

Games 109

Games Scalability Database Retail 109

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. That chance encounter, coupled with the Netflix's fault-tolerant cloud, gave me enough confidence to suggest trying tsc in production as a workaround for the issue. We ended up setting it in the BaseAMI for all cloud services.

Speed 103

Speed Java AWS Virtualization 103

The Netflix TechBlog

DECEMBER 17, 2019

Passive instances across regions are also possible, though it is recommended to operate in the same region as the database host in order to keep the change capture latencies low. Stay Tuned DBLog has additional capabilities which are not covered by this blog post, such as: Ability to capture table schemas without using locks.

Database 221

Database Traffic Transportation Open Source 221

The Netflix TechBlog

DECEMBER 17, 2019

Passive instances across regions are also possible, though it is recommended to operate in the same region as the database host in order to keep the change capture latencies low. Stay Tuned DBLog has additional capabilities which are not covered by this blog post, such as: Ability to capture table schemas without using locks.

Database 206

Database Traffic Transportation Open Source 206