InfoQ

APRIL 26, 2024

Allegro experimented with different performance optimization options to improve Apache Kafka producer tail latency and eventually switched all its clusters to the XFS filesystem. The company used Kafka protocol sniffing, JVM profiling, and eBPF, which proved instrumental in identifying and eliminating performance bottlenecks.

Latency 114

Latency Performance Tuning Scalability 114

VoltDB

FEBRUARY 29, 2024

In this fast-paced ecosystem, two vital elements determine the efficiency of this traffic: latency and throughput. LATENCY: THE WAITING GAME Latency is like the time you spend waiting in line at your local coffee shop. All these moments combined represent latency – the time it takes for your order to reach your hands.

Latency 52

Latency Games Traffic Network 52

The Netflix TechBlog

OCTOBER 8, 2024

Rajiv Shringi Vinay Chella Kaidan Fullerton Oleksii Tkachuk Joey Lynch Introduction As Netflix continues to expand and diversify into various sectors like Video on Demand and Gaming , the ability to ingest and store vast amounts of temporal data — often reaching petabytes — with millisecond access latency has become increasingly vital.

Latency 236

Latency Storage Traffic Tuning 236

InfoQ

JULY 14, 2023

Mei-Chin Tsai, Vinod discuss the internal architecture of Azure Cosmos DB and how it achieves high availability, low latency, and scalability. By Mei-Chin Tsai, Vinod Sridharan

Latency 52

Latency Azure Availability Scalability 52

Scalegrid

SEPTEMBER 10, 2024

At ScaleGrid, we’re always pushing the boundaries to offer more flexibility and scalability to our customers. Additionally, we’ve added the Philadelphia AWS Local Zone , helping to reduce latency for customers operating in the eastern U.S.

Latency 130

Latency AWS Storage Tuning 130

Dynatrace

NOVEMBER 28, 2022

The new Amazon capability enables customers to improve the startup latency of their functions from several seconds to as low as sub-second (up to 10 times faster) at P99 (the 99th latency percentile). This can cause latency outliers and may lead to a poor end-user experience for latency-sensitive applications.

Lambda 235

Lambda AWS Serverless Latency 235

The Netflix TechBlog

SEPTEMBER 18, 2024

Central to this infrastructure is our use of multiple online distributed databases such as Apache Cassandra , a NoSQL database known for its high availability and scalability. It also serves as central configuration of access patterns such as consistency or latency targets. Useful for keeping “n-newest” or prefix path deletion.

Latency 248

Latency Storage Cache Efficiency 248

High Scalability

NOVEMBER 23, 2018

Delay is Not an Option: Low Latency Routing in Space , Murat ). Don't miss all that the Internet has to say on Scalability, click below and become eventually consistent with all scalability knowledge (which means this post has many more items to read so please keep on reading). Here's some fancy FCC reverse engineering magic.

Internet 174

Internet Internet Scalability Analytics 174

DZone

FEBRUARY 2, 2024

This proximity to data generation reduces latency, conserves bandwidth and enables real-time decision-making. However, managing distributed workloads across various edge nodes in a scalable and efficient manner is a complex challenge.

IoT 204

IoT Artificial Intelligence Latency Internet 204

VoltDB

NOVEMBER 20, 2024

This proximity reduces latency and enables real-time decision-making. Lower latency and greater reliability: Edge computing’s localized processing enables immediate responses, reducing latency and improving system reliability. Assess factors like network latency, cloud dependency, and data sensitivity.

IoT 52

IoT Energy Latency Automotive 52

High Scalability

DECEMBER 7, 2018

It's HighScalability time: This is your 1500ms latency in real life situations - pic.twitter.com/guot8khIPX. Don't miss all that the Internet has to say on Scalability, click below and become eventually consistent with all scalability knowledge (which means this post has many more items to read so please keep on reading).

Internet 163

Internet Internet Scalability Blockchain 163

High Scalability

MARCH 22, 2019

µs of replication latency on lossy Ethernet, which is faster than or comparable to specialized replication systems that use programmable switches, FPGAs, or RDMA.". We achieve 5.5 matthewstoller : I just looked at Netflix’s 10K. At some point, the e-mail I send over WiFi will hit a wire, of course". Yep, there are more quotes.

Internet 134

Internet Internet Scalability Wireless 134

Dynatrace

APRIL 7, 2023

Customers can use AWS Lambda Response Streaming to improve performance for latency-sensitive applications and return larger payload sizes. Streaming raises the default 6 MB hard limit to a 20 MB soft limit, adding greater scalability and flexibility to their applications. What is a Lambda serverless function?

Lambda 228

Lambda AWS Serverless Latency 228

Dynatrace

FEBRUARY 21, 2024

This approach supports innovation, ambitious SLOs, DevOps scalability, and competitiveness. These metrics are latency, traffic, errors, and saturation, all of which must be key considerations when curating user experience. In this example, unlike latency, the remaining three signals did not receive a “pass.”

Speed 220

Speed Software Software Latency 220

Dynatrace

MAY 23, 2024

Such frameworks support software engineers in building highly scalable and efficient applications that process continuous data streams of massive volume. Stream processing systems, designed for continuous, low-latency processing, demand swift recovery mechanisms to tolerate and mitigate failures effectively.

Engineering 193

Engineering Tuning Latency Open Source 193

High Scalability

DECEMBER 21, 2018

It's HighScalability time: Have a very scalable Xmas everyone! Tim Bray : How to talk about [Serverless Latency] · To start with, don’t just say “I need 120ms.” See you in the New Year. Do you like this sort of Stuff? Please support me on Patreon. I'd really appreciate it. Explain the Cloud Like I'm 10.

Internet 137

Internet Internet Scalability Serverless 137

The Netflix TechBlog

NOVEMBER 12, 2024

By: Rajiv Shringi , Oleksii Tkachuk , Kartik Sathyanarayanan Introduction In our previous blog post, we introduced Netflix’s TimeSeries Abstraction , a distributed service designed to store and query large volumes of temporal event data with low millisecond latencies. Today, we’re excited to present the Distributed Counter Abstraction.

Latency 224

Latency Cache Infrastructure Strategy 224

Scalegrid

AUGUST 27, 2024

Scalability : Message queues can handle multiple requests and messages simultaneously, making it easier to scale an application to meet increasing demands. This scalability is essential for applications that experience fluctuating workloads. This reliability is crucial for maintaining data integrity and consistency across the system.

Ecommerce 130

Ecommerce IoT Games Scalability 130

High Scalability

JULY 20, 2018

A typical example of modern "microservices-inspired" Java application would function along these lines: Netflix : We observed during experimentation that RAM random read latencies were rarely higher than 1 microsecond whereas typical SSD random read speeds are between 100–500 microseconds. There are a few more quotes.

Internet 121

Internet Internet Scalability Automotive 121

The Netflix TechBlog

NOVEMBER 3, 2022

In that scenario, the system would need to deal with the data propagation latency directly, for example, by use of timeouts or client-originated update tracking mechanisms. We started seeing increased response latencies and leader servers running at dangerously high utilization.

Cache 229

Cache Latency Traffic Systems 229

InfoQ

JUNE 16, 2023

The event-driven architecture (EDA) can accommodate bursts in traffic in the multi-tenant platform with reasonable ingestion latency and acceptable operational costs. Datadog created a dedicated data ingestion architecture offering exactly-once semantics for their third-generation event store, Husky. By Rafal Gancarz

Architecture 57

Architecture Scalability Latency Traffic 57

The Netflix TechBlog

JANUARY 10, 2024

This architecture shift greatly reduced the processing latency and increased system resiliency. We expanded pipeline support to serve our studio/content-development use cases, which had different latency and resiliency requirements as compared to the traditional streaming use case. divide the input video into small chunks 2.

Processing 234

Processing Media Latency Innovation 234

The Netflix TechBlog

FEBRUARY 9, 2021

Lower latency as a result of fewer service calls, which means fewer errors for our visitors. Growth Engineering at Netflix- Creating a Scalable Offers Platform was originally published in Netflix TechBlog on Medium, where people are continuing the conversation by highlighting and responding to this story.

Engineering 144

Engineering Scalability Architecture Innovation 144

High Scalability

AUGUST 17, 2018

12 million requests / hour with sub-second latency, ~300GB of throughput / day. Don't miss all that the Internet has to say on Scalability, click below and become eventually consistent with all scalability knowledge (which means this post has many more items to read so please keep on reading). myelixirstatus !#Serverless.No

Internet 105

Internet Internet Scalability Games 105

Scalegrid

DECEMBER 21, 2023

Identifying key Redis® metrics such as latency, CPU usage, and memory metrics is crucial for effective Redis monitoring. To monitor Redis® instances effectively, collect Redis metrics focusing on cache hit ratio, memory allocated, and latency threshold. It is important to understand these challenges properly to find solutions for them.

Strategy 130

Strategy Monitoring Latency DevOps 130

Dynatrace

MAY 13, 2022

Because of its scalability and distributed architecture, thousands of companies trust it to run their cloud and hybrid-based workloads at high availability without compromising performance. With the Dynatrace Data Explorer, you can easily analyze metrics, such as client read/write latency by Cassandra nodes and disk space usage by keyspaces.

Azure 242

Azure Latency Metrics Infrastructure 242

The Netflix TechBlog

MAY 4, 2023

The first phase involves validating functional correctness, scalability, and performance concerns and ensuring the new systems’ resilience before the migration. It provides a good read on the availability and latency ranges under different production conditions.

Traffic 344

Traffic Latency Tuning Systems 344

High Scalability

JANUARY 11, 2022

When a user requests for feed then there will be two parallel threads involved in fetching the user feeds to optimize for latency. FUN FACT : In this talk , Dikang Gu, a software engineer at Instagram core infra team has mentioned about how they use Cassandra to serve critical usecases, high scalability requirements, and some pain points.

Design 334

Design Media Storage Logistics 334

High Scalability

FEBRUARY 17, 2021

We note that for MongoDB update latency is really very low (low is better) compared to other dbs, however the read latency is on the higher side. The latency table shows that 99th percentile latency for Yugabyte is quite high compared to others (lower is better). Again Yugabyte latency is quite high. Conclusion.

Benchmarking 308

Benchmarking Latency C++ Database 308

All Things Distributed

OCTOBER 12, 2016

Three years ago, as part of our AWS Fast Data journey we introduced Amazon ElastiCache for Redis , a fully managed in-memory data store that operates at sub-millisecond latency. This allows for faster failover times while minimizing latency. Amazon’s enhancements address many day-to-day challenges with running Redis.

Scalability 117

Scalability Cache Analytics AWS 117

The Netflix TechBlog

MARCH 1, 2021

It supports both high throughput services that consume hundreds of thousands of CPUs at a time, and latency-sensitive workloads where humans are waiting for the results of a computation. The third generation, called Reloaded , has been online for about seven years and has proven to be stable and massively scalable.

Serverless 233

Serverless Media Latency Social Media 233

Dynatrace

OCTOBER 10, 2022

Many organizations today rely on cloud-native applications for their scalability and agility, among other benefits. Serverless benefits include the following: Dynamic scalability. Reduced latency. By using cloud providers with multiple server sites, organizations can reduce function latency for end users.

Serverless 175

Serverless Infrastructure Lambda Latency 175

All Things Distributed

JANUARY 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The original Dynamo design was based on a core set of strong distributed systems principles resulting in an ultra-scalable and highly reliable database system.

Scalability 165

Scalability Database Ecommerce Latency 165

All Things Distributed

DECEMBER 8, 2020

And because they never stop, their need for security, availability, performance, scalability, and flexibility over how they choose to run their workloads never stop. The new AWS Asia Pacific Region will be located in the Australian city of Melbourne and will deliver even lower latency to customers and their end users in Asia Pacific.

AWS 189

AWS Latency Scalability Infrastructure 189

Scalegrid

NOVEMBER 4, 2024

The results will help database administrators and decision-makers choose the right platform for their performance, scalability, and cost-efficiency needs. Introduction Purpose and Scope Cloud-hosted PostgreSQL solutions are increasingly popular among organizations seeking scalable, high-performance databases.

Benchmarking 130

Benchmarking AWS Tuning Metrics 130

Scalegrid

JANUARY 8, 2024

This article delves into the specifics of how AI optimizes cloud efficiency, ensures scalability, and reinforces security, providing a glimpse at its transformative role without giving away extensive details. Exploring artificial intelligence in cloud computing reveals a game-changing synergy.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

Scalegrid

MARCH 28, 2024

In this comparison of Redis vs Memcached, we strip away the complexity, focusing on each in-memory data store’s performance, scalability, and unique features. can enhance Redis by handling management tasks, backups, and scalability, facilitating global reach and easy cloud integration for global businesses.

Cache 130

Cache Storage Architecture Scalability 130