The Netflix TechBlog

NOVEMBER 22, 2019

To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows. Netflix runs dozens of stateful services on AWS under strict sub-millisecond tail-latency requirements, which brings unique challenges.

AWS 38

AWS Entertainment Open Source Benchmarking 38

Dynatrace

APRIL 6, 2022

Endpoints include on-premises servers, Kubernetes infrastructure, cloud-hosted infrastructure and services, and open-source technologies. Not just infrastructure connections, but the relationships and dependencies between containers, microservices , and code at all network layers.

DevOps 303

DevOps Innovation Infrastructure Cloud 303

The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. This avoids thrashing caches too much for B and evens out the pressure on the L3 caches of the machine.

Cache 258

Cache Latency Airlines Logistics 258

Dynatrace

APRIL 5, 2021

You will likely need to write code to integrate systems and handle complex tasks or incoming network requests. You can eliminate the latency issues caused by cold starts — an increase in normal response time when a new instance receives its first request — by using edge-optimized functions that run code closer to users and other projects.

Lambda 258

Lambda AWS Serverless Hardware 258

Dynatrace

JULY 6, 2020

Azure Virtual Network Gateways. Our customers have frequently requested support for this first new batch of services, which cover databases, big data, networks, and computing. It enables you to use popular open-source frameworks such as Hadoop, Spark, and Kafka in Azure cloud environments. Azure DB for PostgreSQL.

Azure 227

Azure Cloud Big Data Virtualization 227

DZone

JULY 6, 2020

TiDB is an open-source, distributed SQL database that supports Hybrid Transactional/Analytical Processing (HTAP) workloads. There shouldn't be any jitters (either in the cluster or on disk), and no hotspots, slow queries, or network fluctuations. Ideally, a TiDB cluster should always be efficient and problem-free.

Open Source 130

Open Source Latency Traffic Analytics 130

Dynatrace

MAY 17, 2023

OpenTelemetry , the open source observability tool, has become the go-to standard for instrumenting custom applications to collect observability telemetry data. This allows us to quickly tell whether the network link may be saturated or the processor is running at its limit.

Metrics 243

Metrics Database Monitoring Network 243

The Netflix TechBlog

SEPTEMBER 10, 2024

Dynomite is a Netflix open source wrapper around Redis that provides a few additional features like auto-sharding and cross-region replication, and it provided Pushy with low latency and easy record expiry, both of which are critical for Pushy’s workload. As Pushy’s portfolio grew, we experienced some pain points with Dynomite.

Latency 234

Latency Cache Tuning Efficiency 234

All Things Distributed

JULY 20, 2015

The pool of resources, at this time, is the CPU, memory, and networking resources of Amazon EC2 instances as partitioned by containers. networks ports, memory, CPU, etc). This key/value store acts as the single source of truth for all information on the cluster (state, and all changes to state transitions) are entered and stored here.

Latency 156

Latency Architecture AWS Open Source 156

High Scalability

SEPTEMBER 8, 2018

To meet user-defined goals for performance (request latency) and cost, the monitoring service tracks and adjusts resources to workload changes. This increases the cores and network bandwidth available to serve common requests. Each storage server collects statistics about the requests it serves, the data it stores, etc.

Storage 199

Storage Performance AWS Media 199

Percona

MARCH 29, 2023

In this blog, we will discuss both data and network-level compression offered in MongoDB. We will discuss snappy and zstd for data block and zstd compression in a network. By default, MongoDB provides a snappy block compression method for storage and network communication. I am using PSMDB 6.0.4

Storage 130

Storage Network Open Source Latency 130

High Scalability

MARCH 22, 2019

Hell, many of these providers are just providing open source API compatibility with custom-built backends! What happens when no new open source comes out of the smaller companies, and the big-3 decide they don't really need or want to play nice anymore? We achieve 5.5

Internet 134

Internet Internet Scalability Wireless 134

Percona

APRIL 13, 2023

PostgreSQL is a popular open source relational database management system that is widely used for storing and managing data. In PostgreSQL, replication lag can occur due to various reasons such as network latency, slow disk I/O, long-running transactions, etc. What is replication lag?

Latency 103

Latency Tuning Open Source Network 103

Percona

JULY 20, 2023

We often forget or take for granted the network hops involved and the additional overhead it creates on the overall performance. TCP/IP connection, triggered me to write about other aspects of network impact on performance. How to detect and measure the impact There is no easy mechanism for measuring the impact of network overhead.

Network 75

Network Performance Latency Servers 75

All Things Distributed

AUGUST 20, 2015

When using relational databases, traversing relationships requires expensive table JOIN operations, causing significantly increased latency as table size and query complexity grow. The ability to scale with the accelerating pace of new items added to the catalog, and new objects and locations in the company’s expanding fulfillment network.

Database 121

Database Logistics Availability Social Media 121

Percona

NOVEMBER 9, 2023

At its core, Kubernetes (often abbreviated as K8s) is an open source tool that automates the deployment, scaling, and management of containerized applications. Kubernetes manages and orchestrates these containers, handling tasks such as deployment, scaling, load balancing, and networking.

Efficiency 117

Efficiency Cloud Healthcare Open Source 117

Adrian Cockcroft

NOVEMBER 18, 2019

We’re excited to let you know that we have an Open Source track at re:Invent this year! Brendan Gregg tours BPF tracing, with open source tools & examples for EC2 instance analysis. OPN304 Learnings from migrating a service from JDK 8 to JDK 11 AWS Lambda improved latency by migrating to JDK 11 with Amazon Corretto.

Open Source 40

Open Source AWS Lambda Serverless 40

Adrian Cockcroft

NOVEMBER 18, 2019

We’re excited to let you know that we have an Open Source track at re:Invent this year! Brendan Gregg tours BPF tracing, with open source tools & examples for EC2 instance analysis. OPN304 Learnings from migrating a service from JDK 8 to JDK 11 AWS Lambda improved latency by migrating to JDK 11 with Amazon Corretto.

Open Source 40

Open Source AWS Lambda Serverless 40

The Netflix TechBlog

NOVEMBER 22, 2019

To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows. Netflix runs dozens of stateful services on AWS under strict sub-millisecond tail-latency requirements, which brings unique challenges.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows. Netflix runs dozens of stateful services on AWS under strict sub-millisecond tail-latency requirements, which brings unique challenges.

AWS 100

AWS Entertainment Open Source Benchmarking 100

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. Ford, et al., “TCP

Performance 121

Performance Latency Hardware Storage 121

Scalegrid

AUGUST 27, 2024

These advanced functionalities earmark RabbitMQ as a capable and dominant open-source message broker suited to handle sophisticated needs spanning diverse application landscapes. RabbitMQ excels at managing asynchronous processing and reducing latency while distributing workloads effectively across the system.

Ecommerce 130

Ecommerce IoT Games Scalability 130

Percona

JUNE 22, 2023

A monitoring tool like Percona Monitoring and Management (PMM) is a popular choice among open source options for effectively monitoring MySQL performance. Replication lag can occur due to various factors such as network latency, system resource limitations, complex transactions, or heavy write loads on the primary/master database.

Performance 136

Performance Monitoring Traffic Database 136

Scalegrid

MARCH 28, 2024

Redis Revealed: An Overview Redis, a renowned open-source, in-memory remote dictionary server, stands out for its diverse data structures and advanced features. Memcached Explained: The Simplicity of Caching Alternatively, Memcached, a high-performance, open-source caching solution, prides itself on its simplicity.

Cache 130

Cache Storage Scalability Architecture 130

Smashing Magazine

SEPTEMBER 29, 2021

Compression achieved is relevant because the higher the compression, the smaller the file size, and the lower the data required to transfer the image on the network. The AV1 image file format (AVIF) is an open-source image format for storing still and animated images. Jump to table of contents ?. AVIF Images In The Browser.

Open Source 145

Open Source Speed Website Google 145

All Things Distributed

OCTOBER 12, 2016

Three years ago, as part of our AWS Fast Data journey we introduced Amazon ElastiCache for Redis , a fully managed in-memory data store that operates at sub-millisecond latency. All these capabilities are available to customers at no additional charge, and maintain open-source Redis compatibility. Redis and Fast Data.

Scalability 102

Scalability Cache Analytics AWS 102

The Netflix TechBlog

JANUARY 24, 2022

Technically, “performance” metrics are those relating to the responsiveness or latency of the app, including start up time. so are power levels and network bandwidth. In the future we plan to decouple anomaly and changepoint logic from our test infrastructure and offer it as a standalone open-source library.

Performance 208

Performance Performance Testing Metrics Testing 208

Scalegrid

NOVEMBER 4, 2024

For a more detailed comparison of performance features between different versions, refer to: [link] Benchmarking Methodology Sysbench Overview Sysbench is a versatile, open-source benchmarking tool ideal for testing OLTP (Online Transaction Processing) database workloads.

Benchmarking 130

Benchmarking AWS Tuning Metrics 130

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 103

Performance Latency Cache Virtualization 103

Percona

DECEMBER 26, 2023

This allows for much better data accuracy, especially in the case of high-resolution or unreliable networks. Percona Distribution for PostgreSQL provides the best and most critical enterprise components from the open-source community, in a single distribution, designed and tested to work together. Happy monitoring!

Benchmarking 141

Benchmarking Metrics C++ Database 141

Scalegrid

JUNE 7, 2024

RabbitMQ is an open-source message broker that simplifies inter-service communication by ensuring messages are effectively queued, delivered, and processed across diverse applications. Its commitment to open standard protocols such as AMQP 1.0 Each message needs to be flagged as durable to withstand server reboots.

IoT 130

IoT Software Architecture Architecture Scalability 130

The Morning Paper

FEBRUARY 23, 2020

There are five different types of member in an AnyLog system, and any network node can join without restriction as any type of member. Publishers are the producers of the actual data to be served by the network. Given their position of power in the network, such caching seems to be highly incentivised in the absence of such mechanisms.

Blockchain 94

Blockchain Internet Internet IoT 94

Scalegrid

MARCH 22, 2024

They can also bolster uptime and limit latency issues or potential downtimes. Achieving Interoperability Among Providers Achieving interoperability between providers is possible through using open source standards, employing AI-driven systems, and enabling safe data transfer across various cloud services.

Strategy 130

Strategy Cloud Government Innovation 130

Smashing Magazine

SEPTEMBER 6, 2021

Next, we’ll look at how to set up servers and clients (that’s the hard part unless you’re using a content delivery network (CDN)). Using just a few (but still more than one), however, could nicely balance congestion growth with better performance, especially on high-speed networks. Servers and Networks. Network Configuration.

Network 120

Network Servers Cache Traffic 120

Brendan Gregg

OCTOBER 8, 2018

Created by Alastair Robertson , bpftrace is an open source high-level tracing front-end that lets you analyze systems in custom ways. eBPF was created by Alexei Starovoitov while at PLUMgrid (he's now at Facebook) as a generic in-kernel virtual machine, with software defined networks as the primary use case. eBPF does more.

C++ 105

C++ Virtualization Programming Latency 105

Smashing Magazine

AUGUST 3, 2023

You need to beware that slow server response times can significantly increase TTFB, often due to server overload, network issues, or un-optimized logic on the server side. You need to beware of large HTML files or slow network connections because they can lead to longer download times. Here’s how we do it at Bookaway.

Performance 78

Performance Cache Traffic Metrics 78

Testsigma

AUGUST 24, 2020

Maintaining test data in a central repository and then accessing it from different test environments may ease this problem but may introduce other issues like network latency in tests. The right combination of open source and paid test frameworks/tools can be used rather than relying solely on open-source test frameworks/tools.

Testing 69

Testing Open Source Scalability Infrastructure 69