The Netflix TechBlog

MAY 4, 2023

Migrating Critical Traffic At Scale with No Downtime — Part 1 Shyam Gala , Javier Fernandez-Ivern , Anup Rokkam Pratap , Devang Shah Hundreds of millions of customers tune into Netflix every day, expecting an uninterrupted and immersive streaming experience. It helps expose memory leaks, deadlocks, caching issues, and other system issues.

Traffic 343

Traffic Latency Tuning Systems 343

Dynatrace

JULY 16, 2020

TenantCache: a cache to store tenant information and API token information and semi-permanent data to avoid unnecessary roundtrips. ? These API tokens are then stored in a local cache (the TenantCache using Redis), alongside with other rather static information of the environments: ? tenant-token the current API token to use.

Cache 289

Cache Serverless Efficiency Tuning 289

Alex Russell

MARCH 31, 2022

Browsers will cache tools popular among vocal, leading-edge developers. There's plenty of space for caching most popular frameworks. The best available proxy data also suggests that shared caches would have a minimal positive effect on performance. Browsers now understand the classic shared HTTP cache behaviour as a privacy bug.

Cache 89

Cache Government Traffic Network 89

Percona

AUGUST 31, 2018

Out of the box, the default PostgreSQL configuration is not tuned for any particular workload. It is primarily the responsibility of the database administrator or developer to tune PostgreSQL according to their system’s workload. This parameter sets how much dedicated memory will be used by PostgreSQL for cache. wal_buffers.

Tuning 79

Tuning Database Performance Benchmarking 79

Percona

APRIL 7, 2023

If we were to select the most important MySQL setting, if we were given a freshly installed MySQL or Percona Server for MySQL and could only tune a single MySQL variable, which one would it be? To be fair, that is also true with PostgreSQL; it hasn’t been tuned either, and it, too, can also perform much better.

Tuning 145

Tuning Cache Servers Benchmarking 145

Dynatrace

AUGUST 1, 2022

Interestingly, our partner RedHat reported in 2021 that around 80% of deployed workloads are databases or data caches, storing data in persistent volume claims (PVCs). Stay tuned. Kubernetes was initially designed with a strong focus on stateless workloads, meaning these workloads do not need to store any persistent data.

Storage 246

Storage Database Network Metrics 246

The Netflix TechBlog

SEPTEMBER 24, 2021

Doing so has the added advantage of being able to design and tune the enhancement to suit the requirements of packager and our other encoding applications. It downloads the part(s) that contain the referenced, uploaded bytes and keeps them in an LRU active cache. For write operations, those challenges do not apply.

Cloud 240

Cloud Media Storage Cache 240

Percona

APRIL 24, 2023

Indexes are generally considered to be the panacea when it comes to SQL performance tuning, and PostgreSQL supports different types of indexes catering to different use cases. I keep seeing many articles and talks on “tuning” discussing how creating new indexes speeds up SQL but rarely ones discussing removing them.

Tuning 139

Tuning Cache Storage Database 139

The Netflix TechBlog

SEPTEMBER 10, 2024

After tuning our store for Pushy’s needs, it has been on autopilot since, appropriately scaling and serving our requests with very low latency. This delicate balance led to us doing a deep evaluation of many instance types and performance tuning options. We run this asynchronously to avoid any event loop blocking due to these calls.

Latency 230

Latency Cache Tuning Efficiency 230

The Netflix TechBlog

OCTOBER 8, 2024

Flexible : This metadata can be adjusted per time slice, allowing us to tune the partition settings of future time slices based on observed data patterns in the current time slice. We sometimes raise this limit for backfilling historical data, but it is tuned back down for regular write operations. Also, with Cassandra 4.x,

Latency 235

Latency Storage Traffic Tuning 235

SQL Performance

SEPTEMBER 17, 2019

This article will cover many areas that database administrators need to be aware of in order to properly license, recover, and tune a Reporting Services installation. Tuning Options. Tuning SSRS is much like any other application. General Tuning. Installation and support of SSRS can be confusing.

Tuning 67

Tuning Servers Database Best Practices 67

The Netflix TechBlog

AUGUST 10, 2020

Further tuning of pre-defined encoding parameters. In addition, footprint savings will allow more content to be stored in edge caches, thus contributing to an improved experience for our members. Improving the bitrate ladder that is generated after complexity analysis to choose points with greater intelligence than before.

Innovation 241

Innovation Traffic Network Efficiency 241

The Netflix TechBlog

JULY 1, 2019

Our UI runs on top of a custom rendering engine which uses what we call a “surface cache” to optimize our use of graphics memory. Surface Cache Surface cache is a reserved pool in main memory (or separate graphics memory on a minority of systems) that the Netflix app uses for storing textures (decoded images and cached resources).

Cache 166

Cache Design Testing Development 166

Percona

AUGUST 10, 2018

This may help tune your table level autovacuum settings appropriately. Tuning Autovacuum in PostgreSQL. How do we identify the tables that need their autovacuum settings tuned ? . In order to tune autovacuum for tables individually, you must know the number of inserts/deletes/updates on a table for an interval.

Tuning 67

Tuning Cache Database Storage 67

Dynatrace

JUNE 18, 2019

Instrumenting multi-dex apps sometimes required advanced manual fine-tuning. Moreover, features like Instant Run and the Gradle Build Cache weren’t supported. Out-of-the-box support for Instant Run and the Gradle Build Cache make the auto-instrumentation process barely noticeable. No multi-dex issues. Supportability.

Cache 35

Cache Java Monitoring Tuning 35

Percona

FEBRUARY 15, 2023

Tuning In terms of tuning, two parameters can be tuned, the size of the bitmap and the number of bits set by every value. For good performance, the filter blocks are cached in the RocksDB block cache and normally stay there since they are accessed frequently.

Storage 138

Storage Tuning Cache Engineering 138

Scalegrid

JANUARY 25, 2024

Effective management of memory stores with policies like LRU/LFU proactive monitoring of the replication process and advanced metrics such as cache hit ratio and persistence indicators are crucial for ensuring data integrity and optimizing Redis’s performance. Cache Hit Ratio The cache hit ratio represents the efficiency of cache usage.

Metrics 130

Metrics Monitoring Latency Cache 130

Dynatrace

NOVEMBER 13, 2020

Be sure to fine-tune the anomaly detection settings for your mobile app so that you can focus on those anomalies that are most relevant to the experience of your end users. This flushes the cache on the Dynatrace Cluster; you should see events in the web UI shortly thereafter. What’s next.

Code 244

Code Mobile Monitoring Infrastructure 244

Brendan Gregg

SEPTEMBER 5, 2021

The ZFS Adapative Replacement Cache (ARC) is the main memory cache for the file system. The arc_reclaim_thread periodically runs arc_adjust() to evict memory from the cache to keep it from growing too large, and to maintain a threshold of free memory that applications can quickly use. I worked on this code back at Sun.

Cache 141

Cache Cloud Code Java 141

Percona

MARCH 23, 2023

By caching hot datasets, indexes, and ongoing changes, InnoDB can provide faster response times and utilize disk IO in a much more optimal way. If you see concurrency issues, you can tune this variable. Application tuning for InnoDB Make sure your application is prepared to handle deadlocks that may happen. I hope this helps!

Performance 144

Performance Hardware Tuning Storage 144

The Netflix TechBlog

JULY 21, 2022

Some features (as an example) include Device Type ID, SDK Version, Buffer Sizes, Cache Capacities, UI resolution, Chipset Manufacturer and Brand. Internally, the app caches several pre-fetched data, images, descriptions etc, and the time spent in the level could indicate whether or not those caches are cleared.

Big Data 184

Big Data Cache Engineering Data Engineering 184

Smashing Magazine

NOVEMBER 8, 2021

On top of this foundation, we add layers of caching, prerendering and edge delivery optimizations — not the other way around. Hydrogen fuels dynamic commerce by uniting React Server Components, streaming server-side rendering, and smart caching controls. Stay tuned for more in 2022! Large preview ).

Cache 139

Cache Best Practices Strategy Servers 139

Percona

MAY 1, 2023

Out of the box, the default PostgreSQL configuration is not tuned for any particular workload. It is primarily the responsibility of the database administrator or developer to tune PostgreSQL according to their system’s workload. What is PostgreSQL performance tuning? Why is PostgreSQL performance tuning important?

Tuning 52

Tuning Database Efficiency Performance 52

The Morning Paper

OCTOBER 18, 2020

Radix Sort is carefully designed to make effective use of the L2 cache and sequential memory accesses, whereas Learned Sort is making random accesses all over the destination array. How can learned sort be adapted to make it cache-efficient? If it’s high performance you’re after, you can’t ignore mechanical sympathy.

Cache 137

Cache C++ Java Tuning 137

Percona

MARCH 27, 2023

having to open each table.frm (and in which my test runs, I have purposely read a very high number of tables compared to “Table-open-cache” variable). When running only sysbench, there is a high number of cache hits (~99.98%) and a low number of “misses,” which means the table_cache is big enough for the workload.

Cache 124

Cache Hardware Servers Benchmarking 124

Percona

SEPTEMBER 1, 2023

While there is no magic bullet for MySQL performance tuning, there are a few areas that can be focused on upfront that can dramatically improve the performance of your MySQL installation. What are the Benefits of MySQL Performance Tuning? A finely tuned database processes queries more efficiently, leading to swifter results.

Tuning 52

Tuning Database Performance Hardware 52

Dynatrace

OCTOBER 15, 2020

From http.Transport documentation : By default, Transport caches connections for future reuse. So stay tuned! pconn.br = bufio.NewReader(pconn) pconn.bw = bufio.NewWriter(persistConnWriter{pconn}) go pconn.readLoop() go pconn.writeLoop() }. This may leave many open connections when accessing many hosts.

Transportation 190

Transportation Monitoring Metrics Code 190

Percona

NOVEMBER 9, 2023

With this data, we’ll be able to better understand and tune our Postgres servers. The main idea is to be able to easily detect what the server is doing at any point in time so we can better understand how it reacts to the workload and tune accordingly. You can search the blog for more information on this if needed.

Monitoring 124

Monitoring Tuning Metrics Servers 124

KeyCDN

NOVEMBER 4, 2021

Alternatively, If you would like to request a POP in a certain location or a new feature please let us know and stay tuned for more exciting announcements. If you are experiencing any issues with the new POP in Mexico City, check our status page to verify if we are conducting any scheduled maintenance or open a support request.

Latency 111

Latency Cache Tuning Traffic 111

Scalegrid

JANUARY 10, 2025

Performance Optimization Optimizing the performance of a distributed SQL database involves fine-tuning queries, indexing, and caching strategies to work effectively across multiple servers. This often means balancing the load to prevent any single node from affecting the overall performance.

Database 130

Database Best Practices Scalability Blockchain 130

John McCalpin

APRIL 25, 2023

For most high-end processors these values have remained in the range of 75% to 85% of the peak DRAM bandwidth of the system over the past 15-20 years — an amazing accomplishment given the increase in core count (with its associated cache coherence issues), number of DRAM channels, and ever-increasing pipelining of the DRAMs themselves.

Benchmarking 97

Benchmarking Cache Latency Tuning 97

KeyCDN

MARCH 10, 2021

If you'd like to request a POP in another location or a new feature please let us know and stay tuned for more exciting announcements. In fact, Denver will follow soon and further improve web performance in the US! Happy content delivery everyone!

Latency 110

Latency Internet Internet Speed 110

n0derunner

JULY 23, 2019

Many different queries are executing in parallel, some hitting RAM cache, some hitting storage. The Postgres DB is totally un-tuned and contains purely default settings. The variation in the transaction rate is due to the benchmark itself, the transaction rate is not expected to be uniform.

Benchmarking 76

Benchmarking Storage Cache Tuning 76

Tim Kadlec

APRIL 12, 2020

The cache hit was very low (a topic for another day), and whenever the server had to provide a fresh version of the page, it was taking an unacceptably long time more often than not. Synthetic tests, even properly tuned to match device and network characteristics, only occasionally surfaced the issue.

Cache 70

Cache Tuning Network Servers 70

Brendan Gregg

FEBRUARY 9, 2018

In this post I'll look at the Linux kernel page table isolation (KPTI) patches that workaround Meltdown: what overheads to expect, and ways to tune them. Cache Access Pattern Depending on the memory access pattern and working set size, an additional 1% to 10% overhead can occur at a certain syscall rate. and 4.14.12

Performance 72

Performance Benchmarking Cache Tuning 72

The Netflix TechBlog

DECEMBER 17, 2019

This way, log event processing can resume event-by-event afterwards, eventually discovering the watermarks, without ever needing to cache log event entries. Stay Tuned DBLog has additional capabilities which are not covered by this blog post, such as: Ability to capture table schemas without using locks. Figure 4— Delta Connector.

Database 216

Database Traffic Transportation Open Source 216

The Netflix TechBlog

DECEMBER 17, 2019

This way, log event processing can resume event-by-event afterwards, eventually discovering the watermarks, without ever needing to cache log event entries. Stay Tuned DBLog has additional capabilities which are not covered by this blog post, such as: Ability to capture table schemas without using locks. Figure 4— Delta Connector.

Database 202

Database Traffic Transportation Open Source 202