Remove Availability Remove Cache Remove Storage
article thumbnail

Netflix’s Distributed Counter Abstraction

The Netflix TechBlog

Both categories share common requirements, such as high throughput and high availability. After selecting a mode, users can interact with APIs without needing to worry about the underlying storage mechanisms and counting methods. The table below provides a detailed overview of the diverse requirements across these two categories.

Latency 251
article thumbnail

The Power of Caching: Boosting API Performance and Scalability

DZone

Caching is the process of storing frequently accessed data or resources in a temporary storage location, such as memory or disk, to improve retrieval speed and reduce the need for repetitive processing.

Cache 246
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Consistent caching mechanism in Titus Gateway

The Netflix TechBlog

We introduce a caching mechanism in the API gateway layer, allowing us to offload processing from singleton leader elected controllers without giving up strict data consistency and guarantees clients observe. When a new leader is elected it loads all data from external storage. The cache is kept in sync with the current leader process.

Cache 233
article thumbnail

Introducing Netflix’s Key-Value Data Abstraction Layer

The Netflix TechBlog

Central to this infrastructure is our use of multiple online distributed databases such as Apache Cassandra , a NoSQL database known for its high availability and scalability. This flexibility allows our Data Platform to route different use cases to the most suitable storage system based on performance, durability, and consistency needs.

Latency 260
article thumbnail

How To Design For High-Traffic Events And Prevent Your Website From Crashing

Smashing Magazine

The good news is that you can maximize availability and prevent website crashes by designing websites specifically for these events. There are also online optimization tools available like Tinify , as well as advanced image editing software like Photoshop or GIMP : Image format is also a key consideration. Lets jump right in!

Traffic 86
article thumbnail

Mastering Disk Space Management with MongoDB® Storage Engines

Scalegrid

MongoDB offers several storage engines that cater to various use cases. The default storage engine in earlier versions was MMAPv1, which utilized memory-mapped files and document-level locking. The newer, pluggable storage engine, WiredTiger, addresses this by using prefix compression, collection-level locking, and row-based storage.

Storage 130
article thumbnail

Improved Alerting with Atlas Streaming Eval

The Netflix TechBlog

While Atlas is architected around compute & storage separation, and we could theoretically just scale the query layer to meet the increased query demand, every query, regardless of its type, has a data component that needs to be pushed down to the storage layer. This is one of the reasons it has taken us years to get here.

Storage 297