Remove Article Remove Cache Remove Storage
article thumbnail

Introducing Netflix’s Key-Value Data Abstraction Layer

The Netflix TechBlog

Our goal was to build a versatile and efficient data storage solution that could handle a wide variety of use cases, ranging from the simplest hashmaps to more complex data structures, all while ensuring high availability, tunable consistency, and low latency. Developers just provide their data problem rather than a database solution!

Latency 260
article thumbnail

How To Design For High-Traffic Events And Prevent Your Website From Crashing

Smashing Magazine

How To Design For High-Traffic Events And Prevent Your Website From Crashing How To Design For High-Traffic Events And Prevent Your Website From Crashing Saad Khan 2025-01-07T14:00:00+00:00 2025-01-07T22:04:48+00:00 This article is sponsored by Cloudways Product launches and sales typically attract large volumes of traffic.

Traffic 86
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

PostgreSQL Indexes Can Hurt You: Negative Effects and the Costs Involved

Percona

I keep seeing many articles and talks on “tuning” discussing how creating new indexes speeds up SQL but rarely ones discussing removing them. The more indexes, the more the requirement of memory for effective caching. Cache requirements for indexes are generally much higher than associated tables.

Tuning 139
article thumbnail

Data ingestion pipeline with Operation Management

The Netflix TechBlog

We refer the reader to our previous blog article for details. We store all OperationIDs which are in STARTED state in a distributed cache (EVCache) for fast access during searches. For example, they can store the annotations in a blob storage like S3 and give us a link to the file as part of the single API.

Media 272
article thumbnail

Pushy to the Limit: Evolving Netflix’s WebSocket proxy for the future

The Netflix TechBlog

Since that presentation, Pushy has grown in both size and scope, and this article will be discussing the investments we’ve made to evolve Pushy for the next generation of features. KeyValue is an abstraction over the storage engine itself, which allows us to choose the best storage engine that meets our SLO needs.

Latency 234
article thumbnail

Improving Spark Memory Resource With Off-Heap In-Memory Storage

DZone

To share more thoughts and experiments on how Alluxio enhances Spark workloads, this article focuses on how Alluxio helps to optimize the memory utilization of Spark applications. Improve your Spark memory. In the previous tutorial , we demonstrated how to get started with Spark and Alluxio.

Storage 113
article thumbnail

Redis vs Memcached in 2024

Scalegrid

Key Takeaways Redis offers complex data structures and additional features for versatile data handling, while Memcached excels in simplicity with a fast, multi-threaded architecture for basic caching needs. Redis is better suited for complex data models, and Memcached is better suited for high-throughput, string-based caching scenarios.

Cache 130