Remove Architecture Remove Cache Remove Scalability
article thumbnail

Consistent caching mechanism in Titus Gateway

The Netflix TechBlog

The original assumptions and architectural choices were no longer viable. We introduce a caching mechanism in the API gateway layer, allowing us to offload processing from singleton leader elected controllers without giving up strict data consistency and guarantees clients observe. How do I know that my cache is up to date?

Cache 228
article thumbnail

Title Launch Observability at Netflix Scale

The Netflix TechBlog

This thoughtful approach doesnt just address immediate hurdles; it builds the resilience and scalability needed for the future. Personalization systems handle the recommendation and serving of titles on these canvases, leveraging a vast ecosystem of microservices, caches, databases, code, and configurations to build these product canvases.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Netflix’s Distributed Counter Abstraction

The Netflix TechBlog

Best Effort Regional Counter This type of counter is powered by EVCache , Netflix’s distributed caching solution built on the widely popular Memcached. Rollup Cache To optimize read performance, these values are cached in EVCache for each counter.

Latency 247
article thumbnail

AWS serverless services: Exploring your options

Dynatrace

To get a better understanding of AWS serverless, we’ll first explore the basics of serverless architectures, review AWS serverless offerings, and explore common use cases. Serverless architecture: A primer. Serverless architecture shifts application hosting functions away from local servers onto those managed by providers.

article thumbnail

Improved Alerting with Atlas Streaming Eval

The Netflix TechBlog

While we were able to put out the immediate fire by disabling the newly created alerts, this incident raised some critical concerns around the scalability of our alerting system. It became clear to us that we needed to solve the scalability problem with a fundamentally different approach. OK, Results?

Storage 293
article thumbnail

How DoorDash Rearchitected its Cache to Improve Scalability and Performance

InfoQ

DoorDash rearchitected the heterogeneous caching system they were using across all of their microservices and created a common, multi-layered cache providing a generic mechanism and solving a number of issues coming from the adoption of a fragmented cache. By Sergio De Simone

Cache 112
article thumbnail

Designing Instagram

High Scalability

Architecture. We have chosen this NoSQL based solution over relational databases as it provides the scalability to have hierarchies which go beyond two levels and extensibility due to the schema-less behavior of NoSQL data storage. We will use a cache having an LRU based eviction policy for caching user feeds of active users.

Design 334