Remove Cache Remove Games Remove Latency
article thumbnail

Foundation Model for Personalized Recommendation

The Netflix TechBlog

Yet, many are confined to a brief temporal window due to constraints in serving latency or training costs. In recommendation systems, context windows during inference are often limited to hundreds of eventsnot due to model capability but because these services typically require millisecond-level latency.

Tuning 163
article thumbnail

Pushy to the Limit: Evolving Netflix’s WebSocket proxy for the future

The Netflix TechBlog

Dynomite is a Netflix open source wrapper around Redis that provides a few additional features like auto-sharding and cross-region replication, and it provided Pushy with low latency and easy record expiry, both of which are critical for Pushy’s workload. As Pushy’s portfolio grew, we experienced some pain points with Dynomite.

Latency 234
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Introducing Netflix TimeSeries Data Abstraction Layer

The Netflix TechBlog

Rajiv Shringi Vinay Chella Kaidan Fullerton Oleksii Tkachuk Joey Lynch Introduction As Netflix continues to expand and diversify into various sectors like Video on Demand and Gaming , the ability to ingest and store vast amounts of temporal data — often reaching petabytes — with millisecond access latency has become increasingly vital.

Latency 239
article thumbnail

Performance Hero: Annie Sullivan

Speed Curve

Of course writes were much less common than reads, so I added a caching layer for reads, and that did the trick. After I finished college, I did performance work here and there while developing games for Playstation 2, and later at Google. But my original version was slow, because I queried the database for every page load.

article thumbnail

Expanding the Cloud: More memory, more caching and more performance for your data

All Things Distributed

Amazon ElastiCache is a fully managed, in-memory caching service for customers to optimize the latency, performance and cost of their read workloads. For example, Scopely has built their gaming platform with DynamoDB as their primary datastore, while using Amazon RDS where they need complex query support.

Cache 97
article thumbnail

5.5 mm in 1.25 nanoseconds

Randon ASCII

That meant I started having regular meetings with the hardware engineers who were working with IBM on the CPU which gave me even more expertise on this CPU, which was critical in helping me discover a design flaw in one of its instructions , and in helping game developers master this finicky beast. To the left of that is one of the CPU cores.

Cache 126
article thumbnail

A one size fits all database doesn't fit anyone

All Things Distributed

Typical use cases for a relational database include web and mobile applications, enterprise applications, and online gaming. Use cases such as gaming, ad tech, and IoT lend themselves particularly well to the key-value data model where the access patterns require low-latency Gets/Puts for known key values.

Database 166