article thumbnail

Foundation Model for Personalized Recommendation

The Netflix TechBlog

It facilitates the distribution of these learnings to other models, either through shared model weights for fine tuning or directly through embeddings. In NLP, the trend is moving away from numerous small, specialized models towards a single, large language model that can perform a variety of tasks either directly or with minimal fine-tuning.

Tuning 200
article thumbnail

Netflix’s Distributed Counter Abstraction

The Netflix TechBlog

Best Effort Regional Counter This type of counter is powered by EVCache , Netflix’s distributed caching solution built on the widely popular Memcached. Rollup Cache To optimize read performance, these values are cached in EVCache for each counter. We hope you found this blog post insightful.

Latency 251
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

The Challenges of Ajax CDN

DZone

For the longest time, hosting static files on CDNs was the de facto standard for performance tuning website pages. The host offered browser caching advantages, better stability, and storage on fast edge servers across strategic geolocations. Not only did it have performance benefits, but it was also convenient for developers.

Cache 305
article thumbnail

An approach to index tuning – Part 2

SQL Performance

In my last post , I started to outline the process I go through when tuning queries – specifically when I discover that I need to add a new index, or modify an existing one. His version can be used for the plan cache – the only challenge there is the information is transient, so you may not capture every query that uses a particular index.

Tuning 137
article thumbnail

An approach to index tuning – part 1

SQL Performance

A performance tuning engagement can end up taking many turns as you work through it – it all depends on what is showing up as the problem and what the data tells you. One of my favorite parts of tuning is working with indexes and, as I was thinking about this post, I was tempted to label index tuning as an "easier" task… but it really isn't.

Tuning 130
article thumbnail

PostgreSQL Connection Pooling: Part 3 – Pgpool-II

Scalegrid

Once authentication succeeds, it checks if it already has a cached connection for this database+user combination. Once the client disconnects, Pgpool-II has to decide whether to cache the connection: If it has an empty slot, it caches it. Stay tuned! If it does, it returns the connection to the client.

Cache 264
article thumbnail

Migrating Netflix to GraphQL Safely

The Netflix TechBlog

The GraphQL shim enabled client engineers to move quickly onto GraphQL, figure out client-side concerns like cache normalization, experiment with different GraphQL clients, and investigate client performance without being blocked by server-side migrations. To launch Phase 1 safely, we used AB Testing.

Traffic 357