The Netflix TechBlog

JUNE 14, 2023

Before GraphQL: Monolithic Falcor API implemented and maintained by the API Team Before moving to GraphQL, our API layer consisted of a monolithic server built with Falcor. A single API team maintained both the Java implementation of the Falcor framework and the API Server. To launch Phase 1 safely, we used AB Testing.

Traffic 356

Traffic Latency Metrics Cache 356

The Netflix TechBlog

OCTOBER 29, 2020

The high likelihood of unreliable network connectivity led us to lean into mobile solutions for robust client side persistence and offline support. Poor network connectivity coupled with frequently changing configuration values in response to user activity means that on-device rule evaluation is preferable to server-side evaluation.

Mobile 279

Mobile Cache Network Technology 279

CSS Wizardry

SEPTEMBER 16, 2024

This gives fascinating insights into the network topography of our visitors, and how much we might be impacted by high latency regions. You can’t change that someone was from Nigeria, you can’t change that someone was on a mobile, and you can’t change their network conditions. Go and give it a quick read—the context will help.

Latency 244

Latency Cache Transportation Mobile 244

The Netflix TechBlog

SEPTEMBER 18, 2024

In this example configuration, the ngsegment namespace is backed by both a Cassandra cluster and an EVCache caching layer, allowing for highly durable persistent storage and lower-latency point reads. "persistence_configuration":[ Developers just provide their data problem rather than a database solution!

Latency 258

Latency Storage Cache Efficiency 258

High Scalability

JANUARY 11, 2022

When the server receives a request for an action (post, like etc.) We will use a cache having an LRU based eviction policy for caching user feeds of active users. It’s apparent that the most important features for feed ranking will be related to social network. High Level Design. Architecture. Optimization.

Design 334

Design Media Storage Logistics 334

Scalegrid

AUGUST 30, 2019

Redis , short for Remote Dictionary Server, is a BSD-licensed, open-source in-memory key-value data structure store written in C language by Salvatore Sanfillipo and was first released on May 10, 2009. Depending on how it is configured, Redis can act like a database, a cache or a message broker. Redis Strings Use Cases. Redis Sets.

Cache 232

Cache Ecommerce Social Media Database 232

CSS Wizardry

AUGUST 24, 2022

I can reload the exact same page under the exact same network conditions over and over, and I can guarantee I will not get the exact same, say, DOMContentLoaded each time. What if another file on the critical path had dropped out of cache and needed fetching from the network? In browserland, this is known Queuing.

Benchmarking 276

Benchmarking Metrics Cache Network 276

CSS Wizardry

AUGUST 7, 2019

A lot of people surmise that TTFB is merely time spent on the server, but that is only a small fraction of the true extent of things. TTFB isn’t just time spent on the server, it is also the time spent getting from our device to the sever and back again (carrying, that’s right, the first byte of data!). Expect closer to 75ms.

Latency 274

Latency Ecommerce Servers Mobile 274

Dynatrace

AUGUST 30, 2019

Missing Cache Settings – Make sure you cache resources that don’t change often on the browser or use a CDN. Impacting Server-Side Requests: Dynatrace allows you to drill into your server-side requests to understand why your business logic is executing slow or fails. N+1 Query Pattern.

Cache 214

Cache Database Architecture Government 214

Alex Russell

MARCH 31, 2022

Browsers will cache tools popular among vocal, leading-edge developers. There's plenty of space for caching most popular frameworks. The best available proxy data also suggests that shared caches would have a minimal positive effect on performance. Browsers now understand the classic shared HTTP cache behaviour as a privacy bug.

Cache 89

Cache Government Traffic Network 89

Smashing Magazine

MAY 16, 2022

Rethinking Server-Timing As A Critical Monitoring Tool. Rethinking Server-Timing As A Critical Monitoring Tool. In the world of HTTP Headers, there is one header that I believe deserves more air-time and that is the Server-Timing header. Setting Server-Timing. Sean Roberts. 2022-05-16T10:00:00+00:00.

Servers 111

Servers Monitoring Cache Network 111

Scalegrid

OCTOBER 2, 2019

This Redis management solution allows startups up to enterprise-level organizations automate their Redis operations on Microsoft Azure dedicated cloud servers, alongside their other open source database deployments, including MongoDB , MySQL and PostgreSQL. PALO ALTO, Calif.,

Azure 37

Azure Cloud Open Source Virtualization 37

The Netflix TechBlog

SEPTEMBER 8, 2020

This allows the app to query a list of “paths” in each HTTP request, and get specially formatted JSON (jsonGraph) that we use to cache the data and hydrate the UI. Latencies The old api service was running on the same “machine” that also cached a lot of video metadata (by design). This meant that data that was static (e.g.

Latency 239

Latency Cache Java Traffic 239

Smashing Magazine

SEPTEMBER 28, 2022

The resource loading waterfall is a cascade of files downloaded from the network server to the client to load your website from start to finish. It essentially describes the lifetime of each file you download to load your page from the network. You can see this by opening your browser and looking in the Networking tab.

Cache 141

Cache Performance Servers Architecture 141

Dynatrace

MAY 17, 2023

When software runs in a monolithic stack on on-site servers, observability is manageable enough. Once the user submits the form, this part establishes REST connections to the agents, which execute the network call appropriate for the provided URL and return all information they managed to gather to the central PHP service.

Metrics 245

Metrics Open Source Traffic Cache 245

The Netflix TechBlog

NOVEMBER 23, 2020

Introducing gnmi-gateway: a modular, distributed, and highly available service for modern network telemetry via OpenConfig and gNMI By: Colin McIntosh, Michael Costello Netflix runs its own content delivery network, Open Connect , which delivers all streaming traffic to our members.

Open Source 187

Open Source Network Transportation Cache 187

KeyCDN

FEBRUARY 4, 2021

This query is performed by a Domain Name Server (DNS server) or servers nearby that have been assigned responsibility for that hostname. You can think of a DNS server as a phone book for the internet. A DNS server maintains a directory of domain names and translates them to IPs. So DNS services definitely go down!

Cache 134

Cache Website Internet Internet 134

The Netflix TechBlog

SEPTEMBER 10, 2024

By Karthik Yagna , Baskar Odayarkoil , and Alex Ellis Pushy is Netflix’s WebSocket server that maintains persistent WebSocket connections with devices running the Netflix application. What if we wanted to move past Pushy’s pattern of delivering server-side messages?

Latency 231

Latency Cache Tuning Efficiency 231

Smashing Magazine

DECEMBER 23, 2020

However, let’s take a step further and learn how to deploy modern qualities to PWAs, such as offline functionality, network-based optimizing, cross-device user experience, SEO capabilities, and non-intrusive notifications and requests. The service workers also retrieve the latest data once the server connection is restored.

Cache 136

Cache Internet Internet Google 136

Scalegrid

MARCH 28, 2024

Key Takeaways Redis offers complex data structures and additional features for versatile data handling, while Memcached excels in simplicity with a fast, multi-threaded architecture for basic caching needs. Redis is better suited for complex data models, and Memcached is better suited for high-throughput, string-based caching scenarios.

Cache 130

Cache Storage Architecture Scalability 130

All Things Distributed

SEPTEMBER 3, 2013

Amazon RDS , with support for MySQL, SQL Server and Oracle databases, is for customers with apps where relational database features and support for a specific brand of database are critical. Amazon ElastiCache is a fully managed, in-memory caching service for customers to optimize the latency, performance and cost of their read workloads.

Cache 97

Cache Cloud Performance Retail 97

All Things Distributed

AUGUST 17, 2011

No Server Required - Jekyll & Amazon S3. Amazon S3 is much more than just storage; the network and distributed systems infrastructure to ensure that content can be served fast and at high rates without customers impacting each other, is amazing. No Server Required. All Things Distributed. Comments (). Amazon S3 FTW!

Servers 109

Servers Social Media AWS Website 109

Scalegrid

JANUARY 25, 2024

You will need to know which monitoring metrics for Redis to watch and a tool to monitor these critical server metrics to ensure its health. Evaluating factors like hit rate, which assesses cache efficiency level, or tracking key evictions from the cache are also essential elements during the Redis monitoring process.

Metrics 130

Metrics Monitoring Latency Cache 130

Smashing Magazine

NOVEMBER 8, 2021

From connecting back-office operations to front-of-the-house A/B testing and dynamic personalization for each customer, the shared foundation is fast server-side rendering powered by fast storefront data access. On top of this foundation, we add layers of caching, prerendering and edge delivery optimizations — not the other way around.

Cache 139

Cache Best Practices Strategy Servers 139

Scalegrid

APRIL 16, 2020

A vast majority of the features are the same, outside of these advanced features available through the BYOC model: Virtual Private Clouds / Virtual Networks. Amazon Virtual Private Clouds (VPC) and Azure Virtual Networks (VNET) are private, isolated sections of the cloud infrastructure where you can launch resources. Security Groups.

Cloud 242

Cloud Azure AWS Database 242

Dynatrace

MAY 2, 2019

This blog post introduces the new REST API improvements and some best practices for streamlining API requests and decreasing load on the API by reducing the number of requests required for reporting and reducing the network bandwidth required for implementing common API use cases.

Best Practices 174

Best Practices Monitoring Cache Speed 174

Smashing Magazine

NOVEMBER 4, 2021

One of the main benefits of GraphQL is the client’s ability to request what they need from the server and receive that data exactly and predictably. We’ll be learning how to do this with GraphQL Features like Cache Update, Subscriptions, and Optimistic UI. Updating the cache directly using update function on the useMutation.

Cache 129

Cache Servers Code Transportation 129

Smashing Magazine

JUNE 29, 2021

Without build optimizations (incremental builds, caching, we will get to those soon) this will eventually become unmanageable as well — think about going through all images in a website: resizing, deleting, and/or creating new files over and over again. Under the hood, it simplifies a lot of the work to the server-side.

Cache 139

Cache Website Strategy Traffic 139

All Things Distributed

DECEMBER 5, 2010

The naming system that we are all most familiar with in the internet is the Domain Name System (DNS) that manages the naming of the many different entities in our global network; its most common use is to map a name to an IP address, but it also provides facilities for aliases, finding mail servers, managing security keys, and much more.

Cloud 111

Cloud Internet Internet AWS 111

High Scalability

OCTOBER 3, 2019

This Redis management solution allows startups up to enterprise-level organizations automate their Redis operations on Microsoft Azure dedicated cloud servers, alongside their other open source database deployments, including MongoDB , MySQL and PostgreSQL.

Azure 23

Azure Cloud Open Source Cache 23

The Netflix TechBlog

OCTOBER 8, 2024

Challenges At Netflix, temporal data is continuously generated and utilized, whether from user interactions like video-play events, asset impressions, or complex micro-service network activities. The storage server capacity can be recomputed to accommodate changing requirements using our capacity planner. Also, with Cassandra 4.x,

Latency 237

Latency Storage Traffic Tuning 237

Smashing Magazine

JULY 18, 2022

Segmented Rendering is a new pattern for the Jamstack that lets you personalize content statically, without any sort of client-side rendering or per-request Server-Side Rendering. Like other similar UI libraries, React provides two ways of rendering content: client-side and server-side. CSR, SSR, SSG… Let’s Clarify What They Are.

Cache 127

Cache Website Servers Energy 127

Percona

SEPTEMBER 26, 2023

All you need to do is: Ensure that the source server has binary logs enabled Grant appropriate permissions Execute the CLONE INSTANCE command on the recipient This works extremely easily when you provision a new replica that doesn’t have any data. Some options control data retrieval in case of network failure.

Servers 122

Servers Network Cache Processing 122

Smashing Magazine

NOVEMBER 22, 2021

A website’s performance can make or break its success, yet in August 2020, despite many improvements we had previously made, such as implementing Server-Side Rendering (SSR), the ratio of Wix websites with good Google Core Web Vitals (CWV) scores was only 4%. Dan Shappir. 2021-11-22T10:30:00+00:00. 2021-11-22T11:06:56+00:00.

Website 141

Website Performance Google Website Performance 141

ScaleOut Software

APRIL 22, 2020

The Solution: Distributed Caching. A widely used technology called distributed caching meets this need by storing frequently accessed data in memory on a server farm instead of within a database. This speeds up accesses and updates while offloading back-end database servers.

Cache 52

Cache Storage Servers Database 52

ScaleOut Software

APRIL 22, 2020

The Solution: Distributed Caching. A widely used technology called distributed caching meets this need by storing frequently accessed data in memory on a server farm instead of within a database. This speeds up accesses and updates while offloading back-end database servers.

Cache 52

Cache Storage Servers Database 52

Smashing Magazine

SEPTEMBER 6, 2021

Next, we’ll look at how to set up servers and clients (that’s the hard part unless you’re using a content delivery network (CDN)). This difference by itself doesn’t do all that much (it mainly reduces the overhead on the server-side), but it leads to most of the following points. Server Sharding and Connection Coalescing.

Network 120

Network Servers Cache Traffic 120