The Netflix TechBlog

JUNE 14, 2023

Before GraphQL: Monolithic Falcor API implemented and maintained by the API Team Before moving to GraphQL, our API layer consisted of a monolithic server built with Falcor. A single API team maintained both the Java implementation of the Falcor framework and the API Server. To launch Phase 1 safely, we used AB Testing.

Traffic 355

Traffic Latency Metrics Cache 355

Dynatrace

JANUARY 16, 2023

On-premises data centers invest in higher capacity servers since they provide more flexibility in the long run, while the procurement price of hardware is only one of many cost factors. That trend will likely continue as Kubernetes security awareness further rises and a new class of security solutions becomes available.

Open Source 358

Open Source Java Operating System Programming 358

CSS Wizardry

MAY 31, 2019

Users might already have the file cached. If website-a.com links to [link] , and a user goes from there to website-b.com who also links to [link] , then the user will already have that file in their cache. Critical assets are far too valuable to leave on someone else’s servers. Penalty: Caching. Risk: Service Shutdowns.

Cache 277

Cache Latency Infrastructure Website 277

Scalegrid

JULY 8, 2020

If you must kill the script at this point, there are two options available: SCRIPT KILL command can be used to stop a script that hasn’t yet done any writes. If the script has already performed writes to the server and must still be killed, use the SHUTDOWN NOSAVE to shutdown the server completely. Expert Tip. Demonstration.

Servers 239

Servers Database Availability Monitoring 239

The Netflix TechBlog

SEPTEMBER 18, 2024

Central to this infrastructure is our use of multiple online distributed databases such as Apache Cassandra , a NoSQL database known for its high availability and scalability. Data Model At its core, the KV abstraction is built around a two-level map architecture. Developers just provide their data problem rather than a database solution!

Latency 256

Latency Storage Cache Efficiency 256

High Scalability

FEBRUARY 17, 2021

Redis Server: 5.07, x86/64. MongoDB server: 4.4.2, BangDB server: 2.0.0, Application example: user profile cache, where profiles are constructed elsewhere (e.g., However, user can run the bench for as many numbers as they practically find suitable. About YCSB. Following configurations were used for the evaluation purpose.

Benchmarking 308

Benchmarking Latency C++ Database 308

CSS Wizardry

SEPTEMBER 16, 2024

However, there are a handful of ways available to us—some are, admittedly, more easy and free than others. Reduce Transfer Size Broadly simplified… Web servers don’t send whole files at once—they chunk them into packets and send those. permitted the opening of multiple simultaneous connections to a server at once.

Latency 244

Latency Cache Transportation Mobile 244

The Netflix TechBlog

OCTOBER 29, 2020

This translates to a large number of app configurations to toggle feature availability and optimize the in-app experience for each production. For our use-case, we’re configuring the availability of production, version, and region specific app feature sets. This led us to build a lightweight Hendrix mobile SDK?

Mobile 279

Mobile Cache Network Technology 279

John McCalpin

FEBRUARY 17, 2025

The Multicore Era Over the past ~15 years, server processors from Intel and AMD have evolved from the early quad-core processors to the current monsters with over 50 cores per socket. GB/s peak DRAM bandwidth, requiring 6 concurrent 64-byte cache line accesses to be pending at all times to maintain full bandwidth.

Latency 68

Latency Hardware Cache Systems 68

Dynatrace

JANUARY 31, 2024

The RAG process begins by summarizing and converting user prompts into queries that are sent to a search platform that uses semantic similarities to find relevant data in vector databases, semantic caches, or other online data sources. million AI server units annually by 2027, consuming 75.4+

Cache 276

Cache Azure Infrastructure Monitoring 276

Percona

JUNE 22, 2023

To make data count and to ensure cloud computing is unabated, companies and organizations must have highly available databases. This guide provides an overview of what high availability means, the components involved, how to measure high availability, and how to achieve it.

Availability 132

Availability Database Open Source Hardware 132

CSS Wizardry

AUGUST 7, 2019

A lot of people surmise that TTFB is merely time spent on the server, but that is only a small fraction of the true extent of things. TTFB isn’t just time spent on the server, it is also the time spent getting from our device to the sever and back again (carrying, that’s right, the first byte of data!). Expect closer to 75ms.

Latency 274

Latency Ecommerce Servers Mobile 274

The Netflix TechBlog

MAY 4, 2023

It provides a good read on the availability and latency ranges under different production conditions. These include options where replay traffic generation is orchestrated on the device, on the server, and via a dedicated service. Also, since this logic resides on the server side, we can iterate on any required changes faster.

Traffic 343

Traffic Latency Tuning Systems 343

Dynatrace

OCTOBER 7, 2021

Serverless architecture shifts application hosting functions away from local servers onto those managed by providers. This means you no longer have to provision, scale, and maintain servers to run your applications, databases, and storage systems. Let’s get started. Serverless architecture: A primer. Application integration.

Serverless 325

Serverless AWS Lambda Storage 325

Alex Russell

MARCH 31, 2022

Browsers will cache tools popular among vocal, leading-edge developers. There's plenty of space for caching most popular frameworks. The best available proxy data also suggests that shared caches would have a minimal positive effect on performance. Suppose a user has only downloaded part of the cache.

Cache 89

Cache Government Traffic Network 89

Dynatrace

AUGUST 30, 2019

We have several YouTube Tutorials and blog posts available that show how you can use Dynatrace RUM data for Web Performance & User Experience Optimization. Missing Cache Settings – Make sure you cache resources that don’t change often on the browser or use a CDN. Impressive results I have to say!

Cache 214

Cache Database Architecture Government 214

KeyCDN

JUNE 6, 2019

We’re happy to announce that WebP Caching has landed! The new feature integrates into the existing CDN and is available to all customers. We offer both a one click solution with no change required on your origin server as well as an approach where you can deliver the WebP assets from your origin server.

Cache 81

Cache Servers Website Traffic 81

Scalegrid

OCTOBER 2, 2019

This Redis management solution allows startups up to enterprise-level organizations automate their Redis operations on Microsoft Azure dedicated cloud servers, alongside their other open source database deployments, including MongoDB , MySQL and PostgreSQL. PALO ALTO, Calif.,

Azure 37

Azure Cloud Open Source Virtualization 37

Percona

NOVEMBER 1, 2023

MySQL Server – Community Edition The problem applies to all versions of the upstream MySQL Community up to 8.0.23. Here is an example scenario you may end up here: mysql > select @@version,@@version_comment; + --+ + | @@version | @@version_comment | + --+ + | 5.7.43 | MySQL Community Server (GPL) | + --+ + 1 row in set (0.00

Servers 117

Servers Database Cache C++ 117

Smashing Magazine

MAY 16, 2022

Rethinking Server-Timing As A Critical Monitoring Tool. Rethinking Server-Timing As A Critical Monitoring Tool. In the world of HTTP Headers, there is one header that I believe deserves more air-time and that is the Server-Timing header. Setting Server-Timing. Sean Roberts. 2022-05-16T10:00:00+00:00.

Servers 111

Servers Monitoring Cache Network 111

SQL Shack

NOVEMBER 23, 2021

This article explores the Hybrid Buffer Pool feature available in the SQL Server 2019. Introduction SQL Server uses Dynamic Random Access Memory (D-RAM) buffer pool for caching data pages retrieved from the disk. The buffer cache stores the page and writes back to disk only if it is modified.

Servers 93

Servers Cache Availability Performance 93

Scalegrid

MARCH 28, 2024

Key Takeaways Redis offers complex data structures and additional features for versatile data handling, while Memcached excels in simplicity with a fast, multi-threaded architecture for basic caching needs. Redis is better suited for complex data models, and Memcached is better suited for high-throughput, string-based caching scenarios.

Cache 130

Cache Storage Architecture Scalability 130

Percona

APRIL 6, 2023

Load balancing One of the primary benefits of using pgpool-II is its ability to distribute incoming client connections across multiple PostgreSQL servers, allowing you to balance the load and increase the capacity of your database cluster. This can significantly improve query response times and reduce the load on your database servers.

Cache 138

Cache Open Source Benchmarking Database 138

Dynatrace

MAY 17, 2023

When software runs in a monolithic stack on on-site servers, observability is manageable enough. OpenTelemetry demo application: Distributed host/URL availability checker For our demo, we picked a web-based application whose core service is a distributed host/URL availability check.

Metrics 245

Metrics Open Source Traffic Cache 245

The Netflix TechBlog

NOVEMBER 4, 2019

By batching and parallelizing the requests to retrieve many creatives via a single query to the GraphQL server, we can optimize the index building process. Best of all, our page can load much faster since everything is cached in Elasticsearch. To act on the change, we need a GraphQL server that supports introspection.

Cache 243

Cache Database Servers Performance 243

Scalegrid

OCTOBER 2, 2019

This management solution for Redis™ allows startups up to enterprise-level organizations automate their Redis™ operations on Microsoft Azure dedicated cloud servers, alongside their other open source database deployments, including MongoDB , MySQL and PostgreSQL. PALO ALTO, Calif.,

Azure 100

Azure Availability Open Source Virtualization 100

Percona

APRIL 7, 2023

If we were to select the most important MySQL setting, if we were given a freshly installed MySQL or Percona Server for MySQL and could only tune a single MySQL variable, which one would it be? Sysbench ran on a third server, which I’ll refer to as the application server (APP).

Tuning 145

Tuning Cache Servers Benchmarking 145

The Netflix TechBlog

SEPTEMBER 10, 2024

By Karthik Yagna , Baskar Odayarkoil , and Alex Ellis Pushy is Netflix’s WebSocket server that maintains persistent WebSocket connections with devices running the Netflix application. What if we wanted to move past Pushy’s pattern of delivering server-side messages?

Latency 230

Latency Cache Tuning Efficiency 230

All Things Distributed

SEPTEMBER 3, 2013

Choosing your database architecture may be the most critical decision you’ll make and has a disproportionate impact on the performance, scalability, and availability of your app. Get it right and your application will seamlessly scale from hundreds to tens of millions of users without difficulty, while remaining performant and available.

Cache 99

Cache Cloud Performance Retail 99

SQL Performance

SEPTEMBER 21, 2022

Even SQL Server stores some flag-based data using bitwise representation. Examples include the following: The set_options and required_cursor_options cached plan attributes, which you obtain using the sys.dm_exec_plan_attributes DMF. Setting the server configuration option “ user options” using bitwise representation.

Servers 122

Servers C++ Code Cache 122

Percona

SEPTEMBER 28, 2023

Whenever you install your favorite MySQL server on a freshly created Ubuntu instance, you start by updating the configuration for MySQL, such as configuring buffer pool, changing the default datadir director, and disabling one of the most outstanding features – query cache. It’s a nice thing to do, but first things first.

Servers 128

Servers Best Practices Database Open Source 128

SQL Performance

OCTOBER 7, 2020

Its raison d’être is to cache result rows from a plan subtree, then replay those rows on subsequent iterations if any correlated loop parameters are unchanged. Table-valued functions use a table variable, which can be used to cache and replay results in suitable circumstances. Spools are the least costly way to cache partial results.

Servers 106

Servers Cache Azure Performance 106

Dynatrace

MARCH 22, 2023

This method involves providing the lowest level of access by default, deleting inactive accounts, and auditing server activity. For these, it’s important to turn off auto-completing forms, encrypt data both in transit and at rest with up-to-date encryption techniques, and disable caching on data collection forms.

Open Source 246

Open Source Artificial Intelligence Internet Internet 246

Dynatrace

NOVEMBER 3, 2021

Examples include a spike in memory utilization, a decrease in cache hit ratio, or an increase in CPU utilization. At the same time, metrics on a dashboard are showing resource exhaustion issues, such as lack of available memory. DevOps practitioners struggle to maintain highly available and scalable applications.

Monitoring 264

Monitoring Metrics DevOps Scalability 264

O'Reilly Software

DECEMBER 28, 2017

Learn how to properly design RESTful APIs communication with clients, accounting for request structure, authentication, and caching. In this second part, we will talk in more detail about how the server should react to incoming requests with status codes. We are using the principles of RESTful architecture over HTTP.

Servers 83

Servers Cache Mobile Architecture 83

Dynatrace

AUGUST 12, 2019

With OneAgent installed on an application server, Davis, the Dynatrace AI causation engine, continuously analyzes all database statements within the context of your applications. With additional data from the database server, you’ll be able to resolve performance problems that are rooted deep in the database layer.

Database 170

Database Metrics Cache Servers 170

KeyCDN

SEPTEMBER 3, 2020

Our solution doesn't require any change on the origin server. Even if a browser doesn't support WebP, our WebP caching feature will ensure that the correct image format is delivered. WebP delivery doesn't require any change on the origin server with the WebP caching feature. Enable the Cache Key Host setting.

Processing 127

Processing Cache Website Servers 127