Percona

APRIL 14, 2023

A shared characteristic in most (if not all) databases, be them traditional relational databases like Oracle, MySQL, and PostgreSQL or some kind of NoSQL-style database like MongoDB, is the use of a caching mechanism to keep (a copy of) part of the data in memory. How do you know if your MySQL database caching is operating efficiently?

Cache 96

Cache Efficiency Database Monitoring 96

The Netflix TechBlog

APRIL 27, 2023

Moreover, common database optimizations like caching recently queried data don’t really work for alerting queries because, generally speaking, the last received datapoint is required for correctness. For the example query listed above, the data expressions are name,errors,:eq,:sum and name,rps,:eq,:sum.

Storage 300

Storage Cache Metrics Database 300

High Scalability

JANUARY 11, 2022

We will use a cache having an LRU based eviction policy for caching user feeds of active users. For example, one user is a close follower of Elon Musk while another user can be a close follower of Gordon Ramsay. Optimization. It’s apparent that the most important features for feed ranking will be related to social network.

Design 334

Design Media Storage Logistics 334

Alex Russell

MARCH 31, 2022

Browsers will cache tools popular among vocal, leading-edge developers. There's plenty of space for caching most popular frameworks. The best available proxy data also suggests that shared caches would have a minimal positive effect on performance. Browsers now understand the classic shared HTTP cache behaviour as a privacy bug.

Cache 89

Cache Government Traffic Network 89

High Scalability

FEBRUARY 17, 2021

An application example is a session store recording recent actions. Application example: photo tagging; add a tag is an update, but most operations are to read tags. Application example: user profile cache, where profiles are constructed elsewhere (e.g., Run phase is where each db is tested for different test conditions.

Benchmarking 308

Benchmarking Latency C++ Database 308

Scalegrid

AUGUST 30, 2019

Depending on how it is configured, Redis can act like a database, a cache or a message broker. Session Cache: Many websites leverage Redis Strings to create a session cache to speed up their website experience by caching HTML fragments or pages. Let’s look at an example: LPUSH list x # now the list is "x".

Cache 232

Cache Ecommerce Social Media Database 232

Smashing Magazine

MAY 9, 2022

Performance Game Changer: Browser Back/Forward Cache. Performance Game Changer: Browser Back/Forward Cache. With that caveat out of the way, let’s get to the guts of the article: What is the Back/Forward Cache and why does it matter so much? Didn’t The HTTP Cache Do All That Anyway? Barry Pollard.

Cache 93

Cache Games Performance Website 93

The Netflix TechBlog

JUNE 14, 2023

The GraphQL shim enabled client engineers to move quickly onto GraphQL, figure out client-side concerns like cache normalization, experiment with different GraphQL clients, and investigate client performance without being blocked by server-side migrations. For example, is it more correct for an array to be empty or null, or is it just noise?

Traffic 358

Traffic Latency Metrics Cache 358

Dynatrace

JANUARY 31, 2024

For example, a Stanford University and UC Berkeley team noted in a research study that ChatGPT behavior deteriorates over time. Using the example of a chatbot, once the user submits a natural language prompt, RAG summarizes that prompt using semantic data. Consequently, AI model drift and hallucinations emerge as primary concerns.

Cache 215

Cache Azure Infrastructure Monitoring 215

The Netflix TechBlog

SEPTEMBER 18, 2024

While Cassandra is one example, the abstraction works with multiple data stores like EVCache , DynamoDB , RocksDB , etc… For example, when implemented with Cassandra, the abstraction leverages Cassandra’s partitioning and clustering capabilities. Developers just provide their data problem rather than a database solution!

Latency 254

Latency Storage Cache Efficiency 254

The Netflix TechBlog

SEPTEMBER 24, 2021

As an example, cloud-based post-production editing and collaboration pipelines demand a complex set of functionalities, including the generation and hosting of high quality proxy content. The following table gives us an example of file sizes for 4K ProRes 422 HQ proxies. For write operations, those challenges do not apply.

Cloud 242

Cloud Media Storage Cache 242

The Netflix TechBlog

MARCH 7, 2024

Example use case: Content Knowledge Graph Our knowledge graph of the entertainment world encodes relationships between titles, actors and other attributes of a film or series, supporting all aspects of business at Netflix. For many of our applications, model explainability matters. ETL workflows), as well as downstream (e.g.

Systems 238

Systems Media Cache Open Source 238

CSS Wizardry

SEPTEMBER 16, 2024

Here is a neat example of observing the parallelisation in DevTools: note that Initial connection and (the incorrectly labelled) SSL are parallelised and identical: This means that HTTP/3’s worst-case model mimics TLS 1.3+0⁠-⁠RTT’s Take this client for example: the requests to their API endpoint carry a non-standard Accept-Version header.

Latency 215

Latency Cache Transportation Mobile 215

The Netflix TechBlog

NOVEMBER 12, 2024

Best Effort Regional Counter This type of counter is powered by EVCache , Netflix’s distributed caching solution built on the widely popular Memcached. Rollup Cache To optimize read performance, these values are cached in EVCache for each counter.

Latency 253

Latency Cache Infrastructure Strategy 253

The Netflix TechBlog

MAY 19, 2023

Over time, each node caches a subset of subproblems to support a distributed cache, reduce the datastore load, and achieve SpiceDB’s horizontal scalability. SpiceDB walks the graph and decomposes it into subproblems. These subproblems are assigned through consistent hashing and dispatched to a node in a cluster running SpiceDB.

Cache 257

Cache Google Open Source Systems 257

The Netflix TechBlog

OCTOBER 29, 2020

You only need to write platform-specific code where it’s necessary, for example, to implement a native UI or when working with platform-specific APIs. Disk cache Of course, network connectivity may not always be available so downloaded rule sets need to be cached to disk.

Mobile 280

Mobile Cache Network Architecture 280

The Netflix TechBlog

SEPTEMBER 8, 2020

This allows the app to query a list of “paths” in each HTTP request, and get specially formatted JSON (jsonGraph) that we use to cache the data and hydrate the UI. For example, the artwork service is separate from the video metadata service, but we need the data from both in the detail key. This meant that data that was static (e.g.

Latency 243

Latency Cache Java Traffic 243

Dynatrace

JULY 16, 2020

I wanted to leverage Dynatrace’s Environment APIs, for example to export timeseries data, get problem stats, or change configuration settings, like enforcing a certain data privacy setting. TenantCache: a cache to store tenant information and API token information and semi-permanent data to avoid unnecessary roundtrips. ?

Cache 236

Cache Serverless Efficiency Tuning 236

The Netflix TechBlog

JULY 12, 2019

The Tech Hollow , an OSS technology we released a few years ago, has been best described as a total high-density near cache : Total : The entire dataset is cached on each node?—?there there is no eviction policy, and there are no cache misses. Near : the cache exists in RAM on any instance which requires access to the dataset.

Cache 184

Cache Architecture Latency Engineering 184

Dynatrace

DECEMBER 21, 2023

And while these examples were resolved by just asking a few questions, in many cases, the answers are more elusive, requiring real-time and historical drill-downs into the processes and dependencies specific to each host. A few examples: Reduce roundtrips between services (for example, the N+1 query pattern).

Cloud 222

Cloud Energy Best Practices Cache 222

CSS Wizardry

AUGUST 24, 2022

Most metrics are not atomic: FCP, for example, isn’t a metric we can optimise in isolation—it’s a culmination of other more atomic metrics such as connection overhead, TTFB, and more. For the sake of ease, I’m going to use Largest Contentful Paint (LCP) as the example. For example, continuing our task to reduce CSS size: performance.

Benchmarking 249

Benchmarking Metrics Cache Network 249

The Netflix TechBlog

OCTOBER 16, 2019

One example displaying the need for dataset propagation: at any given time Netflix runs a very large number of A/B tests. For example, you could configure a topic to retain 10 versions or 10 days of versions. for example by region, application, or cluster. for example to train machine-learned models.

Cache 193

Cache Architecture Metrics Java 193

Dynatrace

MAY 13, 2022

For example, the Dynatrace Data Explorer enables you to do the following: Analyze multidimensional metrics , whether built into Dynatrace or ingested from other sources like Azure Monitor. You can also analyze table metrics, such as cache hits and misses. Precise AI-powered answers for Azure Managed Instance for Apache Cassandra.

Azure 242

Azure Latency Metrics Infrastructure 242

The Netflix TechBlog

MARCH 10, 2023

To avoid the ES query for the list of indices for every indexing request, we keep the list of indices in a distributed cache. We refresh this cache whenever a new index is created for the next time bucket, so that new assets will be indexed appropriately. Snippet of the index mapping Fig 4.

Strategy 266

Strategy Cache Storage Analytics 266

The Netflix TechBlog

NOVEMBER 15, 2022

AWS AWS provides a suite of services that a VFX studio, regardless of size, can use to leverage the cloud, including AWS Thinkbox Deadline , Amazon File Cache , and Render Farm Deployment Kit on AWS (RFDK). This program is just one example of the many ways Netflix strives to entertain the world.

Cloud 293

Cloud Entertainment AWS Infrastructure 293

The Netflix TechBlog

NOVEMBER 4, 2019

As an example, our data is centered around a creative service to keep track of the creatives we build. Best of all, our page can load much faster since everything is cached in Elasticsearch. For example, if a title ranking changes, we need to find the related show, then its corresponding creative, and reindex it.

Cache 248

Cache Database Servers Performance 248

The Netflix TechBlog

MARCH 8, 2021

Instead, we created a service to take the most popular configurations and cache them. This salt formula example is the equivalent of running a “yum install sis-lighting-10_1” in the terminal. Most artists were requesting a handful of standard configurations and did not need maximum flexibility.

Entertainment 307

Entertainment Storage Open Source Hardware 307

Testsigma

JUNE 3, 2021

Example: An e-commerce website is unable to process the payment part. For example, a user has submitted a form, and the progress bar is showing no progress or activity then the user will get confused if the form has been submitted successfully or not. Example: divide by zero, multiplication of 2 large numbers, etc.

Software 82

Software Software Testing Hardware 82

Dynatrace

AUGUST 30, 2019

Missing Cache Settings – Make sure you cache resources that don’t change often on the browser or use a CDN. Missing caching layers, e.g. provide a read-only cache for static data. MAMPU showed two great examples for this section; database connectivity and web-server threats.

Cache 205

Cache Database Architecture Government 205

The Netflix TechBlog

JULY 1, 2019

Our UI runs on top of a custom rendering engine which uses what we call a “surface cache” to optimize our use of graphics memory. Surface Cache Surface cache is a reserved pool in main memory (or separate graphics memory on a minority of systems) that the Netflix app uses for storing textures (decoded images and cached resources).

Cache 167

Cache Design Testing Development 167

Dynatrace

DECEMBER 20, 2021

For example, the <body> element of your page exists on one branch of this tree structure, with any <img> assets branching off. Consider the example of “rage clicks,” which are rapid clicks (or taps) on the same spot when a feature is unresponsive. For example, are all user bounces caused by the same issue?

Mobile 255

Mobile Website Analytics Cache 255

The Netflix TechBlog

JULY 21, 2022

Some features (as an example) include Device Type ID, SDK Version, Buffer Sizes, Cache Capacities, UI resolution, Chipset Manufacturer and Brand. Example: Missing values or NULL values might mean the absence of a flag or feature in some attribute, while it might require extra tasks in others. as an example, over 99.1%

Big Data 190

Big Data Cache Engineering Data Engineering 190

CSS Wizardry

NOVEMBER 9, 2018

This is best illustrated with an example. We’re bound to an inefficient caching strategy: a change to, say, the background colour of the currently-selected day on a date picker used on only one page, would require that we cache-bust the entirety of app.css. This reduces the size of the blocking CSS on the Critical Path.

Network 279

Network Performance Media Cache 279

Percona

FEBRUARY 16, 2023

key id, key user, key type, together with keys themselves) into the cache, unless MySQL is restarted, or you want to rotate the master key (you won’t though, as you know you have removed the keyring_file), it will not need the keyring file anymore. and keyring_file_data=/var/lib/mysql/keyring_file ” to enable the Keyring_file plugin.

Database 123

Database Servers Engineering Testing 123

Dynatrace

SEPTEMBER 13, 2023

For example, optimizing resource utilization for greater scale and lower cost and driving insights to increase adoption of cloud-native serverless services. Storing frequently accessed data in faster storage, usually in-memory caching, improves data retrieval speed and overall system performance. Beyond

AWS 259

AWS Efficiency Azure Cloud 259

The Netflix TechBlog

MARCH 7, 2023

Goals Annotation Operations Lets pick an example use case of identifying objects (like trees, cars etc.) There are many naive solutions possible for this problem for example: Write different runs in different databases. in a video file. This seems very similar (not exactly same) to a distributed transaction. Write algo runs into files.

Media 275

Media Latency Architecture Database 275

The Netflix TechBlog

SEPTEMBER 10, 2024

For example, for a recent 24 hour period, direct messages averaged around 160,000 messages per second and indirect averaged at around 50,000 messages per second. The DeviceToDeviceManager is also responsible for observability, with metrics around cache hits, calls to the data store, message delivery rates, and latency percentile measurements.

Latency 233

Latency Cache Tuning Efficiency 233