DZone

SEPTEMBER 3, 2024

High-performance computing systems often use all-flash architectures and kernel-mode parallel file systems to satisfy performance demands. It improves I/O throughput substantially through the distributed cache and uses cost-effective object storage for data storage. It’s hence suitable for serving large-scale AI workloads.

Cache 147

Cache Performance Storage Architecture 147

The Netflix TechBlog

JANUARY 6, 2025

Personalization systems handle the recommendation and serving of titles on these canvases, leveraging a vast ecosystem of microservices, caches, databases, code, and configurations to build these product canvases. What is the architecture of the systems involved? How do we ensure standardization?

Scalability 215

Scalability Cache Engineering Systems 215

Scalegrid

MARCH 23, 2020

Check out the Pgpool-II architecture that supports all of its features, and learn how the connection pooler works. Pgpool-II has a more involved architecture than PgBouncer in order to support all the features it does. The architecture is similar to PostgreSQL server: one process = one connection. How it works.

Cache 264

Cache Servers Architecture Processing 264

DZone

APRIL 9, 2020

Insufficient dispatcher caching. Lack of browser caching. Insufficient server sizing or incorrect architecture. Expensive requests such as expensive searches or inefficient application code, components, etc. Lack of proper maintenance. Lack of CDN. Too many scripts loaded on-page and loaded at top of the page.

Website Performance 264

Website Performance Website Performance Cache 264

Dynatrace

OCTOBER 7, 2021

To get a better understanding of AWS serverless, we’ll first explore the basics of serverless architectures, review AWS serverless offerings, and explore common use cases. Serverless architecture: A primer. Serverless architecture shifts application hosting functions away from local servers onto those managed by providers.

Serverless 325

Serverless AWS Lambda Storage 325

Dynatrace

JANUARY 31, 2024

Retrieval-augmented generation emerges as the standard architecture for LLM-based applications Given that LLMs can generate factually incorrect or nonsensical responses, retrieval-augmented generation (RAG) has emerged as an industry standard for building GenAI applications.

Cache 276

Cache Azure Infrastructure Monitoring 276

The Netflix TechBlog

SEPTEMBER 24, 2021

Table 1: Movie and File Size Examples Initial Architecture A simplified view of our initial cloud video processing pipeline is illustrated in the following diagram. Figure 1: A Simplified Video Processing Pipeline With this architecture, chunk encoding is very efficient and processed in distributed cloud computing instances.

Cloud 240

Cloud Media Storage Cache 240

The Netflix TechBlog

APRIL 27, 2023

Moreover, common database optimizations like caching recently queried data don’t really work for alerting queries because, generally speaking, the last received datapoint is required for correctness. First and foremost, we have successfully alleviated our initial scalability problem with the polling based architecture. OK, Results?

Storage 293

Storage Cache Metrics Database 293

Dynatrace

JANUARY 16, 2023

Of the organizations in the Kubernetes survey, 71% run databases and caches in Kubernetes, representing a +48% year-over-year increase. Together with messaging systems (+36% growth), organizations are increasingly using databases and caches to persist application workload states.

Open Source 358

Open Source Java Operating System Programming 358

The Netflix TechBlog

OCTOBER 29, 2020

The need for fast product delivery led us to experiment with a multiplatform architecture. This approach works well for us for several reasons: Our Android and iOS studio apps have a shared architecture with similar or in some cases identical business logic written on both platforms.

Mobile 279

Mobile Cache Network Technology 279

Dynatrace

DECEMBER 21, 2023

Evaluating these on three levels—data center, host, and application architecture (plus code)—is helpful. Application architectures might not be conducive to rehosting. Implement appropriate caching layers (for example, read-only cache for static data). Is the solution to just move all workloads to the cloud?

Cloud 264

Cloud Energy Best Practices Cache 264

DZone

OCTOBER 11, 2022

Simpler UI Testing with CasperJS ( Architects Zone – Architectural Design Patterns & Best Practices). Using MongoDB as a cache store ( Architects Zone – Architectural Design Patterns & Best Practices). Why haven’t cash-strapped American schools embraced open source? Hacker News).

Java 244

Java Best Practices Google Analytics 244

The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. This avoids thrashing caches too much for B and evens out the pressure on the L3 caches of the machine.

Cache 255

Cache Latency Airlines Logistics 255

Dynatrace

AUGUST 30, 2019

Missing Cache Settings – Make sure you cache resources that don’t change often on the browser or use a CDN. Reducing performance and architectural issues in their backend system gave them a 99% performance improvement! Missing caching layers, e.g. provide a read-only cache for static data.

Cache 214

Cache Database Architecture Government 214

The Netflix TechBlog

JULY 12, 2019

The Tech Hollow , an OSS technology we released a few years ago, has been best described as a total high-density near cache : Total : The entire dataset is cached on each node?—?there there is no eviction policy, and there are no cache misses. Near : the cache exists in RAM on any instance which requires access to the dataset.

Cache 183

Cache Architecture Engineering Latency 183

InfoQ

OCTOBER 28, 2023

DoorDash rearchitected the heterogeneous caching system they were using across all of their microservices and created a common, multi-layered cache providing a generic mechanism and solving a number of issues coming from the adoption of a fragmented cache. By Sergio De Simone

Cache 112

Cache Scalability Performance Systems 112

The Netflix TechBlog

SEPTEMBER 18, 2024

In this post, we dive deep into how Netflix’s KV abstraction works, the architectural principles guiding its design, the challenges we faced in scaling diverse use cases, and the technical innovations that have allowed us to achieve the performance and reliability required by Netflix’s global operations.

Latency 256

Latency Storage Cache Efficiency 256

Dynatrace

JULY 16, 2020

TenantCache: a cache to store tenant information and API token information and semi-permanent data to avoid unnecessary roundtrips. ? These API tokens are then stored in a local cache (the TenantCache using Redis), alongside with other rather static information of the environments: ? tenant-token the current API token to use.

Cache 289

Cache Serverless Efficiency Tuning 289

John McCalpin

FEBRUARY 17, 2025

“Latency” is the duration from the execution of a load instruction (to an address that misses in all the caches), and the completion of that load instruction when the data is returned from memory. GB/s peak DRAM bandwidth, requiring 6 concurrent 64-byte cache line accesses to be pending at all times to maintain full bandwidth.

Latency 68

Latency Hardware Cache Systems 68

High Scalability

JANUARY 11, 2022

Architecture. We will use a cache having an LRU based eviction policy for caching user feeds of active users. Sending and receiving messages from other users. Generating machine learning based personalized recommendations to discover new people, photos, videos, and stories relevant one’s interest. High Level Design.

Design 334

Design Media Storage Logistics 334

Dynatrace

JANUARY 5, 2023

To prevent such a significant service disruption from happening again, we are taking several immediate and mid-term actions in addition to the existing rigorous automated testing process: Improve architectural design to eliminate SSO bottleneck risk.

Cache 246

Cache Monitoring Strategy Speed 246

The Netflix TechBlog

NOVEMBER 15, 2022

Every VFX studio has a slightly different architecture and workflow, and a one-size-fits-all solution often isn’t enough to bridge the gap. VFX studios of varying sizes and locations can leverage these solutions to meet the unique rendering needs of their productions.

Cloud 286

Cloud Entertainment AWS Infrastructure 286

The Netflix TechBlog

SEPTEMBER 8, 2020

This allows the app to query a list of “paths” in each HTTP request, and get specially formatted JSON (jsonGraph) that we use to cache the data and hydrate the UI. For us, it means that we now need to have ~15 MDN tabs open when writing routes :) Let’s briefly discuss the architecture of this microservice. It was a Node.js

Latency 237

Latency Cache Java Traffic 237

InfoQ

JANUARY 29, 2024

RevenueCat extensively uses caching to improve the availability and performance of its product API while ensuring consistency. The company shared its techniques to deliver the platform, which can handle over 1.2 billion daily API requests. The team at RevenueCat created an open-source memcache client that provides several advanced features.

Cache 108

Cache Open Source Availability Performance 108

Dynatrace

APRIL 10, 2023

These range from the simple lift-and-shift re-hosting approach to the significant architectural changes involved in refactoring. “Caching’s one of the key components of any commerce application,” as it has a major impact on performance, Bollampally said. For each on-premises application, Tractor Supply Co.

Cloud 243

Cloud Ecommerce Performance Retail 243

Dynatrace

OCTOBER 4, 2022

While data lakes and data warehousing architectures are commonly used modes for storing and analyzing data, a data lakehouse is an efficient third way to store and analyze data that unifies the two architectures while preserving the benefits of both. This is simply not possible with conventional architectures.

Artificial Intelligence 246

Artificial Intelligence Storage Analytics Government 246

All Things Distributed

SEPTEMBER 3, 2013

Choosing your database architecture may be the most critical decision you’ll make and has a disproportionate impact on the performance, scalability, and availability of your app. No single database architecture or solution can meet all of Amazon.com’s or our customers’ needs.

Cache 99

Cache Cloud Performance Retail 99

Dynatrace

MAY 13, 2022

Because of its scalability and distributed architecture, thousands of companies trust it to run their cloud and hybrid-based workloads at high availability without compromising performance. You can also analyze table metrics, such as cache hits and misses. Apache Cassandra is an open-source, distributed, NoSQL database.

Azure 246

Azure Latency Metrics Infrastructure 246

DZone

MAY 19, 2019

Even if my application runs in the cloud on the JVM, despite all of those software layers abstracting away the underlying hardware, the volatile keyword is still needed due to the cache of the processor that my software runs on. The Volatile Keyword and the Cache of Modern Processors.

Cache 145

Cache Hardware Architecture Cloud 145

Dynatrace

NOVEMBER 29, 2021

Dynatrace’s Lambda extension fully supports Arm-based architectures. You can use Dynatrace to monitor all your AWS Lambda functions, whether they are running on x86 or Arm architecture. According to the official AWS announcement, Graviton2-based Lambda functions offer up to 34% better price-performance improvement.

Lambda 246

Lambda AWS Serverless Metrics 246

Scalegrid

MARCH 28, 2024

Key Takeaways Redis offers complex data structures and additional features for versatile data handling, while Memcached excels in simplicity with a fast, multi-threaded architecture for basic caching needs. Introduction Caching serves a dual purpose in web development – speeding up client requests and reducing server load.

Cache 130

Cache Storage Architecture Scalability 130

The Netflix TechBlog

MARCH 7, 2023

Marken Architecture Marken’s architecture diagram is as follows. Marken Architecture Our goal was to help teams at Netflix to create data pipelines without thinking about how that data is available to the readers or the client teams. We refer the reader to our previous blog article for details.

Media 268

Media Latency Architecture Database 268

The Netflix TechBlog

MARCH 10, 2023

These applications are built on a microservices architecture, and the Asset Management Platform provides asset management to those dozens of services for various asset types. To avoid the ES query for the list of indices for every indexing request, we keep the list of indices in a distributed cache.

Strategy 261

Strategy Cache Analytics Storage 261

The Netflix TechBlog

MAY 4, 2023

When undertaking system migrations, one of the main challenges is establishing confidence and seamlessly transitioning the traffic to the upgraded architecture without adversely impacting the customer experience. It helps expose memory leaks, deadlocks, caching issues, and other system issues.

Traffic 343

Traffic Latency Tuning Systems 343

The Netflix TechBlog

OCTOBER 16, 2019

By Ammar Khaku Introduction In a microservice architecture such as Netflix’s, propagating datasets from a single source to multiple downstream destinations can be challenging. This post is a high level overview of the design and architecture of Gutenberg. A publisher publishes to a topic and consumers consume from a topic.

Cache 189

Cache Architecture Metrics Java 189

Dynatrace

NOVEMBER 28, 2022

Lambda then takes a snapshot of the memory and disk state of the initialized execution environment, persists the encrypted snapshot, and caches it for low-latency access. Understand and optimize your architecture. With SnapStart enabled, function code is initialized once when a function version is published. Optimize timing hotspots.

Lambda 246

Lambda AWS Serverless Latency 246

Dynatrace

NOVEMBER 3, 2021

Organizations are depending more and more on distributed architectures to provide application services. Examples include a spike in memory utilization, a decrease in cache hit ratio, or an increase in CPU utilization. Dynatrace news. This trend is prompting advances in both observability and monitoring.

Monitoring 264

Monitoring Metrics DevOps Scalability 264