IO River

NOVEMBER 2, 2023

CDNs cache content on edge servers distributed globally, reducing the distance between users and the content they want.‍CDNs use load-balancing techniques to distribute incoming traffic across multiple servers called Points of Presence (PoPs) which distribute content closer to end-users and improve overall performance.

Architecture 52

Architecture Cache Performance Latency 52

Scalegrid

MARCH 28, 2024

Key Takeaways Redis offers complex data structures and additional features for versatile data handling, while Memcached excels in simplicity with a fast, multi-threaded architecture for basic caching needs. Introduction Caching serves a dual purpose in web development – speeding up client requests and reducing server load.

Cache 130

Cache Storage Architecture Scalability 130

InfoQ

MARCH 15, 2024

Hashnode created a scalable event-driven architecture (EDA) for composing feed data for thousands of users. The company used serverless services on AWS, including Lambda, Step Functions, EventBridge, and Redis Cache. The solution leverages Step Functions' distributed maps feature that enables high-concurrency processing.

Scalability 76

Scalability AWS Architecture Lambda 76

IO River

NOVEMBER 2, 2023

CDNs cache content on edge servers distributed globally, reducing the distance between users and the content they want.‍CDNs ‍What is CDN Architecture? CDNs cache content on edge servers distributed globally, reducing the distance between users and the content they want.‍CDNs ‍What is CDN Architecture?‍CDN

Architecture 52

Architecture Cache Performance Latency 52

Dynatrace

JANUARY 31, 2024

Retrieval-augmented generation emerges as the standard architecture for LLM-based applications Given that LLMs can generate factually incorrect or nonsensical responses, retrieval-augmented generation (RAG) has emerged as an industry standard for building GenAI applications.

Cache 214

Cache Azure Infrastructure Monitoring 214

DZone

OCTOBER 11, 2022

Simpler UI Testing with CasperJS ( Architects Zone – Architectural Design Patterns & Best Practices). Using MongoDB as a cache store ( Architects Zone – Architectural Design Patterns & Best Practices). Why haven’t cash-strapped American schools embraced open source? Hacker News).

Java 244

Java Best Practices Google Analytics 244

Dynatrace

DECEMBER 21, 2023

Evaluating these on three levels—data center, host, and application architecture (plus code)—is helpful. Options at each level offer significant potential benefits, especially when complemented by practices that influence the design and purchase decisions made by IT leaders and individual contributors.

Cloud 220

Cloud Energy Best Practices Cache 220

The Netflix TechBlog

NOVEMBER 12, 2024

By: Rajiv Shringi , Oleksii Tkachuk , Kartik Sathyanarayanan Introduction In our previous blog post, we introduced Netflix’s TimeSeries Abstraction , a distributed service designed to store and query large volumes of temporal event data with low millisecond latencies. Today, we’re excited to present the Distributed Counter Abstraction.

Latency 224

Latency Cache Infrastructure Strategy 224

The Netflix TechBlog

SEPTEMBER 24, 2021

Table 1: Movie and File Size Examples Initial Architecture A simplified view of our initial cloud video processing pipeline is illustrated in the following diagram. Figure 1: A Simplified Video Processing Pipeline With this architecture, chunk encoding is very efficient and processed in distributed cloud computing instances.

Cloud 240

Cloud Media Storage Cache 240

cdemi

MAY 8, 2016

Applications that rely heavily on a data-store usually can benefit greatly from using the Cache-Aside Pattern. If used correctly, this pattern can improve performance and help maintain consistency between the cache and the underlying data store. This post is part of a Design Patterns series. Lifetime of Cached Data.

Cache 54

Cache Design C++ Processing 54

Dynatrace

OCTOBER 7, 2021

To get a better understanding of AWS serverless, we’ll first explore the basics of serverless architectures, review AWS serverless offerings, and explore common use cases. Serverless architecture: A primer. Serverless architecture shifts application hosting functions away from local servers onto those managed by providers.

Serverless 291

Serverless AWS Lambda Storage 291

The Netflix TechBlog

OCTOBER 8, 2024

In previous blog posts, we introduced the Key-Value Data Abstraction Layer and the Data Gateway Platform , both of which are integral to Netflix’s data architecture. Design Principles So far, we have seen how TimeSeries stores, configures and interacts with event datasets.

Latency 236

Latency Storage Traffic Tuning 236

The Netflix TechBlog

MAY 19, 2023

To do so Netflix’s design required: An event based mechanism that could ingest information about application autoscaling groups. What was problematic about this design? Over time, each node caches a subset of subproblems to support a distributed cache, reduce the datastore load, and achieve SpiceDB’s horizontal scalability.

Cache 252

Cache Google Open Source Systems 252

Adrian Cockcroft

JANUARY 20, 2023

Here’s some predictions I’m making: Jack Dongarra’s efforts to highlight the low efficiency of the HPCG benchmark as an issue will influence the next generation of supercomputer architectures to optimize for sparse matrix computations. Next generation architectures will use CXL3.0 Next generation architectures will use CXL3.0

Architecture 52

Architecture Latency Benchmarking AWS 52

Dynatrace

JANUARY 5, 2023

To prevent such a significant service disruption from happening again, we are taking several immediate and mid-term actions in addition to the existing rigorous automated testing process: Improve architectural design to eliminate SSO bottleneck risk.

Cache 209

Cache Monitoring Strategy Speed 209

Dynatrace

JANUARY 23, 2023

Here’s the update: Improve architectural design to eliminate SSO bottleneck risk [In progress] Security and access are critical aspects of our architecture, and as such, there are many areas we’re looking to improve. Hopefully never.) This has been completed.

Social Media 130

Social Media Cache Traffic Media 130

The Morning Paper

AUGUST 29, 2019

Choosing a cloud DBMS: architectures and tradeoffs Tan et al., As it is infeasible to test every OLAP system runnable on AWS, we chose widely-used systems that represented a variety of architectures and cost models. The design space. Query performance is measured from both warm and cold caches. VLDB’19.

Architecture 76

Architecture Cloud Storage Cache 76

Percona

APRIL 17, 2023

The swap issue is explained in the excellent article by Jeremy Cole at the Swap Insanity and NUMA Architecture. Make sure the drives are mounted with noatime and also if the drives are behind a RAID controller with appropriate battery-backed cache. There is an issue with this, which causes the OS to swap even with memory available.

Best Practices 52

Best Practices Design Tuning Database 52

The Morning Paper

JUNE 25, 2019

Designing far memory data structures: think outside the box Aguilera et al., Therefore, if we want to make full use of one-sided far memory, we need to think carefully about the design of our data structures to make that access efficient. Processor caches can help to hide local accesses too, but not remote accesses.

Design 80

Design Cache Hardware Scalability 80

The Netflix TechBlog

NOVEMBER 15, 2022

Every VFX studio has a slightly different architecture and workflow, and a one-size-fits-all solution often isn’t enough to bridge the gap. VFX studios of varying sizes and locations can leverage these solutions to meet the unique rendering needs of their productions. via direct plug-ins, and is available on multi-cloud platform services.

Cloud 287

Cloud Entertainment AWS Infrastructure 287

Dynatrace

APRIL 10, 2023

These range from the simple lift-and-shift re-hosting approach to the significant architectural changes involved in refactoring. Such testing is critical to identifying customer shopping patterns that inform decisions about application design and user experience. For each on-premises application, Tractor Supply Co.

Cloud 180

Cloud Ecommerce Performance Retail 180

ACM Sigarch

FEBRUARY 23, 2018

In industry, generally due to time-to-market restrictions, we tend to think extremely short term with evolutionary design changes rather than riskier revolutionary ideas that have a longer timeline for returns. I had a professor in grad school who used to joke that all architecture is reinvented every 5 years.

Architecture 47

Architecture Cache Hardware Virtualization 47

The Netflix TechBlog

MARCH 7, 2023

We designed a unique concept called Annotation Operations which allows teams to create data pipelines and easily write annotations without worrying about access patterns of their data from different applications. Marken Architecture Marken’s architecture diagram is as follows. This new operation is marked to be in STARTED state.

Media 269

Media Latency Architecture Database 269

Dynatrace

OCTOBER 4, 2022

While data lakes and data warehousing architectures are commonly used modes for storing and analyzing data, a data lakehouse is an efficient third way to store and analyze data that unifies the two architectures while preserving the benefits of both. This is simply not possible with conventional architectures. Data warehouses.

Artificial Intelligence 219

Artificial Intelligence Storage Analytics Government 219

Smashing Magazine

SEPTEMBER 28, 2022

On design systems, UX, web performance and CSS/JS. Active Memory Caching. When you want to get data that you already had quickly, you need to do caching — caching stores data that a user recently retrieved. Caching partially stores your data and is not used as permanent storage. Caching Schemes.

Cache 128

Cache Performance Servers Architecture 128

The Netflix TechBlog

MARCH 10, 2023

One of the first decisions when integrating with Elasticsearch is designing the indices, their settings and mappings. These applications are built on a microservices architecture, and the Asset Management Platform provides asset management to those dozens of services for various asset types. Net, Ruby, Perl etc.).

Strategy 262

Strategy Cache Storage Analytics 262

The Netflix TechBlog

SEPTEMBER 8, 2020

This allows the app to query a list of “paths” in each HTTP request, and get specially formatted JSON (jsonGraph) that we use to cache the data and hydrate the UI. For us, it means that we now need to have ~15 MDN tabs open when writing routes :) Let’s briefly discuss the architecture of this microservice. It was a Node.js

Latency 238

Latency Cache Java Traffic 238

Scalegrid

FEBRUARY 8, 2024

Their design emphasizes increasing availability by spreading out files among different nodes or servers — this approach significantly reduces risks associated with losing or corrupting data due to node failure. Variations within these storage systems are called distributed file systems.

Storage 130

Storage Systems Big Data Azure 130

The Netflix TechBlog

OCTOBER 16, 2019

By Ammar Khaku Introduction In a microservice architecture such as Netflix’s, propagating datasets from a single source to multiple downstream destinations can be challenging. This post is a high level overview of the design and architecture of Gutenberg. A publisher publishes to a topic and consumers consume from a topic.

Cache 190

Cache Architecture Metrics Java 190

Dynatrace

NOVEMBER 29, 2021

Dynatrace’s Lambda extension fully supports Arm-based architectures. You can use Dynatrace to monitor all your AWS Lambda functions, whether they are running on x86 or Arm architecture. According to the official AWS announcement, Graviton2-based Lambda functions offer up to 34% better price-performance improvement.

Lambda 224

Lambda AWS Serverless Metrics 224

The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. This avoids thrashing caches too much for B and evens out the pressure on the L3 caches of the machine.

Cache 256

Cache Latency Airlines Logistics 256

cdemi

MAY 6, 2016

I have decided to write a series on some common and modern Design Patterns that are useful in today's horizontally scalable (such as cloud-hosted) applications. Cache Aside Pattern. Applications that rely heavily on a data-store usually can benefit greatly from using the Cache-Aside Pattern. How does it work?

Design 40

Design Cache Scalability Architecture 40

ACM Sigarch

MAY 31, 2023

Introduction Memory systems are evolving into heterogeneous and composable architectures. using Compute Express Link or CXL), organizing memory components for optimal performance, adapting system software traditionally designed for homogeneous memory systems, and developing memory abstractions and programming constructs for HCM management.

Latency 52

Latency Hardware Cache Architecture 52

The Morning Paper

FEBRUARY 6, 2020

.’ Stateless is fine until you need state, at which point the coarse-grained solutions offered by current platforms limit the kinds of application designs that work well. On the Cloudburst design teams’ wish list: A running function’s ‘hot’ data should be kept physically nearby for low-latency access.

Serverless 98

Serverless Lambda Cache Latency 98

The Morning Paper

MARCH 8, 2020

This paper describes the design decisions behind the Snowflake cloud-based data warehouse. This paper presents Snowflake design and implementation along with a discussion on how recent changes in cloud infrastructure (emerging hardware, fine-grained billing, etc.) From shared-nothing to disaggregation. joins) during query processing.

Storage 112

Storage Engineering Cache Serverless 112

Dynatrace

APRIL 21, 2022

As organizations adopt microservices architecture with cloud-native technologies such as Microsoft Azure , many quickly notice an increase in operational complexity. The Azure Well-Architected Framework is a set of guiding tenets organizations can use to evaluate architecture and implement designs that will scale over time.

Azure 199

Azure Monitoring Virtualization Metrics 199

All Things Distributed

SEPTEMBER 3, 2013

Choosing your database architecture may be the most critical decision you’ll make and has a disproportionate impact on the performance, scalability, and availability of your app. No single database architecture or solution can meet all of Amazon.com’s or our customers’ needs.

Cache 103

Cache Cloud Performance Retail 103