Dynatrace

JANUARY 31, 2024

Retrieval-augmented generation emerges as the standard architecture for LLM-based applications Given that LLMs can generate factually incorrect or nonsensical responses, retrieval-augmented generation (RAG) has emerged as an industry standard for building GenAI applications.

Cache 276

Cache Azure Infrastructure Monitoring 276

The Netflix TechBlog

SEPTEMBER 18, 2024

Central to this infrastructure is our use of multiple online distributed databases such as Apache Cassandra , a NoSQL database known for its high availability and scalability. Over time as new key-value databases were introduced and service owners launched new use cases, we encountered numerous challenges with datastore misuse.

Latency 260

Latency Storage Cache Servers 260

Dynatrace

AUGUST 30, 2019

Infrastructure Optimization: 100% improvement in Database Connectivity. Missing Cache Settings – Make sure you cache resources that don’t change often on the browser or use a CDN. Reducing performance and architectural issues in their backend system gave them a 99% performance improvement!

Cache 214

Cache Database Architecture Government 214

High Scalability

JANUARY 11, 2022

Architecture. We will use a graph database such as Neo4j to store the information. Additionally, we can use columnar databases like Cassandra to store information like user feeds, activities, and counters. Sample Queries supported by Graph Database. Sending and receiving messages from other users. High Level Design.

Design 334

Design Media Storage Logistics 334

The Netflix TechBlog

OCTOBER 29, 2020

The need for fast product delivery led us to experiment with a multiplatform architecture. This approach works well for us for several reasons: Our Android and iOS studio apps have a shared architecture with similar or in some cases identical business logic written on both platforms.

Mobile 279

Mobile Cache Network Technology 279

All Things Distributed

JANUARY 18, 2012

a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Today is a very exciting day as we release Amazon DynamoDB , a fast, highly reliable and cost-effective NoSQL database service designed for internet scale applications. Werner Vogels weblog on building scalable and robust distributed systems.

Scalability 162

Scalability Database Ecommerce Latency 162

Dynatrace

DECEMBER 21, 2023

Evaluating these on three levels—data center, host, and application architecture (plus code)—is helpful. Application architectures might not be conducive to rehosting. Reduce the volume of data volumes requested from databases (for example, request all, filter in memory). Is the solution to just move all workloads to the cloud?

Cloud 264

Cloud Energy Best Practices Cache 264

Dynatrace

MAY 13, 2022

Apache Cassandra is an open-source, distributed, NoSQL database. Because of its scalability and distributed architecture, thousands of companies trust it to run their cloud and hybrid-based workloads at high availability without compromising performance. Microsoft Azure offers multiple ways to manage Apache Cassandra databases.

Azure 246

Azure Latency Metrics Infrastructure 246

Dynatrace

APRIL 10, 2023

These range from the simple lift-and-shift re-hosting approach to the significant architectural changes involved in refactoring. “Caching’s one of the key components of any commerce application,” as it has a major impact on performance, Bollampally said. For each on-premises application, Tractor Supply Co.

Cloud 243

Cloud Ecommerce Performance Retail 243

All Things Distributed

JULY 14, 2015

I am excited to share with you that today we are expanding DynamoDB with streams, cross-region replication, and database triggers. Streams provide you with the underlying infrastructure to create new applications, such as continuously updated free-text search indexes, caches, or other creative extensions requiring up-to-date table changes.

Database 158

Database Lambda AWS IoT 158

Scalegrid

JANUARY 10, 2025

Heading into 2024, SQL databases will remain essential in data management, increasingly using distributed systems to meet growing needs for scalability and reliability. According to 2023 statistics, 49% of web applications use an SQL-based database , with SQL having a 75% adoption rate in the IT industry.

Database 130

Database Scalability Best Practices Blockchain 130

The Netflix TechBlog

MARCH 7, 2023

There are many naive solutions possible for this problem for example: Write different runs in different databases. Instead our challenge was to implement this feature on top of Cassandra and ElasticSearch databases because that’s what Marken uses. Marken Architecture Marken’s architecture diagram is as follows.

Media 272

Media Latency Architecture Database 272

Percona

JUNE 22, 2023

To make data count and to ensure cloud computing is unabated, companies and organizations must have highly available databases. A basic high availability database system provides failover (preferably automatic) from a primary database node to redundant nodes within a cluster. HA is sometimes confused with “fault tolerance.”

Availability 132

Availability Database Open Source Hardware 132

Dynatrace

NOVEMBER 3, 2021

Organizations are depending more and more on distributed architectures to provide application services. For example, when monitoring a database, you’ll want to know about any latency when writing data to a disk or average query response time. Dynatrace news. This trend is prompting advances in both observability and monitoring.

Monitoring 264

Monitoring Metrics DevOps Scalability 264

All Things Distributed

SEPTEMBER 3, 2013

Today, we added two important choices for customers running high performance apps in the cloud: support for Redis in Amazon ElastiCache and a new high memory database instance (db.cr1.8xlarge) for Amazon RDS. No single database architecture or solution can meet all of Amazon.com’s or our customers’ needs.

Cache 99

Cache Cloud Performance Retail 99

Dynatrace

NOVEMBER 29, 2021

Dynatrace’s Lambda extension fully supports Arm-based architectures. You can use Dynatrace to monitor all your AWS Lambda functions, whether they are running on x86 or Arm architecture. According to the official AWS announcement, Graviton2-based Lambda functions offer up to 34% better price-performance improvement.

Lambda 246

Lambda AWS Serverless Metrics 246

Scalegrid

MARCH 28, 2024

Key Takeaways Redis offers complex data structures and additional features for versatile data handling, while Memcached excels in simplicity with a fast, multi-threaded architecture for basic caching needs. Introduction Caching serves a dual purpose in web development – speeding up client requests and reducing server load.

Cache 130

Cache Storage Scalability Architecture 130

The Netflix TechBlog

MAY 19, 2023

A cleanup process to prune stale relationships from the database. Over time, each node caches a subset of subproblems to support a distributed cache, reduce the datastore load, and achieve SpiceDB’s horizontal scalability. What was problematic about this design? SpiceDB walks the graph and decomposes it into subproblems.

Cache 255

Cache Google Open Source Systems 255

InfoQ

JANUARY 29, 2024

RevenueCat extensively uses caching to improve the availability and performance of its product API while ensuring consistency. The company shared its techniques to deliver the platform, which can handle over 1.2 billion daily API requests. The team at RevenueCat created an open-source memcache client that provides several advanced features.

Cache 109

Cache Open Source Availability Performance 109

Smashing Magazine

SEPTEMBER 28, 2022

Active Memory Caching. When you want to get data that you already had quickly, you need to do caching — caching stores data that a user recently retrieved. Caching partially stores your data and is not used as permanent storage. Caching partially stores your data and is not used as permanent storage.

Cache 141

Cache Performance Servers Architecture 141

The Netflix TechBlog

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events. Designed with High Availability in mind.

Database 221

Database Traffic Transportation Open Source 221

The Netflix TechBlog

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events. Designed with High Availability in mind.

Database 206

Database Traffic Transportation Open Source 206

Dynatrace

APRIL 21, 2022

As organizations adopt microservices architecture with cloud-native technologies such as Microsoft Azure , many quickly notice an increase in operational complexity. The Azure Well-Architected Framework is a set of guiding tenets organizations can use to evaluate architecture and implement designs that will scale over time.

Azure 246

Azure Monitoring Virtualization Metrics 246

Percona

APRIL 7, 2023

I’ve used a fourth instance to host a PMM server to monitor servers A and B and used the data collected by the PMM agents installed on the database servers to compare performance. That’s a heritage of the LAMP model when the same server would host both the database and the web server.

Tuning 145

Tuning Cache Servers Benchmarking 145

VoltDB

MARCH 21, 2024

In the world of databases, data management, and data platforms, this entropy usually takes the form of a simple database or data platform that might be ideal for early use cases evolving (or rather, de volving) into an expensive and unmanageable nightmare due to operational strain from use-case gluttony. How hard can it be?

Cache 52

Cache Database Storage Availability 52

Dynatrace

OCTOBER 15, 2021

OpenTelemetry reference architecture. This occurs once data is safely stored within a local cache. Cloud databases excel at storing large volumes of information for later reference, and this data often has business value or privacy restrictions. Source: OpenTelemetry Documentation. What is telemetry data?

Open Source 246

Open Source Metrics Cloud Transportation 246

The Netflix TechBlog

OCTOBER 8, 2024

In previous blog posts, we introduced the Key-Value Data Abstraction Layer and the Data Gateway Platform , both of which are integral to Netflix’s data architecture. Note: Contrary to what the name may suggest, this system is not built as a general-purpose time series database. Also, with Cassandra 4.x,

Latency 239

Latency Storage Traffic Tuning 239

O'Reilly Software

JUNE 12, 2018

In fact, before we even had the word microservices in our lexicon, back when it was just good old-fashioned service-oriented architecture, we were talking about data: how to access it, where it lives, who “owns” it. Back then, the most common pattern I saw for service-based systems was sharing a database among multiple services.

Database 72

Database Cache Architecture Latency 72

The Morning Paper

AUGUST 29, 2019

Choosing a cloud DBMS: architectures and tradeoffs Tan et al., As it is infeasible to test every OLAP system runnable on AWS, we chose widely-used systems that represented a variety of architectures and cost models. Query performance is measured from both warm and cold caches. VLDB’19. The last word.

Architecture 76

Architecture Cloud Storage Serverless 76

Dynatrace

JANUARY 23, 2023

Here’s the update: Improve architectural design to eliminate SSO bottleneck risk [In progress] Security and access are critical aspects of our architecture, and as such, there are many areas we’re looking to improve. Hopefully never.) This has been completed.

Social Media 130

Social Media Cache Traffic Media 130

Percona

OCTOBER 2, 2023

You can get summaries of your database servers, or you verify replication lag on MySQL and PostgreSQL servers. You get thirty-eight scripts that can do any manner of actions, and you will find them very valuable in your regular database work. 33-generic Architecture | CPU = 64-bit, OS = 64-bit Threading | NPTL 2.35 Caches | 12.4G

Cache 114

Cache Database Virtualization Servers 114

Scalegrid

JANUARY 21, 2025

With its widespread use in modern application architectures, understanding the ins and outs of Redis monitoring is essential for any tech professional. Redis Monitoring Essentials Ensuring the performance, reliability, and safety of a Redis database requires active monitoring. Redis, a powerful in-memory data store, is no exception.

Strategy 130

Strategy Monitoring Latency DevOps 130

The Morning Paper

FEBRUARY 6, 2020

Last week we looked at a function shipping solution to the problem; Cloudburst uses the more common data shipping to bring data to caches next to function runtimes (though you could also make a case that the scheduling algorithm placing function execution in locations where the data is cached a flavour of function-shipping too).

Serverless 98

Serverless Lambda Cache Latency 98

The Netflix TechBlog

MARCH 5, 2019

the order of the rows on your Netflix home page, issuing content licenses when you click play, finding the Open Connect cache closest to you with the content you requested, and many more). A majority of the Netflix product features are either partially or completely dependent on one of our many micro-services (e.g.,

Infrastructure 185

Infrastructure Cloud Scalability AWS 185

ScaleOut Software

APRIL 22, 2020

Maintaining rapidly changing data in back-end databases creates bottlenecks that impact responsiveness. In addition, repeatedly accessing back-end databases to serve up popular items, such as product descriptions and news stories, also adds to the bottleneck. The Solution: Distributed Caching.

Cache 52

Cache Storage Servers Database 52

ScaleOut Software

APRIL 22, 2020

Maintaining rapidly changing data in back-end databases creates bottlenecks that impact responsiveness. In addition, repeatedly accessing back-end databases to serve up popular items, such as product descriptions and news stories, also adds to the bottleneck. The Solution: Distributed Caching.

Cache 52

Cache Storage Servers Database 52

Smashing Magazine

DECEMBER 23, 2020

The service workers enable the offline usage of the PWA by fetching cached data or informing the user about the absence of an Internet connection. Application shell architecture. When developing a PWA, you can cache the application shell’s resources and assets in the browser. Cached content with IndexedDB.

Cache 136

Cache Internet Internet Google 136