All Things Distributed

JANUARY 18, 2012

a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Today is a very exciting day as we release Amazon DynamoDB , a fast, highly reliable and cost-effective NoSQL database service designed for internet scale applications. Werner Vogels weblog on building scalable and robust distributed systems.

Scalability 164

Scalability Database Ecommerce Latency 164

The Netflix TechBlog

SEPTEMBER 18, 2024

Central to this infrastructure is our use of multiple online distributed databases such as Apache Cassandra , a NoSQL database known for its high availability and scalability. Over time as new key-value databases were introduced and service owners launched new use cases, we encountered numerous challenges with datastore misuse.

Latency 261

Latency Storage Cache Efficiency 261

Dynatrace

JANUARY 31, 2024

The RAG process begins by summarizing and converting user prompts into queries that are sent to a search platform that uses semantic similarities to find relevant data in vector databases, semantic caches, or other online data sources. Observing AI models Running AI models at scale can be resource-intensive.

Cache 215

Cache Azure Infrastructure Monitoring 215

All Things Distributed

JUNE 21, 2018

A common question that I get is why do we offer so many database products? To do this, they need to be able to use multiple databases and data models within the same application. Seldom can one database fit the needs of multiple distinct use cases. Seldom can one database fit the needs of multiple distinct use cases.

Database 167

Database AWS Games Latency 167

Scalegrid

JULY 8, 2020

If you must kill the script at this point, there are two options available: SCRIPT KILL command can be used to stop a script that hasn’t yet done any writes. The complete information on methods to kill the script execution and related behavior are available in the documentation. Behavior on Sentinel-Monitored High Availability Systems.

Servers 239

Servers Database Availability Monitoring 239

Scalegrid

APRIL 16, 2020

Where you decide to host your cloud databases is a huge decision. But, if you’re considering leveraging a managed databases provider, you have another decision to make – are you able to host in your own cloud account or are you required to host through your managed service provider? Where to host your cloud database?

Cloud 242

Cloud Azure AWS Database 242

The Netflix TechBlog

OCTOBER 29, 2020

This translates to a large number of app configurations to toggle feature availability and optimize the in-app experience for each production. For our use-case, we’re configuring the availability of production, version, and region specific app feature sets.

Mobile 279

Mobile Cache Network Technology 279

Dynatrace

AUGUST 12, 2019

With OneAgent installed on an application server, Davis, the Dynatrace AI causation engine, continuously analyzes all database statements within the context of your applications. Now, with Oracle database insights, we’re going even deeper, giving you visibility into what’s going on in the database layer.

Database 128

Database Metrics Cache Servers 128

All Things Distributed

JULY 14, 2015

I am excited to share with you that today we are expanding DynamoDB with streams, cross-region replication, and database triggers. Streams provide you with the underlying infrastructure to create new applications, such as continuously updated free-text search indexes, caches, or other creative extensions requiring up-to-date table changes.

Database 159

Database Lambda AWS IoT 159

Scalegrid

OCTOBER 2, 2019

October 2, 2019 – ScaleGrid, a rapidly growing leader in the Database-as-a-Service (DBaaS) space, has just launched their new fully managed Redis on Azure service. Redis, the #1 key-value store and top 10 database in the world, has grown by over 300% in popularity over that past 5 years, per the DB-Engines knowledge base.

Azure 37

Azure Cloud Open Source Virtualization 37

Dynatrace

MAY 13, 2022

Apache Cassandra is an open-source, distributed, NoSQL database. Because of its scalability and distributed architecture, thousands of companies trust it to run their cloud and hybrid-based workloads at high availability without compromising performance. Microsoft Azure offers multiple ways to manage Apache Cassandra databases.

Azure 242

Azure Latency Metrics Infrastructure 242

InfoQ

JANUARY 29, 2024

RevenueCat extensively uses caching to improve the availability and performance of its product API while ensuring consistency. The company shared its techniques to deliver the platform, which can handle over 1.2 billion daily API requests. By Rafal Gancarz

Cache 108

Cache Open Source Availability Performance 108

Dynatrace

AUGUST 30, 2019

Infrastructure Optimization: 100% improvement in Database Connectivity. We have several YouTube Tutorials and blog posts available that show how you can use Dynatrace RUM data for Web Performance & User Experience Optimization. Digital Performance: 99% reduction in Response Time, from 18.2s Impressive results I have to say!

Cache 205

Cache Database Architecture Government 205

Dynatrace

OCTOBER 7, 2021

This means you no longer have to provision, scale, and maintain servers to run your applications, databases, and storage systems. AWS AppSync: AppSync offers a fully managed approach to developing APIs with GraphQL — connecting to AWS DynamoLB or Lambda along with adding caches and client-side data. Data Store.

Serverless 293

Serverless AWS Lambda Storage 293

All Things Distributed

SEPTEMBER 3, 2013

Today, we added two important choices for customers running high performance apps in the cloud: support for Redis in Amazon ElastiCache and a new high memory database instance (db.cr1.8xlarge) for Amazon RDS. No single database architecture or solution can meet all of Amazon.com’s or our customers’ needs.

Cache 101

Cache Cloud Performance Retail 101

Scalegrid

OCTOBER 2, 2019

October 2, 2019 – ScaleGrid, a rapidly growing leader in the Database-as-a-Service (DBaaS) space, has just launched their new fully managed Hosting on Azure for Redis™ service. Redis™, the #1 key-value store and top 10 database in the world, has grown by over 300% in popularity over that past 5 years, per the DB-Engines knowledge base.

Azure 100

Azure Availability Open Source Virtualization 100

The Netflix TechBlog

NOVEMBER 4, 2019

Specifically, how our team uses the relationships and schemas defined within GraphQL to automatically build and maintain a search database. Each service could potentially implement its own search database, but then we would still need an aggregator. Best of all, our page can load much faster since everything is cached in Elasticsearch.

Database 247

Database Cache Servers Performance 247

Scalegrid

MARCH 28, 2024

Key Takeaways Redis offers complex data structures and additional features for versatile data handling, while Memcached excels in simplicity with a fast, multi-threaded architecture for basic caching needs. Redis is better suited for complex data models, and Memcached is better suited for high-throughput, string-based caching scenarios.

Cache 130

Cache Storage Architecture Scalability 130

The Netflix TechBlog

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events. Designed with High Availability in mind.

Database 221

Database Traffic Transportation Open Source 221

CSS Wizardry

AUGUST 7, 2019

only to find that the resource they’re requesting isn’t in that PoP ’s cache. Database queries: Pages that require data from a database will incur a cost when searching over it. This is exactly what we did at BBC iPlayer last year: The newly-available Server-Timing header can be added to any response.

Latency 271

Latency Ecommerce Servers Mobile 271

The Netflix TechBlog

MARCH 7, 2023

There are many naive solutions possible for this problem for example: Write different runs in different databases. Instead our challenge was to implement this feature on top of Cassandra and ElasticSearch databases because that’s what Marken uses. This is obviously very expensive. Write algo runs into files.

Media 273

Media Latency Architecture Database 273

Dynatrace

NOVEMBER 3, 2021

For example, when monitoring a database, you’ll want to know about any latency when writing data to a disk or average query response time. Experienced database administrators learn to spot patterns that can lead to common problems. DevOps practitioners struggle to maintain highly available and scalable applications.

Monitoring 233

Monitoring Metrics DevOps Scalability 233

VoltDB

MARCH 21, 2024

In the world of databases, data management, and data platforms, this entropy usually takes the form of a simple database or data platform that might be ideal for early use cases evolving (or rather, de volving) into an expensive and unmanageable nightmare due to operational strain from use-case gluttony. How hard can it be?

Cache 52

Cache Database Storage Availability 52

Dynatrace

APRIL 10, 2023

We also couldn’t compromise on performance and availability.” “Caching’s one of the key components of any commerce application,” as it has a major impact on performance, Bollampally said. . “Over the last few years, the priorities have shifted with the ways consumers are shopping,” he said.

Cloud 182

Cloud Ecommerce Performance Retail 182

The Netflix TechBlog

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events. Designed with High Availability in mind.

Database 207

Database Traffic Transportation Open Source 207

Dynatrace

DECEMBER 21, 2023

Reduce the volume of data volumes requested from databases (for example, request all, filter in memory). Implement appropriate caching layers (for example, read-only cache for static data). A few examples: Reduce roundtrips between services (for example, the N+1 query pattern). Reduce inter-process communications overhead.

Cloud 222

Cloud Energy Best Practices Cache 222

High Scalability

OCTOBER 3, 2019

ScaleGrid, a rapidly growing leader in the Database-as-a-Service (DBaaS) space, has just launched their new fully managed Redis on Azure service. Redis, the #1 key-value store and top 10 database in the world, has grown by over 300% in popularity over that past 5 years, per the DB-Engines knowledge base.

Azure 23

Azure Cloud Open Source Cache 23

Percona

APRIL 7, 2023

I’ve used a fourth instance to host a PMM server to monitor servers A and B and used the data collected by the PMM agents installed on the database servers to compare performance. MySQL comes pre-configured to be conservative instead of making the most of the resources available in the server. Why is that?

Tuning 139

Tuning Cache Servers Benchmarking 139

Scalegrid

JANUARY 25, 2024

Redis® is an in-memory database that provides blazingly fast performance. This makes it a compelling alternative to disk-based databases when performance is a concern. Redis returns a big list of database metrics when you run the info command on the Redis shell. This blog post lists the important database metrics to monitor.

Metrics 130

Metrics Monitoring Latency Cache 130

Percona

NOVEMBER 1, 2023

version, like this: ANALYZE TABLE removes the table from the table definition cache, which requires a flush lock. This makes the query wait for any long-running queries to finish but also can trigger cascading waiting for other incoming requests. In short, ANALYZE could lead to nasty stalls in busy production environments. x are all safe.

Servers 103

Servers Database Cache C++ 103

Percona

APRIL 6, 2023

PostgreSQL is a popular open source relational database management system many organizations use to store and manage their data. However, as the size of your database grows, it can become challenging to manage and optimize its performance. This can significantly improve query response times and reduce the load on your database servers.

Cache 120

Cache Open Source Benchmarking Database 120

Scalegrid

MAY 11, 2024

WiredTiger excels with operational databases and transactional workloads as it offers b-tree-based storage and well-ordered data structures. However, it is limited by the available free memory amount, and all data is lost when the server stops. It uses a filesystem cache and write-ahead log for crash recovery.

Storage 130

Storage Engineering Cache Database 130

All Things Distributed

AUGUST 22, 2011

Today AWS has launched Amazon ElastiCache , a new service that makes it easy to add distributed in-memory caching to any application. Amazon ElastiCache handles the complexity of creating, scaling and managing an in-memory cache to free up brainpower for more differentiating activities. blog comments powered by Disqus. Contact Info.

Cloud 106

Cloud Cache AWS Storage 106

Percona

APRIL 24, 2023

This post is about PostgreSQL, but most of the problems also apply to other database systems. Effectively, the memory available for pages of the table gets less. The more indexes, the more the requirement of memory for effective caching. Cache requirements for indexes are generally much higher than associated tables.

Tuning 131

Tuning Cache Storage Database 131

Scalegrid

FEBRUARY 11, 2019

With such strong interest in this installation, we decided to write up the steps to configure your MySQL database on the ScaleGrid side to get you up and running ever faster with WordPress on Now. Setting Up Your MySQL Database for WordPress on ZEIT Now. Create a MySQL Database in ScaleGrid. Leave your comments: [link].

Serverless 138

Serverless Azure Database Cache 138

HammerDB

JULY 5, 2022

Python is a popular programming language, especially for beginners, and consequently we see it occurring in places where it just shouldn’t be used, such as database benchmarking. We use stored procedures because, as the introductory post shows, using single SQL statements turns our database benchmark into a network test).

Benchmarking 98

Benchmarking Database C++ Virtualization 98

All Things Distributed

JUNE 21, 2017

Today, I'm excited to announce the general availability of Amazon DynamoDB Accelerator (DAX) , a fully managed, highly available, in-memory cache that can speed up DynamoDB response times from milliseconds to microseconds, even at millions of requests per second. DynamoDB was the first service at AWS to use SSD storage.

Speed 98

Speed Cache Latency AWS 98