All Things Distributed

JANUARY 18, 2012

a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Today is a very exciting day as we release Amazon DynamoDB , a fast, highly reliable and cost-effective NoSQL database service designed for internet scale applications. Amazon DynamoDB offers low, predictable latencies at any scale. Comments ().

Scalability 162

Scalability Database Ecommerce Latency 162

Dynatrace

JANUARY 14, 2022

The optimization goal was to improve the application efficiency, that is to improve the ratio between service throughput and cloud costs while not increasing the application latency (e.g. The baseline configuration—the initial sizing of microservices—only provided an efficiency of 0.29 below 500ms) and error rates (e.g.

Latency 246

Latency Tuning Efficiency AWS 246

Dynatrace

JULY 22, 2024

Metrics are typically aggregated and stored in time series databases for monitoring and alerting purposes. Traces are used for performance analysis, latency optimization, and root cause analysis. Capture critical performance indicators such as request latency, error rates, and resource usage. Employ efficient sampling.

Latency 264

Latency Best Practices Metrics Open Source 264

All Things Distributed

JUNE 21, 2018

A common question that I get is why do we offer so many database products? To do this, they need to be able to use multiple databases and data models within the same application. Seldom can one database fit the needs of multiple distinct use cases. Seldom can one database fit the needs of multiple distinct use cases.

Database 167

Database AWS Games Latency 167

Dynatrace

JANUARY 15, 2020

Citrix is a sophisticated, efficient, and highly scalable application delivery platform that is itself comprised of anywhere from hundreds to thousands of servers. Dynatrace Extension: database performance as experienced by the SAP ABAP server. Comparison of these metrics between VDAs characterizes load balancing efficiency.

Latency 52

Latency Performance Virtualization Infrastructure 52

The Netflix TechBlog

OCTOBER 8, 2024

Rajiv Shringi Vinay Chella Kaidan Fullerton Oleksii Tkachuk Joey Lynch Introduction As Netflix continues to expand and diversify into various sectors like Video on Demand and Gaming , the ability to ingest and store vast amounts of temporal data — often reaching petabytes — with millisecond access latency has become increasingly vital.

Latency 239

Latency Storage Traffic Tuning 239

Dynatrace

JANUARY 31, 2024

The RAG process begins by summarizing and converting user prompts into queries that are sent to a search platform that uses semantic similarities to find relevant data in vector databases, semantic caches, or other online data sources. Observing AI models Running AI models at scale can be resource-intensive.

Cache 276

Cache Azure Infrastructure Monitoring 276

Dynatrace

APRIL 5, 2021

The 2014 launch of AWS Lambda marked a milestone in how organizations use cloud services to deliver their applications more efficiently, by running functions at the edge of the cloud without the cost and operational overhead of on-premises servers. A new record entering a database table. Dynatrace news. What is AWS Lambda?

Lambda 258

Lambda AWS Serverless Hardware 258

Scalegrid

OCTOBER 17, 2019

In that environment, the first PostgreSQL developers decided forking a process for each connection to the database is the safest choice. It would be a shame if your database crashed, after all. Developers are often strongly discouraged from holding a database connection while other operations take place.

Architecture 200

Architecture Database Latency Servers 200

All Things Distributed

JULY 14, 2015

I am excited to share with you that today we are expanding DynamoDB with streams, cross-region replication, and database triggers. In traditional database architectures, database engines often run a small search engine or data warehouse engines on the same hardware as the database. DynamoDB Cross-region Replication.

Database 158

Database Lambda AWS IoT 158

The Netflix TechBlog

OCTOBER 27, 2020

The data warehouse is not designed to serve point requests from microservices with low latency. Therefore, we must efficiently move data from the data warehouse to a global, low-latency and highly-reliable key-value store. As most key-value storage engines support efficiently deleting a namespace (e.g.

Latency 252

Latency Storage Big Data Tuning 252

Dynatrace

JULY 6, 2020

In addition to providing visibility for core Azure services like virtual machines, load balancers, databases, and application services, we’re happy to announce support for the following 10 new Azure services, with many more to come soon: Virtual Machines (classic ones). Effortlessly optimize Azure database performance.

Azure 227

Azure Cloud Big Data Virtualization 227

High Scalability

SEPTEMBER 8, 2018

New databases used to be announced seemingly every week. While database neogenesis has slowed down considerably, it has not gone necrotic. Anna is not only incredibly fast, it’s incredibly efficient and elastic too: an autoscaling, multi-tier, selectively-replicating cloud service. What's changed ?

Storage 199

Storage Performance AWS Cloud 199

Percona

NOVEMBER 9, 2023

If you have any experience working with database software, you have undoubtedly heard the term Kubernetes a lot. Cost and resource efficiency One of Kubernetes’ main advantages is its efficient use of resources. You may already be using it daily and find it makes running applications in the cloud much more manageable.

Efficiency 117

Efficiency Cloud Healthcare Open Source 117

All Things Distributed

AUGUST 20, 2015

It opens up the possibility to enjoy the value that graph databases bring to relationship-centric use cases, without worrying about managing the underlying storage. Developers need efficient methods to store, traverse, and query these relationships. Enter graph databases. Graph databases at Amazon.

Database 121

Database Logistics Availability Social Media 121

The Netflix TechBlog

JANUARY 10, 2024

This architecture shift greatly reduced the processing latency and increased system resiliency. We expanded pipeline support to serve our studio/content-development use cases, which had different latency and resiliency requirements as compared to the traditional streaming use case. divide the input video into small chunks 2.

Processing 238

Processing Media Latency Innovation 238

The Netflix TechBlog

DECEMBER 21, 2020

We built AutoOptimize to efficiently and transparently optimize the data and metadata storage layout while maximizing their cost and performance benefits. This article will list some of the use cases of AutoOptimize, discuss the design principles that help enhance efficiency, and present the high-level architecture.

Storage 212

Storage Latency Efficiency Data Engineering 212

Scalegrid

JANUARY 25, 2024

Redis® is an in-memory database that provides blazingly fast performance. This makes it a compelling alternative to disk-based databases when performance is a concern. Redis returns a big list of database metrics when you run the info command on the Redis shell. This blog post lists the important database metrics to monitor.

Metrics 130

Metrics Monitoring Latency Cache 130

The Netflix TechBlog

JULY 26, 2021

Operational Reporting is a reporting paradigm specialized in covering high-resolution, low-latency data sets, serving detailed day-to-day activities¹ and processes of a business domain. In the initial stage, data consumers set up ETL pipelines directly pulling data from databases. When an upstream schema evolves (e.g.

Big Data 257

Big Data Government Processing Analytics 257

Dynatrace

SEPTEMBER 30, 2021

Like any move, a cloud migration requires a lot of planning and preparation, but it also has the potential to transform the scope, scale, and efficiency of how you deliver value to your customers. This can fundamentally transform how they work, make processes more efficient, and improve the overall customer experience. Here are three.

Cloud 241

Cloud Traffic Best Practices Strategy 241

Scalegrid

JANUARY 21, 2025

Identifying key Redis metrics such as latency, CPU usage, and memory metrics is crucial for effective Redis monitoring. Redis Monitoring Essentials Ensuring the performance, reliability, and safety of a Redis database requires active monitoring. Monitoring tools should also be considered when setting up your Redis database.

Strategy 130

Strategy Monitoring Latency DevOps 130

The Netflix TechBlog

SEPTEMBER 3, 2021

Remote calls are never free; they impose extra latency, increase probability of an error, and consume network bandwidth. If the service knows which fields are important for the caller, it can make an informed decision about making expensive calls, starting resource-heavy computations, and/or calling the database.

Design 246

Design Java Code Servers 246

Dynatrace

SEPTEMBER 25, 2019

Citrix is a sophisticated, efficient, and highly scalable application delivery platform that is itself comprised of anywhere from hundreds to thousands of servers. Dynatrace Extension: database performance as experienced by the SAP ABAP server. Comparison of these metrics between VDAs characterizes load balancing efficiency.

Latency 164

Latency Performance Virtualization Infrastructure 164

The Netflix TechBlog

JUNE 13, 2023

By collecting and analyzing key performance metrics of the service over time, we can assess the impact of the new changes and determine if they meet the availability, latency, and performance requirements. Our system doesn’t require strict consistency guarantees and does not use database transactions.

Traffic 285

Traffic Metrics Systems Strategy 285

DZone

JULY 6, 2020

TiDB is an open-source, distributed SQL database that supports Hybrid Transactional/Analytical Processing (HTAP) workloads. Ideally, a TiDB cluster should always be efficient and problem-free. It should be stable, load-balanced, and have a reliable rate of queries per second (QPS).

Open Source 130

Open Source Latency Traffic Analytics 130

Scalegrid

DECEMBER 21, 2023

Identifying key Redis® metrics such as latency, CPU usage, and memory metrics is crucial for effective Redis monitoring. Redis® Monitoring Essentials Ensuring the performance, reliability, and safety of a Redis® database requires active monitoring. Monitoring tools should also be considered when setting up your Redis® database.

Strategy 130

Strategy Monitoring Latency DevOps 130

The Netflix TechBlog

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events. Designed with High Availability in mind.

Database 221

Database Traffic Transportation Open Source 221

Dynatrace

AUGUST 5, 2019

Database & functional migration. Remember: This is a critical aspect as you do not want to migrate a service and suddenly introduce high latency or costs to a system that you forgot about having a dependency with! Step 4: Smart Database Migration. What’s the current performance of key database queries and stored procedures?

Cloud 38

Cloud Traffic Database Network 38

The Netflix TechBlog

OCTOBER 19, 2020

If we had an ID for each streaming session then distributed tracing could easily reconstruct session failure by providing service topology, retry and error tags, and latency measurements for all service calls. However, having a scalable stream processing platform doesn’t help much if you can’t store data in a cost efficient manner.

Infrastructure 238

Infrastructure Transportation Storage Open Source 238

The Netflix TechBlog

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events. Designed with High Availability in mind.

Database 206

Database Traffic Transportation Open Source 206

Percona

JUNE 22, 2023

As a MySQL database administrator, keeping a close eye on the performance of your MySQL server is crucial to ensure optimal database operations. Query performance Query performance is a key performance indicator (KPI) in MySQL, as it measures the efficiency and speed of query execution.

Performance 136

Performance Monitoring Traffic Database 136

Scalegrid

JANUARY 8, 2024

This article delves into the specifics of how AI optimizes cloud efficiency, ensures scalability, and reinforces security, providing a glimpse at its transformative role without giving away extensive details. Using AI for Enhanced Cloud Operations The integration of AI in cloud computing is enhancing operational efficiency in several ways.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

Scalegrid

APRIL 10, 2025

Planning your upgrade strategy well in advance helps mitigate risks and ensures your systems remain secure and efficient. Unsupported MongoDB versions may result in slow query execution and increased downtime, affecting database responsiveness and user experience. Upgrades enhance operational efficiency and improve the user experience.

Best Practices 130

Best Practices Benchmarking Strategy Database 130

Scalegrid

MARCH 28, 2024

Snapshots provide point-in-time captures of the dataset, which are efficient for recovery on startup. Memcached shines in scenarios where a simple, fast, and efficient caching solution is required without data persistence. Memory Efficiency Compared When it comes to memory efficiency, Redis and Memcached have different strengths.

Cache 130

Cache Storage Scalability Architecture 130

All Things Distributed

NOVEMBER 8, 2012

Improving the Cloud - More Efficient Queuing with SQS. For example, AWS customers use SQS for asynchronous communication pipelines, buffer queues for databases, asynchronous work queues, and moving latency out of highly responsive requests paths. All Things Distributed. By Werner Vogels on 08 November 2012 03:00 PM. Comments ().

Efficiency 84

Efficiency Cloud Games Scalability 84

Percona

MARCH 29, 2023

Compression in any database is necessary as it has many advantages, like storage reduction, data transmission time, etc. As the amount of data grows, the need for efficient data compression becomes increasingly important to save storage space, reduce I/O overhead, and improve query performance. provides higher compression rates.

Storage 130

Storage Network Open Source Latency 130

Percona

MARCH 20, 2023

In this scenario, it is also crucial to be efficient in resource utilization and scaling with frugality. In short, each cluster is, in reality, a single database with high availability and other functionalities built in. Let us take a look also the latency: Here the situation starts to be a little bit more complicated.

Games 141

Games Latency Traffic Cache 141