Scalegrid

MAY 11, 2024

MongoDB offers several storage engines that cater to various use cases. The default storage engine in earlier versions was MMAPv1, which utilized memory-mapped files and document-level locking. This allowed for sequential access and indexed access, but random writes could cause performance issues.

Storage 130

Storage Engineering Cache Database 130

Dynatrace

DECEMBER 13, 2023

Mobile applications (apps) are an increasingly important channel for reaching customers, but the distributed nature of mobile app platforms and delivery networks can cause performance problems that leave users frustrated, or worse, turning to competitors. What is mobile app performance? Issue remediation.

Best Practices 246

Best Practices Mobile Metrics Performance 246

The Netflix TechBlog

SEPTEMBER 24, 2021

The ProRes codec family provides great editing performance and image quality. From chunk encoding to assembly and packaging, the result of each previous processing step must be uploaded to cloud storage and then downloaded by the next processing step. Uploading and downloading data always come with a penalty, namely latency.

Cloud 242

Cloud Media Storage Cache 242

Smashing Magazine

JANUARY 7, 2025

In this article, well discuss six ways to design websites for high-traffic events like product drops and sales: Compress and optimize images , Choose a scalable web host , Use a CDN , Leverage caching , Stress test websites , Refine the backend. You can also find optimization plugins or caching solutions that give you access to a CDN.

Traffic 86

Traffic Website Design Cache 86

The Netflix TechBlog

APRIL 27, 2023

While Atlas is architected around compute & storage separation, and we could theoretically just scale the query layer to meet the increased query demand, every query, regardless of its type, has a data component that needs to be pushed down to the storage layer.

Storage 297

Storage Cache Metrics Database 297

Dynatrace

OCTOBER 7, 2021

This means you no longer have to provision, scale, and maintain servers to run your applications, databases, and storage systems. Speed is next; serverless solutions are quick to spin up or down as needed, and there are no delays due to limited storage or resource access. AWS offers four serverless offerings for storage.

Serverless 325

Serverless AWS Lambda Storage 325

The Morning Paper

MARCH 8, 2020

Building an elastic query engine on disaggregated storage , Vuppalapati, NSDI’20. For such workloads, shared-nothing architectures beget high cost, inflexibility, poor performance, and inefficiency, which hurts production applications and cluster deployments. joins) during query processing. Disaggregation (or not).

Storage 112

Storage Engineering Cache Serverless 112

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. Understanding distributed storage is imperative as data volumes and the need for robust storage solutions rise.

Storage 130

Storage Systems Big Data Azure 130

Dynatrace

JANUARY 16, 2023

The study analyzes factual Kubernetes production data from thousands of organizations worldwide that are using the Dynatrace Software Intelligence Platform to keep their Kubernetes clusters secure, healthy, and high performing. The report also reveals the leading programming languages practitioners use for application workloads.

Open Source 358

Open Source Java Operating System Programming 358

The Netflix TechBlog

OCTOBER 8, 2024

Flexible Storage : The service is designed to integrate with various storage backends, including Apache Cassandra and Elasticsearch , allowing Netflix to customize storage solutions based on specific use case requirements. DistinctAggregation) , this endpoint performs the given aggregation within a given time interval.

Latency 239

Latency Storage Traffic Tuning 239

Percona

APRIL 14, 2023

A shared characteristic in most (if not all) databases, be them traditional relational databases like Oracle, MySQL, and PostgreSQL or some kind of NoSQL-style database like MongoDB, is the use of a caching mechanism to keep (a copy of) part of the data in memory. How do you know if your MySQL database caching is operating efficiently?

Cache 107

Cache Efficiency Database Monitoring 107

The Netflix TechBlog

MARCH 10, 2023

are stored in secure storage layers. Amsterdam is built on top of three storage layers. Although this indexing strategy worked smoothly for a while, interesting challenges started coming up and we started to notice performance issues over time. When performing a query, we always execute it on the alias.

Strategy 264

Strategy Cache Storage Analytics 264

Dynatrace

OCTOBER 4, 2022

Data warehouses offer a single storage repository for structured data and provide a source of truth for organizations. Unlike data warehouses, however, data is not transformed before landing in storage. A data lakehouse provides a cost-effective storage layer for both structured and unstructured data. Query language.

Artificial Intelligence 246

Artificial Intelligence Storage Analytics Government 246

Percona

MARCH 23, 2023

This blog is in reference to our previous ones for ‘Innodb Performance Optimizations Basics’ 2007 and 2013. Although there have been many blogs about adjusting MySQL variables for better performance since then, I think this topic deserves a blog update since the last update was a decade ago, and MySQL 5.7

Performance 144

Performance Hardware Tuning Storage 144

Smashing Magazine

SEPTEMBER 28, 2022

Five Data-Loading Patterns To Improve Frontend Performance. Five Data-Loading Patterns To Improve Frontend Performance. When it comes to performance, you shouldn’t be stingy. On design systems, UX, web performance and CSS/JS. Active Memory Caching. Using the cache as permanent storage is an anti-pattern.

Cache 141

Cache Performance Servers Architecture 141

Percona

FEBRUARY 1, 2023

PostgreSQL is a fantastic database, but if you’re storing images, video, audio files, or other large data objects, you need to “toast” them to get optimal performance. This post will look at using The Oversized-Attribute Storage Technique (TOAST) to improve performance and scalability.

Storage 111

Storage Scalability Strategy Performance 111

Percona

JUNE 22, 2023

As a MySQL database administrator, keeping a close eye on the performance of your MySQL server is crucial to ensure optimal database operations. A monitoring tool like Percona Monitoring and Management (PMM) is a popular choice among open source options for effectively monitoring MySQL performance.

Performance 136

Performance Monitoring Traffic Database 136

The Netflix TechBlog

NOVEMBER 15, 2022

But it’s not easy: to pull this off, VFX studios need to build and operate serious technical infrastructure (compute, storage, networking, and software licensing), otherwise known as a “ render farm.” Netflix production teams work with a global roster of VFX studios (both large and small) and their artists to create this amazing imagery.

Cloud 291

Cloud Entertainment AWS Infrastructure 291

Dynatrace

SEPTEMBER 13, 2023

The framework comprises six pillars: Operational Excellence, Security, Reliability, Performance Efficiency, Cost Optimization, and Sustainability. And how can you verify this performance consistently across a multicloud environment that also uses Microsoft Azure and Google Cloud Platform frameworks?

AWS 305

AWS Efficiency Azure Cloud 305

The Netflix TechBlog

MAY 4, 2023

The first phase involves validating functional correctness, scalability, and performance concerns and ensuring the new systems’ resilience before the migration. These include Quality-of-Experience(QoE) measurements at the customer device level, Service-Level-Agreements (SLAs), and business-level Key-Performance-Indicators(KPIs).

Traffic 347

Traffic Latency Tuning Systems 347

Percona

APRIL 24, 2023

Indexes are generally considered to be the panacea when it comes to SQL performance tuning, and PostgreSQL supports different types of indexes catering to different use cases. The benefits come with a cost in terms of performance and resource consumption. The more indexes, the more the requirement of memory for effective caching.

Tuning 139

Tuning Cache Storage Database 139

The Netflix TechBlog

SEPTEMBER 10, 2024

Finally, the device receives the message, and the action, such as “Show me Stranger Things on Netflix”, is performed. Dynomite had great performance, but it required manual scaling as the system grew. KeyValue is an abstraction over the storage engine itself, which allows us to choose the best storage engine that meets our SLO needs.

Latency 234

Latency Cache Tuning Efficiency 234

Scalegrid

MARCH 28, 2024

In this comparison of Redis vs Memcached, we strip away the complexity, focusing on each in-memory data store’s performance, scalability, and unique features. Redis and Memcached both provide high performance with sub-millisecond response times. Choosing between Redis and Memcached hinges on specific application requirements.

Cache 130

Cache Storage Architecture Scalability 130

Dynatrace

DECEMBER 20, 2021

Streamlined asset caching: Asset caching is critical for creating accurate replays. Minimal infrastructure impact: The way your session replay tool compresses, stores, and processes video data can have an impact on system performance. Make sure you know what assets your replay tool is recording and how you can access them.

Mobile 264

Mobile Website Analytics Cache 264

Percona

FEBRUARY 15, 2023

For good performance, the filter blocks are cached in the RocksDB block cache and normally stay there since they are accessed frequently. LSM storage engines like MyRocks are very different from the more common B-Tree-based storage engines like InnoDB.

Storage 138

Storage Tuning Cache Engineering 138

Dynatrace

NOVEMBER 5, 2019

Application Insights – Collects performance metrics of the application code. In addition to the OneAgent collecting all these metrics, Dynatrace has an integration with Azure Monitor to capture additional metrics for platform services such as Storage Accounts, Redis Cache, API Management Services, Load Balancers among others.

Azure 198

Azure Artificial Intelligence Metrics Innovation 198

All Things Distributed

SEPTEMBER 20, 2013

Not everybody agreed that the "N-ary Storage Model" (NSM) was the best approach for all workloads but it stayed dominant until hardware constraints, especially on caches, forced the community to revisit some of the alternatives. Many of the modern high-performance data warehouses such as Amazon Redshift are based on column stores.

Storage 71

Storage Hardware Cache C++ 71

Alex Russell

MARCH 6, 2021

Back in 2016, I gave a talk outlining the causes and effects of the terrible performance of web apps built using popular tools on the fastest-growing device segment: low-end to mid-range Android phones. Poor performance has a compound effect on user expectations at an ecosystem level. Live by the link, die by the link.

Performance 127

Performance Network Mobile Metrics 127

All Things Distributed

AUGUST 22, 2011

Today AWS has launched Amazon ElastiCache , a new service that makes it easy to add distributed in-memory caching to any application. Amazon ElastiCache handles the complexity of creating, scaling and managing an in-memory cache to free up brainpower for more differentiating activities. Driving Storage Costs Down for AWS Customers.

Cloud 103

Cloud Cache AWS Storage 103

Percona

APRIL 7, 2023

I’ve used a fourth instance to host a PMM server to monitor servers A and B and used the data collected by the PMM agents installed on the database servers to compare performance. To be fair, that is also true with PostgreSQL; it hasn’t been tuned either, and it, too, can also perform much better. Why is that?

Tuning 145

Tuning Cache Servers Benchmarking 145

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! Or even on a plane.

Performance 103

Performance Latency Cache Virtualization 103

Scalegrid

JANUARY 25, 2024

Redis® is an in-memory database that provides blazingly fast performance. This makes it a compelling alternative to disk-based databases when performance is a concern. You might already use ScaleGrid hosting for Redis hosting to power your performance-sensitive applications.

Metrics 130

Metrics Monitoring Latency Cache 130

ScaleOut Software

APRIL 22, 2020

The Solution: Distributed Caching. The solution to this challenge is to use scalable, memory-based data storage for fast-changing data so that web sites can keep up with exploding workloads. It’s not enough simply to lash together a set of servers hosting a collection of in-memory caches.

Cache 52

Cache Storage Servers Database 52

ScaleOut Software

APRIL 22, 2020

The Solution: Distributed Caching. The solution to this challenge is to use scalable, memory-based data storage for fast-changing data so that web sites can keep up with exploding workloads. It’s not enough simply to lash together a set of servers hosting a collection of in-memory caches.

Cache 52

Cache Storage Servers Database 52

Dynatrace

OCTOBER 15, 2021

OpenTelemetry (also referred to as OTel) is an open-source observability framework made up of a collection of tools, APIs, and SDKs, that enables IT teams to instrument, generate, collect, and export telemetry data for analysis and understand software performance and behavior. This occurs once data is safely stored within a local cache.

Open Source 246

Open Source Metrics Cloud Transportation 246

Dynatrace

SEPTEMBER 17, 2019

PostgreSQL & Elastic for data storage. REDIS for caching. Robert’s AWS & EKS admin team are monitoring most services with that capability but found it beneficial for them to have Dynatrace monitor Elastic File Storage (EFS). 2: Automate Quality aka “Performance as a Self-Service”. NGINX as an API Gateway.

AWS 170

AWS Monitoring Ecommerce Lambda 170

All Things Distributed

OCTOBER 2, 2017

We were pushing the limits of what was a leading commercial database at the time and were unable to sustain the availability, scalability and performance needs that our growing Amazon business demanded. Performant – The service would need to be able to maintain consistent performance in the face of diverse customer workloads.

Internet 110

Internet Internet AWS Performance 110