DZone

JANUARY 20, 2023

Having a distributed and scalable graph database system is highly sought after in many enterprise scenarios. Do Not Be Misled Designing and implementing a scalable graph database system has never been a trivial task.

Scalability 210

Scalability Big Data Hardware Internet 210

The Netflix TechBlog

DECEMBER 17, 2024

As Netflix scaled, we faced the mounting challenge of providing accurate, timely answers to increasingly complex queries about title performance and discoverability. The complexity of these operational demands underscored the urgent need for a scalable solution.

Traffic 172

Traffic Scalability Strategy Monitoring 172

DZone

SEPTEMBER 19, 2024

RabbitMQ is a powerful and widely used message broker that facilitates communication between distributed applications by handling the transmission, storage, and delivery of messages. This decoupling allows applications to operate independently, promoting scalability, resilience, and fault tolerance.

Storage 264

Storage Performance Scalability Architecture 264

The Netflix TechBlog

MARCH 31, 2025

Besides the need for robust cloud storage for their media, artists need access to powerful workstations and real-time playback. Our AnswerContent Hubs Media Production Suite(MPS) [link] Building a global scalable solution that could be utilized in a diversity of markets has been an exciting challenge.

Media 203

Media Logistics Innovation Cloud 203

Percona

APRIL 1, 2025

As more organizations move their PostgreSQL databases onto Kubernetes, a common question arises: Which storage solution best handles its demands? Picking the right option is critical, directly impacting performance, reliability, and scalability.

Storage 66

Storage Benchmarking Scalability Database 66

Dynatrace

OCTOBER 23, 2023

Secondly, determining the correct allocation of resources (CPU, memory, storage) to each virtual machine to ensure optimal performance without over-provisioning can be difficult. This presents a challenge for IT operations teams, specifically in identifying and addressing performance issues or planning how to prevent future issues.

Efficiency 264

Efficiency Virtualization Hardware Performance 264

Dynatrace

APRIL 4, 2025

For forensic log analytics use cases, the Security Investigator app benefits from the scalability and analytics power of Dynatrace Grail. The Grail architecture ensures scalability, making log data accessible for detailed analysis regardless of volume.

Analytics 147

Analytics Operating System Scalability Infrastructure 147

Dynatrace

MARCH 11, 2025

For deeper exploration, our Distributed Tracing app empowers you to analyze raw trace data and uncover insights, whether troubleshooting errors, optimizing performance, or discovering the unknown unknowns. Say hello to advanced trace an alytics and new data storage and capture options. But why stop there?

Games 165

Games Analytics Innovation Metrics 165

Scalegrid

MAY 13, 2020

Greenplum uses an MPP database design that can help you develop a scalable, high performance deployment. High performance, query optimization, open source and polymorphic data storage are the major Greenplum advantages. At a glance – TLDR. The Greenplum Architecture. Greenplum Advantages. Major Use Cases.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

Scalegrid

FEBRUARY 27, 2025

PostgreSQL 17 improves performance, backups, JSON handling, and security. Heres what stands out: Key Takeaways Better Performance: Faster write operations and improved vacuum processes help handle high-concurrency workloads more smoothly. Key Benefits: Smaller Storage Footprint: Saves only modified data, cutting down backup size.

Speed 130

Speed Database Storage Efficiency 130

Dynatrace

OCTOBER 7, 2021

This means you no longer have to provision, scale, and maintain servers to run your applications, databases, and storage systems. Speed is next; serverless solutions are quick to spin up or down as needed, and there are no delays due to limited storage or resource access. Scalability. Finally, there’s scalability.

Serverless 325

Serverless AWS Lambda Storage 325

High Scalability

JANUARY 11, 2022

from a client it performs two parallel operations: i) persisting the action in the data store ii) publish the action in a streaming data store for a pub-sub model. User Feed Service, Media Counter Service) read the actions from the streaming data store and performs their specific tasks. After that, the various services (e.g.

Design 334

Design Media Storage Logistics 334

Dynatrace

FEBRUARY 10, 2023

These are just some of the topics being showcased at Perform 2023 in Las Vegas. Perform 2023 news At Perform 2023 in Las Vegas, the headliner theme is IT automation. What’s more, organizations are no longer concerned only about application performance and sales numbers. We’ll post news here as it happens!

Efficiency 306

Efficiency Performance Analytics DevOps 306

Scalegrid

FEBRUARY 24, 2025

Scaling RabbitMQ ensures your system can handle growing traffic and maintain high performance. Key Takeaways RabbitMQ improves scalability and fault tolerance in distributed systems by decoupling applications, enabling reliable message exchanges. Erlang is the backbone of RabbitMQ clustering. The minimum required version is 20.2,

Best Practices 147

Best Practices Traffic Strategy Scalability 147

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. Understanding distributed storage is imperative as data volumes and the need for robust storage solutions rise.

Storage 130

Storage Systems Big Data Azure 130

Dynatrace

NOVEMBER 11, 2022

Therefore, they need an environment that offers scalable computing, storage, and networking. Hyperconverged infrastructure (HCI) is an IT architecture that combines servers, storage, and networking functions into a unified, software-centric platform to streamline resource management. What is hyperconverged infrastructure?

Infrastructure 264

Infrastructure Storage Virtualization Network 264

The Netflix TechBlog

DECEMBER 17, 2024

DJ then can perform the joins to bring in any requested dimensions from `users_dimension_table`. If country_iso_code doesnt already exist in the fact table, the metric owner only needs to tell DJ that account_id is the foreign key to an `users_dimension_table` (we call this process dimension linking ).

Analytics 212

Analytics Engineering Entertainment Metrics 212

All Things Distributed

JANUARY 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The original Dynamo design was based on a core set of strong distributed systems principles resulting in an ultra-scalable and highly reliable database system.

Scalability 162

Scalability Database Ecommerce Latency 162

Scalegrid

MAY 11, 2024

MongoDB offers several storage engines that cater to various use cases. The default storage engine in earlier versions was MMAPv1, which utilized memory-mapped files and document-level locking. This allowed for sequential access and indexed access, but random writes could cause performance issues.

Storage 130

Storage Engineering Cache Database 130

Dynatrace

AUGUST 11, 2022

Before an organization moves to function as a service, it’s important to understand how it works, its benefits and challenges, its effect on scalability, and why cloud-native observability is essential for attaining peak performance. Infrastructure as a service (IaaS) handles compute, storage, and network resources.

Development 279

Development Serverless Best Practices Lambda 279

DZone

JUNE 3, 2019

Using local SSDs inside of the GPU node delivers fast access to data during training, but introduces challenges that impact the overall solution in terms of scalability, data access, and data protection. For example, one well-respected vendor's standard solution is limited to 7.5TB of internal storage, and it can only scale to 30TB.

Storage 100

Storage Performance Network Scalability 100

Dynatrace

JANUARY 15, 2020

This extends Dynatrace visibility into Citrix user experience and Citrix platform performance. Citrix is a sophisticated, efficient, and highly scalable application delivery platform that is itself comprised of anywhere from hundreds to thousands of servers. Dynatrace Extension: SAP ABAP platform performance. Citrix VDA.

Latency 52

Latency Performance Virtualization Infrastructure 52

The Netflix TechBlog

MARCH 4, 2025

Data storage and distribution through HollowFeeds Netflix Hollow is an Open Source java library and toolset for disseminating in-memory datasets from a single producer to many consumers for high performance read-only access. Conclusion Throughout this series, weve explored the journey of enhancing title launch observability at Netflix.

Traffic 180

Traffic Strategy Entertainment Innovation 180

Dynatrace

OCTOBER 4, 2022

This architecture offers rich data management and analytics features (taken from the data warehouse model) on top of low-cost cloud storage systems (which are used by data lakes). This decoupling ensures the openness of data and storage formats, while also preserving data in context. High-performance analytics—no indexing required.

Artificial Intelligence 290

Artificial Intelligence Analytics Storage Architecture 290

The Netflix TechBlog

APRIL 27, 2023

While we were able to put out the immediate fire by disabling the newly created alerts, this incident raised some critical concerns around the scalability of our alerting system. It became clear to us that we needed to solve the scalability problem with a fundamentally different approach. OK, Results?

Storage 297

Storage Cache Metrics Database 297

Dynatrace

JANUARY 11, 2023

With more organizations taking the multicloud plunge, monitoring cloud infrastructure is critical to ensure all components of the cloud computing stack are available, high-performing, and secure. These next-generation cloud monitoring tools present reports — including metrics, performance, and incident detection — visually via dashboards.

Cloud 295

Cloud Monitoring Best Practices Infrastructure 295

DZone

NOVEMBER 27, 2023

An open-source distributed SQL query engine, Trino is widely used for data analytics on distributed data storage. Optimizing Trino to make it faster can help organizations achieve quicker insights and better user experiences, as well as cut costs and improve infrastructure efficiency and scalability. But how do we do that?

Tuning 162

Tuning Speed Performance Open Source 162

Dynatrace

JANUARY 17, 2024

An AI observability strategy—which monitors IT system performance and costs—may help organizations achieve that balance. AI requires more compute and storage. Training AI data is resource-intensive and costly, again, because of increased computational and storage requirements. AI performs frequent data transfers.

Strategy 288

Strategy Artificial Intelligence Storage Cloud 288

The Netflix TechBlog

OCTOBER 8, 2024

The Key-Value Abstraction offers a flexible, scalable solution for storing and accessing structured key-value data, while the Data Gateway Platform provides essential infrastructure for protecting, configuring, and deploying the data tier. DistinctAggregation) , this endpoint performs the given aggregation within a given time interval.

Latency 239

Latency Storage Traffic Tuning 239

High Scalability

SEPTEMBER 8, 2018

You get all the multicore Anna performance you want, but you don’t pay for what you don’t need. Just to throw out some numbers, we measured Anna providing 355x the performance of DynamoDB for the dollar. Each storage server collects statistics about the requests it serves, the data it stores, etc.

Storage 199

Storage Performance AWS Media 199

The Netflix TechBlog

OCTOBER 19, 2020

Our distributed tracing infrastructure is grouped into three sections: tracer library instrumentation, stream processing, and storage. An additional implication of a lenient sampling policy is the need for scalable stream processing and storage infrastructure fleets to handle increased data volume. Storage: don’t break the bank!

Infrastructure 238

Infrastructure Transportation Storage Open Source 238

Dynatrace

MAY 7, 2024

However, you can also use Fluent Bit as a processor because you can perform various actions on the data. which offers a range of updates: HTTP/2 support: Fluentbit now supports HTTP/2, enabling efficient data transmission with Gzip compression for OpenTelemetry data, enhancing pipeline performance. What’s new in Fluent Bit 3.0

Best Practices 279

Best Practices IoT Metrics Storage 279

InfoQ

MAY 15, 2023

A horizontally scalable exabyte-scale blob storage system which operates out of multiple regions, Magic Pocket is used to store all of Dropbox’s data. Adopting SMR technology and erasure codes, the system has extremely high durability guarantees but is cheaper than operating in the cloud. By Facundo Agriel

Storage 117

Storage Systems Scalability Cloud 117

The Netflix TechBlog

SEPTEMBER 18, 2024

Central to this infrastructure is our use of multiple online distributed databases such as Apache Cassandra , a NoSQL database known for its high availability and scalability. Firstly, developers struggled to reason about consistency, durability and performance in this complex global deployment across multiple stores.

Latency 260

Latency Storage Cache Servers 260

Dynatrace

OCTOBER 4, 2022

Teams have introduced workarounds to reduce storage costs. Additionally, efforts such as lowered data retention times, two-tiered storage systems, shaky index management, sampled data, and data pipelines reduce the overall amount of stored data. Stop worrying about log data ingest and storage — start creating value instead.

Analytics 264

Analytics Artificial Intelligence Storage Serverless 264

Dynatrace

SEPTEMBER 8, 2022

Log management is an organization’s rules and policies for managing and enabling the creation, transmission, analysis, storage, and other tasks related to IT systems’ and applications’ log data. This is critical to ensure high performance, security, and a positive user experience for cloud-native applications and services.

Cloud 260

Cloud Systems Analytics DevOps 260

Dynatrace

JANUARY 23, 2024

These are the goals of AI observability and data observability, a key theme at Dynatrace Perform 2024 , the observability provider’s annual conference, which takes place in Las Vegas from January 29 to February 1, 2024. Join us at Dynatrace Perform 2024 , either on-site or virtuall y, to explore these themes further.

Performance 246

Performance DevOps Innovation Artificial Intelligence 246