Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. Understanding distributed storage is imperative as data volumes and the need for robust storage solutions rise.

Storage 130

Storage Systems Big Data Azure 130

Dynatrace

FEBRUARY 1, 2024

Maintaining optimal application performance is crucial for businesses, and fast databases are vital in achieving this goal. For an effective approach to database performance, it’s crucial to have a comprehensive overview of all databases, including server-side DBs.

Database 196

Database Monitoring Games Metrics 196

Dynatrace

SEPTEMBER 8, 2023

In part 2, we’ll show you how to retrieve business data from a database, analyze that data using dashboards and ad hoc queries, and then use a Davis analyzer to predict metric behavior and detect behavioral anomalies. However, as we highlighted previously, business data can be significantly more complex than simple metrics.

Database 279

Database Artificial Intelligence Metrics Monitoring 279

Percona

JANUARY 4, 2024

Managing storage and performance efficiently in your MySQL database is crucial, and general tablespaces offer flexibility in achieving this. In contrast to the single system tablespace that holds system tables by default, general tablespaces are user-defined storage containers for multiple InnoDB tables.

Storage 93

Storage Engineering Database Open Source 93

DZone

APRIL 11, 2023

Data processing in the cloud has become increasingly popular due to its scalability, flexibility, and cost-effectiveness. This article will explore how these technologies can be used together to create an optimized data pipeline for data processing in the cloud.

Azure 246

Azure Analytics Storage Cloud 246

DZone

JUNE 6, 2023

What is compaction in the database? Think of your disks as a warehouse: The compaction mechanism is like a team of storekeepers (with genius organizing skills like Marie Kondo) who help put away the incoming data. These files go by different names in different databases. In my community, we call them Rowsets ).

Storage 202

Storage Database 202

Dynatrace

OCTOBER 4, 2022

For IT infrastructure managers and site reliability engineers, or SREs , logs provide a treasure trove of data. But on their own, logs present just another data silo as IT professionals attempt to troubleshoot and remediate problems. Data volume explosion in multicloud environments poses log issues.

Analytics 234

Analytics Storage Infrastructure Metrics 234

Scalegrid

JANUARY 5, 2024

Enhanced data security, better data integrity, and efficient access to information. If you’re considering a database management system, understanding these benefits is crucial. Understanding Database Management Systems (DBMS) A Database Management System (DBMS) assists users in creating and managing databases.

Efficiency 147

Efficiency Storage Database Scalability 147

Percona

DECEMBER 11, 2023

There are a wealth of options on how you can approach storage configuration in Percona Operator for PostgreSQL , and in this blog post, we review various storage strategies — from basics to more sophisticated use cases. For example, you can choose the public cloud storage type – gp3, io2, etc, or set file system.

Storage 109

Storage Strategy Cloud Network 109

Percona

SEPTEMBER 6, 2024

Database novices often wonder how ‘things work behind the scenes’ when starting with PostgreSQL. Many things happen when creating a table and adding data that are not apparent. You might ask, ‘Where does the data go?’ ’ Luckily, it is easy to discover the details.

Storage 98

Storage Database 98

Scalegrid

DECEMBER 6, 2023

In the digital age, data management has transformed from locally hosted servers to cloud solutions. The choice of self-managed cloud databases vs DBaaS is a common debate among those who are looking for the best option that will cater to their particular needs.

Database 130

Database Cloud Hardware Storage 130

DZone

AUGUST 6, 2021

Most log management solutions store log data in a database and enable search by storing an index of the data. As the database grows in size, so does the index management cost. When companies are handling terabytes of data every day, the database-backed log management system becomes untenable.

Storage 189

Storage Database Systems Efficiency 189

InfoQ

NOVEMBER 6, 2024

Pinterest has modernized and enhanced its Goku time-series database. The recent updates focus on optimizing storage and resource usage without compromising service quality. By Mohit Palriwal

Database 90

Database Efficiency Storage Design 90

The Netflix TechBlog

MARCH 7, 2023

These media focused machine learning algorithms as well as other teams generate a lot of data from the media files, which we described in our previous blog , are stored as annotations in Marken. There are many naive solutions possible for this problem for example: Write different runs in different databases. in a video file.

Media 269

Media Latency Architecture Database 269

DZone

OCTOBER 30, 2024

Log-Structured Merge Trees (LSM trees) are a powerful data structure widely used in modern databases to efficiently handle write-heavy workloads. They offer significant performance benefits through batching writes and optimizing reads with sorted data structures.

Strategy 244

Strategy Storage Efficiency Database 244

Dynatrace

JUNE 9, 2023

ln a world driven by macroeconomic uncertainty, businesses increasingly turn to data-driven decision-making to stay agile. They’re unleashing the power of cloud-based analytics on large data sets to unlock the insights they and the business need to make smarter decisions. All of these factors challenge DevOps maturity.

DevOps 196

DevOps Analytics Storage Metrics 196

Scalegrid

JULY 17, 2020

It is an open standard format which organizes data into key/value pairs and arrays detailed in RFC 7159. JSON is the most common format used by web services to exchange data, store documents, unstructured data, etc. You can also check out our Working with JSON Data in PostgreSQL vs. JSONB Patterns & Antipatterns.

Storage 321

Storage Database Efficiency Processing 321

Dynatrace

APRIL 20, 2023

Modern organizations ingest petabytes of data daily, but legacy approaches to log analysis and management cannot accommodate this volume of data. based financial services group, discussed how the bank uses log monitoring on the Dynatrace platform with an emphasis on observability and security data.

Analytics 201

Analytics Infrastructure Storage Architecture 201

Scalegrid

APRIL 28, 2020

If you’re hosting your databases in the cloud, choosing the right cloud service provider is a significant decision to make for your long-term hosting costs. Over the last few weeks, we have been inundated with requests from SMB customers looking to improve the ROI on their database hosting. MongoDB® Database. EC2 instances.

Azure 344

Azure AWS Database Latency 344

Percona

AUGUST 9, 2023

MySQL 8 brought a significant architectural transformation by replacing the traditional MyISAM-based system tables with the Transaction Data Dictionary (TDD), a more efficient and reliable approach. The primary goal of the Transaction Data Dictionary (TDD) is to enhance the overall performance, stability, and scalability of MySQL databases.

Database 82

Database Storage Scalability Games 82

Dynatrace

AUGUST 20, 2024

Driven by that value, Dynatrace brings real-time observability, security, and business data into context and makes sense of it so our customers can get answers, automate, predict, and prevent. Executives are sitting on a goldmine of data, and they don’t know it.

Analytics 220

Analytics Latency Processing Systems 220

Scalegrid

JUNE 4, 2020

ScaleGrid is a fully managed DBaaS that supports MySQL, PostgreSQL and Redis™, along with additional support for MongoDB® database and Greenplum® database. Along with many popular cloud providers, DigitalOcean also provides a Managed Databases service. So, which database service is right for your application? Single Node.

Database 230

Database Latency Benchmarking Performance 230

DZone

JULY 3, 2023

Data engineering projects often require the setup and management of complex infrastructures that support data processing, storage, and analysis. In this article, we will explore the benefits of leveraging IaC for data engineering projects and provide detailed implementation steps to get started.

Data Engineering 150

Data Engineering Infrastructure Code Engineering 150

Percona

JANUARY 30, 2023

As Ibrar Ahmed noted in his blog post on Transparent Database Encryption (TDE). PostgreSQL is a surprising outlier when it comes to offering Transparent Database Encryption. Does PostgreSQL Need TDE (Transparent Data Encryption)? If database files are copied or otherwise exposed in their raw form, exposure does not happen.

Database 129

Database Storage Government Open Source 129

The Netflix TechBlog

OCTOBER 27, 2020

By Tianlong Chen and Ioannis Papapanagiotou Netflix has more than 195 million subscribers that generate petabytes of data everyday. Data scientists and engineers collect this data from our subscribers and videos, and implement data analytics models to discover customer behaviour with the goal of maximizing user joy.

Latency 249

Latency Storage Big Data Tuning 249

Percona

FEBRUARY 10, 2023

Previously, deploying and maintaining a database usually meant many burdensome chores and repetitive tasks to ensure proper functioning. ViewBlock , a blockchain explorer, uses the Percona Operator for MongoDB to store critical data. In our lab we will use AWS EKS with a standard storage class.

Storage 115

Storage Blockchain AWS Cloud 115

Dynatrace

JANUARY 31, 2024

I have ingested important custom data into Dynatrace, critical to running my applications and making accurate business decisions… but can I trust the accuracy and reliability?” ” Welcome to the world of data observability. At its core, data observability is about ensuring the availability, reliability, and quality of data.

DevOps 203

DevOps Analytics Airlines Metrics 203

Dynatrace

OCTOBER 4, 2022

Software and data are a company’s competitive advantage. But for software to work perfectly, organizations need to use data to optimize every phase of the software lifecycle. The only way to address these challenges is through observability data — logs, metrics, and traces. Teams interact with myriad data types.

Analytics 204

Analytics Software Software Storage 204

Scalegrid

JANUARY 19, 2024

When a MongoDB rollback happens, it can cause trouble to your data integrity and system consistency. Understanding how to address a rollback is critical for minimizing potential data loss and maintaining seamless operations. The consequences of rollbacks are significant and should not be underestimated.

Database 130

Database Network Servers Monitoring 130

Dynatrace

FEBRUARY 16, 2023

How do you get more value from petabytes of exponentially exploding, increasingly heterogeneous data? The short answer: The three pillars of observability—logs, metrics, and traces—converging on a data lakehouse. To solve this problem, Dynatrace launched Grail, its causational data lakehouse , in 2022.

Analytics 199

Analytics Innovation Metrics Database 199

Percona

MARCH 21, 2024

PostgreSQL has a feature called data checksum which is used to detect any storage-level corruption of data pages. However, a new PostgreSQL database cluster does not have this feature enabled by default. what about […]

Storage 89

Storage Database 89

InfoQ

MAY 15, 2023

A horizontally scalable exabyte-scale blob storage system which operates out of multiple regions, Magic Pocket is used to store all of Dropbox’s data. Adopting SMR technology and erasure codes, the system has extremely high durability guarantees but is cheaper than operating in the cloud. By Facundo Agriel

Storage 114

Storage Systems Scalability Cloud 114

Scalegrid

NOVEMBER 12, 2019

PostgreSQL is an amazing relational database. However, beyond just the features, there are other important aspects of a database that need to be considered. However, beyond just the features, there are other important aspects of a database that need to be considered. Feature-wise, it is up there with the best, if not the best.

Database 184

Database Open Source Servers Storage 184

Dynatrace

JULY 11, 2024

Data deletion might seem simple, but it’s critical in data management and privacy laws. It’s not just about hitting the Delete button; it’s about securely meeting compliance requirements while ensuring data integrity. A data lakehouse is schema-on-read and indexless, making deletion operations complex.

Storage 218

Storage Government Best Practices Media 218

The Netflix TechBlog

APRIL 27, 2023

Ruchir Jha , Brian Harrington , Yingwu Zhao TL;DR Streaming alert evaluation scales much better than the traditional approach of polling time-series databases. It allows us to overcome high dimensionality/cardinality limitations of the time-series database. It opens doors to support more exciting use-cases.

Storage 294

Storage Cache Metrics Database 294

Percona

FEBRUARY 1, 2023

PostgreSQL is a fantastic database, but if you’re storing images, video, audio files, or other large data objects, you need to “toast” them to get optimal performance. This post will look at using The Oversized-Attribute Storage Technique (TOAST) to improve performance and scalability.

Storage 95

Storage Scalability Strategy Performance 95

DZone

JANUARY 29, 2020

One day I faced the problem with downloading a relatively large binary data file from PostgreSQL. There are several limitations to store and fetch such data (all restrictions could be found in official documentation ). To resolve the problem it was suggested to find more suitable data storage.

Storage 114

Storage Efficiency Testing Database 114