Smashing Magazine

JANUARY 7, 2025

How To Design For High-Traffic Events And Prevent Your Website From Crashing How To Design For High-Traffic Events And Prevent Your Website From Crashing Saad Khan 2025-01-07T14:00:00+00:00 2025-01-07T22:04:48+00:00 This article is sponsored by Cloudways Product launches and sales typically attract large volumes of traffic.

Traffic 86

Traffic Website Design Cache 86

Dynatrace

OCTOBER 7, 2021

This means you no longer have to provision, scale, and maintain servers to run your applications, databases, and storage systems. Instead of worrying about infrastructure management functions, such as capacity provisioning and hardware maintenance, teams can focus on application design, deployment, and delivery. Reliability.

Serverless 325

Serverless AWS Lambda Storage 325

All Things Distributed

MARCH 13, 2019

Relational databases have been around for a long time. The core technologies underpinning the major relational database management systems of today were developed in the 1980–1990s. Those fundamentals helped make relational databases immensely popular with users everywhere.

Database 134

Database Design Cloud AWS 134

Highly Scalable

SEPTEMBER 18, 2012

These developments gradually highlight a system of relevant database building blocks with proven practical efficiency. In this article I’m trying to provide more or less systematic description of techniques related to distributed operations in NoSQL databases. Data Placement. System Coordination. Read/Write latency.

Database 213

Database Latency C++ Scalability 213

The Netflix TechBlog

SEPTEMBER 18, 2024

Central to this infrastructure is our use of multiple online distributed databases such as Apache Cassandra , a NoSQL database known for its high availability and scalability. Over time as new key-value databases were introduced and service owners launched new use cases, we encountered numerous challenges with datastore misuse.

Latency 256

Latency Storage Cache Servers 256

All Things Distributed

MARCH 13, 2019

Relational databases have been around for a long time. The core technologies underpinning the major relational database management systems of today were developed in the 1980–1990s. Those fundamentals helped make relational databases immensely popular with users everywhere.

Database 132

Database Design Cloud AWS 132

All Things Distributed

JANUARY 18, 2012

a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Today is a very exciting day as we release Amazon DynamoDB , a fast, highly reliable and cost-effective NoSQL database service designed for internet scale applications. Amazon DynamoDB â?? By Werner Vogels on 18 January 2012 07:00 AM.

Scalability 162

Scalability Database Ecommerce Latency 162

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. Understanding distributed storage is imperative as data volumes and the need for robust storage solutions rise.

Storage 130

Storage Systems Big Data Azure 130

Percona

JANUARY 30, 2023

As Ibrar Ahmed noted in his blog post on Transparent Database Encryption (TDE). PostgreSQL is a surprising outlier when it comes to offering Transparent Database Encryption. If database files are copied or otherwise exposed in their raw form, exposure does not happen. Does PostgreSQL Need TDE (Transparent Data Encryption)?

Database 145

Database Storage Government Open Source 145

Dynatrace

AUGUST 1, 2022

Kubernetes was initially designed with a strong focus on stateless workloads, meaning these workloads do not need to store any persistent data. Interestingly, our partner RedHat reported in 2021 that around 80% of deployed workloads are databases or data caches, storing data in persistent volume claims (PVCs). Dynatrace news.

Storage 246

Storage Database Network Metrics 246

Scalegrid

JULY 17, 2020

Why should a relational database even care about unstructured data? JSON database in 9.2 It is useful to validate incoming JSON and store in the database. JSONB storage has some drawbacks vs. traditional columns: PostreSQL does not store column statistics for JSONB columns. JSONB Patterns & Antipatterns.

Storage 321

Storage Database Efficiency Availability 321

All Things Distributed

JUNE 21, 2018

A common question that I get is why do we offer so many database products? To do this, they need to be able to use multiple databases and data models within the same application. Seldom can one database fit the needs of multiple distinct use cases. Seldom can one database fit the needs of multiple distinct use cases.

Database 167

Database AWS Games Latency 167

Dynatrace

AUGUST 27, 2020

The latest batch of services cover databases, networks, machine learning and computing. Amazon Database Migration Service. Amazon Quantum Ledger Database (QLDB). AWS Storage Gateway. Ensure high application performance by easily troubleshooting Amazon Neptune graph database. Available Now. Coming Soon. AWS AppSync.

AWS 279

AWS Cloud IoT Database 279

DZone

JANUARY 20, 2023

Having a distributed and scalable graph database system is highly sought after in many enterprise scenarios. Do Not Be Misled Designing and implementing a scalable graph database system has never been a trivial task.

Scalability 210

Scalability Big Data Hardware Internet 210

All Things Distributed

MAY 19, 2017

In many, high-throughput, OLTP style applications the database plays a crucial role to achieve scale, reliability, high-performance and cost efficiency. For a long time, these requirements were almost exclusively served by commercial, proprietary databases.

Database 89

Database Design Cloud Storage 89

All Things Distributed

AUGUST 20, 2012

Managing Cold Storage with Amazon Glacier. With the introduction of Amazon Glacier , IT organizations now have a solution that removes the headaches of digital archiving and provides extremely low cost storage. Amazon Glacier integrates seamlessly with other AWS services such as Amazon S3 and the different AWS Database services.

Storage 114

Storage Cloud AWS Media 114

Highly Scalable

MARCH 1, 2012

NoSQL databases are often compared by various non-functional criteria, such as scalability, performance, and consistency. At the same time, NoSQL data modeling is not so well studied and lacks the systematic theory found in relational databases. Document databases advance the BigTable model offering two significant improvements.

Database 279

Database Ecommerce Engineering Efficiency 279

Percona

JUNE 22, 2023

To make data count and to ensure cloud computing is unabated, companies and organizations must have highly available databases. A basic high availability database system provides failover (preferably automatic) from a primary database node to redundant nodes within a cluster. HA is sometimes confused with “fault tolerance.”

Availability 132

Availability Database Open Source Hardware 132

The Netflix TechBlog

OCTOBER 8, 2024

Building on these foundational abstractions, we developed the TimeSeries Abstraction  — a versatile and scalable solution designed to efficiently store and query large volumes of temporal event data with low millisecond latencies, all in a cost-effective manner across various use cases.

Latency 235

Latency Storage Traffic Infrastructure 235

High Scalability

SEPTEMBER 8, 2018

New databases used to be announced seemingly every week. While database neogenesis has slowed down considerably, it has not gone necrotic. Each storage server collects statistics about the requests it serves, the data it stores, etc. Our monitoring engine automatically moves data between tiers based on access patterns.

Storage 199

Storage Performance AWS Cloud 199

Dynatrace

OCTOBER 4, 2022

Traditionally, though, to gain true business insight, organizations had to make tradeoffs between accessing quality, real-time data and factors such as data storage costs. It should be open by design to accelerate innovation, enable powerful integration with other tools, and purposefully unify data and analytics. User experience data.

Analytics 246

Analytics Software Software Storage 246

Dynatrace

NOVEMBER 23, 2020

Nevertheless, there are related components and processes, for example, virtualization infrastructure and storage systems (see image below), that can lead to problems in your Kubernetes infrastructure. Configuring storage in Kubernetes is more complex than using a file system on your host. What does observability mean for Kubernetes?

Virtualization 237

Virtualization Infrastructure Monitoring Cloud 237

Scalegrid

SEPTEMBER 16, 2019

PostgreSQL graphical user interface (GUI) tools help these open source database users to manage, manipulate, and visualize their data. PostgreSQL is the fourth most popular database management system in the world, and heavily used in all sizes of applications from small to large. Why Use a GUI Tool? pgAdmin Cost: Free (open source).

Open Source 262

Open Source Database Azure Cloud 262

Dynatrace

SEPTEMBER 5, 2024

Native support for Syslog messages Syslog messages are generated by default in Linux and Unix operating systems, security devices, network devices, and applications such as web servers and databases. The dashboard tracks a histogram chart of total storage utilized with logs daily. It also tracks the top five log producers by entity.

Innovation 290

Innovation AWS Analytics Infrastructure 290

The Netflix TechBlog

MARCH 10, 2020

At one point, more than 30 developers were working on it, and it had well over 300 database tables. The idea of Hexagonal Architecture is to put inputs and outputs at the edges of our design. a database, a microservice API exposed via gRPC or REST, or just a simple CSV file.

Architecture 345

Architecture Transportation Java Strategy 345

Percona

FEBRUARY 1, 2023

PostgreSQL is a fantastic database, but if you’re storing images, video, audio files, or other large data objects, you need to “toast” them to get optimal performance. This post will look at using The Oversized-Attribute Storage Technique (TOAST) to improve performance and scalability.

Storage 111

Storage Scalability Strategy Performance 111

Percona

MARCH 30, 2023

The use of open source databases has increased steadily in recent years. Past trepidation — about perceived vulnerabilities and performance issues — has faded as decision makers realize what an “open source database” really is and what it offers. What is an open source database?

Open Source 106

Open Source Database Storage Scalability 106

The Morning Paper

MARCH 3, 2020

Millions of tiny databases , Brooker et al., It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. NSDI’20. This paper is a real joy to read.

Database 106

Database AWS Network Design 106

InfoQ

MAY 15, 2023

A horizontally scalable exabyte-scale blob storage system which operates out of multiple regions, Magic Pocket is used to store all of Dropbox’s data. Adopting SMR technology and erasure codes, the system has extremely high durability guarantees but is cheaper than operating in the cloud. By Facundo Agriel

Storage 114

Storage Systems Scalability Cloud 114

Dynatrace

JUNE 9, 2023

When extended to include application security practices, DevOps becomes DevSecOps and includes security-focused criteria, such as security by design and making security a critical release criterion. The sheer number of permutations can break traditional databases.

DevOps 246

DevOps Analytics Storage Metrics 246

InfoQ

OCTOBER 14, 2023

Google recently announced various improvements to Cloud Spanner, its distributed, decoupled relational database service with a “50% increase in throughput and 2.5 times the storage per node than before” without a price change. By Steef-Jan Wiggers

Google 102

Google Storage Cloud Database 102

The Morning Paper

JANUARY 28, 2020

Narrowing the gap between serverless and its state with storage functions , Zhang et al., In databases you probably know it as stored procedures. Shredder is " a low-latency multi-tenant cloud store that allows small units of computation to be performed directly within storage nodes. " SoCC’19. "Narrowing

Serverless 99

Serverless Storage Latency Cloud 99

Scalegrid

FEBRUARY 11, 2025

Choosing the right database often comes down to MongoDB vs MySQL. Whether you need a relational database for complex transactions or a NoSQL database for flexible data storage, weve got you covered. Data modeling is a critical skill for developers to manage and analyze data within these database systems effectively.

Scalability 147

Scalability Database Storage IoT 147

Percona Community

FEBRUARY 16, 2025

Introduction Percona Operator for MongoDB is an open-source solution designed to streamline and automate database operations within Kubernetes. When running database workloads on Amazon EKS (Elastic Kubernetes Service), backup and restore processes often require access to AWS services like S3 for storage.

AWS 58

AWS Open Source Storage Database 58

The Netflix TechBlog

OCTOBER 19, 2020

Now let’s look at how we designed the tracing infrastructure that powers Edgar. Our distributed tracing infrastructure is grouped into three sections: tracer library instrumentation, stream processing, and storage. A second job taps the data feed from the first job, does tail sampling of data and writes traces to the storage system.

Infrastructure 236

Infrastructure Transportation Storage Open Source 236

The Netflix TechBlog

MARCH 7, 2023

We designed a unique concept called Annotation Operations which allows teams to create data pipelines and easily write annotations without worrying about access patterns of their data from different applications. There are many naive solutions possible for this problem for example: Write different runs in different databases.

Media 268

Media Latency Architecture Database 268

Percona

OCTOBER 18, 2023

Migrating a proprietary database to open source is a major decision that can significantly affect your organization. Today, we’ll be taking a deep dive into the intricacies of database migration, along with specific solutions to help make the process easier.

Open Source 111

Open Source Database Strategy Hardware 111