DZone

MAY 23, 2019

How do you tune the Snowflake data warehouse when there are no indexes, and few options available to tune the database itself? Snowflake was designed for simplicity, with few performance tuning options. This article summarizes the top five best practices to maximize query performance.

Best Practices 100

Best Practices Tuning Performance Database 100

Dynatrace

JUNE 16, 2022

An ideal RASP technology does not need training or fine-tuning to learn what bad application behavior looks like. These limitations include the following: High tuning and monitoring overhead. Not scalable in cloud-native environments. This reduces false positives in your DevSecOps process. More time for vulnerability management.

Tuning 246

Tuning Cloud Open Source Network 246

The Netflix TechBlog

SEPTEMBER 18, 2024

Central to this infrastructure is our use of multiple online distributed databases such as Apache Cassandra , a NoSQL database known for its high availability and scalability. Over time as new key-value databases were introduced and service owners launched new use cases, we encountered numerous challenges with datastore misuse.

Latency 258

Latency Storage Cache Efficiency 258

Dynatrace

JULY 21, 2020

The Dynatrace Software Intelligence Platform supports you on your way to the enterprise cloud with deep insights into containerized, scalable microservices on cutting-edge technologies like Red Hat OpenShift or Kubernetes. The IMS service flow traverses the IMS SOAP Gateway and different IMS regions, finally hitting a DL/I database.

Java 257

Java Database Programming Government 257

Dynatrace

SEPTEMBER 29, 2021

This opens the door to auto-scalable applications, which effortlessly matches the demands of rapidly growing and varying user traffic. For a deeper look into how to gain end-to-end observability into Kubernetes environments, tune into the on-demand webinar Harness the Power of Kubernetes Observability. What is Docker? Kubernetes.

Open Source 334

Open Source Traffic DevOps Cloud 334

Dynatrace

APRIL 20, 2023

With the extent of observability data going beyond human capacity to manage, Grail is the first purpose-built causational data lakehouse that allows for immediate answers with cost-efficient, scalable storage. ” In many cases, indexed databases only provide access to a sample of statistical data summaries. Seamless integration.

Analytics 246

Analytics Infrastructure Storage Architecture 246

Percona

OCTOBER 18, 2023

Migrating a proprietary database to open source is a major decision that can significantly affect your organization. Today, we’ll be taking a deep dive into the intricacies of database migration, along with specific solutions to help make the process easier.

Open Source 111

Open Source Database Strategy Hardware 111

The Netflix TechBlog

FEBRUARY 9, 2021

Retrieve eligible SKUs from SKU Platform The SKU Platform consists of a rules engine, a database, and application logic. The database contains the plans, prices and offers. Stay tuned for more details on this, as well as more details on the internals of the new SKU Platform in one of our upcoming blog posts.

Engineering 144

Engineering Scalability Architecture Innovation 144

The Netflix TechBlog

FEBRUARY 18, 2022

To this end, we developed a Rapid Event Notification System (RENO) to support use cases that require server initiated communication with devices in a scalable and extensible manner. This separation allows us to tune system configuration and scaling policies independently for different event priorities and traffic patterns.

Systems 334

Systems Traffic Architecture Mobile 334

Percona

NOVEMBER 3, 2023

Sure, database migration is complex, particularly when you’re looking to migrate from a proprietary database to an open source one. Database migration is almost always time-consuming, tedious, and full of potential pitfalls. Database migration is complex Let’s start here. Have you tuned your environment?

Database 107

Database Open Source Benchmarking Strategy 107

The Netflix TechBlog

MARCH 25, 2019

Central engineering teams provide paved paths (secure, vetted and supported options) and guard rails to help reduce variance in choices available for tools and technologies to support the development of scalable technical architectures. Challenges We faced a diverse set of challenges spread across many layers in the system.

Infrastructure 223

Infrastructure Big Data Transportation Architecture 223

The Netflix TechBlog

OCTOBER 8, 2024

The Key-Value Abstraction offers a flexible, scalable solution for storing and accessing structured key-value data, while the Data Gateway Platform provides essential infrastructure for protecting, configuring, and deploying the data tier. We do not use it for metrics, histograms, timers, or any such near-real time analytics use case.

Latency 237

Latency Storage Traffic Tuning 237

Scalegrid

NOVEMBER 4, 2024

The results will help database administrators and decision-makers choose the right platform for their performance, scalability, and cost-efficiency needs. Introduction Purpose and Scope Cloud-hosted PostgreSQL solutions are increasingly popular among organizations seeking scalable, high-performance databases.

Benchmarking 130

Benchmarking AWS Tuning Metrics 130

Dynatrace

MAY 17, 2023

Think about items such as general system metrics (for example, CPU utilization, free memory, number of services), the connectivity status, details of our web server, or even more granular in-application tasks like database queries. Database monitoring Once more, under Applications & Microservices, we’ll also find Databases.

Metrics 243

Metrics Database Monitoring Network 243

Dynatrace

DECEMBER 8, 2020

It inherits the automation, AI, scalability, and enterprise-grade robustness of the Dynatrace platform. With new RASP capabilities of the Dynatrace OneAgent, the same trusted approach extends the Dynatrace platform to application security: automatic, intelligent, highly scalable. Stay tuned – this is only the start.

Cloud 306

Cloud Open Source Internet Internet 306

Percona

MARCH 23, 2023

Hardware Memory The amount of RAM to be provisioned for database servers can vary greatly depending on the size of the database and the specific requirements of the company. Storage The type of storage and disk used for database servers can have a significant impact on performance and reliability. Benchmark before you decide.

Performance 144

Performance Hardware Tuning Storage 144

The Netflix TechBlog

OCTOBER 27, 2020

As the paved path for moving data to key-value stores, Bulldozer provides a scalable and efficient no-code solution. One namespace in a Key-Value DAL contains as many key-value data as required, it is the equivalent to a table in a database. Figure 1 shows how we use Bulldozer to move data at Netflix.

Latency 249

Latency Storage Big Data Tuning 249

Percona

MAY 1, 2023

Out of the box, the default PostgreSQL configuration is not tuned for any particular workload. It has default settings for all of the database parameters. It is primarily the responsibility of the database administrator or developer to tune PostgreSQL according to their system’s workload.

Tuning 52

Tuning Database Efficiency Performance 52

Dynatrace

DECEMBER 18, 2023

For busy site reliability engineers, ensuring system reliability, scalability, and overall health is an imperative that’s getting harder to achieve in ever-expanding, cloud-native, container-based environments. Please stay tuned! To get a more granular look into telemetry data, many analysts rely on custom metrics using Prometheus.

Metrics 245

Metrics Engineering Energy Tuning 245

Scalegrid

SEPTEMBER 10, 2024

At ScaleGrid, we’re always pushing the boundaries to offer more flexibility and scalability to our customers. We’re committed to continuously expanding and improving the ScaleGrid platform, and we hope these updates help you get even more out of your database management experience. </p>

Latency 130

Latency AWS Storage Tuning 130

The Netflix TechBlog

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events. Designed with High Availability in mind.

Database 218

Database Traffic Transportation Open Source 218

The Netflix TechBlog

OCTOBER 18, 2022

As Big data and ML became more prevalent and impactful, the scalability, reliability, and usability of the orchestrating ecosystem have increasingly become more important for our data scientists and the company. Motivation Scalability and usability are essential to enable large-scale workflows and support a wide range of use cases.

Java 209

Java Scalability Traffic Architecture 209

Percona

SEPTEMBER 1, 2023

While there is no magic bullet for MySQL performance tuning, there are a few areas that can be focused on upfront that can dramatically improve the performance of your MySQL installation. What are the Benefits of MySQL Performance Tuning? A finely tuned database processes queries more efficiently, leading to swifter results.

Tuning 52

Tuning Database Performance Hardware 52

Percona

FEBRUARY 15, 2023

Bloom filters are an essential component of an LSM-based database engine like MyRocks. Tuning In terms of tuning, two parameters can be tuned, the size of the bitmap and the number of bits set by every value. A good understanding of how bloom filters work can only lead to improved database performance.

Storage 138

Storage Tuning Cache Engineering 138

The Netflix TechBlog

OCTOBER 19, 2020

An additional implication of a lenient sampling policy is the need for scalable stream processing and storage infrastructure fleets to handle increased data volume. Our engineering teams tuned their services for performance after factoring in increased resource utilization due to tracing. Storage: don’t break the bank!

Infrastructure 237

Infrastructure Transportation Storage Open Source 237

The Netflix TechBlog

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events. Designed with High Availability in mind.

Database 204

Database Traffic Transportation Open Source 204

Percona

NOVEMBER 2, 2023

MongoDB is a dynamic database system continually evolving to deliver optimized performance, robust security, and limitless scalability. Our new eBook, “ From Planning to Performance: MongoDB Upgrade Best Practices ,” guides you through the entire process to ensure your database’s long-term success.

Best Practices 111

Best Practices Hardware Tuning Scalability 111

Dynatrace

OCTOBER 2, 2023

Because monolithic applications combine database, client-side interfaces, and server-side application elements in a single executable, they’re difficult to understand, even for their own administrators. With real-time observability, teams can easily plan their migration and fine-tune performance as they migrate microservices.

Architecture 278

Architecture Artificial Intelligence Cloud Open Source 278

All Things Distributed

MARCH 7, 2013

Werner Vogels weblog on building scalable and robust distributed systems. Many of our customers have, with the click of a button, created DynamoDB deployments in a matter of minutes that are able to serve trillions of database requests per year. s fast and easy scalability can be quickly applied to building high scale applications.

Ecommerce 119

Ecommerce Storage Scalability Database 119

All Things Distributed

NOVEMBER 28, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Unlike traditional row-based relational databases, which store data for each row sequentially on disk, Amazon Redshift stores each column sequentially. This means that Redshift performs much less wasted IO than a row-based database because it doesnâ??t

Cloud 152

Cloud Storage Architecture Scalability 152

Percona

JUNE 20, 2023

mysql> use app_schema Database changed mysql> show tables; ERROR 1226 (42000): User 'john_smith' has exceeded the 'max_questions' resource (current value: 10) max_updates_per_hour If the user tries to run more than the defined updates per hour, the following error message will appear. You can read more about it in MySQL 8.0

Tuning 126

Tuning Database Open Source Scalability 126

Percona

JUNE 2, 2023

WordPress also benefited from and popularized MySQL, introducing the LAMP stack – and open source – to an audience that might never have touched a database before or had any intro to open source. MySQL was the database for phpWebLog, for example, way back in 2000. With a little tuning, though, MySQL could hold its own.

Open Source 114

Open Source Traffic Tuning Database 114

Percona

OCTOBER 10, 2023

Databases are different from a lot of software. This is not a general rule, but as databases are responsible for a core layer of any IT system – data storage and processing — they require reliability. Think of us as the extra set of eyes, the extra layer of QA to ensure your safety passage to the next database version.

Servers 120

Servers Availability Database Open Source 120

The Netflix TechBlog

JANUARY 10, 2024

Reloaded was well-architected, providing good stability, scalability, and a reasonable level of flexibility. In addition to the scalability and the stability that the developers already enjoyed in Reloaded, Cosmos aimed to significantly increase system flexibility and feature development velocity. 264, AV1, etc.).

Processing 235

Processing Media Latency Innovation 235

The Netflix TechBlog

DECEMBER 21, 2020

Other than these principles, there are some other design considerations to support and enable: Multi-tenancy with database and table prioritization. Orient: Gather tuning parameters for a particular table that changed. AutoAnalyze In short, AutoAnalyze finds the best tuning/configuration parameters for a table.

Storage 209

Storage Latency Efficiency Data Engineering 209

All Things Distributed

OCTOBER 2, 2017

Today marks the 10 year anniversary of Amazon's Dynamo whitepaper , a milestone that made me reflect on how much innovation has occurred in the area of databases over the last decade and a good reminder on why taking a customer obsessed approach to solving hard problems can have lasting impact beyond your original expectations.

Internet 110

Internet Internet AWS Performance 110

Dynatrace

NOVEMBER 10, 2022

To take full advantage of the scalability, flexibility, and resilience of cloud platforms, organizations need to build or rearchitect applications around a cloud-native architecture. Taken together, these features enable organizations to build software that is more scalable, reliable, and flexible than traditionally built software.

Cloud 162

Cloud Architecture Serverless Infrastructure 162