DZone

AUGUST 4, 2022

For the longest time, hosting static files on CDNs was the de facto standard for performance tuning website pages. The host offered browser caching advantages, better stability, and storage on fast edge servers across strategic geolocations. Not only did it have performance benefits, but it was also convenient for developers.

Cache 305

Cache Tuning Storage Website 305

DZone

DECEMBER 14, 2021

Metadata synchronization (sync) is a core feature in Alluxio that keeps files and directories consistent with their source of truth in under-storage systems, thus making it simple for users to reason the data retrieved from Alluxio. Meanwhile, understanding the internal process is important in order to tune the performance.

Design 244

Design Storage Tuning Systems 244

The Netflix TechBlog

MAY 4, 2023

Migrating Critical Traffic At Scale with No Downtime — Part 1 Shyam Gala , Javier Fernandez-Ivern , Anup Rokkam Pratap , Devang Shah Hundreds of millions of customers tune into Netflix every day, expecting an uninterrupted and immersive streaming experience. This technique facilitates validation on multiple fronts.

Traffic 347

Traffic Latency Tuning Systems 347

The Netflix TechBlog

SEPTEMBER 18, 2024

Our goal was to build a versatile and efficient data storage solution that could handle a wide variety of use cases, ranging from the simplest hashmaps to more complex data structures, all while ensuring high availability, tunable consistency, and low latency. Developers just provide their data problem rather than a database solution!

Latency 260

Latency Storage Cache Efficiency 260

Percona

DECEMBER 11, 2023

There are a wealth of options on how you can approach storage configuration in Percona Operator for PostgreSQL , and in this blog post, we review various storage strategies — from basics to more sophisticated use cases. For example, you can choose the public cloud storage type – gp3, io2, etc, or set file system.

Storage 122

Storage Strategy Cloud Network 122

Dynatrace

AUGUST 1, 2022

You quickly realize that it will take ages to fill up the overprovisioned database storage. Two days later, your database runs out of storage in the middle of the night. Unfortunately, you did not have any monitoring or alerting in place, and you stopped checking the system daily because you have lost faith in your idea.

Storage 246

Storage Database Network Metrics 246

The Netflix TechBlog

OCTOBER 8, 2024

Note: Contrary to what the name may suggest, this system is not built as a general-purpose time series database. Those use cases are well served by the Netflix Atlas telemetry system. Effectively managing this data at scale to extract valuable insights is crucial for ensuring optimal user experiences and system reliability.

Latency 239

Latency Storage Traffic Tuning 239

Scalegrid

JULY 13, 2020

Oracle Database is a commercial, proprietary multi-model database management system produced by Oracle Corporation, and the largest relational database management system (RDBMS) in the world. Compare ease of use across compatibility, extensions, tuning, operating systems, languages and support providers. PostgreSQL.

Open Source 244

Open Source Tuning C++ Database 244

Dynatrace

SEPTEMBER 23, 2020

Operating Systems are not always set up in the same way. Storage mount points in a system might be larger or smaller, local or remote, with high or low latency, and various speeds. Starting with OneAgent version 1.199, the runtime folder is configurable and consequently you can retain your storage mount point setup as-is.

Storage 227

Storage Latency Operating System Network 227

The Netflix TechBlog

MARCH 14, 2023

We implemented a batch processing system for users to submit their requests and wait for the system to generate the output. This limited pilot system greatly reduced the time spent by our users to manually analyze the content. Maintaining disparate systems posed a challenge. Processing took several hours to complete.

Media 299

Media Innovation Energy Architecture 299

The Netflix TechBlog

SEPTEMBER 24, 2021

Lastly, the packager kicks in, adding a system layer to the asset, making it ready to be consumed by the clients. From chunk encoding to assembly and packaging, the result of each previous processing step must be uploaded to cloud storage and then downloaded by the next processing step.

Cloud 242

Cloud Media Storage Cache 242

Scalegrid

FEBRUARY 24, 2025

Scaling RabbitMQ ensures your system can handle growing traffic and maintain high performance. Key Takeaways RabbitMQ improves scalability and fault tolerance in distributed systems by decoupling applications, enabling reliable message exchanges.

Best Practices 147

Best Practices Traffic Strategy Efficiency 147

The Netflix TechBlog

OCTOBER 19, 2020

which is difficult when troubleshooting distributed systems. Troubleshooting a session in Edgar When we started building Edgar four years ago, there were very few open-source distributed tracing systems that satisfied our needs. Investigating a video streaming failure consists of inspecting all aspects of a member account.

Infrastructure 238

Infrastructure Transportation Storage Open Source 238

Dynatrace

SEPTEMBER 28, 2020

Before we dive into the technical implementation, let me explain the visual concept of this “Global Status Page”: Another requirement for this status page was that it has to be lightweight, with no data storage at all. This is where the consolidated API, which I presented in my last post , comes into play.

Storage 276

Storage Architecture Tuning Efficiency 276

The Netflix TechBlog

OCTOBER 27, 2020

For how our machine learning recommendation systems leverage our key-value stores, please see more details on this presentation. Then the KV DAL handles writing to the appropriate underlying storage engines depending on latency, availability, cost, and durability requirements.

Latency 252

Latency Storage Big Data Tuning 252

Dynatrace

FEBRUARY 9, 2022

Cloud vendors such as Amazon Web Services (AWS), Microsoft, and Google provide a wide spectrum of serverless services for compute and event-driven workloads, databases, storage, messaging, and other purposes. In addition, Davis provides automatic alerting of service-to-service communication problems using queues and other event systems.

Serverless 246

Serverless Azure Lambda AWS 246

Dynatrace

DECEMBER 18, 2023

For busy site reliability engineers, ensuring system reliability, scalability, and overall health is an imperative that’s getting harder to achieve in ever-expanding, cloud-native, container-based environments. But often, we use additional services and solutions within our environment for backups, storage, networking, and more.

Metrics 245

Metrics Engineering Energy Tuning 245

Percona

JANUARY 4, 2024

Managing storage and performance efficiently in your MySQL database is crucial, and general tablespaces offer flexibility in achieving this. In contrast to the single system tablespace that holds system tables by default, general tablespaces are user-defined storage containers for multiple InnoDB tables.

Storage 114

Storage Engineering Database Open Source 114

Dynatrace

FEBRUARY 14, 2022

Among these, you can find essential elements of application and infrastructure stacks, from app gateways (like HAProxy), through app fabric (like RabbitMQ), to databases (like MongoDB) and storage systems (like NetApp, Consul, Memcached, and InfluxDB, just to name a few). It’s easy—no intermediaries and no redundant moving parts.

Technology 246

Technology Technology Metrics Infrastructure 246

Dynatrace

JULY 6, 2022

Virtualization has revolutionized system administration by making it possible for software to manage systems, storage, and networks. This can reduce labor costs and enhance reliability by enabling systems to self-heal. Design, implement, and tune effective SLOs.

Best Practices 246

Best Practices Open Source Tuning Infrastructure 246

Dynatrace

JUNE 8, 2021

In software we use the concept of Service Level Objectives (SLOs) to enable us to keep track of our system versus our goals, often shown in a dashboard – like below –, to help us to reach an objective or provide an excellent service for users. Usual exceptions raised by our system that is now considered to be normal by Davis.

Metrics 242

Metrics Tuning Programming Systems 242

The Netflix TechBlog

JUNE 13, 2023

This is where large-scale system migrations come into play. By tracking metrics only at the level of service being updated, we might miss capturing deviations in broader end-to-end system functionality. Canaries and sticky canaries are valuable tools in the system migration process.

Traffic 285

Traffic Metrics Systems Strategy 285

Percona

APRIL 24, 2023

Indexes are generally considered to be the panacea when it comes to SQL performance tuning, and PostgreSQL supports different types of indexes catering to different use cases. I keep seeing many articles and talks on “tuning” discussing how creating new indexes speeds up SQL but rarely ones discussing removing them.

Tuning 139

Tuning Cache Storage Database 139

Dynatrace

AUGUST 28, 2020

Azure Data Lake Storage Gen1. Azure Automation accounts allow you to simplify cloud operations by automating the creation and deployment as well as the maintenance of resources in the Azure Cloud and across external systems. We’ll release additional monitoring support for new services soon, so stay tuned for further updates.

Azure 235

Azure Cloud Tuning Monitoring 235

Dynatrace

DECEMBER 22, 2019

AWS offers a broad set of global, cloud-based services including computing, storage, networking, Internet of Things (IoT), and many others. Amazon Elastic File System (EFS). Amazon Simple Storage Service (S3). Choose any service, for example, the Elastic File System (EFS) service, to view the list of configured metrics.

AWS 200

AWS Metrics IoT Storage 200

Dynatrace

NOVEMBER 15, 2021

A log is a detailed, timestamped record of an event generated by an operating system, computing environment, application, server, or network device. Logs can include data about user inputs, system processes, and hardware states. Optimized system performance. What is log monitoring? Log monitoring vs log analytics.

Analytics 264

Analytics Monitoring DevOps Artificial Intelligence 264

Dynatrace

DECEMBER 5, 2023

This growth was spurred by mobile ecosystems with Android and iOS operating systems, where ARM has a unique advantage in energy efficiency while offering high performance. See the OneAgent support matrix for your operating system and deploy OneAgent in your ARM environment today.

Architecture 290

Architecture Efficiency Energy Monitoring 290

Dynatrace

MARCH 15, 2024

Syslog is the go-to protocol that delivers infrastructure administrators, network engineers, and security team logs that tell them all they need to know about their systems’ delivery, performance, availability, and security. Syslog is a protocol with clear specifications that require a dedicated syslog server.

Open Source 246

Open Source Infrastructure Network Government 246

The Netflix TechBlog

NOVEMBER 6, 2023

We have built an internal system that allows someone to perform in-video search across the entire Netflix video catalog, and we’d like to share our experience in building this system. Building in-video search To build such a visual search engine, we needed a machine learning system that can understand visual elements.

Media 234

Media Social Media Tuning Engineering 234

Percona

MARCH 23, 2023

Storage The type of storage and disk used for database servers can have a significant impact on performance and reliability. Operating system Linux is the most common operating system for high-performance MySQL servers. If you see concurrency issues, you can tune this variable. Setting oom_score_adj to -800.

Performance 144

Performance Hardware Tuning Storage 144

Dynatrace

DECEMBER 22, 2019

AWS offers a broad set of global, cloud-based services including computing, storage, networking, Internet of Things (IoT), and many others. Amazon Elastic File System (EFS). Amazon Simple Storage Service (S3). Choose any service, for example, the Elastic File System (EFS) service, to view the list of configured metrics.

AWS 182

AWS Metrics IoT Storage 182

The Netflix TechBlog

JUNE 20, 2024

However, as the system has increased in scale and complexity, Pensive has been facing challenges due to its limited support for operational automation, especially for handling memory configuration errors and unclassified errors. To handle errors efficiently, Netflix developed a rule-based classifier for error classification called “Pensive.”

Data Engineering 206

Data Engineering Engineering Entertainment Software Engineering 206

The Netflix TechBlog

SEPTEMBER 10, 2024

Sample system diagram for an Alexa voice command. The other main use case was RENO, the Rapid Event Notification System mentioned above. Rewriting always comes with a risk, and it’s never the first solution we reach for, particularly when working with a system that’s in place and working well.

Latency 234

Latency Cache Tuning Efficiency 234

Percona

AUGUST 10, 2018

In fact, you should not set it to OFF in a production system unless you are 100% sure about what you are doing and its implications. This may help tune your table level autovacuum settings appropriately. Tuning Autovacuum in PostgreSQL. How do we identify the tables that need their autovacuum settings tuned ? .

Tuning 69

Tuning Cache Database Storage 69

All Things Distributed

NOVEMBER 28, 2012

Werner Vogels weblog on building scalable and robust distributed systems. They contain large amounts of locally attached storage on multiple spindles and are connected by a minimally oversubscribed 10 Gigabit Ethernet network. Loading, monitoring, tuning, taking backups, and recovering from faults are complex and time-consuming tasks.

Cloud 152

Cloud Storage Architecture Scalability 152

Scalegrid

JULY 29, 2019

MySQL is a free open source relational database management system that is leveraged across a majority of WordPress sites, and allows you to query your data such as posts, pages, images, user profiles, and more. Managing a database is hard, as it needs continuous updating, tuning, and monitoring to ensure the performance of your website.

Database 166

Database Cloud Website Azure 166

Dynatrace

JULY 8, 2020

Kubernetes has taken over the container management world and beyond , to become what some say the operating system or the new Linux of the cloud. That’s another example where monitoring is of tremendous help as it provides the current resource consumption picture and help to continuously fine tune those settings. .

Infrastructure 278

Infrastructure Monitoring Cloud Metrics 278