The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 38

AWS Entertainment Open Source Benchmarking 38

The Netflix TechBlog

DECEMBER 3, 2019

by David Berg , Ravi Kiran Chirravuri , Romain Cledat , Savin Goyal , Ferras Hamad , Ville Tuulos tl;dr Metaflow is now open-source! both for compute and storage. For the open-source release, we partnered with AWS to provide a seamless integration between Metaflow and various AWS services.

Open Source 135

Open Source AWS Infrastructure Energy 135

Dynatrace

JANUARY 16, 2023

Open-source software drives a vibrant Kubernetes ecosystem. Most Kubernetes clusters in the cloud (73%) are built on top of managed distributions from the hyperscalers like AWS Elastic Kubernetes Service (EKS), Azure Kubernetes Service (AKS), or Google Kubernetes Engine (GKE). Java, Go, and Node.js

Open Source 358

Open Source Java Operating System Programming 358

Dynatrace

SEPTEMBER 29, 2021

Prometheus is an open-source monitoring and alerting toolkit for services and applications that run in containers. Prometheus components include client libraries for application code instrumentation, special-purpose exporters for popular services, and the optional Prometheus server for orchestrating service discovery and data storage.

Technology 246

Technology Technology Monitoring AWS 246

Dynatrace

SEPTEMBER 17, 2019

Kubernetes (k8s) provides basic monitoring through the Kubernetes API and you can find instructions like Top 9 Open Source Tools for Monitoring Kubernetes as a “do it yourself guide”. PostgreSQL & Elastic for data storage. AWS EKS for Integration and Production. Dynatrace news. Full-stack observability.

AWS 170

AWS Monitoring Ecommerce Lambda 170

The Netflix TechBlog

MARCH 8, 2021

Below is a broad technical overview of how to go from an AWS instance to a Netflix Workstation. Machine Configuration: Spinnaker Starting at the left of the chart, Spinnaker is an open-source platform that controls the creation of workstation pools. Now that you know why, here is how we did it.

Entertainment 307

Entertainment Storage Open Source Hardware 307

Dynatrace

DECEMBER 15, 2022

Fluentd is an open source data collector that decouples data sources from observability tools and platforms by providing a unified logging layer. Set up the configuration on the same port as specified for source data, in this example 5140. 3: Ingest AWS Fargate logs with Fluent Bit. What is Fluentd?

Strategy 245

Strategy AWS Open Source Transportation 245

Scalegrid

JUNE 9, 2020

MySQL and PostgreSQL are the top two open source relational databases in the world, and Redis is the top key-value database. The open source model is not only popular with the developer market, but also enterprise companies looking to modernize their infrastructure and reduce spend.

Availability 227

Availability Open Source Benchmarking Database 227

Dynatrace

MAY 26, 2021

From May 17 to May 18, 2021, the Open-Source Engineering team at Dynatrace attended the virtual observability conference, o11yfest. The second focused on the OTel community, with more technical talks by representatives from companies like AWS, Elastic, and more. Trace-based sampling can help you save storage costs.

AWS 246

AWS Strategy Storage Metrics 246

The Netflix TechBlog

OCTOBER 19, 2020

Troubleshooting a session in Edgar When we started building Edgar four years ago, there were very few open-source distributed tracing systems that satisfied our needs. Our tactical approach was to use Netflix-specific libraries for collecting traces from Java-based streaming services until open source tracer libraries matured.

Infrastructure 238

Infrastructure Transportation Storage Open Source 238

Percona Community

FEBRUARY 16, 2025

Introduction Percona Operator for MongoDB is an open-source solution designed to streamline and automate database operations within Kubernetes. When running database workloads on Amazon EKS (Elastic Kubernetes Service), backup and restore processes often require access to AWS services like S3 for storage.

AWS 59

AWS Open Source Storage Database 59

High Scalability

SEPTEMBER 8, 2018

No, I don’t think that is because AWS is earning a 355x margin on DynamoDB! They've posted about Anna's new superpowers in Going Fast and Cheap: How We Made Anna Autoscale : Using Anna v0 as an in-memory storage engine, we set out to address the cloud storage problems described above.

Storage 199

Storage Performance AWS Cloud 199

Scalegrid

OCTOBER 7, 2019

As this open source database continues to pull new users from expensive commercial database management systems like Oracle, DB2 and SQL Server, organizations are adopting new approaches and evolving their own to maintain the exceptional performance of their SQL deployments. PostgreSQL popularity is skyrocketing in the enterprise space.

Strategy 182

Strategy Cloud Java Open Source 182

Dynatrace

JANUARY 31, 2024

Introducing Dynatrace OpenPipeline OpenPipeline is a stream-processing technology that transforms how the Dynatrace platform ingests data from any source, at any scale, and in any format. With OpenPipeline, you can easily collect data from Dynatrace OneAgent®, open source collectors such as OpenTelemetry, or other third-party tools.

Analytics 272

Analytics Processing Transportation Storage 272

Percona

DECEMBER 11, 2023

A quick configuration change may do the trick in improving the performance of your AWS RDS for MySQL instance. A Dedicated Log Volume (DLV) is a specialized storage volume designed to house database transaction logs separately from the volume containing the database tables. Who can benefit from DLV? and later v13 versions, 14.7

AWS 117

AWS Benchmarking Performance Traffic 117

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 100

AWS Entertainment Open Source Benchmarking 100

Dynatrace

OCTOBER 11, 2021

In a time when modern microservices are easier to deploy, GCF, like its counterparts AWS Lambda and Microsoft Azure Functions , gives development teams an agility boost for delivering value to their customers quickly with low overhead costs. Avoid lock-in with open-source technologies. What is Google Cloud Functions?

Google 246

Google Cloud Serverless Azure 246

Dynatrace

AUGUST 21, 2023

OpenTelemetry is an open source framework that provides agents, APIs, and SDKs that automatically instrument, generate, and gather telemetry data. It also provides tools and integrations with popular open source projects, including Kubernetes, Apache Kafka, Jaeger, and Prometheus, among others. What is OpenTelemetry?

Open Source 246

Open Source Analytics Lambda Metrics 246

Scalegrid

JULY 8, 2019

Are you looking to get started with the world’s most popular open-source database, and wondering how you should setup your MySQL hosting ? This is why we caution against defaulting to Azure Database, or it’s AWS competitor, Amazon RDS, as they do not allow you to keep MySQL superuser access or even SSH access to your machines.

Azure 219

Azure Cloud Virtualization Database 219

Scalegrid

DECEMBER 16, 2019

MongoDB is the #3 open source database and the #1 NoSQL database in the world. So, what makes DigitalOcean a compelling alternative to other popular MongoDB hosting providers like AWS and Azure ? DigitalOcean, along with AWS and Azure, offer a 99.99% uptime SLA, but while that sounds close to perfect, that 0.01% equates to 52.6

Azure 187

Azure AWS Database Latency 187

Dynatrace

NOVEMBER 23, 2020

Nevertheless, there are related components and processes, for example, virtualization infrastructure and storage systems (see image below), that can lead to problems in your Kubernetes infrastructure. Configuring storage in Kubernetes is more complex than using a file system on your host. Possible solutions.

Virtualization 237

Virtualization Infrastructure Monitoring Cloud 237

All Things Distributed

AUGUST 20, 2015

Today, we are releasing a plugin that allows customers to use the Titan graph engine with Amazon DynamoDB as the backend storage layer. It opens up the possibility to enjoy the value that graph databases bring to relationship-centric use cases, without worrying about managing the underlying storage. Graph databases at Amazon.

Database 121

Database Logistics Availability Social Media 121

Percona

JANUARY 30, 2023

Instead, it seems PostgreSQL Developers are of the opinion that encryption is a storage-level problem and is better solved on the filesystem or block device level. For example, physical backups stored in open S3 buckets are relatively common exposure vectors. It adds defense in depth.

Database 145

Database Storage Government Open Source 145

Percona

MARCH 7, 2023

One approach is to separate compute and storage to allow for independent scaling. It’s an open source alternative to AWS Aurora Postgres that utilizes a serverless architecture. It’s an open source alternative to AWS Aurora Postgres that utilizes a serverless architecture.

Serverless 128

Serverless Storage Open Source Architecture 128

Dynatrace

MAY 26, 2021

From May 17 to May 18, 2021, the Open-Source Engineering team at Dynatrace attended the virtual observability conference, o11yfest. The second focused on the OTel community, with more technical talks by representatives from companies like AWS, Elastic, and more. Trace-based sampling can help you save storage costs.

AWS 147

AWS Strategy Storage Metrics 147

Scalegrid

JULY 29, 2019

MySQL is a free open source relational database management system that is leveraged across a majority of WordPress sites, and allows you to query your data such as posts, pages, images, user profiles, and more. Host MySQL on AWS , or MySQL on Azure with configurable instance sizes through the top two cloud providers in the world.

Database 166

Database Cloud Website Azure 166

Percona

JANUARY 30, 2023

Percona is a leading provider of unbiased open source database solutions that allow organizations to easily, securely, and affordably maintain business agility, minimize risks, and stay competitive. As such, you save on storage space and data transfer in case of cloud setups. It’s time for the release roundup!

Open Source 111

Open Source Storage AWS Cloud 111

The Netflix TechBlog

MARCH 10, 2023

are stored in secure storage layers. Amsterdam is built on top of three storage layers. The first layer, Cassandra , is the source of truth for us. By Burak Bacioglu , Meenakshi Jindal Asset Management at Netflix At Netflix, all of our digital media assets (images, videos, text, etc.)

Strategy 264

Strategy Cache Storage Analytics 264

The Netflix TechBlog

JULY 30, 2019

and beyond By Anoop Panicker and Kishore Banala Conductor is a workflow orchestration engine developed and open-sourced by Netflix. Our cluster size ranges from 12–18 instances of AWS EC2 m4.4xlarge instances, typically running at ~30% capacity. *?—?Cassandra Cassandra persistence module is a partial implementation.

Lambda 191

Lambda Open Source Media Metrics 191

Percona

JANUARY 20, 2023

When using cloud storage like EBS or similar, it is normally easy(er) to extend volumes, which gives us the luxury to plan the space to allocate for data with a good grade of relaxation. The story The case was on AWS using EKS. aws-ebs"} ,storageclass.kubernetes.io/is-default-class=false aws-ebs"} ,storageclass.kubernetes.io/is-default-class=false

AWS 120

AWS Storage Monitoring Cloud 120

Percona

FEBRUARY 24, 2023

Figure 1: PMM Home Dashboard From the Amazon Web Services (AWS) documentation , an instance is considered over-provisioned when at least one specification of your instance, such as CPU, memory, or network, can be sized down while still meeting the performance requirements of your workload and no specification is under-provisioned.

Cloud 133

Cloud Serverless AWS Storage 133

High Scalability

APRIL 3, 2019

PostgreSQL is an open source object-relational database system that has soared in popularity over the past 30 years from its active, loyal, and growing community. For the 2nd year in a row, PostgreSQL has kept the title of #1 fastest growing database in the world according to the DBMS of the Year report by the experts at DB-Engines.

Database 177

Database Cloud Open Source Systems 177

Percona

FEBRUARY 23, 2023

Fortunately, there are ways to skip the local storage entirely and stream MongoDB backups directly to the destination. At the same time, the common goal is to save both the network bandwidth and storage space (cost savings!) The two most popular ones — s3cmd and AWS — are sufficient, and I will show examples using both. %H-%M)

AWS 142

AWS Storage Database Open Source 142

Scalegrid

NOVEMBER 4, 2024

Performance Benchmarking of PostgreSQL on ScaleGrid vs. AWS RDS Using Sysbench This article evaluates PostgreSQL’s performance on ScaleGrid and AWS RDS, focusing on versions 13, 14, and 15. Test Environment Setup Instance Types : We used similar cloud instances for AWS RDS and ScaleGrid to ensure a fair comparison.

Benchmarking 130

Benchmarking AWS Tuning Metrics 130

The Polyglot Developer

APRIL 6, 2017

When building a mobile application, there are often scenarios where you need to storage files remotely and when I say files, I don’t mean database data. For example, maybe you want to develop an image manager or photo storage solution like what Facebook and Instagram offer?

Storage 59

Storage Cloud Open Source Mobile 59

Percona

JANUARY 24, 2023

Our Operators provide built-in backup and restore capabilities, but some users are still looking for old-fashioned ways, like storage-level snapshots (i.e., AWS EBS Snapshots). Both your storage and Container Storage Interface (CSI) must support snapshots. For example, the AWS EBS snapshot is priced at $0.05/GB,

Database 97

Database Storage Open Source Cloud 97