The Netflix TechBlog

JANUARY 6, 2025

This thoughtful approach doesnt just address immediate hurdles; it builds the resilience and scalability needed for the future. Personalization systems handle the recommendation and serving of titles on these canvases, leveraging a vast ecosystem of microservices, caches, databases, code, and configurations to build these product canvases.

Scalability 219

Scalability Cache Engineering Systems 219

DZone

JUNE 15, 2023

The scalability, agility, and continuous delivery offered by microservices architecture make it a popular option for businesses today. Nevertheless, microservices architectures are not invulnerable to disruptions.

Engineering 314

Engineering Architecture Scalability Google 314

Dynatrace

OCTOBER 7, 2021

To get a better understanding of AWS serverless, we’ll first explore the basics of serverless architectures, review AWS serverless offerings, and explore common use cases. Serverless architecture: A primer. Serverless architecture shifts application hosting functions away from local servers onto those managed by providers.

Serverless 325

Serverless AWS Lambda Storage 325

High Scalability

SEPTEMBER 28, 2018

MrTonyD : I was writing production code over 30 years ago (C, OS, database). Martin Sústrik : Philosophers, by and large, tend to be architecture astronauts. Programmers' insight is that architecture astronauts fail. billion increase in pure-play foundry market; Quotable Quotes: WhatsApp cofounder : I am a sellout.

Internet 35

Internet Internet Scalability Blockchain 35

The Netflix TechBlog

APRIL 27, 2023

Ruchir Jha , Brian Harrington , Yingwu Zhao TL;DR Streaming alert evaluation scales much better than the traditional approach of polling time-series databases. It allows us to overcome high dimensionality/cardinality limitations of the time-series database. It opens doors to support more exciting use-cases.

Storage 297

Storage Cache Metrics Database 297

Dynatrace

NOVEMBER 10, 2022

To take full advantage of the scalability, flexibility, and resilience of cloud platforms, organizations need to build or rearchitect applications around a cloud-native architecture. So, what is cloud-native architecture, exactly? What is cloud-native architecture? Microservices. Service mesh. Immutable infrastructure.

Cloud 162

Cloud Architecture Serverless Infrastructure 162

Scalegrid

JANUARY 10, 2025

Heading into 2024, SQL databases will remain essential in data management, increasingly using distributed systems to meet growing needs for scalability and reliability. According to 2023 statistics, 49% of web applications use an SQL-based database , with SQL having a 75% adoption rate in the IT industry.

Database 130

Database Scalability Best Practices Blockchain 130

High Scalability

JANUARY 11, 2022

Architecture. We will use a graph database such as Neo4j to store the information. Additionally, we can use columnar databases like Cassandra to store information like user feeds, activities, and counters. Sample Queries supported by Graph Database. Sending and receiving messages from other users. High Level Design.

Design 334

Design Media Storage Logistics 334

Dynatrace

JANUARY 16, 2023

The strongest Kubernetes growth areas are security, databases, and CI/CD technologies. Through effortless provisioning, a larger number of small hosts provide a cost-effective and scalable platform. Strongest Kubernetes growth areas are security, databases, and CI/CD technologies. Java, Go, and Node.js

Open Source 358

Open Source Java Operating System Programming 358

Percona

JUNE 22, 2023

To make data count and to ensure cloud computing is unabated, companies and organizations must have highly available databases. A basic high availability database system provides failover (preferably automatic) from a primary database node to redundant nodes within a cluster. HA is sometimes confused with “fault tolerance.”

Availability 132

Availability Database Open Source Hardware 132

All Things Distributed

JULY 14, 2015

I am excited to share with you that today we are expanding DynamoDB with streams, cross-region replication, and database triggers. In traditional database architectures, database engines often run a small search engine or data warehouse engines on the same hardware as the database. DynamoDB Triggers.

Database 156

Database Lambda AWS IoT 156

The Netflix TechBlog

FEBRUARY 18, 2022

To this end, we developed a Rapid Event Notification System (RENO) to support use cases that require server initiated communication with devices in a scalable and extensible manner. Architecture As shown in the diagram above, the RENO service can be broken down into the following components.

Systems 334

Systems Traffic Architecture Mobile 334

Percona

JUNE 12, 2023

When it comes to access to their applications, users demand instant, reliable, and secure interactions — and that means databases must be highly available. With database high availability (HA), services are largely uninterrupted, and end users are largely satisfied. They’re proven and ready-to-go.

Architecture 124

Architecture Availability Open Source Healthcare 124

Percona

MARCH 23, 2023

When it comes to enterprise-level databases, there are several options available in the market, but PostgreSQL stands out as one of the most popular and reliable choices. PostgreSQL is a free and open source object-relational database management system (ORDBMS) that has existed since the mid-1990s.

Database 139

Database Open Source Traffic Small Business 139

Dynatrace

JANUARY 11, 2023

Database monitoring. This ensures the database queries are performant, while also identifying host problems. For example, uptime detection can identify database instability and help to improve mean time to restoration. Measure cloud resource consumption to ensure resources are scalable and keep up with business requirements.

Cloud 295

Cloud Monitoring Best Practices Infrastructure 295

Dynatrace

OCTOBER 2, 2023

Transforming an application from monolith to microservices-based architecture can be daunting, and knowing where to start can be difficult. Because monolithic applications combine database, client-side interfaces, and server-side application elements in a single executable, they’re difficult to understand, even for their own administrators.

Architecture 278

Architecture Artificial Intelligence Cloud Open Source 278

Dynatrace

NOVEMBER 3, 2021

Organizations are depending more and more on distributed architectures to provide application services. For example, when monitoring a database, you’ll want to know about any latency when writing data to a disk or average query response time. DevOps practitioners struggle to maintain highly available and scalable applications.

Monitoring 264

Monitoring Metrics DevOps Scalability 264

Dynatrace

MAY 13, 2022

Apache Cassandra is an open-source, distributed, NoSQL database. Because of its scalability and distributed architecture, thousands of companies trust it to run their cloud and hybrid-based workloads at high availability without compromising performance. Microsoft Azure offers multiple ways to manage Apache Cassandra databases.

Azure 246

Azure Latency Metrics Infrastructure 246

Dynatrace

APRIL 20, 2023

Logs highlight observability challenges Ingesting, storing, and processing the unprecedented explosion of data from sources such as software as a service, multicloud environments, containers, and serverless architectures can be overwhelming for today’s organizations. Grail enables 100% precision insights into all stored data.

Analytics 246

Analytics Infrastructure Storage Architecture 246

Scalegrid

DECEMBER 6, 2023

The choice of self-managed cloud databases vs DBaaS is a common debate among those who are looking for the best option that will cater to their particular needs. Database as a Service (DBaaS) and managed databases offer distinct advantages along with certain challenges.

Database 130

Database Cloud Hardware Storage 130

The Netflix TechBlog

MARCH 5, 2019

Ten years on: How Netflix completed a historic cloud migration with AWS Amazon Fleet Management: Meet the Man Who Keeps Amazon Servers Running, No Matter What | Amazon Web Services ADS Framework at Palantir Building a SOCless detection team Lessons Learned in Detection Engineering Engineering Trade-Offs and The Netflix API Re-Architecture Evolving (..)

Infrastructure 185

Infrastructure Cloud Scalability AWS 185

The Netflix TechBlog

FEBRUARY 9, 2021

In particular, we’ll define plans and offers, review the legacy architecture and some of its shortcomings, and dig into our new architecture and some of its advantages. Let’s take a deeper look at the architecture, protocols, and systems involved. The database contains the plans, prices and offers.

Engineering 145

Engineering Scalability Architecture Innovation 145

Dynatrace

JUNE 9, 2023

Increasing an organization’s DevOps maturity is a key goal as teams adopt more cloud-native technologies, which simultaneously makes their environments more scalable and feature-rich but also more complex. Research has found that 99% of organizations have embraced a multicloud architecture.

DevOps 246

DevOps Analytics Storage Metrics 246

The Netflix TechBlog

MARCH 25, 2019

In the rest of this blog, we will a) touch on the complexity of Netflix cloud landscape, b) discuss lineage design goals, ingestion architecture and the corresponding data model, c) share the challenges we faced and the learnings we picked up along the way, and d) close it out with “what’s next” on this journey.

Infrastructure 225

Infrastructure Big Data Transportation Architecture 225

The Netflix TechBlog

DECEMBER 11, 2020

Our Journey so Far Over the past year, we’ve implemented the core infrastructure pieces necessary for a federated GraphQL architecture as described in our previous post: Studio Edge Architecture The first Domain Graph Service (DGS) on the platform was the former GraphQL monolith that we discussed in our first post (Studio API).

Architecture 255

Architecture Best Practices Engineering Open Source 255

High Scalability

JUNE 15, 2018

1.6x : better deep learning cluster scheduling on k8s; 100,000 : Large-scale Diverse Driving Video Database; 3rd : reddit popularity in the US; 50% : increase in Neural Information Processing System papers, AI bubble? JoeEmison : Another thing that serverless architectures change: how do you software development. Hungry for more?

Internet 113

Internet Internet Scalability Blockchain 113

Dynatrace

DECEMBER 21, 2023

Evaluating these on three levels—data center, host, and application architecture (plus code)—is helpful. Application architectures might not be conducive to rehosting. Reduce the volume of data volumes requested from databases (for example, request all, filter in memory). Is the solution to just move all workloads to the cloud?

Cloud 264

Cloud Energy Best Practices Cache 264

Scalegrid

FEBRUARY 11, 2025

Choosing the right database often comes down to MongoDB vs MySQL. This article will help you understand the core differences in data structure, scalability, and use cases. Whether you need a relational database for complex transactions or a NoSQL database for flexible data storage, weve got you covered.

Scalability 147

Scalability Database Storage IoT 147

Dynatrace

SEPTEMBER 30, 2021

The breadth of fully-featured services, the pay-as-you-go scalability, and the agility of cloud platforms enable organizations to expand their modern approaches to building and managing digital services in a way they can’t with on-premises apps and infrastructure. Increased scalability. Migrate databases intelligently.

Cloud 241

Cloud Traffic Best Practices Strategy 241

Percona

MARCH 30, 2023

The use of open source databases has increased steadily in recent years. Past trepidation — about perceived vulnerabilities and performance issues — has faded as decision makers realize what an “open source database” really is and what it offers. What is an open source database?

Open Source 107

Open Source Database Storage Scalability 107

Dynatrace

JANUARY 5, 2022

To do so we have successfully established AI-based White box load and resiliency testing with JMeter and Dynatrace, helping identify and resolve major performance and scalability problems in recent projects before deploying to production. Our customers usually involve us 2-4 weeks before the production release. a Jenkinsfile.

Testing 246

Testing Open Source Metrics Infrastructure 246

All Things Distributed

AUGUST 20, 2015

It opens up the possibility to enjoy the value that graph databases bring to relationship-centric use cases, without worrying about managing the underlying storage. Traditionally, these connections have been stored in relational databases, with each object type requiring its own table. Enter graph databases.

Database 119

Database Logistics Availability Social Media 119

Dynatrace

NOVEMBER 2, 2020

IT infrastructure is the heart of your digital business and connects every area – physical and virtual servers, storage, databases, networks, cloud services. Ensures platform is flexible and scalable to handle peaks by sending alerts to IT management. Dynatrace news. for unplanned downtime, resource saturation, network intrusion.

Infrastructure 246

Infrastructure Monitoring Virtualization Serverless 246

Dynatrace

DECEMBER 22, 2021

They are particularly important in distributed systems, such as microservices architectures. Observability platforms are becoming essential as the complexity of cloud-native architectures increases. The key driver behind this change in architecture was the need to release better software faster.

Artificial Intelligence 245

Artificial Intelligence Metrics Architecture DevOps 245

The Netflix TechBlog

SEPTEMBER 18, 2024

Central to this infrastructure is our use of multiple online distributed databases such as Apache Cassandra , a NoSQL database known for its high availability and scalability. Over time as new key-value databases were introduced and service owners launched new use cases, we encountered numerous challenges with datastore misuse.

Latency 260

Latency Storage Cache Efficiency 260

Dynatrace

MAY 1, 2023

Identify data use cases and develop a scalable delivery model with documentation. NoSQL database. Nontabular data management, as opposed to tabular relations used in relational databases, is useful when working with large sets of distributed data. Automate analytics tools and processes. Establish data governance. Apache Spark.

Analytics 246

Analytics Artificial Intelligence Big Data Open Source 246

InfoQ

APRIL 9, 2024

The company leveraged Instagram's existing monolithic architecture and quickly iterated to create a new text-first microblogging service in record time. Zahan Malkani talked during QCon London 2024 about Meta’s journey from identifying the opportunity in the market to shipping the Threads application only five months later.

Architecture 140

Architecture Serverless Mobile Scalability 140