The Netflix TechBlog

MARCH 28, 2025

This scenario underscored the need for a new recommender system architecture where member preference learning is centralized, enhancing accessibility and utility across different models. To harness this data effectively, we employ a process of interaction tokenization, ensuring meaningful events are identified and redundancies are minimized.

Tuning 165

Tuning Efficiency Latency Strategy 165

DZone

FEBRUARY 24, 2023

This is widely used to build event-driven systems or decouple services on AWS. Benefits of Amazon SQS Amazon SQS is a highly reliable and scalable message queuing service that enables you to reliably connect your applications. It provides the following benefits:

Architecture 243

Architecture AWS Scalability Systems 243

Dynatrace

OCTOBER 7, 2021

To get a better understanding of AWS serverless, we’ll first explore the basics of serverless architectures, review AWS serverless offerings, and explore common use cases. Serverless architecture: A primer. Serverless architecture shifts application hosting functions away from local servers onto those managed by providers.

Serverless 325

Serverless AWS Lambda Storage 325

The Netflix TechBlog

MARCH 4, 2025

Part 3: System Strategies and Architecture By: VarunKhaitan With special thanks to my stunning colleagues: Mallika Rao , Esmir Mesic , HugoMarques This blog post is a continuation of Part 2 , where we cleared the ambiguity around title launch observability at Netflix. The response schema for the observability endpoint.

Traffic 180

Traffic Strategy Entertainment Innovation 180

Scalegrid

FEBRUARY 24, 2025

Key Takeaways RabbitMQ improves scalability and fault tolerance in distributed systems by decoupling applications, enabling reliable message exchanges. This decoupling is crucial in modern architectures where scalability and fault tolerance are paramount.

Best Practices 147

Best Practices Traffic Strategy Scalability 147

DZone

JULY 23, 2024

An architectural pattern named Event Sourcing is gaining more and more recognition from developers who aim for strong and scalable systems. This article is aimed at software architects, system developers, and project managers who might be contemplating or are already engaged in integrating Event Sourcing into their systems.

Systems 130

Systems Scalability Architecture Technology 130

InfoQ

NOVEMBER 1, 2024

At QCon San Francisco 2024, software architecture is front and center, with two tracks dedicated to exploring some of the largest and most complex architectures today. Join senior software practitioners as they provide inspiration and practical lessons for architects seeking to tackle issues at a massive scale. By Artenisa Chatziou

Software Architecture 85

Software Architecture Architecture Software Software 85

DZone

FEBRUARY 29, 2024

In the world of cloud computing and event-driven applications, efficiency and flexibility are absolute necessities. A proper architecture ensures that there are no bottlenecks in the movement of messages. A smooth flow of messages in an event-driven application is the key to its performance and efficiency.

Efficiency 264

Efficiency AWS Scalability Architecture 264

DZone

FEBRUARY 29, 2024

In the vibrant world of microservices and event-driven architectures, messaging queues have emerged as a critical component, enabling asynchronous communication, decoupling systems, and unlocking scalability. However, with a vibrant landscape of options, choosing the optimal queue can feel like navigating a complex maze.

Scalability 263

Scalability Architecture Processing Systems 263

Dynatrace

AUGUST 11, 2022

Before an organization moves to function as a service, it’s important to understand how it works, its benefits and challenges, its effect on scalability, and why cloud-native observability is essential for attaining peak performance. FaaS vs. monolithic architectures. How does function as a service affect scalability?

Development 279

Development Serverless Best Practices Lambda 279

Dynatrace

OCTOBER 1, 2021

As dynamic systems architectures increase in complexity and scale, IT teams face mounting pressure to track and respond to conditions and issues across their multi-cloud environments. Dynatrace news. As teams begin collecting and working with observability data, they are also realizing its benefits to the business, not just IT.

Metrics 363

Metrics Open Source Monitoring Cloud 363

Scalegrid

MAY 13, 2020

In this blog post, we explain what Greenplum is, and break down the Greenplum architecture, advantages, major use cases, and how to get started. It’s architecture was specially designed to manage large-scale data warehouses and business intelligence workloads by giving you the ability to spread your data out across a multitude of servers.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

Dynatrace

OCTOBER 4, 2022

Grail architectural basics. The aforementioned principles have, of course, a major impact on the overall architecture. A data lakehouse addresses these limitations and introduces an entirely new architectural design. From the beginning, Grail was built to be fast and scalable to manage massive volumes of data.

Artificial Intelligence 290

Artificial Intelligence Analytics Storage Architecture 290

The Netflix TechBlog

JUNE 7, 2021

Flow Exporter The Flow Exporter is a sidecar that uses eBPF tracepoints to capture TCP flows at near real time on instances that power the Netflix microservices architecture. Flow Collector consumes two data streams, the IP address change events from Sonar via Kafka and eBPF flow log data from the Flow Exporter sidecars. What is BPF?

Network 327

Network Transportation AWS Cloud 327

Dynatrace

OCTOBER 2, 2023

Transforming an application from monolith to microservices-based architecture can be daunting, and knowing where to start can be difficult. Unsurprisingly, organizations are breaking away from monolithic architectures and moving toward event-driven microservices. Migration is time-consuming and involved.

Architecture 278

Architecture Artificial Intelligence Cloud Open Source 278

Dynatrace

JULY 11, 2023

We’re delighted to share that IBM and Dynatrace have joined forces to bring the Dynatrace Operator, along with the comprehensive capabilities of the Dynatrace platform, to Red Hat OpenShift on the IBM Power architecture (ppc64le). It also detects new containers and injects OneAgent code modules into application pods.

Architecture 189

Architecture Availability Infrastructure Metrics 189

The Netflix TechBlog

APRIL 27, 2023

While we were able to put out the immediate fire by disabling the newly created alerts, this incident raised some critical concerns around the scalability of our alerting system. It became clear to us that we needed to solve the scalability problem with a fundamentally different approach. OK, Results?

Storage 297

Storage Cache Metrics Database 297

The Netflix TechBlog

MARCH 5, 2019

Challenges & Opportunities in the Infra Data Space Security Events Platform for Anomaly Detection How can we develop a complex event processing system to ingest semi-structured data predicated on schema contracts from hundreds of sources and transform it into event streams of structured data for downstream analysis?

Infrastructure 185

Infrastructure Cloud Scalability AWS 185

All Things Distributed

JULY 14, 2015

In this blog post, I will explain how these three new capabilities empower you to build applications with distributed systems architecture and create responsive, reliable, and high-performance applications using DynamoDB that work at any scale. Amazon Redshift) and Elasticsearch machines. DynamoDB Cross-region Replication.

Database 156

Database Lambda AWS IoT 156

High Scalability

JANUARY 11, 2022

Architecture. We have chosen this NoSQL based solution over relational databases as it provides the scalability to have hierarchies which go beyond two levels and extensibility due to the schema-less behavior of NoSQL data storage. Sending and receiving messages from other users. High Level Design. Streaming Data Model.

Design 334

Design Media Storage Logistics 334

Dynatrace

JULY 9, 2020

Autonomous Cloud Enablement (ACE) and Keptn – the Event-Driven Autonomous Cloud Control Plane – are helping our Dynatrace customers to automate their delivery and operations processes. This is now where Keptn, our Event-Driven Control Plane for Autonomous Cloud Control Plane, comes into the picture! Dynatrace news.

Cloud 261

Cloud DevOps Architecture Azure 261

Dynatrace

APRIL 20, 2023

Logs highlight observability challenges Ingesting, storing, and processing the unprecedented explosion of data from sources such as software as a service, multicloud environments, containers, and serverless architectures can be overwhelming for today’s organizations. ” Watch session now!

Analytics 246

Analytics Infrastructure Storage Architecture 246

InfoQ

MARCH 7, 2024

Uber replaced a legacy architecture built using the WAMP protocol with a new solution that takes advantage of GraphQL subscriptions. By Rafal Gancarz

Scalability 129

Scalability Architecture Design Development 129

The Netflix TechBlog

OCTOBER 8, 2024

In previous blog posts, we introduced the Key-Value Data Abstraction Layer and the Data Gateway Platform , both of which are integral to Netflix’s data architecture. Instead, we focus on addressing the challenge of storing and accessing extremely high-throughput, immutable temporal event data in a low-latency and cost-efficient manner.

Latency 239

Latency Storage Traffic Tuning 239

Dynatrace

APRIL 7, 2023

Streaming raises the default 6 MB hard limit to a 20 MB soft limit, adding greater scalability and flexibility to their applications. Triggering the Lambda function is event-driven and could include changes in state or an update to a file. What is a Lambda serverless function? What is Lambda Response Streaming?

Lambda 246

Lambda AWS Serverless Latency 246

Dynatrace

APRIL 30, 2019

At its heart it uses Istio (for traffic control) and Knative (for event driven tool orchestration) and stores all configuration in Git – following the GitOps approach. Beyond basic metrics: Detecting Architectural Regressions. Use this to detect any architectural regressions introduced through code or config changes.

Architecture 149

Architecture Open Source Azure Metrics 149

All Things Distributed

AUGUST 17, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Back-to-Basics Weekend Reading - Staged Event-Driven Architecture. Staged Event-Driven Architecture. SEDA: An Architecture for Well-Conditioned, Scalable Internet Services , Matt Welsh, David Culler, and Eric Brewer.

Architecture 75

Architecture AWS Internet Internet 75

Dynatrace

FEBRUARY 3, 2020

Keptn’s event-driven control plane solves four major challenges organizations have when moving to the autonomous cloud. But – what if the new version has performance, scalability or architectural flaws and therefore should never reach production? The recent improvements released in Keptn 0.6, keptnexamples/carts --tag=0.10.1.

Cloud 295

Cloud Google Open Source Scalability 295

The Netflix TechBlog

NOVEMBER 3, 2022

The original assumptions and architectural choices were no longer viable. Overview The figure below depicts a simplified high-level architecture of a single Titus cluster (a.k.a Let’s assume a sequence of events E?…E??, cell): Titus Job Coordinator is a leader elected process managing the active state of the system. of the data.

Cache 233

Cache Latency Traffic Systems 233

Dynatrace

NOVEMBER 28, 2022

The Dynatrace Software Intelligence Platform accelerates cloud operations, helping users achieve service-level objectives (SLOs) with automated intelligence and unmatched scalability. Understand and optimize your architecture. Built for enterprise scalability. Optimize timing hotspots. Simplify error analytics.

Lambda 246

Lambda AWS Serverless Latency 246

Dynatrace

AUGUST 16, 2021

Automatically collect and evaluate business, service, and architectural indicator metrics to promote or roll back deployments. Providing standardized self-service pipeline templates, best practices, and scalable automation for monitoring, testing, and SLO validation. Example #2 – Deployment information events. Annotation.

Software 246

Software Software Open Source Azure 246

Dynatrace

AUGUST 21, 2023

A traditional log management solution uses an often manual and siloed approach, which limits scalability and ultimately hinders organizational innovation. These solutions often provide better scalability and performance than on-premises solutions, while still providing broad infrastructure coverage. Reduce costs and inefficiencies.

Analytics 223

Analytics Innovation Infrastructure Scalability 223

Dynatrace

OCTOBER 6, 2023

Table name Default bucket logs default_logs events default_events metrics default_metrics bizevents default_bizevents dt.system.events dt_system_events entities spans (in the future) The default buckets let you ingest data immediately, but you can also create additional custom buckets to make the most of Grail.

Artificial Intelligence 279

Artificial Intelligence Metrics Analytics Storage 279

Dynatrace

JULY 29, 2021

Today’s digital businesses run on heterogeneous and highly dynamic architectures with interconnected applications and microservices deployed via Kubernetes and other cloud-native platforms. Common questions include: Where do bottlenecks occur in our architecture? How can we optimize for performance and scalability?

Analytics 246

Analytics Open Source Serverless Architecture 246

InfoQ

MARCH 15, 2024

Hashnode created a scalable event-driven architecture (EDA) for composing feed data for thousands of users. The company used serverless services on AWS, including Lambda, Step Functions, EventBridge, and Redis Cache. The solution leverages Step Functions' distributed maps feature that enables high-concurrency processing.

Scalability 76

Scalability AWS Architecture Lambda 76

Dynatrace

NOVEMBER 9, 2021

Amplify PowerUP, our half-yearly global event to update our partner community, covered a lot of ground including key Partner Program announcements, Q2 earnings and partner contribution, market growth and momentum, Dynatrace platform capabilities, and the partner services offering the platform powers.

DevOps 246

DevOps Innovation Cloud Programming 246

Dynatrace

DECEMBER 21, 2023

Evaluating these on three levels—data center, host, and application architecture (plus code)—is helpful. Application architectures might not be conducive to rehosting. For a deeper look into these and many other recommendations, my colleagues and I wrote an eBook about performance and scalability on the topic.

Cloud 264

Cloud Energy Best Practices Cache 264