Dynatrace

MAY 23, 2024

Stream processing One approach to such a challenging scenario is stream processing, a computing paradigm and software architectural style for data-intensive software systems that emerged to cope with requirements for near real-time processing of massive amounts of data.

Engineering 245

Engineering Tuning Latency Open Source 245

The Netflix TechBlog

MARCH 4, 2025

Part 3: System Strategies and Architecture By: VarunKhaitan With special thanks to my stunning colleagues: Mallika Rao , Esmir Mesic , HugoMarques This blog post is a continuation of Part 2 , where we cleared the ambiguity around title launch observability at Netflix. The request schema for the observability endpoint.

Traffic 180

Traffic Strategy Entertainment Innovation 180

DZone

NOVEMBER 16, 2023

This article is intended for data scientists, AI researchers, machine learning engineers, and advanced practitioners in the field of artificial intelligence who have a solid grounding in machine learning concepts, natural language processing , and deep learning architectures.

Artificial Intelligence 264

Artificial Intelligence Architecture Network Engineering 264

Dynatrace

AUGUST 17, 2021

This method of structuring, developing, and operating complex, multi-function software as a collection of smaller independent services is known as microservice architecture. ” it helps to understand the monolithic architectures that preceded them. Understanding monolithic architectures.

Architecture 246

Architecture Software Software Development 246

Dynatrace

AUGUST 17, 2021

This method of structuring, developing, and operating complex, multi-function software as a collection of smaller independent services is known as microservice architecture. ” it helps to understand the monolithic architectures that preceded them. Understanding monolithic architectures.

Architecture 246

Architecture Software Software Development 246

DZone

FEBRUARY 26, 2025

With the evolution of modern applications serving increasing needs for real-time data processing and retrieval, scalability does, too. One such open-source, distributed search and analytics engine is Elasticsearch, which is very efficient at handling data in large sets and high-velocity queries.

Scalability 147

Scalability Open Source Latency Architecture 147

The Netflix TechBlog

JANUARY 10, 2024

Future blogs will provide deeper dives into each service, sharing insights and lessons learned from this process. The Netflix video processing pipeline went live with the launch of our streaming service in 2007. The Netflix video processing pipeline went live with the launch of our streaming service in 2007.

Processing 238

Processing Media Latency Innovation 238

Dynatrace

JULY 7, 2022

Many organizations are taking a microservices approach to IT architecture. However, in some cases, an organization may be better suited to another architecture approach. Therefore, it’s critical to weigh the advantages of microservices against its potential issues, other architecture approaches, and your unique business needs.

Architecture 246

Architecture Serverless Azure Programming 246

The Netflix TechBlog

APRIL 12, 2022

By Alex Hutter , Falguni Jhaveri and Senthil Sayeebaba Over the past few years Content Engineering at Netflix has been transitioning many of its services to use a federated GraphQL platform. In a federated graph architecture, how can we answer such a query given that each entity is served by its own service?

Engineering 271

Engineering Architecture Java Infrastructure 271

Dynatrace

FEBRUARY 4, 2021

Site reliability engineering (SRE) is the practice of applying software engineering principles to operations and infrastructure processes to help organizations create highly reliable and scalable software systems. Shift-left using an SRE approach means that reliability is baked into each process, app and code change.

Engineering 245

Engineering DevOps Government Latency 245

Dynatrace

JANUARY 31, 2022

Key takeaways from this article on modern observability for serverless architecture: As digital transformation accelerates, organizations need to innovate faster and continually deliver value to customers. Companies often turn to serverless architecture to accelerate modernization efforts while simplifying IT management.

Serverless 245

Serverless Architecture Open Source Innovation 245

Dynatrace

MARCH 6, 2024

As organizations look to expand DevOps maturity, improve operational efficiency, and increase developer velocity, they are embracing platform engineering as a key driver. Platform engineering: Build for self-service Self-service deployment is a key attribute of platform engineering. “It makes them more productive.

Engineering 264

Engineering Development DevOps Infrastructure 264

Dynatrace

APRIL 2, 2025

Streamlining site reliability at scale can be daunting, particularly with large-scale AWS environments and architecture that rely on hundredsor even thousandsof Amazon EC2 instances. This step-by-step guide will show you how to configure your architecture to trigger guardians whenever EC2 tags are updated.

AWS 147

AWS Efficiency Architecture DevOps 147

Dynatrace

MARCH 29, 2024

Five of the most common include cluster instability, resource and cost management, security, observability, and stress on engineering teams. Engineering teams are overwhelmed with stuff to do.” The post Enhancing Kubernetes cluster management key to platform engineering success appeared first on Dynatrace news.

Engineering 264

Engineering DevOps Operating System Cloud 264

The Netflix TechBlog

NOVEMBER 14, 2023

By Abhinaya Shetty , Bharath Mummadisetty At Netflix, our Membership and Finance Data Engineering team harnesses diverse data related to plans, pricing, membership life cycle, and revenue to fuel analytics, power various dashboards, and make data-informed decisions. Let’s dive in! What is late-arriving data? Some techniques we used were: 1.

Data Engineering 271

Data Engineering Engineering Processing Games 271

Dynatrace

FEBRUARY 12, 2024

When it comes to platform engineering, not only does observability play a vital role in the success of organizations’ transformation journeys—it’s key to successful platform engineering initiatives. The various presenters in this session aligned platform engineering use cases with the software development lifecycle.

Engineering 246

Engineering Development Infrastructure Cloud 246

Dynatrace

MARCH 25, 2025

This powerful tool can be leveraged across various environments, including production, to enhance development processes and ensure robust application performance. Following are some of the coolest things weve seen engineers do with Live Debugger. Live snapshot includes variables, process, stack trace, and tracing information.

Benchmarking 147

Benchmarking Code Open Source Engineering 147

The Netflix TechBlog

JANUARY 6, 2025

This process involves: Identifying Stakeholders: Determine who is impacted by the issue and whose input is crucial for a successful resolution. In this context, were focused on developing systems that ensure successful title launches, build trust between content creators and our brand, and reduce engineering operational overhead.

Scalability 219

Scalability Cache Engineering Systems 219

Dynatrace

NOVEMBER 14, 2023

Site reliability engineering (SRE) has become increasingly important to organizations looking to keep up with the rapid pace of digital transformation. Effective site reliability engineering requires enterprise-wide transformation Without a unified understanding of SRE practices, organizational silos can quickly form between departments.

Best Practices 246

Best Practices Engineering DevOps Software Engineering 246

The Netflix TechBlog

FEBRUARY 14, 2025

Every image you hover over isnt just a visual placeholder; its a critical data point that fuels our sophisticated personalization engine. It requires a state-of-the-art system that can track and process these impressions while maintaining a detailed history of each profiles exposure.

Tuning 166

Tuning Latency Efficiency Storage 166

The Netflix TechBlog

NOVEMBER 20, 2023

by Jun He , Yingyi Zhang , and Pawan Dixit Incremental processing is an approach to process new or changed data in workflows. The key advantage is that it only incrementally processes data that are newly added or updated to a dataset, instead of re-processing the complete dataset.

Processing 219

Processing Big Data Efficiency Engineering 219

Scalegrid

MAY 13, 2020

Greenplum Database is a massively parallel processing (MPP) SQL database that is built and based on PostgreSQL. In this blog post, we explain what Greenplum is, and break down the Greenplum architecture, advantages, major use cases, and how to get started. The Greenplum Architecture. The Greenplum Architecture.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

The Netflix TechBlog

JUNE 20, 2024

A summary of sessions at the first Data Engineering Open Forum at Netflix on April 18th, 2024 The Data Engineering Open Forum at Netflix on April 18th, 2024. At Netflix, we aspire to entertain the world, and our data engineering teams play a crucial role in this mission by enabling data-driven decision-making at scale.

Data Engineering 206

Data Engineering Engineering Entertainment Software Engineering 206

The Netflix TechBlog

MARCH 28, 2025

This scenario underscored the need for a new recommender system architecture where member preference learning is centralized, enhancing accessibility and utility across different models. To harness this data effectively, we employ a process of interaction tokenization, ensuring meaningful events are identified and redundancies are minimized.

Tuning 165

Tuning Efficiency Latency Strategy 165

The Netflix TechBlog

FEBRUARY 18, 2022

Motivation With the rapid growth in Netflix member base and the increasing complexity of our systems, our architecture has evolved into an asynchronous one that enables both online and offline computation. Personalized Experience Refresh Netflix Recommendation engine continuously refreshes recommendations for every member.

Systems 334

Systems Traffic Architecture Mobile 334

DZone

JANUARY 31, 2024

The reality of the startup is that engineering teams are often at a crossroads when it comes to choosing the foundational architecture for their software applications. The allure of a microservice architecture is understandable in today's tech state of affairs, where scalability, flexibility, and independence are highly valued.

Architecture 289

Architecture Scalability Design Engineering 289

Dynatrace

OCTOBER 7, 2021

To get a better understanding of AWS serverless, we’ll first explore the basics of serverless architectures, review AWS serverless offerings, and explore common use cases. Serverless architecture: A primer. Serverless architecture shifts application hosting functions away from local servers onto those managed by providers.

Serverless 325

Serverless AWS Lambda Storage 325

Dynatrace

FEBRUARY 25, 2025

This blog post dissects the vulnerability, explains how Struts processes file uploads, details the exploit mechanics, and outlines mitigation strategies. Introduction Apache Struts 2 is a widely used Java framework for web applications, valued for its flexibility and Model-View-Controller (MVC) architecture.

Servers 214

Servers Processing Java Tuning 214

DZone

NOVEMBER 7, 2023

With businesses constantly in the race to stay ahead, the process of integrating this data becomes crucial. However, it's no longer enough to assimilate data in isolated, batch-oriented processes. Businesses were content with accumulating data over defined intervals and then processing it in scheduled batches.

Systems 292

Systems Analytics Architecture Engineering 292

The Netflix TechBlog

JUNE 15, 2022

By Alex Hutter , Falguni Jhaveri , and Senthil Sayeebaba In a previous post , we described the indexing architecture of Studio Search and how we scaled the architecture by building a config-driven self-service platform that allowed teams in Content Engineering to spin up search indices easily.

Engineering 192

Engineering Availability Architecture Tuning 192

Dynatrace

OCTOBER 4, 2022

Grail architectural basics. The aforementioned principles have, of course, a major impact on the overall architecture. A data lakehouse addresses these limitations and introduces an entirely new architectural design. Ingest and process with Grail. It’s based on cloud-native architecture and built for the cloud.

Artificial Intelligence 290

Artificial Intelligence Analytics Storage Architecture 290

Scalegrid

FEBRUARY 24, 2025

This decoupling is crucial in modern architectures where scalability and fault tolerance are paramount. The architecture of RabbitMQ is meticulously designed for complex message routing, enabling dynamic and flexible interactions between producers and consumers. Erlang is the backbone of RabbitMQ clustering.

Best Practices 147

Best Practices Traffic Strategy Scalability 147

The Netflix TechBlog

DECEMBER 11, 2020

Our Journey so Far Over the past year, we’ve implemented the core infrastructure pieces necessary for a federated GraphQL architecture as described in our previous post: Studio Edge Architecture The first Domain Graph Service (DGS) on the platform was the former GraphQL monolith that we discussed in our first post (Studio API).

Architecture 255

Architecture Best Practices Engineering Open Source 255

The Netflix TechBlog

FEBRUARY 9, 2021

Growth Engineering at Netflix?—?Automated In the Growth Engineering team, we refer to this as the top of the signup funnel. For more background on the signup funnel and Growth Engineering’s role in the signup funnel, please read our initial post on the topic: Growth Engineering at Netflix? Accelerating Innovation.

Engineering 172

Engineering Storage Latency Entertainment 172

The Netflix TechBlog

MARCH 14, 2023

Specifically, we will dive into the architecture that powers search capabilities for studio applications at Netflix. We implemented a batch processing system for users to submit their requests and wait for the system to generate the output. Processing took several hours to complete. Here is a visualization of this flow.

Media 299

Media Innovation Energy Architecture 299

Dynatrace

OCTOBER 6, 2020

Observability as a topic is becoming more important as applications are using microservice architectures and are deployed in Kubernetes environments. Shortly after applying the heavy load, Davis, the Dynatrace AI engine, notified me of a problem. Dynatrace news. The setup . The service flow .

Metrics 276

Metrics Architecture Engineering Processing 276

Dynatrace

JULY 11, 2023

We’re delighted to share that IBM and Dynatrace have joined forces to bring the Dynatrace Operator, along with the comprehensive capabilities of the Dynatrace platform, to Red Hat OpenShift on the IBM Power architecture (ppc64le).

Architecture 189

Architecture Availability Infrastructure Metrics 189