The Netflix TechBlog

JANUARY 25, 2023

Scalable Annotation Service — Marken by Varun Sekhri , Meenakshi Jindal Introduction At Netflix, we have hundreds of micro services each with its own data models or entities. With the growing number of annotations and its usage across the studio applications, prioritizing scalability becomes essential.

Scalability 293

Scalability Latency Media Architecture 293

DZone

JANUARY 8, 2024

As organizations increasingly migrate their applications to the cloud, efficient and scalable load balancing becomes pivotal for ensuring optimal performance and high availability. Each of these services addresses specific use cases, offering diverse functionalities to meet the demands of modern applications. What Is Load Balancing?

Azure 287

Azure Scalability Traffic Performance 287

DZone

JUNE 25, 2024

As display manufacturing continues to evolve, the demand for scalable software solutions to support automation has become more critical than ever. Scalable software architectures are the backbone of efficient and flexible production lines, enabling manufacturers to meet the increasing demands for innovative display technologies.

Scalability 241

Scalability Software Software Software Architecture 241

High Scalability

JANUARY 25, 2022

This is a guest post by Ankit Sirmorya. Ankit is working as a Machine Learning Lead/Sr. Machine Learning Engineer at Amazon and has led several machine-learning initiatives across the Amazon ecosystem. Ankit has been working on applying machine learning to solve ambiguous business problems and improve customer experience.

Design 329

Design Engineering Development 329

High Scalability

DECEMBER 13, 2021

Design a video streaming platform similar to Netflix where content creators can upload their video content and viewers are able to play video on different devices. Problem Statement. We should also be able to store user statistics of the videos such as number of views, video watched duration, and so forth.

Design 253

Design Engineering Development 253

DZone

JANUARY 20, 2023

Having a distributed and scalable graph database system is highly sought after in many enterprise scenarios. Do Not Be Misled Designing and implementing a scalable graph database system has never been a trivial task.

Scalability 210

Scalability Big Data Hardware Internet 210

The Netflix TechBlog

SEPTEMBER 15, 2021

By Ricky Gardiner , Alex Borysov Background In our previous post , we discussed how we utilize FieldMask as a solution when designing our APIs so that consumers can request the data they need when fetched via gRPC. This solution is not scalable. What if we want to update more than one field and do it atomically in a single RPC?

Design 242

Design Scalability Engineering Performance 242

DZone

AUGUST 9, 2023

Machine learning (ML) has seen explosive growth in recent years, leading to increased demand for robust, scalable, and efficient deployment methods. This article proposes a technique using Docker, an open-source platform designed to automate application deployment, scaling, and management, as a solution to these challenges.

Scalability 246

Scalability Best Practices Open Source Virtualization 246

DZone

JANUARY 19, 2024

A transformative journey into the realm of system design with our tutorial, tailored for software engineers aspiring to architect solutions that seamlessly scale to serve millions of users.

Systems 189

Systems Design Software Engineering Scalability 189

Dynatrace

NOVEMBER 3, 2023

that offers security, scalability, and simplicity of use. are technologically very different, Python and JMX extensions designed for Extension Framework 1.0 Python code also carries limited scalability and the burden of governing its security in production environments and lifecycle management. Extensions 2.0 Extensions 2.0

Technology 255

Technology Technology Scalability Availability 255

DZone

OCTOBER 9, 2024

The Scheduler service enables this and is designed to address the performance and scalability improvements on Actor reminders and the Workflow API. In this post, I am going to deep dive into the details of how the Scheduler service was designed and its implementation to give you some background. Prior to v1.14 Prior to v1.14

Scalability 318

Scalability Design Database Processing 318

DZone

AUGUST 14, 2024

When building ETL data pipelines using Azure Data Factory (ADF) to process huge amounts of data from different sources, you may often run into performance and design-related challenges. This article will serve as a guide in building high-performance ETL pipelines that are both efficient and scalable.

Azure 306

Azure Cloud Scalability Efficiency 306

DZone

JANUARY 24, 2024

These storage alternatives have been designed to meet a range of requirements, including performance, scalability, durability, and price. These storage options are intended to suit certain needs, such as scalability, durability, performance, and cost-effectiveness.

Storage 278

Storage Cloud Scalability Design 278

Dynatrace

MARCH 29, 2024

As organizations continue to expand within cloud-native environments using Google Cloud, ensuring scalability becomes a top priority. Visit Dynatrace booth #1141 during the event to explore how its real-time insights and optimization capabilities ensure seamless scalability and performance.

Google 273

Google Innovation Cloud Analytics 273

DZone

JANUARY 31, 2024

At the heart of this decision lies a crucial question: should these teams lay the groundwork with a microservice architecture, known for its distributed and decentralized nature, or opt for a monolithic design, where the entire application is unified and interdependent?

Architecture 289

Architecture Scalability Design Engineering 289

DZone

SEPTEMBER 23, 2024

With the rise of microservices architecture , there has been a rapid acceleration in the modernization of legacy platforms, leveraging cloud infrastructure to deliver highly scalable, low-latency, and more responsive services. Why Use Spring WebFlux?

Performance 287

Performance Latency Architecture Programming 287

DZone

DECEMBER 4, 2023

As organizations seek more robust, scalable, and reliable solutions for deploying and managing containerized applications , Kubernetes emerges as the clear frontrunner. Kubernetes , on the other hand, is an open-source platform designed to automate the deployment, scaling, and operation of application containers.

Best Practices 328

Best Practices Open Source Scalability Design 328

Smashing Magazine

JANUARY 3, 2022

Composition-Based Design System In Figma. Composition-Based Design System In Figma. Working as a designer on a design system for a large product has taught me how precious the time you spend on a single task/component is. Things advance fast, and I try to keep up making it work for both designers and developers.

Design 141

Design Systems Code Scalability 141

Dynatrace

DECEMBER 9, 2024

Non-compliance and misconfigurations thrive in scalable clusters without continuous reporting. The time has come to move beyond outdated practices and adopt solutions designed for the realities of Kubernetes environments. This empowers teams to efficiently deliver secure, compliant Kubernetes applications by design.

Best Practices 256

Best Practices Benchmarking DevOps Efficiency 256

DZone

MARCH 20, 2023

Microservices architecture has gained popularity recently as a technique for creating sophisticated and scalable software systems. Microservices are scalable, independently deployable services that talk to one another across a network. HTTP and messaging are two popular methods for microservices communication.

Scalability 264

Scalability Architecture Network Design 264

Dynatrace

OCTOBER 7, 2021

Instead of worrying about infrastructure management functions, such as capacity provisioning and hardware maintenance, teams can focus on application design, deployment, and delivery. Scalability. Finally, there’s scalability. The first benefit is simplicity. Let’s explore each in more detail. Compute services.

Serverless 293

Serverless AWS Lambda Storage 293

DZone

DECEMBER 27, 2023

As organizations increasingly embrace the microservices approach, the need for a resilient testing framework becomes important for the reliability, scalability , and security of these distributed systems. What Is MRTF? In embracing a holistic and collaborative approach, let’s start by explaining the cornerstones of MRTF.

Testing 228

Testing Scalability Architecture Design 228

DZone

FEBRUARY 29, 2024

Simple Notification Service (SNS), a native pub/sub messaging service from AWS can be leveraged to design a distributed messaging platform. SNS will act as the supplier of messages to various subscribers, resulting in maximizing throughput and effortless scalability.

Efficiency 264

Efficiency AWS Scalability Architecture 264

DZone

SEPTEMBER 30, 2023

While this architectural approach offers scalability, reusability, and adaptability, it also presents a unique challenge: effectively managing communication between these microservices. Successfully coordinating messages among these services is a fundamental aspect of their design.

Systems 286

Systems Virtualization Architecture Scalability 286

DZone

OCTOBER 10, 2023

Enter IoT device management — the suite of tools and practices designed to monitor, maintain, and update these interconnected devices. Why IoT Device Management Matters Scalability : As industries and consumers increasingly adopt IoT, the number of devices can surge into the billions.

IoT 310

IoT Internet Internet Network 310

InfoQ

MARCH 7, 2024

The main drivers for creating a new architecture were challenges around reliability, scalability, observability/debugibility, as well as technical debt impeding the team’s ability to maintain the existing solution. By Rafal Gancarz

Scalability 128

Scalability Architecture Design Development 128

DZone

DECEMBER 28, 2020

Performances testing helps establish the scalability, stability, and speed of the software application. Confirming scalability, dependability, stability, and speed of the app is crucial. Therefore, designing and implementing such tests are crucial to ensure the stability of the website.

Performance Testing 230

Performance Testing Testing Tools Testing Performance 230

DZone

JULY 10, 2024

Effective API management is critical to ensuring that these interfaces are secure, scalable, and maintainable. This article explores the essential best practices for API management, providing insights into design principles, security measures, performance optimization, lifecycle management, documentation strategies, etc.

Best Practices 227

Best Practices Software Architecture Strategy Scalability 227

InfoQ

JANUARY 25, 2023

In this article, Rogerio Robetti discusses the challenges in auto-scaling stateful storage systems and proposes an opinionated design solution to automatically scale up (vertical) and scale out (horizontal) from a single node up to several nodes in a cluster with minimum configuration and interference of the operator. By Rogerio Robetti

Design 144

Design Systems Storage Data Engineering 144

Scalegrid

MAY 13, 2020

It’s architecture was specially designed to manage large-scale data warehouses and business intelligence workloads by giving you the ability to spread your data out across a multitude of servers. Greenplum uses an MPP database design that can help you develop a scalable, high performance deployment. At a glance – TLDR.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

DZone

MARCH 22, 2023

It is designed to be highly scalable, fault-tolerant, and cloud-agnostic, running on multiple cloud platforms and on-premise environments. Kubernetes (sometimes called K8s) is an open-source container-orchestration system that simplifies the deployment, scaling, and management of containerized applications.

Open Source 253

Open Source Scalability Architecture Cloud 253

DZone

SEPTEMBER 11, 2024

Regarding contemporary software architecture, distributed systems have been widely recognized for quite some time as the foundation for applications with high availability, scalability, and reliability goals. Spring Boot's default codes and annotation setup lessen the time it takes to design an application.

Systems 249

Systems Java Software Architecture Programming 249

Dynatrace

DECEMBER 3, 2024

This year’s AWS re:Invent will showcase a suite of new AWS and Dynatrace integrations designed to enhance cloud performance, security, and automation. The rapid evolution of cloud technology continues to shape how businesses operate and compete.

AWS 256

AWS Cloud Performance Innovation 256

DZone

JANUARY 17, 2022

To design a scalable Android application in a multi-core device environment, an Android developer must be able to create concurrent execution lines that mix and match data from many resources.

Mobile 264

Mobile Performance Monitoring Scalability 264

DZone

JULY 12, 2023

In the world of cloud computing, virtual machines (VMs) have revolutionized the way businesses operate by providing scalable and flexible computing resources. These VMs are designed to handle workloads that have varying resource requirements and can adapt to changing demands dynamically. What Are Azure B Series Virtual Machines?

Azure 246

Azure Virtualization Scalability Cloud 246

Dynatrace

MARCH 14, 2023

Amazon’s new general-purpose Linux for AWS is designed to provide a secure, stable, and high-performance execution environment to develop and run cloud applications.

AWS 292

AWS Lambda Serverless Virtualization 292

The Netflix TechBlog

FEBRUARY 18, 2022

To this end, we developed a Rapid Event Notification System (RENO) to support use cases that require server initiated communication with devices in a scalable and extensible manner. This is not an easy task, considering the wide variety of supported devices and the sheer volume of actions our members perform.

Systems 334

Systems Traffic Architecture Mobile 334