The Netflix TechBlog

JANUARY 25, 2023

Scalable Annotation Service — Marken by Varun Sekhri , Meenakshi Jindal Introduction At Netflix, we have hundreds of micro services each with its own data models or entities. With the growing number of annotations and its usage across the studio applications, prioritizing scalability becomes essential.

Scalability 288

Scalability Latency Media Architecture 288

High Scalability

JANUARY 3, 2022

Design an instant messenger platform such as WhatsApp or Signal which users can utilize tosend messages to each other. Currently, he is in the Alexa Shopping organization where he is developing machine-learning-based solutions to send personalized reorder hints to customers for improving their experience. Problem Statement.

Design 344

Design Servers Engineering Development 344

High Scalability

JANUARY 17, 2022

Design a location-based social search application similar to Tinder which if often used as a dating service. Currently, he is in the Alexa Shopping organization where he is developing machine-learning-based solutions to send personalized reorder hints to customers for improving their experience. Problem Statement.

Design 334

Design Engineering Development 334

DZone

JANUARY 20, 2023

Having a distributed and scalable graph database system is highly sought after in many enterprise scenarios. Do Not Be Misled Designing and implementing a scalable graph database system has never been a trivial task.

Scalability 199

Scalability Big Data Hardware Internet 199

DZone

JANUARY 19, 2024

A transformative journey into the realm of system design with our tutorial, tailored for software engineers aspiring to architect solutions that seamlessly scale to serve millions of users.

Systems 189

Systems Design Software Engineering Scalability 189

DZone

AUGUST 9, 2023

Machine learning (ML) has seen explosive growth in recent years, leading to increased demand for robust, scalable, and efficient deployment methods. This article proposes a technique using Docker, an open-source platform designed to automate application deployment, scaling, and management, as a solution to these challenges.

Scalability 246

Scalability Best Practices Open Source Virtualization 246

High Scalability

DECEMBER 13, 2021

Design a video streaming platform similar to Netflix where content creators can upload their video content and viewers are able to play video on different devices. Problem Statement. We should also be able to store user statistics of the videos such as number of views, video watched duration, and so forth.

Design 329

Design Engineering Development 329

High Scalability

JANUARY 25, 2022

This is a guest post by Ankit Sirmorya. Ankit is working as a Machine Learning Lead/Sr. Machine Learning Engineer at Amazon and has led several machine-learning initiatives across the Amazon ecosystem. Ankit has been working on applying machine learning to solve ambiguous business problems and improve customer experience.

Design 329

Design Engineering Development 329

DZone

OCTOBER 9, 2024

The Scheduler service enables this and is designed to address the performance and scalability improvements on Actor reminders and the Workflow API. In this post, I am going to deep dive into the details of how the Scheduler service was designed and its implementation to give you some background. Prior to v1.14 Prior to v1.14

Scalability 317

Scalability Design Database Processing 317

Dynatrace

NOVEMBER 3, 2023

that offers security, scalability, and simplicity of use. are technologically very different, Python and JMX extensions designed for Extension Framework 1.0 Python code also carries limited scalability and the burden of governing its security in production environments and lifecycle management. Extensions 2.0 Extensions 2.0

Technology 255

Technology Technology Scalability Availability 255

The Netflix TechBlog

SEPTEMBER 15, 2021

By Ricky Gardiner , Alex Borysov Background In our previous post , we discussed how we utilize FieldMask as a solution when designing our APIs so that consumers can request the data they need when fetched via gRPC. This solution is not scalable. What if we want to update more than one field and do it atomically in a single RPC?

Design 237

Design Scalability Engineering Performance 237

InfoQ

SEPTEMBER 23, 2024

Netflix’s engineers implemented many improvements across the Pushy ecosystem to ensure the platform's scalability and reliability and support new capabilities. By Rafal Gancarz

Scalability 97

Scalability Engineering Cache Design 97

InfoQ

MARCH 7, 2024

The main drivers for creating a new architecture were challenges around reliability, scalability, observability/debugibility, as well as technical debt impeding the team’s ability to maintain the existing solution. By Rafal Gancarz

Scalability 128

Scalability Architecture Design Development 128

DZone

SEPTEMBER 23, 2024

With the rise of microservices architecture , there has been a rapid acceleration in the modernization of legacy platforms, leveraging cloud infrastructure to deliver highly scalable, low-latency, and more responsive services. Why Use Spring WebFlux?

Performance 287

Performance Latency Architecture Programming 287

DZone

AUGUST 14, 2024

When building ETL data pipelines using Azure Data Factory (ADF) to process huge amounts of data from different sources, you may often run into performance and design-related challenges. This article will serve as a guide in building high-performance ETL pipelines that are both efficient and scalable.

Azure 306

Azure Cloud Scalability Efficiency 306

Smashing Magazine

JANUARY 3, 2022

Composition-Based Design System In Figma. Composition-Based Design System In Figma. Working as a designer on a design system for a large product has taught me how precious the time you spend on a single task/component is. Things advance fast, and I try to keep up making it work for both designers and developers.

Design 141

Design Systems Code Scalability 141

InfoQ

JANUARY 12, 2024

The revised architecture improved scalability and deployability and reduced resource utilization. The team at lastminute.com rearchitected the search result aggregation process by breaking up the single service into multiple ones and introducing asynchronous integration. By Rafal Gancarz

Scalability 105

Scalability Architecture Processing Development 105

Dynatrace

MAY 5, 2020

We’re therefore excited to announce that Dynatrace has received the Amazon RDS Service Ready designation. Achieving this designation differentiates Dynatrace as an AWS Advanced Technology Partner with a product that is integrated with Amazon RDS and is generally available and fully supported.

Design 145

Design AWS Education Innovation 145

High Scalability

NOVEMBER 9, 2018

AMD is now using the second-gen Infinity Fabric to connect a multi-chip design with a 14nm I/O die serving as the linchpin of the design. That central chip ties together the 7nm CPU chiplets, creating a massively scalable architecture. AMD has improved the Infinity Fabric. Doubleagent has reached the maximum level of 110.".

Internet 192

Internet Internet Scalability Blockchain 192

Dynatrace

MARCH 29, 2024

As organizations continue to expand within cloud-native environments using Google Cloud, ensuring scalability becomes a top priority. Visit Dynatrace booth #1141 during the event to explore how its real-time insights and optimization capabilities ensure seamless scalability and performance.

Google 273

Google Innovation Cloud Analytics 273

Uber Engineering

AUGUST 18, 2020

The making of Edge Gateway, the highly-available and scalable self-serve gateway to configure, manage, and monitor APIs of every business domain at Uber. In October 2014, Uber had started its journey of scale in what … The post Designing Edge Gateway, Uber’s API Lifecycle Management Platform appeared first on Uber Engineering Blog.

Design 144

Design Scalability Engineering Monitoring 144

DZone

JUNE 12, 2019

A system that has the ability to easily scale resources to meet the increasing workload without affecting the performance is known as a scalable system. An architect should focus on designing a scalable software architecture from the early phase of the product life cycle.

Scalability 100

Scalability Software Architecture Storage Architecture 100

Uber Engineering

JANUARY 12, 2016

The making of Schemaless, Uber Engineering’s custom designed datastore using MySQL, which has allowed us to scale from 2014 to beyond. In Project Mezzanine we described … The post Designing Schemaless, Uber Engineering’s Scalable Datastore Using MySQL appeared first on Uber Engineering Blog.

Scalability 102

Scalability Design Engineering Database 102

DZone

OCTOBER 7, 2024

By designing an infrastructure capable of handling multiple GPU SKUs (such as NVIDIA, AMD, and potentially Intel), businesses can achieve a flexible and cost-efficient system that is resilient to supply chain delays and able to leverage diverse hardware capabilities. Why Choose In-House Model Serving Infrastructure?

Infrastructure 173

Infrastructure Azure Hardware AWS 173

Smashing Magazine

AUGUST 18, 2020

Inspired Design Decisions With Bradbury Thompson: The Art Of Graphic Design. Inspired Design Decisions With Bradbury Thompson: The Art Of Graphic Design. I learned how to channel my often rebellious attitude to conventional design thinking to develop novel solutions to often everyday design problems.

Design 122

Design Media Entertainment Website 122

DZone

JANUARY 24, 2024

These storage alternatives have been designed to meet a range of requirements, including performance, scalability, durability, and price. These storage options are intended to suit certain needs, such as scalability, durability, performance, and cost-effectiveness.

Storage 276

Storage Cloud Scalability Design 276

InfoQ

JANUARY 25, 2023

In this article, Rogerio Robetti discusses the challenges in auto-scaling stateful storage systems and proposes an opinionated design solution to automatically scale up (vertical) and scale out (horizontal) from a single node up to several nodes in a cluster with minimum configuration and interference of the operator. By Rogerio Robetti

Design 144

Design Systems Storage Data Engineering 144

DZone

JANUARY 31, 2024

At the heart of this decision lies a crucial question: should these teams lay the groundwork with a microservice architecture, known for its distributed and decentralized nature, or opt for a monolithic design, where the entire application is unified and interdependent?

Architecture 289

Architecture Scalability Design Engineering 289

DZone

JULY 10, 2024

Effective API management is critical to ensuring that these interfaces are secure, scalable, and maintainable. This article explores the essential best practices for API management, providing insights into design principles, security measures, performance optimization, lifecycle management, documentation strategies, etc.

Best Practices 222

Best Practices Software Architecture Strategy Scalability 222

High Scalability

OCTOBER 5, 2018

Because the device in question is a high-speed unit designed to process a high volume of ballots for an entire county, hacking just one of these machines could enable anattacker to flip the Electoral College and determine the outcome of a presidential election?. They'll love it and you'll be their hero forever. So many more quotes.

Internet 156

Internet Internet Scalability Software Engineering 156

DZone

SEPTEMBER 11, 2024

Regarding contemporary software architecture, distributed systems have been widely recognized for quite some time as the foundation for applications with high availability, scalability, and reliability goals. Spring Boot's default codes and annotation setup lessen the time it takes to design an application.

Systems 246

Systems Java Software Architecture Programming 246

DZone

SEPTEMBER 18, 2024

This case study discusses the problems, principles of architecture, and best practices that I implemented in order to create a scalable country-agnostic customer-agnostic platform supporting both B2B and B2C transactions.

Best Practices 147

Best Practices Scalability Architecture Network 147

Smashing Magazine

JANUARY 5, 2022

Ten Tips For The Aspiring Designer Beginners (Part 1). Ten Tips For The Aspiring Designer Beginners (Part 1). In this article, I want to share ten tips that helped me grow and become a better designer, and I hope these tips will also help you while you’re trying to find more solid ground under your feet. Luis Ouriach.

Design 128

Design Website Social Media Best Practices 128

DZone

DECEMBER 27, 2023

As organizations increasingly embrace the microservices approach, the need for a resilient testing framework becomes important for the reliability, scalability , and security of these distributed systems. What Is MRTF? In embracing a holistic and collaborative approach, let’s start by explaining the cornerstones of MRTF.

Testing 228

Testing Scalability Architecture Design 228

DZone

DECEMBER 4, 2023

As organizations seek more robust, scalable, and reliable solutions for deploying and managing containerized applications , Kubernetes emerges as the clear frontrunner. Kubernetes , on the other hand, is an open-source platform designed to automate the deployment, scaling, and operation of application containers.

Best Practices 328

Best Practices Open Source Scalability Design 328

All Things Distributed

MARCH 19, 2018

At AWS, we continue to strive to enable builders to build cutting-edge technologies faster in a secure, reliable, and scalable fashion. While building Amazon SageMaker and applying it for large-scale machine learning problems, we realized that scalability is one of the key aspects that we need to focus on. Streaming algorithms.

Scalability 146

Scalability Hardware AWS Tuning 146

InfoQ

MARCH 15, 2024

Hashnode created a scalable event-driven architecture (EDA) for composing feed data for thousands of users. The company used serverless services on AWS, including Lambda, Step Functions, EventBridge, and Redis Cache. The solution leverages Step Functions' distributed maps feature that enables high-concurrency processing. By Rafal Gancarz

Scalability 76

Scalability AWS Architecture Lambda 76