The Netflix TechBlog

FEBRUARY 18, 2022

Motivation With the rapid growth in Netflix member base and the increasing complexity of our systems, our architecture has evolved into an asynchronous one that enables both online and offline computation. While a mobile device is almost always connected to the internet and reachable, a smart TV is only online while in use.

Systems 334

Systems Traffic Architecture Mobile 334

High Scalability

AUGUST 3, 2018

David Rosenthal : The margins on AWS, averaging 24.75% over the last twelve quarters, are what enables Amazon to run the US retail business averaging under 3% margin and the international business averaging -3.7% Stacey Higginbotham : a startup in France called GreenWaves Technologies has built a dedicated chip for the Internet of Things.

Internet 113

Internet Internet Scalability Blockchain 113

All Things Distributed

AUGUST 17, 2012

Back-to-Basics Weekend Reading - Staged Event-Driven Architecture. I am in São Paolo, Brazil for the 2012 AWS Latin America Summit and for The Next Web Latin America conference. I will also be visiting Chile and Mexico on this trip and have the great fortune to meet many of our Latin American AWS customers. Comments ().

Architecture 76

Architecture AWS Internet Internet 76

All Things Distributed

JULY 14, 2015

In just three short years, Amazon DynamoDB has emerged as the backbone for many powerful Internet applications such as AdRoll , Druva , DeviceScape , and Battlecamp. In traditional database architectures, database engines often run a small search engine or data warehouse engines on the same hardware as the database. DynamoDB Streams.

Database 158

Database Lambda AWS IoT 158

Adrian Cockcroft

MAY 6, 2023

Then they tried to scale it to cope with high traffic and discovered that some of the state transitions in their step functions were too frequent, and they had some overly chatty calls between AWS lambda functions and S3. which provides this as a service and where the chief architect and CTO are both ex-Netflix colleagues of mine.

Serverless 145

Serverless Lambda Best Practices Traffic 145

All Things Distributed

JANUARY 18, 2012

a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Today is a very exciting day as we release Amazon DynamoDB , a fast, highly reliable and cost-effective NoSQL database service designed for internet scale applications. By Werner Vogels on 18 January 2012 07:00 AM. Comments ().

Scalability 162

Scalability Database Ecommerce Latency 162

All Things Distributed

MARCH 13, 2019

At the same time, modern internet workloads have become more demanding and require several essential properties from infrastructure: Users want to start with a small footprint and then grow massively without infrastructure limiting their velocity. Since Aurora's original release, it has been the fastest-growing service in the history of AWS.

Database 135

Database Design Cloud AWS 135

All Things Distributed

DECEMBER 5, 2010

DNS is one of the fundamental building blocks of internet applications and was high on the wish list of our customers for some time already. Route 53 has the business properties that you have come to expect from an AWS service: fully self-service and programmable, with transparent pay-as-you-go pricing and no minimum usage commitments.

Cloud 113

Cloud Internet Internet AWS 113

The Netflix TechBlog

MAY 26, 2020

Service Segmentation: The ease of the cloud deployments has led to the organic growth of multiple AWS accounts, deployment practices, interconnection practices, etc. VPC Flow Logs VPC Flow Logs is an AWS feature that captures information about the IP traffic going to and from network interfaces in a VPC. 43416 5001 52.213.180.42

Network 154

Network Tuning AWS Traffic 154

All Things Distributed

MARCH 13, 2019

At the same time, modern internet workloads have become more demanding and require several essential properties from infrastructure: Users want to start with a small footprint and then grow massively without infrastructure limiting their velocity. No one wants a single system failure to have a large impact on their business.

Database 132

Database Design Cloud AWS 132

All Things Distributed

APRIL 27, 2011

Look inside a current textbook on software architecture, and youll find few patterns that we dont apply at Amazon. Service-oriented architecture -- or SOA -- is the fundamental building abstraction for Amazon technologies. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway.

Technology 129

Technology Technology AWS Storage 129

All Things Distributed

NOVEMBER 15, 2010

Building general purpose architectures has always been hard; there are often so many conflicting requirements that you cannot derive an architecture that will serve all, so we have often ended up focusing on one side of the requirements that allow you to serve that area really well. From CPU to GPU.

AWS 125

AWS Programming Latency Architecture 125

All Things Distributed

MARCH 28, 2011

Our smart phones and tablets are obvious examples, but many other devices are quickly gaining these capabilities; TV Sets and Hifi systems are internet enabled, and soon our treadmills and automobiles will be equally plugged into the digital world. Driving Storage Costs Down for AWS Customers. Countdown to What is Next in AWS.

AWS 123

AWS Cloud Storage Internet 123

All Things Distributed

JUNE 26, 2016

In June 2015, Amazon Web Services announced that it would launch a new AWS infrastructure region in India. Examples of continuous sensing are found in the managed cloud platform built by Rachio on AWS IoT to enable the secure interaction of its connected devices with cloud applications/other devices. The opportunity to revolutionize.

AWS 77

AWS Cloud Healthcare Blockchain 77

All Things Distributed

AUGUST 19, 2011

Job Openings in AWS - Senior Leader in Database Services. This week it is an opening for senior leaders with AWS Database Services. AWS Database Services is responsible for setting the database strategy and delivering distributed structured storage services to our AWS customers. Countdown to What is Next in AWS.

AWS 66

AWS Database Storage Scalability 66

Scalegrid

JUNE 7, 2024

In this article, we will explore what RabbitMQ is, its mechanisms to facilitate message queueing, its role within software architectures, and the tangible benefits it delivers in real-world scenarios. It acts as a producer that delivers these messages to the message broker, storing and waiting for consumers to retrieve and process them.

IoT 130

IoT Software Architecture Architecture Scalability 130

High Scalability

OCTOBER 24, 2022

You can even go old school and use non cloud-native architectures. For example, AWS created Nitro. Would Nitro have been invented if AWS was restricted to being a platform provider? And we have k8s striving to become a cloud in a box droppable into any datacenter. You can switch between clouds with effort. It has been done.

Cloud 187

Cloud Hardware Infrastructure Innovation 187

All Things Distributed

JULY 13, 2010

Additionally, many high-end HPC applications take advantage of knowing their in-house hardware platforms to achieve major speedup by exploiting the specific processor architecture. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Countdown to What is Next in AWS. until today.

Cloud 98

Cloud AWS Automotive Latency 98

DZone

SEPTEMBER 19, 2019

Time is money , especially in the age of the Internet. If you have a serverless architecture , cold starts can cause these lags. In fact, users decide within 8 seconds if they're going to continue using your service. Frequent lags can destroy your reputation.

Serverless 100

Serverless Internet Internet Architecture 100

All Things Distributed

OCTOBER 8, 2014

Since launch, DynamoDB has been the core infrastructure powering various AWS and Amazon services and has provided more than 5 9s of availability worldwide. JSON has become the accepted medium for interchange between numerous Internet services. NoSQL and Flexibility: Document Model. The DynamoDB team is launching document model support.

Availability 124

Availability Performance Scalability AWS 124

All Things Distributed

SEPTEMBER 30, 2010

With existing customers I get a change to dive deep on their AWS usage and understand what works well and where we can do better. Visiting future customers is equally exiting as you get a change to understand their current architecture, if it is a migration, and how they plan to exploit cloud services in their new setup. All postings.

AWS 66

AWS Cloud Storage Best Practices 66

All Things Distributed

NOVEMBER 19, 2010

Understanding Throughput-Oriented Architectures - background article in CACM on massively parallel and throughput vs latency oriented architectures. The Big Idea: Biomimetic Architecture - The National Geographic came in the mail this week with a beautiful pull-out of Gaudís Sagrada Família, the online version is only a summary.

AWS 62

AWS Cloud Benchmarking Storage 62

The Symphonia

MARCH 14, 2018

AWS announced a new service?—?the The general goal of SAR is to make it easier to distribute, and consume, applications that have been developed using AWS Serverless products, like Lambda. SAM itself is built on top of AWS CloudFormation ?—?Amazon’s the Serverless Application Repository (SAR)?—?at at re:Invent 2017.

Serverless 40

Serverless AWS Lambda Open Source 40

Enprowess

JANUARY 12, 2022

Internet of Things (IoT). Serverless Architecture. Besides that, these apps do well in areas with a slow internet connection. So it is convenient for all to use irrespective of internet speed and it works offline using cached data. Internet of Things (IoT). List of Top Web Development Trends to Track in 2022.

Blockchain 59

Blockchain IoT Development Serverless 59

All Things Distributed

DECEMBER 12, 2013

When designing a new application that will operate in the AWS cloud, first take a look at DynamoDB when selecting a database. The enhanced query flexibility that global and local secondary indexes provide means DynamoDB can support an even broader range of workloads.

Games 109

Games Scalability Database Retail 109

Smashing Magazine

JUNE 25, 2020

Small projects benefit from simple architecture. For example, if you were planning to store your files in AWS S3, you’d want to do the following, which is very similar to the process of storing files with Google Cloud, Azure, Backblaze, or similar competing services. Option 1: Default Django.

Media 77

Media Cache Storage AWS 77

Brendan Gregg

FEBRUARY 28, 2023

Titus, the Netflix container management platform, is now open source,” [link] Apr 2018 - [Cutress 19] Dr. [link] 2021 - [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] Apr 2021 - [Ghigoff 21] Yoann Ghigoff, et al., "BMC:

Performance 103

Performance Latency Cache Virtualization 103

All Things Distributed

DECEMBER 20, 2017

Developments like cloud computing, the internet of things, artificial intelligence, and machine learning are proving that IT has (again) become a strategic business driver. Breuninger, a fashion department store chain steeped in tradition, has recognized this and relies on a self-developed e-commerce platform in the AWS Cloud.

Artificial Intelligence 70

Artificial Intelligence Social Media Logistics AWS 70

VoltDB

JUNE 1, 2017

Bear in mind that the internet currently takes 4ms from New York to Philadelphia. Instead of having a private cloud architecture that’s cookie-cuttered to multiple locations, we’ll need centralized management of herds of up to 1,000 private clouds. Some of these will serve large urban areas and will be sensitive to efficiency.

Hardware 56

Hardware Latency Virtualization Cloud 56

ScaleOut Software

JANUARY 9, 2020

It can receive telemetry from retail stores over the Internet using event delivery systems such as Azure IoT Event Hub, AWS, Kafka, and REST, and it can respond back to the retail stores in milliseconds.

Logistics 52

Logistics Retail Analytics Azure 52

ScaleOut Software

JANUARY 9, 2020

It can receive telemetry from retail stores over the Internet using event delivery systems such as Azure IoT Event Hub, AWS, Kafka, and REST, and it can respond back to the retail stores in milliseconds.

Logistics 52

Logistics Retail Analytics Azure 52

ScaleOut Software

JANUARY 9, 2020

It can receive telemetry from retail stores over the Internet using event delivery systems such as Azure IoT Event Hub, AWS, Kafka, and REST, and it can respond back to the retail stores in milliseconds.

Logistics 52

Logistics Retail Analytics Azure 52

The Symphonia

DECEMBER 6, 2017

The light show at the re:Play party Another re:Invent has come and gone, and us mere AWS-using mortals are now rapidly trying to sort the wheat from the chaff of a heady harvest of announcements. It’s funny to think that AWS Lambda was announced at re:Invent only 3 years ago?—?the skip to the end if you want my take on those.

Serverless 40

Serverless Lambda AWS Traffic 40

ScaleOut Software

MAY 19, 2020

It’s ideal for a wide range of applications, including real-time intelligent monitoring (the example above), Industrial Internet of Things (IIoT), logistics, security and disaster recovery, e-commerce recommendations, financial services, and much more. The ScaleOut Digital Twin Streaming Service is available now.

Logistics 52

Logistics IoT Analytics Azure 52

ScaleOut Software

MAY 19, 2020

It’s ideal for a wide range of applications, including real-time intelligent monitoring (the example above), Industrial Internet of Things (IIoT), logistics, security and disaster recovery, e-commerce recommendations, financial services, and much more. The ScaleOut Digital Twin Streaming Service is available now.

Logistics 52

Logistics IoT Analytics Azure 52

VoltDB

JUNE 1, 2017

Bear in mind that the internet currently takes 4ms from New York to Philadelphia. Instead of having a private cloud architecture that’s cookie-cuttered to multiple locations, we’ll need centralized management of herds of up to 1,000 private clouds. Some of these will serve large urban areas and will be sensitive to efficiency.

Hardware 40

Hardware Latency Virtualization Cloud 40

Testsigma

MAY 19, 2021

Sure cloud-based test automation tools solve all our architectural and server problems but so do millions of dollars in the bank account. So, how do you select one of the choices that are presented to you on the internet? You can also integrate Testsigma with Amazon AWS and Microsoft Azure. is a bad idea. Business Requirement.

DevOps 59

DevOps Cloud Artificial Intelligence Infrastructure 59