The Netflix TechBlog

JULY 15, 2021

I was later hired into my first purely data gig where I was able to deepen my knowledge of big data. After that, I joined MySpace back at its peak as a data engineer and got my first taste of data warehousing at internet-scale. In the data engineering space, very little of the same technology remains.

Data Engineering 197

Data Engineering Engineering Entertainment Big Data 197

Dynatrace

JUNE 29, 2022

Hybrid cloud architecture is a computing environment that shares data and applications on a combination of public clouds and on-premises private clouds. Public cloud refers to on-demand infrastructure and services provided by a third party over the public internet. With public clouds, multiple organizations share resources.

Infrastructure 246

Infrastructure Cloud Azure AWS 246

The Netflix TechBlog

APRIL 29, 2019

Content is placed on the network of servers in the Open Connect CDN as close to the end user as possible, improving the streaming experience for our customers and reducing costs for both Netflix and our Internet Service Provider (ISP) partners. Many of the components of the orchestration service are written in Python.

Open Source 280

Open Source Network Infrastructure Big Data 280

All Things Distributed

NOVEMBER 5, 2015

The new region, coupled with the existing AWS regions in Dublin and Frankfurt, will provide customers with quick, low-latency access to websites, mobile applications, games, SaaS applications, big data analysis, Internet of Things (IoT) applications, and more.

AWS 167

AWS Retail Entertainment IoT 167

The Netflix TechBlog

JUNE 20, 2024

SQLMesh, an open-source project born from our collective experience at companies like Airbnb, Apple, Google, and Netflix, is designed to handle the complexities of evolving data pipelines at an internet scale. To handle errors efficiently, Netflix developed a rule-based classifier for error classification called “Pensive.”

Data Engineering 206

Data Engineering Engineering Entertainment Software Engineering 206

DZone

JUNE 6, 2023

This can include the use of cloud computing, artificial intelligence, big data analytics, the Internet of Things (IoT), and other digital tools. The digital transformation of businesses involves the adoption of digital technologies to change the way companies operate and deliver value to their customers.

Artificial Intelligence 130

Artificial Intelligence Systems IoT Testing 130

All Things Distributed

DECEMBER 13, 2016

With the launch of the AWS Europe (London) Region, AWS can enable many more UK enterprise, public sector and startup customers to reduce IT costs, address data locality needs, and embark on rapid transformations in critical new areas, such as big data analysis and Internet of Things. Fraud.net is a good example of this.

AWS 155

AWS Cloud Artificial Intelligence IoT 155

All Things Distributed

SEPTEMBER 29, 2016

The new European region, coupled with the existing AWS Regions in Dublin and Frankfurt, and a future one in London, will provide customers with quick, low-latency access to websites, mobile applications, games, SaaS applications, Big Data analysis, Internet of Things applications, and more.

AWS 158

AWS IoT Internet Internet 158

The Netflix TechBlog

SEPTEMBER 18, 2020

I bring my breadth of big data tools and technologies while Julie has been building statistical models for the past decade. They are continuously innovating compression algorithms to efficiently send high quality audio and video files to our customers over the internet. Do they cause less errors?

Analytics 230

Analytics Education Innovation Engineering 230

The Netflix TechBlog

MAY 26, 2020

By default, each record captures a network internet protocol (IP) traffic flow (characterized by a 5-tuple on a per network interface basis) that occurs within an aggregation interval. These characteristics allow for an on-call response time that is relaxed and more in line with traditional big data analytical pipelines.

Network 154

Network Tuning AWS Big Data 154

All Things Distributed

DECEMBER 5, 2010

DNS is one of the fundamental building blocks of internet applications and was high on the wish list of our customers for some time already. DNS is an absolutely critical piece of the internet infrastructure. The Domain Name System is a wonderful practical piece of technology; it is a fundamental building block of our modern internet.

Cloud 113

Cloud Internet Internet AWS 113

Highly Scalable

MARCH 1, 2012

There is a huge array of log records with information about internet users and their visits from different sites ( click stream ). The main idea of this technique is to use an index to find data that meets a criteria, but aggregate data using original representation or full scans. Let’s consider an example.

Database 279

Database Ecommerce Efficiency Engineering 279

All Things Distributed

JUNE 20, 2017

Then too, Internet service providers can shut down their services any time they feel threatened by the DDoS attacks. Hong Kong's largest listed multimedia group, Next Digital , operates businesses spanning Hong Kong, Taiwan, Japan, and the United States.

AWS 126

AWS Logistics Cloud Social Media 126

All Things Distributed

MAY 24, 2011

Elastic Load Balancing now provides support for EC2 Security Groups such that customers that hosts their Internet accessible application instances behind ELB can build security rules that for example restrict traffic to only the ELB instances that front them. Introducing a new Internet protocol is not a simple feat.

Internet 96

Internet Internet AWS Scalability 96

Highly Scalable

MAY 1, 2012

Statistical analysis and mining of huge multi-terabyte data sets is a common task nowadays, especially in the areas like web analytics and Internet advertising. Analysis of such large data sets often requires powerful distributed data stores like Hadoop and heavy data processing with techniques like MapReduce.

Analytics 191

Analytics Traffic Big Data Efficiency 191

All Things Distributed

JANUARY 6, 2016

A region in South Korea has been highly requested by companies around the world who want to take full advantage of Korea’s world-leading Internet connectivity and provide their customers with quick, low-latency access to websites, mobile applications, games, SaaS applications, and more.

AWS 99

AWS Cloud Games Latency 99

All Things Distributed

MARCH 28, 2011

Our smart phones and tablets are obvious examples, but many other devices are quickly gaining these capabilities; TV Sets and Hifi systems are internet enabled, and soon our treadmills and automobiles will be equally plugged into the digital world. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications.

AWS 123

AWS Cloud Storage Internet 123

All Things Distributed

APRIL 4, 2017

Scania is planning to use AWS for their connected vehicle systems, which allows truck owners to track their vehicles, collect real-time running data, and run diagnostics to understand when maintenance is needed to reduce vehicle downtime.

AWS 107

AWS Airlines Latency Games 107

All Things Distributed

MARCH 24, 2011

Over the past years The Next Web Conference has become a premier conference on internet life and its technologies. Up to 200 developers and designers will get together to hack up interesting applications using the Internets APIs and SDKs. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications.

AWS 75

AWS Internet Internet Storage 75

All Things Distributed

JANUARY 11, 2011

The one thing that I have always struggled with during my travels are the data plans of the cell phone companies. For an internet road warrior they are a complete nightmare. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics.

Wireless 87

Wireless AWS Internet Internet 87

All Things Distributed

DECEMBER 14, 2011

a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. Countdown to What is Next in AWS. Expanding the Cloud â?? Introducing the AWS South America (Sao Paulo) Region. Expanding the Cloud - Introducing Amazon ElastiCache.

AWS 105

AWS Latency Storage Cloud 105

All Things Distributed

AUGUST 22, 2011

a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. Countdown to What is Next in AWS. Expanding the Cloud â?? Introducing the AWS South America (Sao Paulo) Region. Expanding the Cloud - Introducing Amazon ElastiCache.

Cloud 106

Cloud Cache AWS Storage 106

All Things Distributed

AUGUST 16, 2011

Government and Big Data. One particular early use case for AWS GovCloud (US) will be massive data processing and analytics. Several agencies of very different parts of the government have needs for data analytics that really put the Big in Big-Data, sometimes several orders of magnitude larger than commonly found in industry.

AWS 90

AWS Government Big Data Cloud 90

All Things Distributed

JULY 7, 2011

AWS Import/Export transfers data off of storage devices using Amazons high-speed internal network and bypassing the Internet. With this new functionality AWS Import/Export now supports importing data directly into Amazon EBS snapshots. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications.

AWS 77

AWS Cloud Storage Internet 77

All Things Distributed

MARCH 2, 2011

a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. Countdown to What is Next in AWS. Expanding the Cloud â?? Introducing the AWS South America (Sao Paulo) Region. Expanding the Cloud - Introducing Amazon ElastiCache.

AWS 92

AWS Cloud Games Latency 92

All Things Distributed

AUGUST 17, 2011

a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. Countdown to What is Next in AWS. Expanding the Cloud â?? Introducing the AWS South America (Sao Paulo) Region. Expanding the Cloud - Introducing Amazon ElastiCache.

Servers 111

Servers Social Media AWS Website 111

All Things Distributed

JUNE 26, 2016

AdiMap uses Amazon Kinesis to process real-time streaming online ad data and job feeds, and processes them for storage in petabyte-scale Amazon Redshift. Advanced problem solving that connects big data with machine learning. warehouses to glean business insights for jobs, ad spend, or financials for mobile apps.

AWS 77

AWS Cloud Healthcare Blockchain 77

All Things Distributed

APRIL 27, 2011

a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. Countdown to What is Next in AWS. Expanding the Cloud â?? Introducing the AWS South America (Sao Paulo) Region. Expanding the Cloud - Introducing Amazon ElastiCache.

Technology 129

Technology Technology AWS Storage 129

All Things Distributed

FEBRUARY 25, 2011

a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. Countdown to What is Next in AWS. Expanding the Cloud â?? Introducing the AWS South America (Sao Paulo) Region. Expanding the Cloud - Introducing Amazon ElastiCache.

AWS 98

AWS Cloud Scalability Storage 98

All Things Distributed

JUNE 29, 2011

a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. Countdown to What is Next in AWS. Expanding the Cloud â?? Introducing the AWS South America (Sao Paulo) Region. Expanding the Cloud - Introducing Amazon ElastiCache.

AWS 84

AWS Retail Innovation Strategy 84

All Things Distributed

FEBRUARY 23, 2011

a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. Countdown to What is Next in AWS. Expanding the Cloud â?? Introducing the AWS South America (Sao Paulo) Region. Expanding the Cloud - Introducing Amazon ElastiCache.

AWS 67

AWS Storage Big Data Servers 67

All Things Distributed

NOVEMBER 30, 2016

Today, I want to focus on helping app developers who have chosen to develop their apps on AWS and have in the past developed some of the seminal apps of our times on AWS, such as Netflix, AirBnB, or Pinterest or created internet connected devices powered by AWS such as Alexa and Dropcam.

AWS 153

AWS Lambda Artificial Intelligence Mobile 153

All Things Distributed

DECEMBER 9, 2010

By supporting such large object sizes, Amazon S3 better enables a variety of interesting big data use cases. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. For example, a 2-hour movie on Blu-ray can be 50 gigabytes.

AWS 68

AWS Big Data Scalability Storage 68

All Things Distributed

JANUARY 19, 2011

a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. Countdown to What is Next in AWS. Expanding the Cloud â?? Introducing the AWS South America (Sao Paulo) Region. Expanding the Cloud - Introducing Amazon ElastiCache.

AWS 100

AWS Cloud Java Scalability 100

All Things Distributed

FEBRUARY 27, 2011

a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. Countdown to What is Next in AWS. Expanding the Cloud â?? Introducing the AWS South America (Sao Paulo) Region. Expanding the Cloud - Introducing Amazon ElastiCache.

AWS 60

AWS Storage Big Data Scalability 60

All Things Distributed

SEPTEMBER 29, 2010

a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. Countdown to What is Next in AWS. Expanding the Cloud â?? Introducing the AWS South America (Sao Paulo) Region. Expanding the Cloud - Introducing Amazon ElastiCache.

AWS 63

AWS Storage Big Data Scalability 63

All Things Distributed

AUGUST 19, 2011

a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. Countdown to What is Next in AWS. Expanding the Cloud â?? Introducing the AWS South America (Sao Paulo) Region. Expanding the Cloud - Introducing Amazon ElastiCache.

AWS 66

AWS Database Storage Scalability 66