The Netflix TechBlog

JULY 15, 2021

Interview with Kevin Wylie This post is part of our “Data Engineers of Netflix” series, where our very own data engineers talk about their journeys to Data Engineering @ Netflix. Kevin Wylie is a Data Engineer on the Content Data Science and Engineering team. What drew you to Netflix?

Data Engineering 197

Data Engineering Engineering Entertainment Big Data 197

The Netflix TechBlog

OCTOBER 28, 2021

During earlier years of my career, I primarily worked as a backend software engineer, designing and building the backend systems that enable big data analytics. I developed many batch and real-time data pipelines using open source technologies for AOL Advertising and eBay.

Data Engineering 181

Data Engineering Engineering Big Data Software Engineering 181

Dynatrace

JULY 5, 2022

AIOps combines big data and machine learning to automate key IT operations processes, including anomaly detection and identification, event correlation, and root-cause analysis. For many organizations, adopting new technologies can add to management and monitoring challenges, which can slow the pace of transformation.

Artificial Intelligence 325

Artificial Intelligence Cloud Innovation Strategy 325

All Things Distributed

APRIL 27, 2011

The Amazon.com 2010 Shareholder Letter Focusses on Technology. In the 2010 Shareholder Letter Jeff Bezos writes about the unique technologies developed at Amazon.com over the years. Given that I have frequently written about many of these technologies on this blog I asked investor relations to be allowed to reprint it here.

Technology 127

Technology Technology AWS Storage 127

The Netflix TechBlog

SEPTEMBER 18, 2020

Part of our series on who works in Analytics at Netflix?—?and and what the role entails by Julie Beckley & Chris Pham This Q&A provides insights into the diverse set of skills, projects, and culture within Data Science and Engineering (DSE) at Netflix through the eyes of two team members: Chris Pham and Julie Beckley.

Analytics 230

Analytics Education Innovation Engineering 230

DZone

DECEMBER 28, 2020

The introduction of innovative technologies has brought the newest updates in software testing, development, design, and delivery. Digital transformation is yet another significant focus point for the sectors and the enterprises that are ranking top on cloud and business analytics. Besides, AI and ML seem to reach a new level.

Software 193

Software Software Testing Big Data 193

The Netflix TechBlog

JUNE 7, 2021

Cloud Network Insight is a suite of solutions that provides both operational and analytical insight into the cloud network infrastructure to address the identified problems. Netflix software infrastructure is a large distributed ecosystem that consists of specialized functional tiers that are operated on the AWS and Netflix owned services.

Network 327

Network Transportation AWS Cloud 327

Dynatrace

JULY 6, 2020

Our customers have frequently requested support for this first new batch of services, which cover databases, big data, networks, and computing. Use the technology overview and filter for Azure to access all newly added databases across all subscriptions. See the health of your big data resources at a glance.

Azure 227

Azure Cloud Big Data Virtualization 227

Dynatrace

OCTOBER 25, 2022

“AIOps platforms address IT leaders’ need for operations support by combining big data and machine learning functionality to analyze the ever-increasing volume, variety and velocity of data generated by IT in response to digital transformation.” – Gartner Market Guide for AIOps platforms. Evolution of modern AIOps.

DevOps 246

DevOps Big Data Cloud Innovation 246

Dynatrace

DECEMBER 15, 2022

As more organizations adopt cloud-native technologies, traditional approaches to IT operations have been evolving. Complex cloud computing environments are increasingly replacing traditional data centers. In fact, Gartner estimates that 80% of enterprises will shut down their on-premises data centers by 2025. So, what is ITOps?

Artificial Intelligence 246

Artificial Intelligence DevOps Hardware Virtualization 246

Dynatrace

MARCH 24, 2023

Container technology enables organizations to efficiently develop cloud-native applications or to modernize legacy applications to take advantage of cloud services. Apache Mesos with the Marathon DC/OS is popular for large-scale production clusters running existing workloads on big data systems, such as Hadoop, Kafka, and Spark.

Infrastructure 246

Infrastructure Open Source Operating System Cloud 246

The Netflix TechBlog

JULY 26, 2021

The paradigm spans across methods, tools, and technologies and is usually defined in contrast to analytical reporting and predictive modeling which are more strategic (vs. At Netflix Studio, teams build various views of business data to provide visibility for day-to-day decision making. tactical) in nature.

Big Data 257

Big Data Government Processing Analytics 257

Dynatrace

JUNE 1, 2020

Go faster, deliver consistently better results, with less team friction that you ever thought possible, as Dynatrace combines a unified data platform with advanced analytics to provide a single source of truth for your Biz, Dev and Ops teams. User Experience and Business Analytics ery user journey and maximize business KPIs.

Artificial Intelligence 254

Artificial Intelligence Social Media Monitoring IoT 254

Dynatrace

AUGUST 10, 2021

Carrie called out how at Dynatrace we know it takes a village to achieve the extraordinary, from innovating reliable digital services at speed to learning how to adapt and thrive while managing our increasingly complex, dynamic technology environments. Investing in data is easy but using it is really hard”. She wasn’t wrong.

DevOps 246

DevOps Innovation Big Data Cloud 246

The Netflix TechBlog

JUNE 20, 2024

In this talk, Jason Reid discusses the pros and cons of both data warehouse bundling and unbundling in terms of performance, governance, and flexibility, and he examines how the trend of data warehouse unbundling will impact the data engineering landscape in the next 5 years.

Data Engineering 206

Data Engineering Engineering Entertainment Software Engineering 206

All Things Distributed

DECEMBER 13, 2016

Today, I'm happy to announce that the AWS Europe (London) Region, our 16th technology infrastructure region globally, is now generally available for use by customers worldwide. The British Government is also helping to drive innovation and has embraced a cloud-first policy for technology adoption.

AWS 154

AWS Cloud Artificial Intelligence IoT 154

DZone

JUNE 6, 2023

The digital transformation of businesses involves the adoption of digital technologies to change the way companies operate and deliver value to their customers. This can include the use of cloud computing, artificial intelligence, big data analytics, the Internet of Things (IoT), and other digital tools.

Artificial Intelligence 130

Artificial Intelligence Systems IoT Testing 130

The Netflix TechBlog

OCTOBER 27, 2020

Data scientists and engineers collect this data from our subscribers and videos, and implement data analytics models to discover customer behaviour with the goal of maximizing user joy. We provide the job template MoveDataToKvDal for moving the data from the warehouse to one Key-Value DAL.

Latency 252

Latency Storage Big Data Tuning 252

The Netflix TechBlog

MAY 26, 2020

Cloud Network Insight is a suite of solutions that provides both operational and analytical insight into the Cloud Network Infrastructure to address the identified problems. Requirements There are multiple ways you can solve this problem and many technologies to choose from.

Network 154

Network Tuning AWS Traffic 154

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. This guide delves into how these systems work, the challenges they solve, and their essential role in businesses and technology.

Storage 130

Storage Systems Big Data Azure 130

All Things Distributed

OCTOBER 7, 2015

Big data challenges. Over the last several years, AWS has delivered on a comprehensive set of services to help customers collect, store, and process their growing volume of data. QuickSight is a cloud-native BI service built from the ground up to address the big data challenges around speed, complexity, and cost.

Cloud 112

Cloud Big Data AWS Analytics 112

Dynatrace

JUNE 1, 2020

Go faster, deliver consistently better results, with less team friction that you ever thought possible, as Dynatrace combines a unified data platform with advanced analytics to provide a single source of truth for your Biz, Dev and Ops teams. User Experience and Business Analytics ery user journey and maximize business KPIs.

Monitoring 173

Monitoring Performance Social Media Artificial Intelligence 173

Dynatrace

OCTOBER 17, 2022

Artificial intelligence for IT operations, or AIOps, combines big data and machine learning to provide actionable insight for IT teams to shape and automate their operational strategy. This makes developing, operating, and securing modern applications and the environments they run on practically impossible without AI.

DevOps 246

DevOps Artificial Intelligence Healthcare Innovation 246

DZone

MAY 30, 2019

With big data on the rise and data algorithms advancing, the ways in which technology has been applied to real-world challenges have grown more automated and autonomous. Financial analysis with real-time analytics is used for predicting investments and drives the FinTech industry's needs for high-performance computing.

Artificial Intelligence 100

Artificial Intelligence Social Media FinTech Storage 100

Dynatrace

OCTOBER 14, 2021

Gartner defines AIOps as the combination of “big data and machine learning to automate IT operations processes, including event correlation, anomaly detection, and causality determination.” Only deterministic AIOps technology enables fully automated cloud operations across the entire enterprise development lifecycle.

Artificial Intelligence 246

Artificial Intelligence DevOps Innovation Metrics 246

ScaleOut Software

JULY 19, 2021

Real-Time Device Tracking with In-Memory Computing Can Fill an Important Gap in Today’s Streaming Analytics Platforms. The Limitations of Today’s Streaming Analytics. How are we managing the torrent of telemetry that flows into analytics systems from these devices? The list goes on.

IoT 78

IoT Big Data Analytics Architecture 78

ScaleOut Software

JUNE 15, 2020

When analyzing telemetry from a large population of data sources, such as a fleet of rental cars or IoT devices in “smart cities” deployments, it’s difficult if not impossible for conventional streaming analytics platforms to track the behavior of each individual data source and derive actionable information in real time.

Analytics 52

Analytics IoT Lambda Big Data 52

ScaleOut Software

JUNE 15, 2020

When analyzing telemetry from a large population of data sources, such as a fleet of rental cars or IoT devices in “smart cities” deployments, it’s difficult if not impossible for conventional streaming analytics platforms to track the behavior of each individual data source and derive actionable information in real time.

Analytics 52

Analytics IoT Lambda Big Data 52

All Things Distributed

FEBRUARY 17, 2011

Driving down the cost of Big-Data analytics. The Amazon.com 2010 Shareholder Letter Focusses on Technology. Introducing the AWS South America (Sao Paulo) Region. Expanding the Cloud - Introducing Amazon ElastiCache. Job Openings in AWS - Senior Leader in Database Services. No Server Required - Jekyll & Amazon S3.

AWS 120

AWS Website Storage Servers 120

All Things Distributed

SEPTEMBER 6, 2013

Shell leverages AWS for big data analytics to help achieve these goals. When Tom Tom launched the LBS platform they wanted the ability to reach millions of developers all around the world without having them invest a lot of capital upfront in hardware and building expensive data centers so turned to the cloud.

Cloud 100

Cloud Energy AWS Healthcare 100

All Things Distributed

AUGUST 16, 2011

Government and Big Data. One particular early use case for AWS GovCloud (US) will be massive data processing and analytics. The scalability, flexibility and the elasticity of AWS makes it an ideal environment for the agencies to run their analytics. Driving down the cost of Big-Data analytics.

AWS 88

AWS Government Big Data Cloud 88

All Things Distributed

DECEMBER 14, 2011

Driving down the cost of Big-Data analytics. The Amazon.com 2010 Shareholder Letter Focusses on Technology. Introducing the AWS South America (Sao Paulo) Region. Expanding the Cloud - Introducing Amazon ElastiCache. Job Openings in AWS - Senior Leader in Database Services. No Server Required - Jekyll & Amazon S3.

AWS 103

AWS Latency Storage Cloud 103

All Things Distributed

MARCH 28, 2011

If you are an engineer interested in working on Amazon Cloud Drive and related technologies the team has a number of openings and would love to talk to you! Driving down the cost of Big-Data analytics. The Amazon.com 2010 Shareholder Letter Focusses on Technology. More details at [link]. Contact Info.

AWS 121

AWS Cloud Storage Internet 121

DZone

JUNE 4, 2019

NVMe storage's strong performance, combined with the capacity and data availability benefits of shared NVMe storage over local SSD, makes it a strong solution for AI/ML infrastructures of any size. There are several AI/ML focused use cases to highlight.

Storage 100

Storage Artificial Intelligence FinTech Performance 100

All Things Distributed

AUGUST 22, 2011

Driving down the cost of Big-Data analytics. The Amazon.com 2010 Shareholder Letter Focusses on Technology. Introducing the AWS South America (Sao Paulo) Region. Expanding the Cloud - Introducing Amazon ElastiCache. Job Openings in AWS - Senior Leader in Database Services. No Server Required - Jekyll & Amazon S3.

Cloud 103

Cloud Cache AWS Storage 103

Scalegrid

MARCH 14, 2024

Integrating technology from private and public clouds and on-premises resources within one hybrid cloud platform creates an integrated IT infrastructure that leverages the strengths of each component. Integrating Existing Systems When selecting a tool for integrating a hybrid cloud, evaluating several key aspects is important.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

All Things Distributed

MARCH 2, 2011

Driving down the cost of Big-Data analytics. The Amazon.com 2010 Shareholder Letter Focusses on Technology. Introducing the AWS South America (Sao Paulo) Region. Expanding the Cloud - Introducing Amazon ElastiCache. Job Openings in AWS - Senior Leader in Database Services. No Server Required - Jekyll & Amazon S3.

AWS 90

AWS Cloud Games Latency 90