Remove Big Data Remove Infrastructure Remove Transportation
article thumbnail

Building and Scaling Data Lineage at Netflix to Improve Data Infrastructure Reliability, and…

The Netflix TechBlog

Building and Scaling Data Lineage at Netflix to Improve Data Infrastructure Reliability, and Efficiency By: Di Lin , Girish Lingappa , Jitender Aswani Imagine yourself in the role of a data-inspired decision maker staring at a metric on a dashboard about to make a critical business decision but pausing to ask a question?—?“Can

article thumbnail

How Netflix uses eBPF flow logs at scale for network insight

The Netflix TechBlog

At much less than 1% of CPU and memory on the instance, this highly performant sidecar provides flow data at scale for network insight. Challenges The cloud network infrastructure that Netflix utilizes today consists of AWS services such as VPC, DirectConnect, VPC Peering, Transit Gateways, NAT Gateways, etc and Netflix owned devices.

Network 327
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Kubernetes in the wild report 2023

Dynatrace

The study analyzes factual Kubernetes production data from thousands of organizations worldwide that are using the Dynatrace Software Intelligence Platform to keep their Kubernetes clusters secure, healthy, and high performing. Kubernetes infrastructure models differ between cloud and on-premises. Kubernetes moved to the cloud in 2022.

article thumbnail

Databook: Turning Big Data into Knowledge with Metadata at Uber

Uber Engineering

From driver and rider locations and destinations, to restaurant orders and payment transactions, every interaction on Uber’s transportation platform is driven by data.

Big Data 110
article thumbnail

Data Movement in Netflix Studio via Data Mesh

The Netflix TechBlog

Data Mesh provides a drag-and-drop, self-service user interface for exploring sources and creating pipelines so that users can focus on delivering business value without having to worry about managing and scaling complex data streaming infrastructure.

Big Data 258
article thumbnail

Expanding the Cloud: Introducing the AWS Asia Pacific (Mumbai) Region

All Things Distributed

In June 2015, Amazon Web Services announced that it would launch a new AWS infrastructure region in India. Market innovators and change agents need a comprehensive infrastructure platform that can reliably scale on-demand. Advanced problem solving that connects big data with machine learning.

AWS 80
article thumbnail

Dutch Enterprises and The Cloud

All Things Distributed

Shell leverages AWS for big data analytics to help achieve these goals. By offloading the task of managing infrastructure to AWS Essent is able to spend more time on innovating on behalf of their customers to help them in their energy usage.

Cloud 104