The Netflix TechBlog

OCTOBER 28, 2021

Interview with Pallavi Phadnis This post is part of our “ Data Engineers of Netflix ” series, where our very own data engineers talk about their journeys to Data Engineering @ Netflix. Pallavi Phadnis is a Senior Software Engineer at Netflix. Pallavi, what’s your journey to data engineering at Netflix?

Data Engineering 183

Data Engineering Engineering Big Data Software Engineering 183

DZone

FEBRUARY 27, 2021

As a Software Engineer, the mind is trained to seek optimizations in every aspect of development and ooze out every bit of available CPU Resource to deliver a performing application. One, by researching on the Internet; Two, by developing small programs and benchmarking. These include Python, PHP, Perl, and Ruby.

Java 214

Java C++ Benchmarking Programming 214

The Netflix TechBlog

JUNE 20, 2024

On April 18th, 2024, we hosted the inaugural Data Engineering Open Forum at our Los Gatos office, bringing together data engineers from various industries to share, learn, and connect. At the conference, our speakers share their unique perspectives on modern developments, immediate challenges, and future prospects of data engineering.

Data Engineering 209

Data Engineering Engineering Entertainment Software Engineering 209

Dynatrace

NOVEMBER 7, 2023

Platform engineering is on the rise. According to leading analyst firm Gartner, “80% of software engineering organizations will establish platform teams as internal providers of reusable services, components, and tools for application delivery…” by 2026.

Engineering 285

Engineering DevOps Best Practices Infrastructure 285

Smashing Magazine

JANUARY 5, 2022

Ten Tips For The Aspiring Designer Beginners (Part 1). Ten Tips For The Aspiring Designer Beginners (Part 1). In this article, I want to share ten tips that helped me grow and become a better designer, and I hope these tips will also help you while you’re trying to find more solid ground under your feet. Luis Ouriach.

Design 128

Design Website Social Media Best Practices 128

Dynatrace

JUNE 4, 2024

Build an umbrella for Development and Operations In modern software engineering, the discipline of platform engineering delivers DevSecOps practices to developers to bridge the gaps between development, security, and operations and enhance the developer experience.

Metrics 244

Metrics Engineering Code Tuning 244

The Netflix TechBlog

NOVEMBER 9, 2021

Netflix is proud to be a founding member of AOMedia and a key contributor to the development of AV1. Netflix has also partnered with YouTube to develop an open-source solution for an AV1 decoder on game consoles that utilizes the additional power of GPUs. The specification of AV1 was published in 2018.

Media 246

Media Open Source Software Engineering Efficiency 246

Dynatrace

MAY 23, 2024

Stream processing One approach to such a challenging scenario is stream processing, a computing paradigm and software architectural style for data-intensive software systems that emerged to cope with requirements for near real-time processing of massive amounts of data. We designed experimental scenarios inspired by chaos engineering.

Engineering 192

Engineering Tuning Latency Open Source 192

The Netflix TechBlog

MARCH 25, 2019

Now, imagine yourself in the role of a software engineer responsible for a micro-service which publishes data consumed by few critical customer facing services (e.g. Design a flexible data model ? —?Represent Can I run a check myself to understand what data is behind this metric?” Enable seamless integration?—?

Infrastructure 226

Infrastructure Big Data Transportation Architecture 226

The Netflix TechBlog

NOVEMBER 29, 2023

As noted in an earlier blog post , we began developing an HDR variant of VMAF; let’s call it HDR-VMAF. A vital aspect of such development is subjective testing with HDR encodes in order to generate training data. The pandemic, however, posed unique challenges in conducting a conventional in-lab subjective test with HDR encodes.

Open Source 262

Open Source Software Engineering Internet Internet 262

J. Paul Reed

MARCH 14, 2019

The 737Max and Why Software Engineers Might Want to Pay Attention As someone with a bit of a reputation for talking about aviation and software development and operations , I’ve been asked about the 737Max repeatedly over the past week. a selling point ?—?and

Software Engineering 75

Software Engineering Engineering Software Software 75

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 202 A day in the life of a Netflix Engineer Dave Hahn , SRE Engineering Manager Abstract : Netflix is a large, ever-changing ecosystem serving millions of customers across the globe through cloud-based systems and a globally distributed CDN. Wednesday?—?December

AWS 38

AWS Entertainment Open Source Benchmarking 38

Dynatrace

NOVEMBER 22, 2021

With dependable, contextual observability data, teams can develop data-driven service-level agreements (SLAs) and service-level objectives (SLOs) to make their AWS infrastructure more reliable and resilient. EC2 is Amazon’s Infrastructure-as-a-service (IaaS) compute platform designed to handle any workload at scale. Amazon EC2.

Best Practices 224

Best Practices AWS Monitoring Serverless 224

The Netflix TechBlog

DECEMBER 3, 2019

mainly because of mundane reasons related to software engineering. By design, Metaflow is a deceptively simple Python library: Data scientists can structure their workflow as a Directed Acyclic Graph of steps, as depicted above. It leverages elasticity of the cloud by design?—?both Metaflow is a cloud-native framework.

Open Source 239

Open Source AWS Infrastructure Energy 239

The Netflix TechBlog

FEBRUARY 1, 2022

The interview panel consists of two or three engineers, a hiring manager and a recruiter. The engineers assess your technical skills by asking you to solve various design and coding problems. The interview panel comprises an engineering director, a partner engineer or manager, and another engineering leader.

Engineering 211

Engineering Games Entertainment Innovation 211

Dynatrace

MARCH 17, 2021

Application security is a software engineering term that refers to several different types of security practices designed to ensure applications do not contain vulnerabilities that could allow illicit access to sensitive data, unauthorized code modification, or resource hijacking. Dynatrace news. So, why is all this important?

Open Source 176

Open Source Cloud Games Java 176

O'Reilly

OCTOBER 19, 2021

As with many burgeoning fields and disciplines, we don’t yet have a shared canonical infrastructure stack or best practices for developing and deploying data-intensive applications. In effect, the engineer designs and builds the world wherein the software operates. This approach is not novel.

DevOps 140

DevOps Software Engineering Infrastructure Open Source 140

The Netflix TechBlog

OCTOBER 27, 2021

link] Metaflow is a full-stack framework for data science that we started developing at Netflix over four years ago and which we open-sourced in 2019. Requirements for a Metaflow GUI Metaflow is a human-centered system by design. The GUI should integrate well with other GUIs.

Open Source 232

Open Source Monitoring Scalability Code 232

Dynatrace

JUNE 2, 2022

Site reliability engineering (SRE) continues to gain popularity as organizations embrace hybrid cloud strategies and IT automation at scale. By applying software engineering principles to operations and infrastructure practices, SRE enables organizations to streamline and automate IT processes. Dynatrace news.

DevOps 147

DevOps Innovation Engineering Benchmarking 147

High Scalability

AUGUST 4, 2020

has hours of system design content. They also do live system design discussions every week. T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Trusted by 10,000+ developers. Who's Hiring? InterviewCamp.io Try it now!

Education 115

Education AWS Scalability Java 115

Dynatrace

JANUARY 18, 2023

DevOps and SRE: Methodologies that are transforming software development with the help of DevOps observability. DevOps is a software delivery methodology that comprises flexible practices and processes to create and deliver applications and services, ultimately closing the gap between software development and IT operations.

DevOps 211

DevOps Best Practices Innovation Strategy 211

Scalegrid

OCTOBER 18, 2024

Enabling keyboard shortcuts and possessing visual appeal and transparency to minimize strain on wrists and eyesight to prevent Carpal Tunnel Syndrome and visual impairment from developing in users. To conclude, GUIs are a vital addition to ease the lives of database users and developers. Easy to use and highly customizable.

Open Source 147

Open Source Database Cloud Operating System 147

Dynatrace

JANUARY 19, 2021

Serverless architectures help developers innovate more efficiently and effectively by removing the burden of managing underlying infrastructure. the impact of serverless functions and applications on customer experience and business outcomes, thereby improving collaboration between developer and business teams. applications,?mobile

Lambda 222

Lambda Serverless AWS Mobile 222

The Morning Paper

FEBRUARY 16, 2020

Migrating a privacy-safe information extraction system to a software 2.0 design , Sheng, CIDR’20. This is a comparatively short (7 pages) but very interesting paper detailing the migration of a software system to a ‘Software 2.0’ ’ design. traditional software) to a Software 2.0

Systems 84

Systems Design Software Software 84

High Scalability

APRIL 14, 2020

has hours of system design content. They also do live system design discussions every week. Scrapinghub is hiring a Senior Software Engineer (Big Data/AI). this is going to be a challenging journey for any backend engineer! this is going to be a challenging journey for any backend engineer! Who's Hiring?

Education 105

Education Software Engineering Scalability Engineering 105

High Scalability

JUNE 11, 2020

has hours of system design content. They also do live system design discussions every week. T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Developers care about shipping secure applications. Who's Hiring?

Education 105

Education AWS Scalability Java 105

High Scalability

APRIL 16, 2019

Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Join Etleap , an Amazon Redshift ETL tool to learn the latest trends in designing a modern analytics infrastructure. Make your job search O (1), not O ( n ). Apply here.

Analytics 26

Analytics Java Metrics Software Engineering 26

High Scalability

SEPTEMBER 3, 2020

has hours of system design content. They also do live system design discussions every week. T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Trusted by 10,000+ developers. Who's Hiring? InterviewCamp.io Try it now!

Education 105

Education AWS Scalability Java 105

High Scalability

APRIL 10, 2019

Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Join Etleap , an Amazon Redshift ETL tool to learn the latest trends in designing a modern analytics infrastructure. Make your job search O (1), not O ( n ). Apply here.

Analytics 26

Analytics Java Metrics Software Engineering 26

High Scalability

MAY 12, 2020

has hours of system design content. They also do live system design discussions every week. Scrapinghub is hiring a Senior Software Engineer (Big Data/AI). this is going to be a challenging journey for any backend engineer! this is going to be a challenging journey for any backend engineer! Who's Hiring?

Education 102

Education Software Engineering Scalability Engineering 102

High Scalability

APRIL 28, 2020

has hours of system design content. They also do live system design discussions every week. Scrapinghub is hiring a Senior Software Engineer (Big Data/AI). this is going to be a challenging journey for any backend engineer! this is going to be a challenging journey for any backend engineer! Who's Hiring?

Education 102

Education Software Engineering Scalability Engineering 102

High Scalability

JULY 8, 2020

has hours of system design content. They also do live system design discussions every week. T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Developers care about shipping secure applications. Who's Hiring?

Education 102

Education AWS Scalability Java 102

Dynatrace

JANUARY 23, 2024

AI data analysis can help development teams release software faster and at higher quality. Another key theme at Dynatrace Perform 2024 is organizations’ growing adoption of platform engineering , which helps accelerate the delivery of software applications.

Performance 198

Performance DevOps Innovation Artificial Intelligence 198

High Scalability

JANUARY 8, 2019

Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Stream is currently also hiring Devops and Python/Go developers in Amsterdam. Who's Hiring? Make your job search O (1), not O ( n ). Apply here. Need excellent people?

Java 137

Java Metrics Software Engineering DevOps 137

High Scalability

MARCH 30, 2020

has hours of system design content. They also do live system design discussions every week. Scrapinghub is hiring a Senior Software Engineer (Big Data/AI). this is going to be a challenging journey for any backend engineer! this is going to be a challenging journey for any backend engineer! Who's Hiring?

Education 105

Education Software Engineering Engineering Big Data 105

Tasktop

MAY 31, 2019

We’re typically heads-down, and it seems any interaction we have is just business: problem solving, design discussions, code review comments, story planning. And this is on to p of what our “team of teams” Product Development team does (visiting escape rooms and bowling have been examples). How is your team doing?

Software Engineering 40

Software Engineering Engineering Software Software 40

High Scalability

MARCH 24, 2020

Scrapinghub is hiring a Senior Software Engineer (Big Data/AI). You will be designing and implementing distributed systems : large-scale web crawling platform, integrating Deep Learning based web data extraction components, working on queue algorithms, large datasets, creating a development platform for other company departments, etc.

Education 105

Education Software Engineering Engineering Big Data 105