The Netflix TechBlog

JUNE 20, 2024

Data Productivity at Scale Recording Speaker : Iaroslav Zeigerman (Co-Founder and Chief Architect at Tobiko Data) Summary : The development and evolution of data pipelines are hindered by outdated tooling compared to software development. Until next time!

Data Engineering 206

Data Engineering Engineering Entertainment Software Engineering 206

Dynatrace

NOVEMBER 17, 2020

We sat together with Armin Ruech and Daniel Dyla, software engineers at Dynatrace and leaders within the OpenTelemetry community, to hear about their involvement with the second most active CNCF project. My name is Armin Ruech, I’m a Software Engineer at Dynatrace and I started as a software developer around 3.5

Open Source 207

Open Source Software Engineering Government Java 207

Dynatrace

APRIL 20, 2023

At Dynatrace Perform 2023 , Maciej Pawlowski, senior director of product management for infrastructure monitoring at Dynatrace, and a senior software engineer at a U.K.-based Yet the ability to make decisions regarding value versus cost is prioritized at each stage of log management and analytics processes. Seamless integration.

Analytics 246

Analytics Infrastructure Storage Architecture 246

DZone

JANUARY 23, 2021

If you need to dynamically trace Linux process system calls, you might first consider strace. strace is simple to use and works well for issues such as "Why can't the software run on this machine?" However, if you're running a trace in a production environment, strace is NOT a good choice. The answer is YES.

Systems 171

Systems Performance Software Engineering Performance Testing 171

The Netflix TechBlog

MARCH 25, 2019

Now, imagine yourself in the role of a software engineer responsible for a micro-service which publishes data consumed by few critical customer facing services (e.g. To improve data accuracy, we decided to leverage AWS S3 access logs to identify entity relationships not been captured by our traditional ingestion process.

Infrastructure 225

Infrastructure Big Data Transportation Architecture 225

O'Reilly

MARCH 25, 2025

Were also betting that this will be a time of software development flourishing. With the advent of generative AI, therell be significant opportunities for product managers, designers, executives, and more traditional software engineers to contribute to and build AI-powered software. Evaluation : Same as above.

Systems 67

Systems Development Tuning Monitoring 67

The Netflix TechBlog

OCTOBER 18, 2022

For example, a workflow to backfill hourly data for the past five years can lead to 43800 jobs (24 * 365 * 5), each of which processes data for an hour. We would like our users to focus on their business logic and let the orchestrator solve cross-cutting concerns like scheduling, processing, error handling, security etc.

Java 211

Java Scalability Traffic Architecture 211

The Netflix TechBlog

MAY 14, 2021

We are expected to process 1,000 watermarks for a single distribution in a minute, with non-linear latency growth as the number of watermarks increases. The goal is to process these documents as fast as possible and reliably deliver them to recipients while offering strong observability to both our users and internal teams.

Traffic 166

Traffic Java Latency Google 166

SQL Server According to Bob

SEPTEMBER 9, 2019

I recall when we were tuning the sp_reset_connection (which releases the database lock and acquires it again) command we tested rates in excess of 250,000/sec to ensure the partitioned database lock scaled: [link]. The opaque bytes are processed by the lock manager to determine the hash bucket location.

Servers 103

Servers Database Scalability Tuning 103

High Scalability

AUGUST 24, 2021

T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. No more hassles of benchmarking and tuning algorithms or building and maintaining infrastructure for vector search. They also do live system design discussions every week.

Education 100

Education DevOps Infrastructure Benchmarking 100

High Scalability

OCTOBER 27, 2021

T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. No more hassles of benchmarking and tuning algorithms or building and maintaining infrastructure for vector search. They also do live system design discussions every week.

Education 100

Education DevOps Infrastructure Benchmarking 100

High Scalability

SEPTEMBER 29, 2021

T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. No more hassles of benchmarking and tuning algorithms or building and maintaining infrastructure for vector search. They also do live system design discussions every week.

Education 100

Education DevOps Infrastructure Benchmarking 100

High Scalability

SEPTEMBER 15, 2021

T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. No more hassles of benchmarking and tuning algorithms or building and maintaining infrastructure for vector search. They also do live system design discussions every week.

Education 100

Education DevOps Infrastructure Benchmarking 100

The Morning Paper

NOVEMBER 10, 2019

It’s been clear for a while that software designed explicitly for the data center environment will increasingly want/need to make different design trade-offs to e.g. general-purpose systems software that you might install on your own machines. Data plane operations are handled by pluggable engines (Pony Express is an engine).

Network 92

Network Transportation Latency Entertainment 92

The Netflix TechBlog

FEBRUARY 9, 2021

Introduction and account creation Highlight our value propositions and begin the account creation process. Given the flow and mode, the Orchestration Service can then process the request. Stay tuned for more details on this, as well as more details on the internals of the new SKU Platform in one of our upcoming blog posts.

Engineering 145

Engineering Scalability Architecture Innovation 145

Smashing Magazine

JANUARY 5, 2022

With entrance into the industry being so easy and lack of proper benchmarking (Note: this is somewhat contradictory to point 2, but more on that later) around what makes a good designer, software engineer, or product manager, we’re forced to face the facts that it’s a recipe for poor quality products. Stay tuned! Show it off.

Design 132

Design Website Social Media Best Practices 132

Abhishek Tiwari

JULY 20, 2019

Specialisation could be around products, business process, or technologies. One way to create a Spotify model inspired engineering organisation is to organise long-lived squads by retail business process hubs - i.e. specialisation around business process. Secondly, fine-tune team composition based on work.

Engineering 61

Engineering Retail Airlines Healthcare 61

Abhishek Tiwari

JANUARY 9, 2019

When it comes to agile estimation, quite often agile teams spend a big chunk of their time in heavyweight processes like detailed story point estimation to improve the predictability or accuracy of their estimates. In next post we will cover more details so stay tuned. Easy said than done. So how should we optimise for velocity ?

Tuning 40

Tuning Software Engineering Innovation Engineering 40

Abhishek Tiwari

SEPTEMBER 15, 2024

So how is it that NASA can land a rover on Mars, millions of miles away, with software that works flawlessly? The answer lies in a combination of factors that set space-grade software apart from your average app. The software driving the Curiosity rover comprises a staggering 2.5 million lines of C code.

Engineering 52

Engineering Social Media Hardware C++ 52

The Agile Manager

JUNE 30, 2015

We have to look at skills and capabilities: we're not going to be much of a software company if we don't employ any software engineers. But skills, capabilities, processes and culture all wilt in the face of an overbearing capital structure.

Software 40

Software Software Innovation Hardware 40

SQL Server According to Bob

JUNE 9, 2016

This is a process of calling the CPUID instruction to obtain feature information reported by the CPU. VMWare provides options to ‘Assign a Virtual Machine to a Specific Processor’ that may be helpful in tuning your installation. Bob Dorr – Principal Software Engineer SQL Server. What Is Your System Showing?

Servers 40

Servers Virtualization Tuning Architecture 40

The Netflix TechBlog

FEBRUARY 13, 2024

Safe software deployment, canary testing, and play-delay Software engineering readers of this blog are likely familiar with unit, integration and load testing, as well as other testing practices that aim to prevent bugs from reaching production systems. Black dots indicate where the p-value process dips below the alpha=0.05

Testing 248

Testing Software Software Metrics 248

Rigor

SEPTEMBER 11, 2019

Reading time 16 min Whether you’re a web performance expert, an evangelist for the culture of performance, a web engineer incorporating performance into your process, or someone new to the web performance entirely, you probably identify as curious, excited about new ideas, and always learning. Rick Byers. Rick Byers.

Performance 89

Performance Education Google Website 89