The Netflix TechBlog

FEBRUARY 1, 2022

By Karen Casella, Director of Engineering, Access & Identity Management Have you ever experienced one of the following scenarios while looking for your next role? Interviewing can be a daunting endeavor and how companies, and teams, approach the process varies greatly. If so, we invite you to begin the interview process.

Engineering 211

Engineering Games Entertainment Innovation 211

The Netflix TechBlog

JUNE 20, 2024

A summary of sessions at the first Data Engineering Open Forum at Netflix on April 18th, 2024 The Data Engineering Open Forum at Netflix on April 18th, 2024. At Netflix, we aspire to entertain the world, and our data engineering teams play a crucial role in this mission by enabling data-driven decision-making at scale.

Data Engineering 209

Data Engineering Engineering Entertainment Software Engineering 209

The Netflix TechBlog

OCTOBER 28, 2021

Data Engineers of Netflix?—?Interview Interview with Pallavi Phadnis This post is part of our “ Data Engineers of Netflix ” series, where our very own data engineers talk about their journeys to Data Engineering @ Netflix. Pallavi Phadnis is a Senior Software Engineer at Netflix.

Data Engineering 183

Data Engineering Engineering Big Data Software Engineering 183

The Netflix TechBlog

NOVEMBER 20, 2023

by Jun He , Yingyi Zhang , and Pawan Dixit Incremental processing is an approach to process new or changed data in workflows. The key advantage is that it only incrementally processes data that are newly added or updated to a dataset, instead of re-processing the complete dataset.

Processing 221

Processing Big Data Efficiency Engineering 221

Dynatrace

FEBRUARY 12, 2024

When it comes to platform engineering, not only does observability play a vital role in the success of organizations’ transformation journeys—it’s key to successful platform engineering initiatives. The various presenters in this session aligned platform engineering use cases with the software development lifecycle.

Engineering 194

Engineering Development Infrastructure Cloud 194

Dynatrace

NOVEMBER 14, 2023

Site reliability engineering (SRE) has become increasingly important to organizations looking to keep up with the rapid pace of digital transformation. Effective site reliability engineering requires enterprise-wide transformation Without a unified understanding of SRE practices, organizational silos can quickly form between departments.

Best Practices 204

Best Practices Engineering DevOps Software Engineering 204

Dynatrace

FEBRUARY 4, 2021

Site reliability engineering (SRE) is the practice of applying software engineering principles to operations and infrastructure processes to help organizations create highly reliable and scalable software systems. Dynatrace news. SRE focuses on automation. SRE drives a “shift left” mindset.

Engineering 188

Engineering DevOps Government Latency 188

The Morning Paper

JULY 7, 2019

Software engineering for machine learning: a case study Amershi et al., Previously on The Morning Paper we’ve looked at the spread of machine learning through Facebook and Google and some of the lessons learned together with processes and tools to address the challenges arising. A general process. ICSE’19.

Software Engineering 92

Software Engineering Engineering Software Software 92

DZone

SEPTEMBER 19, 2021

Software engineering team scalability is equally important. Software Engineering Team Scalability. We can say that system scalability is about supporting a linear rate of growth in system resource requirements given that code running inside the system is unchanged.

Scalability 241

Scalability Software Engineering Engineering Systems 241

Strategic Tech

MARCH 16, 2021

There are a few qualities that differentiate average from high performing software engineering organisations. In my experience, the culture is better and the results are better in orgs where engineers and architects obsess over the design of code and architecture. Regularly spending time with domain experts is important.

Software Engineering 80

Software Engineering Design Engineering Software 80

Strategic Tech

MARCH 26, 2019

A software developer with a computer science degree will produce the same quality of work as any other software developer with a computer science degree. It makes business sense to hire cheap programmers and put in place a standard process. In fact, there are near infinite ways to solve every software engineering challenging.

Software Engineering 76

Software Engineering Engineering Software Software 76

DZone

MARCH 9, 2023

I participated in this hackathon with the Carbon Optimised Process Scheduler project along with my colleagues Kamlesh Kshirsagar and Mayur Andulkar, in which we developed an API to optimize job scheduling in order to reduce carbon emissions, and we won the “Most Insightful” project prize.

Software 244

Software Software Software Engineering Engineering 244

DZone

JULY 14, 2021

Fei Xu (Software Engineer at PingCAP). TiDB is a Hybrid Transaction/Analytical Processing (HTAP) database that can efficiently process analytical queries. However, when large amounts of data are involved, the CPU becomes the bottleneck for processing queries that include JOIN statements and/or aggregation functions.

Analytics 223

Analytics Software Engineering Performance Database 223

The Netflix TechBlog

JUNE 1, 2021

Data Engineers of Netflix?—?Interview Interview with Dhevi Rajendran Dhevi Rajendran This post is part of our “Data Engineers of Netflix” interview series, where our very own data engineers talk about their journeys to Data Engineering @ Netflix. The culture was also something that piqued my interest.

Data Engineering 140

Data Engineering Engineering Software Engineering Big Data 140

Dynatrace

MAY 6, 2024

A tight integration between Red Hat Ansible Automation Platform, Dynatrace Davis ® AI, and the Dynatrace observability and security platform enables closed-loop remediation to automate the process from: Detecting a problem. With DQL, the workflow trigger to initiate a required automation and remediation process can be defined.

DevOps 295

DevOps Software Engineering Games Java 295

The Netflix TechBlog

FEBRUARY 9, 2021

Growth Engineering at Netflix?—?Automated In the Growth Engineering team, we refer to this as the top of the signup funnel. For more background on the signup funnel and Growth Engineering’s role in the signup funnel, please read our initial post on the topic: Growth Engineering at Netflix? Accelerating Innovation.

Engineering 174

Engineering Storage Latency Entertainment 174

High Scalability

JANUARY 11, 2022

Machine Learning Engineer at Amazon and has led several machine-learning initiatives across the Amazon ecosystem. FUN FACT : In this talk , Rodrigo Schmidt, director of engineering at Instagram talks about the different challenges they have faced in scaling the data infrastructure at Instagram. This is a guest post by Ankit Sirmorya.

Design 334

Design Media Storage Logistics 334

Dynatrace

JUNE 2, 2022

Site reliability engineering (SRE) continues to gain popularity as organizations embrace hybrid cloud strategies and IT automation at scale. By applying software engineering principles to operations and infrastructure practices, SRE enables organizations to streamline and automate IT processes. Dynatrace news.

DevOps 147

DevOps Innovation Engineering Benchmarking 147

Dynatrace

FEBRUARY 24, 2021

DevOps is focused on optimizing software development and delivery, and SRE is focused on operations processes. DevOps is not a specific process, but rather a general collection of flexible software creation and delivery practices that looks to close the gap between software development and IT operations.

DevOps 196

DevOps Software Engineering Speed Google 196

The Netflix TechBlog

JUNE 1, 2021

Data Engineers of Netflix?—?Interview Interview with Samuel Setegne Samuel Setegne This post is part of our “Data Engineers of Netflix” interview series, where our very own data engineers talk about their journeys to Data Engineering @ Netflix. What drew you to Netflix?

Data Engineering 130

Data Engineering Engineering Big Data Healthcare 130

Dynatrace

MARCH 3, 2020

For software engineering teams, this demand means not only delivering new features faster but ensuring quality, performance, and scalability too. One way to apply improvements is transforming the way application performance engineering and testing is done. Here is the definition of this model: ?. Try it today using Keptn .

Performance 253

Performance Education Innovation Software Architecture 253

The Netflix TechBlog

FEBRUARY 9, 2021

The Growth Engineering team is responsible for executing growth initiatives that help us anticipate and adapt to this change. For more background on Growth Engineering and the signup funnel, please have a look at our previous blog post that covers the basics. We need to be constantly adapting and innovating as a result of this change.

Engineering 146

Engineering Scalability Architecture Innovation 146

Dynatrace

JUNE 4, 2024

This process, known as auto-adaptive thresholding, eliminates the need to define a static threshold upfront. A key element in platform engineering is the establishment of fast feedback cycles regarding the quality and security measures of new software releases.

Metrics 244

Metrics Engineering Code Tuning 244

The Netflix TechBlog

NOVEMBER 29, 2023

For a given rate-quality operating point, the DO process helps allocate bits among the various shots while maximizing an overall objective function. Additionally, the current version has some algorithmic limitations that we are in the process of improving before the official release. Krasula, A. Choudhury, S. Malfait, A.

Open Source 262

Open Source Software Engineering Internet Internet 262

Dynatrace

MAY 31, 2023

Site reliability engineering (SRE) has recently become a critical discipline in recent years as the world has shifted in favor of web-based interactions. This shift is leading more organizations to hire site reliability engineers to guarantee the reliability and resiliency of their services. Mobile retail e-commerce spending in the U.

Best Practices 233

Best Practices DevOps Latency Metrics 233

DZone

JANUARY 23, 2021

If you need to dynamically trace Linux process system calls, you might first consider strace. strace is simple to use and works well for issues such as "Why can't the software run on this machine?" However, if you're running a trace in a production environment, strace is NOT a good choice. The answer is YES.

Systems 171

Systems Performance Software Engineering Performance Testing 171

Dynatrace

JUNE 28, 2022

Mobile analytics can help organizations optimize their mobile application performance, earning customer accolades and increasing revenue in the process. After investigating, the software engineering team discovered that it wasn’t leveraging application performance monitoring (APM) tooling data to its full potential.

Mobile 224

Mobile Analytics Best Practices Software Engineering 224

Dynatrace

DECEMBER 5, 2022

DevOps is a widely practiced set of procedures and tools for streamlining the development, release, and updating of software. In their most basic form, DevOps procedures can result in complicated processes, data silos, and fragmented responsibilities. Automation versus orchestration. Get started with DevOps orchestration.

DevOps 222

DevOps Virtualization Best Practices Innovation 222

Alex Russell

JUNE 22, 2022

As penance for this error, and for being short with Miguel , I must deconstruct the ways Apple has undermined browser engine diversity. Contrary to claims of Apple partisans, iOS engine restrictions are not preventing a "takeover" by Chromium — at least that's not the primary effect. And that's a choice. "WebKit

Engineering 124

Engineering Traffic Government Google 124

The Netflix TechBlog

SEPTEMBER 13, 2021

Supporting developers through those checklists for edge cases, and then validating that each team’s choices resulted in an architecture with all the desired security properties, was similarly not scalable for our security engineers. Netflix engineers talk a lot about the concept of a “ Paved Road ”.

Internet 229

Internet Internet Cloud Traffic 229

Dynatrace

NOVEMBER 2, 2023

But with many organizations relying on traditional, manual processes to ensure service reliability and code quality, software delivery speed suffers. But according to the 2023 DevOps Automation Pulse , only 56% of end-to-end DevOps processes are automated. Automation is a crucial aspect of achieving DevOps excellence.

DevOps 218

DevOps Benchmarking Azure Innovation 218

DZone

MARCH 13, 2024

As software engineers, we are always striving for high performance and efficiency in our code. One powerful way that can help us accurately measure the performance of our code is a process called benchmarking, and we’ll look at how to use BenchmarkDotNet with our C# code.

Benchmarking 147

Benchmarking Tuning Performance Open Source 147

The Netflix TechBlog

MARCH 25, 2019

Now, imagine yourself in the role of a software engineer responsible for a micro-service which publishes data consumed by few critical customer facing services (e.g. In this model, we scan system logs and metadata generated by various compute engines to collect corresponding lineage data.

Infrastructure 226

Infrastructure Big Data Transportation Architecture 226

Dynatrace

JANUARY 18, 2023

However, getting reliable answers from observability data so teams can automate more processes to ensure speed, quality, and reliability can be challenging. According to recent Dynatrace research , organizations expect to make software updates 58% more frequently in the coming year. What is SRE (site reliability engineering)?

DevOps 211

DevOps Best Practices Innovation Strategy 211

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! Over the years, this platform took on support for both elastic online services and fully featured batch workloads supporting use cases across Netflix engineering.

AWS 38

AWS Entertainment Open Source Benchmarking 38

Dynatrace

APRIL 20, 2023

Causal AI—which brings AI-enabled actionable insights to IT operations—and a data lakehouse, such as Dynatrace Grail , can help break down silos among ITOps, DevSecOps, site reliability engineering, and business analytics teams. “It’s quite a big scale,” said an engineer at the financial services group.

Analytics 200

Analytics Infrastructure Storage Architecture 200

The Netflix TechBlog

DECEMBER 3, 2019

mainly because of mundane reasons related to software engineering. We heard many stories about difficulties related to data access and basic data processing. They know that feature engineering is critical for many models, so they want to stay in control of model inputs and feature engineering logic.

Open Source 239

Open Source AWS Infrastructure Energy 239