Blog, Code and Processing - Technology Performance Pulse

Rebuilding Netflix Video Processing Pipeline with Microservices

The Netflix TechBlog

JANUARY 10, 2024

This introductory blog focuses on an overview of our journey. Future blogs will provide deeper dives into each service, sharing insights and lessons learned from this process. Future blogs will provide deeper dives into each service, sharing insights and lessons learned from this process.

Processing

Processing Media Latency Innovation

Manage your monitoring as code with Dynatrace’s HashiCorp Terraform integration

Dynatrace

MARCH 16, 2021

HashiCorp’s Terraform is an open-source infrastructure as a code software tool that provides a consistent CLI workflow to manage hundreds of cloud services. With this integration, Dynatrace customers can now leverage Terraform to manage their monitoring infrastructure as code,” said Asad Ali, Senior Director of Sales Engineering at Dynatrace.

Code

Code Monitoring Best Practices Infrastructure

Progressive delivery at cloud scale: Optimizing CPU intensive code with Dynatrace

Dynatrace

OCTOBER 21, 2020

If that’s the case, the update process continues to the next set of clusters and that process continues until all clusters are updated to the new version. And the code-level root cause information is what makes troubleshooting easy for developers. Step 3: Identifying root-cause in code.

Code

Code Cloud Engineering Java

What is infrastructure as code? Discover the basics, benefits, and best practices

Dynatrace

JUNE 10, 2022

The IT world is rife with jargon — and “as code” is no exception. “As code” means simplifying complex and time-consuming tasks by automating some, or all, of their processes. ” While this methodology extends to every layer of the IT stack, infrastructure as code (IAC) is the most prominent example.

Best Practices

Best Practices Infrastructure Code Speed

Incremental Processing using Netflix Maestro and Apache Iceberg

The Netflix TechBlog

NOVEMBER 20, 2023

by Jun He , Yingyi Zhang , and Pawan Dixit Incremental processing is an approach to process new or changed data in workflows. The key advantage is that it only incrementally processes data that are newly added or updated to a dataset, instead of re-processing the complete dataset.

Processing

Processing Big Data Efficiency Engineering

Software intelligence as code enables tailored observability, AIOps, and application security at scale

Dynatrace

FEBRUARY 9, 2022

Modern infrastructure needs to be elastic and GitOps approaches are used to automate the provisioning of infrastructure and applications using Git, an open-source control system that provides the change processes including reviews and approvals. Key components of GitOps are declarative infrastructure as code, orchestration, and observability.

Code

Code Software Software DevOps

Path to NoOps part 2: How infrastructure as code makes cloud automation attainable—and repeatable—at scale

Dynatrace

NOVEMBER 29, 2022

Infrastructure as code is a way to automate infrastructure provisioning and management. In my previous blog post, Path to NoOps part 1: How modern AIOps brings NoOps within reach, I explored the aspirations of NoOps and how modern AIOps makes it possible. Infrastructure-as-code. But how does it work in practice? Is it practical?

Infrastructure

Infrastructure Code Cloud DevOps

Boost application performance with improved CPU analysis across all your deep-monitored workloads

Dynatrace

JULY 31, 2020

Fully automated code-level visibility. Apart from its best-in-class observability capabilities like distributed traces, metrics, and logs, Dynatrace OneAgent additionally provides automatic deep code-level insights for Java,NET, Node.js, PHP, and Golang, without the need to change any application code or configuration.

Monitoring

Monitoring Performance Java Processing

Migrating Critical Traffic At Scale with No Downtime?—?Part 2

The Netflix TechBlog

JUNE 13, 2023

Our previous blog post presented replay traffic testing — a crucial instrument in our toolkit that allows us to implement these transformations with precision and reliability. A process that doesn’t just minimize risk, but also facilitates a continuous evaluation of the rollout’s impact.

Traffic

Traffic Metrics Systems Strategy

Migrating Critical Traffic At Scale with No Downtime?—?Part 1

The Netflix TechBlog

MAY 4, 2023

This blog series will examine the tools, techniques, and strategies we have utilized to achieve this goal. This blog post will provide a detailed analysis of replay traffic testing, a versatile technique we have applied in the preliminary validation phase for multiple migration initiatives.

Traffic

Traffic Latency Tuning Systems

Continuous integration and continuous delivery (CI/CD): How it enhances DevOps and continuous deployment

Dynatrace

APRIL 29, 2021

CI/CD is a series of interconnected processes that empower developers to build quality software through well-aligned and automated development, testing, delivery, and deployment. As Deloitte reports, continuous integration (CI) streamlines the process of internal software development. Continuous integration streamlines development.

DevOps

DevOps Logistics Code Software

Ready-to-go sample data pipelines with Dataflow

The Netflix TechBlog

DECEMBER 3, 2022

All the above commands are very likely to be described in separate future blog posts, but right now let’s focus on the dataflow sample command. One of the main reasons this feature exists is just like with food samples, to give you “a taste” of the production quality ETL code that you could encounter inside the Netflix data ecosystem.

Best Practices

Best Practices Code Testing Data Engineering

Automate CI/CD pipelines with Dynatrace: Part 3, Testing stage

Dynatrace

DECEMBER 18, 2023

In the last blog post of this series, we delved into how Dynatrace, functioning as a deploy-stage orchestrator, solves the challenges confronted by Site Reliability Engineers (SREs) during the early of automating CI/CD processes. This slow feedback and time spent rerunning tests can hinder the overall software deployment process.

Testing

Testing Best Practices Performance Testing Engineering

Automate CI/CD pipelines with Dynatrace: Part 2, Deploy stage

Dynatrace

NOVEMBER 28, 2023

In the previous installment of this blog series , we explored how to set up Dynatrace as a build-stage orchestrator to effectively address the challenges faced by Site Reliability Engineers (SREs). Deploy stage In the deployment stage, the application code is typically deployed in an environment that mirrors the production environment.

Traffic

Traffic Best Practices Strategy Engineering

The top eight DevSecOps trends in 2022

Dynatrace

FEBRUARY 23, 2022

Indeed, according to one survey, DevOps practices have led to 60% of developers releasing code twice as quickly. But increased speed creates a tradeoff: According to another study, nearly half of organizations consciously deploy vulnerable code because of time pressure. Increased adoption of Infrastructure as code (IaC).

Serverless

Serverless Infrastructure Innovation DevOps

Next generation Dynatrace Davis AI becomes the default causation engine

Dynatrace

NOVEMBER 26, 2019

Read on for links to blog posts that highlight the key benefits you get with our next-generation AI causation engine. These blog posts, published over the course of this year, span a huge feature set comprising Davis 2.0, Save time by directly analyzing code-level information. We opened up the Davis 2.0

Engineering

Engineering Serverless Metrics Code

Noisy Neighbor Detection with eBPF

The Netflix TechBlog

SEPTEMBER 10, 2024

One issue that often complicates this process is the "noisy neighbor" problem. In this blog post, we'll reveal how we leveraged eBPF to achieve continuous, low-overhead instrumentation of the Linux scheduler, enabling effective self-serve monitoring of noisy neighbor issues.

Latency

Latency Metrics Programming Monitoring

What is OpenShift and why automation matters

Dynatrace

JANUARY 5, 2021

However, with dynamic containers running in microservices, with increasingly frequent code pushes, and levels of abstraction away from the cloud infrastructure, how do you know how your applications are performing at any given time? The post What is OpenShift and why automation matters appeared first on Dynatrace blog.

Cloud

Cloud Infrastructure Operating System Monitoring

Automate CI/CD pipelines with Dynatrace: Part 1, Build stage

Dynatrace

NOVEMBER 17, 2023

In the first blog post of this series , we explored how the Dynatrace ® observability and security platform boosts the reliability of Site Reliability Engineers (SRE) CI/CD pipelines and enhances their ability to focus on innovation. In this blog post, we’ll focus on the first stage of the pipeline, the Build stage.

Innovation

Innovation Code Processing Architecture

Perform 2023 Guide: Organizations mine efficiencies with automation, causal AI

Dynatrace

FEBRUARY 10, 2023

Grail, the Dynatrace causational data lakehouse with a massively parallel processing analytics engine, unites observability, security, and business data from multicloud and cloud-native environments while retaining the data’s context to deliver precise answers in real time. What is a data lakehouse?

Efficiency

Efficiency Performance Analytics DevOps

What is DevSecOps?

Dynatrace

JANUARY 26, 2021

DevSecOps is a cross-team collaboration framework that integrates security into DevOps processes from the start rather than waiting to address security in a separate silo. DevOps has gained ground in recent years as a way to combine key operational principles with development cycles, recognizing that these two processes must coexist.

DevOps

DevOps Best Practices Open Source Tuning

NUnit Tutorial: Parameterized Tests With Examples

DZone

MAY 15, 2021

Cross-browser testing has become an integral part of the test process to ensure the product experience and behavior remain consistent across different combinations of web browsers, devices, and operating systems. This is where a parameterized test can be beneficial as it enables testing the code/methods against different input values.

Testing

Testing Operating System Code Processing

DevOps observability: A guide for DevOps and DevSecOps teams

Dynatrace

JANUARY 18, 2023

However, getting reliable answers from observability data so teams can automate more processes to ensure speed, quality, and reliability can be challenging. This drive for speed has a cost: 22% of leaders admit they’re under so much pressure to innovate faster that they must sacrifice code quality.

DevOps

DevOps Best Practices Innovation Strategy

How Dynatrace protects its software development and delivery life cycle against supply chain attacks

Dynatrace

DECEMBER 16, 2020

Typically, the attackers attempt to exploit some weakness in the vendor’s development or delivery life cycle and attempt to inject malicious code before an application is signed and certified. It all starts with the code. Dynatrace has established a secure SDL, which automatically enforces that all developed code is reviewed by a peer.

Software

Software Software Development AWS

Unlock the power of contextual log analytics

Dynatrace

OCTOBER 2, 2024

This shortens root cause analysis dramatically, as explained in our recent blog post Full Kubernetes logging in context from Fluent Bit to Dynatrace. This is explained in detail in our blog post, Unlock log analytics: Seamless insights without writing queries.

Analytics

Analytics AWS DevOps Cloud

Observability throughout the software development lifecycle increases delivery performance

Dynatrace

OCTOBER 4, 2024

Today, development teams suffer from a lack of automation for time-consuming tasks, the absence of standardization due to an overabundance of tool options, and insufficiently mature DevSecOps processes. This process begins when the developer merges a code change and ends when it is running in a production environment.

Software

Software Software Development Performance

Dynatrace joins the OpenTelemetry project

Dynatrace

JUNE 13, 2019

Dynatrace has been building automated application instrumentation—without the need to modify source code—for over 15 years already. Driving the implementation of higher-level APIs—also called “typed spans”—to simplify the implementation of semantically strong tracing code. What Dynatrace will contribute.

IoT

IoT C++ Analytics Java

Create compelling insights into business and operational KPIs through metric calculations in the Data explorer

Dynatrace

AUGUST 2, 2021

To achieve relevant insights, raw metrics typically need to be processed through filtering, aggregation, or arithmetic operations. Often referred to as calculated metrics (see Adobe Analytics and Google Analytics ), such metric processing takes one or more existing metrics as input to create a new user-defined metric.

Metrics

Metrics Analytics Google Code

Dynatrace leverages new AWS Lambda extensions for seamless end-to-end observability

Dynatrace

MAY 24, 2021

Dynatrace provides automatic and intelligent observability without touching any code through auto-instrumentation, thereby helping you to better understand potential issues that may impact your end users’ experience.

Lambda

Lambda AWS Serverless Java

Auto-adaptive thresholds for AI-driven quality gating

Dynatrace

JUNE 4, 2024

This process, known as auto-adaptive thresholding, eliminates the need to define a static threshold upfront. To provide automated feedback for developers, the concept of quality gates for static code analysis in continuous integration is widely adopted throughout the industry.

Metrics

Metrics Engineering Code Tuning

Automating DevOps practices fuels speed and quality

Dynatrace

JANUARY 13, 2022

Still, while DevOps practices enable developer agility and speed as well as better code quality, they can also introduce complexity and data silos. More seamless handoffs between tasks in the toolchain can improve DevOps efficiency, software development innovation, and better code quality. They need automated DevOps practices.

DevOps

DevOps Speed Artificial Intelligence Innovation

Maestro: Netflix’s Workflow Orchestrator

The Netflix TechBlog

JULY 22, 2024

By Jun He , Natallia Dzenisenka , Praneeth Yenugutala , Yingyi Zhang , and Anjali Norwood TL;DR We are thrilled to announce that the Maestro source code is now open to the public! This is useful if a workflow is designed to always process the latest data, such as processing the latest snapshot of an entire table each time.

Strategy

Strategy Scalability Code Engineering

Microsoft embeds Dynatrace natively in the Azure Portal

Dynatrace

JUNE 8, 2022

Easily send Azure logs and metrics to Dynatrace, adding to the Dynatrace platform’s extensive observability data, and extending advanced AIOps with code-level analysis to your complete Azure, hybrid, or multicloud environment. If yes, it instruments the process automatically – this process is continuous and applies to all new processes.

Azure

Azure Cloud Virtualization Innovation

New continuous compliance requirements drive the need to converge observability and security

Dynatrace

DECEMBER 12, 2024

Carefully planning and integrating new processes and tools is critical to ensuring compliance without disrupting daily operations. Visibility of all business processes starting from the back end and ending with customer experience is perhaps the biggest challenge.

Analytics

Analytics Government Efficiency Innovation

InfoSec 2022 guide: How DevSecOps practices drive organizational resilience

Dynatrace

JUNE 13, 2022

Open source code, for example, has generated new threat vectors for attackers to exploit. Considering open source software (OSS) libraries now account for more than 70% of most applications’ code base, this threat is not going anywhere anytime soon. Cloud operations and observability boost resilience for American Family – blog.

Open Source

Open Source DevOps Java Innovation

Part 1: How Dynatrace and GitHub help you deliver better software faster

Dynatrace

AUGUST 16, 2021

These include spending too much time on manual processes, finger-pointing due to siloed teams, and poor customer experience because of unplanned work. These problems are the drivers behind Dynatrace’s solution offering called Cloud Automation and this two-part blog series shows how to tackle these problems using GitHub Actions.

Software

Software Software Open Source Azure

Dynatrace wins AI Breakthrough Award for Davis AI engine

Dynatrace

AUGUST 26, 2020

Dynatrace automatically collects data not just from metrics, traces, and logs, but also user experience and code-level insights – all in context and mapped into a topology. The post Dynatrace wins AI Breakthrough Award for Davis AI engine appeared first on Dynatrace blog.

Engineering

Engineering DevOps Innovation AWS

What is OpenShift and why automation matters

Dynatrace

JANUARY 5, 2021

However, with dynamic containers running in microservices, with increasingly frequent code pushes, and levels of abstraction away from the cloud infrastructure, how do you know how your applications are performing at any given time? The post What is OpenShift and why automation matters appeared first on Dynatrace blog.

Cloud

Cloud Infrastructure Operating System Monitoring

RSA guide 2024: AI and security are top concerns for organizations in every industry

Dynatrace

MAY 2, 2024

In fact, according to the recent Dynatrace survey, “ The state of AI 2024 ,” 95% of technology leaders are concerned that using generative AI to create code could result in data leakage and improper or illegal use of intellectual property. In this blog, Carolyn Ford recaps her discussion with Tracy Bannon about AI in the workplace.

Artificial Intelligence

Artificial Intelligence Cloud Best Practices DevOps

AWS serverless services: Exploring your options

Dynatrace

OCTOBER 7, 2021

Amazon compute solutions are designed to streamline resource provisioning and container management with two services: AWS Lambda : Lambda provides serverless compute infrastructure that lets you run code in response to predetermined events or conditions and automatically manage all compute resources required for these processes.

Serverless

Serverless AWS Lambda Storage

Kubernetes made simple? Kelsey Hightower and Andreas Grabner discuss the future of cloud-native technologies

Dynatrace

FEBRUARY 17, 2022

I’ll make some assumptions, read multiple blog posts, and I need to run it myself a couple of times. So when people hear me explain things, it’s this process of convincing myself I completely understand it.”. There are stakeholders, dependencies, and end-users throughout the process. How does Kubernetes work?

Technology

Technology Technology Cloud Infrastructure

What is observability? Not just logs, metrics and traces

Dynatrace

OCTOBER 1, 2021

As more organizations adopt cloud-native architectures, they are also looking for ways to implement AIOps, harnessing AI as a way to automate more processes throughout the DevSecOps life cycle. An advanced observability solution can also be used to automate more processes, increasing efficiency and innovation among Ops and Apps teams.

Metrics

Metrics Open Source Monitoring Cloud

Part 2: How Dynatrace and GitHub help you deliver better software faster

Dynatrace

SEPTEMBER 29, 2021

This blog continues with more examples of Dynatrace’s Monitoring as Code (Monaco) and Service Level Objectives (SLOs) release validation using Dynatrace SaaS Cloud Automation. For orientation on the use cases in this blog series, refer to the picture below. Blog series use cases. Monitoring as Code workflow example.

Software

Software Software Open Source DevOps

Netflix’s Distributed Counter Abstraction

The Netflix TechBlog

NOVEMBER 12, 2024

By: Rajiv Shringi , Oleksii Tkachuk , Kartik Sathyanarayanan Introduction In our previous blog post, we introduced Netflix’s TimeSeries Abstraction , a distributed service designed to store and query large volumes of temporal event data with low millisecond latencies. This process can also be used to track the provenance of increments.

Latency

Latency Cache Infrastructure Strategy

Rebuilding Netflix Video Processing Pipeline with Microservices

Manage your monitoring as code with Dynatrace’s HashiCorp Terraform integration

Trending Sources

Progressive delivery at cloud scale: Optimizing CPU intensive code with Dynatrace

What is infrastructure as code? Discover the basics, benefits, and best practices

Incremental Processing using Netflix Maestro and Apache Iceberg

Software intelligence as code enables tailored observability, AIOps, and application security at scale

Path to NoOps part 2: How infrastructure as code makes cloud automation attainable—and repeatable—at scale

Boost application performance with improved CPU analysis across all your deep-monitored workloads

Migrating Critical Traffic At Scale with No Downtime?—?Part 2

Migrating Critical Traffic At Scale with No Downtime?—?Part 1

Continuous integration and continuous delivery (CI/CD): How it enhances DevOps and continuous deployment

Ready-to-go sample data pipelines with Dataflow

Automate CI/CD pipelines with Dynatrace: Part 3, Testing stage

Automate CI/CD pipelines with Dynatrace: Part 2, Deploy stage

The top eight DevSecOps trends in 2022

Next generation Dynatrace Davis AI becomes the default causation engine

Noisy Neighbor Detection with eBPF

What is OpenShift and why automation matters

Automate CI/CD pipelines with Dynatrace: Part 1, Build stage

Perform 2023 Guide: Organizations mine efficiencies with automation, causal AI

What is DevSecOps?

NUnit Tutorial: Parameterized Tests With Examples

DevOps observability: A guide for DevOps and DevSecOps teams

How Dynatrace protects its software development and delivery life cycle against supply chain attacks

Unlock the power of contextual log analytics

Observability throughout the software development lifecycle increases delivery performance

Dynatrace joins the OpenTelemetry project

Create compelling insights into business and operational KPIs through metric calculations in the Data explorer

Dynatrace leverages new AWS Lambda extensions for seamless end-to-end observability

Auto-adaptive thresholds for AI-driven quality gating

Automating DevOps practices fuels speed and quality

Maestro: Netflix’s Workflow Orchestrator

Microsoft embeds Dynatrace natively in the Azure Portal

New continuous compliance requirements drive the need to converge observability and security

InfoSec 2022 guide: How DevSecOps practices drive organizational resilience

Part 1: How Dynatrace and GitHub help you deliver better software faster

Dynatrace wins AI Breakthrough Award for Davis AI engine

What is OpenShift and why automation matters

RSA guide 2024: AI and security are top concerns for organizations in every industry

AWS serverless services: Exploring your options

Kubernetes made simple? Kelsey Hightower and Andreas Grabner discuss the future of cloud-native technologies

What is observability? Not just logs, metrics and traces

Part 2: How Dynatrace and GitHub help you deliver better software faster

Netflix’s Distributed Counter Abstraction

Stay Connected