The Netflix TechBlog

DECEMBER 3, 2022

The most commonly used one is dataflow project , which helps folks in managing their data pipeline repositories through creation, testing, deployment and few other activities. Workflow Definitions Below you can see a typical file structure of a sample workflow package written in SparkSQL. ??? backfill.sch.yaml ??? daily.sch.yaml ???

Best Practices 362

Best Practices Code Testing Data Engineering 362

DZone

JULY 20, 2020

Taking part in testing more than 50 projects we saw how tests can give confidence in the code base, begin to save time for the entire development team and help to comply with business requirements. For those who come from other ecosystems, let us first explain what the term “functional tests” means in Symfony.

Testing 178

Testing Code Development Performance Testing 178

Alex Podelko

SEPTEMBER 8, 2020

Some time ago Federico Toledo published Performance Testing with Open Source Tools- Busting The Myths. While Federico definitely has good points there, there is some truth in these myths too. I remember really liking the technical side of these tests. What load testing tools did you use? What is your business model?

Open Source 223

Open Source Performance Testing Testing Performance 223

DZone

JULY 19, 2021

The quality can be subjective, so different teams may use different definitions based on the context. Code can be considered good quality if it is clear, simple, well tested, bug-free, refactored, documented, and performant. Keeping good code quality is also crucial for developing safety-critical systems.

Code 278

Code Metrics Testing Systems 278

The Netflix TechBlog

JUNE 14, 2023

The three strategies we will discuss today are AB Testing , Replay Testing, and Sticky Canaries. To launch Phase 1 safely, we used AB Testing. To launch Phase 2 safely, we used Replay Testing and Sticky Canaries. We knew we could test the same query with the same inputs and consistently expect the same results.

Traffic 358

Traffic Latency Metrics Cache 358

DZone

JUNE 18, 2020

To facilitate the development of robust, error-free code, Apex supports the creation and execution of unit tests. Unit tests are class methods that verify whether a particular piece of code is working properly. Unit test methods take no arguments, commit no data to the database, and send no emails.

Testing 147

Testing Database Code Development 147

Dynatrace

JULY 22, 2022

Given this capability, you can now define user groups such as: Developer : Permission to deploy or test a service in a particular project that’s in development. Product Engineer or Release Manager: Permission to approve the release of applications into the hardening stage for load testing, or into production for end-user usage.

Cloud 239

Cloud DevOps Best Practices Engineering 239

The Netflix TechBlog

FEBRUARY 9, 2022

The important thing is that this business logic can be built in a separate repository and maintained independently from the workflow definition. ACID deployment : for every scheduler workflow definition change, we would like to have all the workflow assets bundled in an atomic, durable, isolated and consistent manner.

Storage 213

Storage Data Engineering Testing Code 213

Dynatrace

AUGUST 27, 2024

To help determine how customers can comply with DORA requirements, DORA’s articles can be classified in the following three categories: Definition : Describes terms and the scope of the act. Thus, Site Reliability Guardian supports DevOps and SREs in continuously testing application releases to improve release quality.

Best Practices 276

Best Practices Government DevOps Analytics 276

Dynatrace

MARCH 3, 2020

One way to apply improvements is transforming the way application performance engineering and testing is done. This involves new software delivery models, adapting to complex software architectures, and embracing automation for analysis and testing. Here is the definition of this model: ?. Performance-as-a-self-service .

Performance 253

Performance Education Innovation Software Architecture 253

The Netflix TechBlog

JULY 22, 2024

It supports a wide range of workflow use cases, including ETL pipelines, ML workflows, AB test pipelines, pipelines to move data between different storages, etc. A workflow definition is defined in a JSON format. A Maestro workflow definition comprises two main sections: properties and versioned workflow including its metadata.

Strategy 260

Strategy Scalability Code Engineering 260

Dynatrace

JANUARY 17, 2022

A new preview section enables you to test the definition iteratively against actual values before creating the SLO. On the Service-level objectives page, the Actions > Edit SLO entry has been renamed SLO definition. Removed seven-day preview from create/edit custom event for alerting pages.

Metrics 209

Metrics Monitoring Availability Testing 209

Dynatrace

JULY 16, 2021

Many of our users are performance engineers using Cloud Automation Quality Gates to automate the analysis of their performance and load tests – saving hours of analysis time for each test they run. Whether it’s used to automate your test analysis or fully integrated into your delivery pipeline, this blog will guide you through it!

DevOps 246

DevOps Open Source Cloud Azure 246

Dynatrace

FEBRUARY 18, 2021

To improve the naming of our navigation menu entries, we will soon conduct A/B testing for one of the main entry points to the Dynatrace navigation menu. Definitely not. A/B testing. Therefore we want to test if the new terminology is easier to find for users and fulfills our assumptions and hypothesis.

Testing 246

Testing Java Tuning DevOps 246

The Netflix TechBlog

JULY 30, 2019

This allows us to proactively push changes to the open source version while ensuring that the changes are fully functional and well-tested. Adoption As of writing this blog, Conductor orchestrates 600+ workflow definitions owned by 50+ teams across Netflix. The ability to dynamically create and execute workflows removes this friction.

Lambda 192

Lambda Media Open Source Metrics 192

Dynatrace

MAY 19, 2022

This helps SRE teams quickly mitigate issues by turning off poorly-performing features, enabling features for specific subsets of end-users, or performing side-by-side A/B feature testing. Feature flag solutions currently use proprietary SDKs with frameworks, definitions, and data/event types that are unique to their platforms.

Java 269

Java Cloud Code Technology 269

Dynatrace

JULY 15, 2024

As HTTP and browser monitors cover the application level of the ISO /OSI model , successful executions of synthetic tests indicate that availability and performance meet the expected thresholds of your entire technological stack. into NAM test definitions. Our script, available on GitHub , provides details.

Availability 242

Availability Network Monitoring Infrastructure 242

The Netflix TechBlog

JUNE 13, 2023

Migrating Critical Traffic At Scale with No Downtime — Part 2 Shyam Gala , Javier Fernandez-Ivern , Anup Rokkam Pratap , Devang Shah Picture yourself enthralled by the latest episode of your beloved Netflix series, delighting in an uninterrupted, high-definition streaming experience. This is where large-scale system migrations come into play.

Traffic 287

Traffic Metrics Systems Strategy 287

Dynatrace

SEPTEMBER 4, 2020

First, let me take a moment to thank Klaus Enzenhofer, Technical Product Manager at Dynatrace, who challenged me to make SLI & SLO definition simpler so that it is more appealing to a non-deep technical user base. For that Keptn already offers integrations with JMeter and Neoload with other testing tool integrations in the works.

DevOps 252

DevOps Metrics Innovation Azure 252

Dynatrace

MARCH 8, 2021

With the monitoring flexibility that comes with Dynatrace, it’s impossible to test and describe all technologies, use cases, and possible scenarios. Based on the number of product ideas already submitted in the forums, we know that the above quote is definitely true! Ranks is definitely the most awaited form of gamification.

Innovation 231

Innovation Testing Monitoring Technology 231

DZone

FEBRUARY 27, 2021

But these are definitely ruled out for enterprise applications due to the complexity in development, maintainability, need for object orientation, and interoperability. Input The input will contain several test cases (not more than 10). Each test case is a single line with a number n, 0 <= n <= 1 000 000 000.

Java 214

Java C++ Benchmarking Programming 214

Dynatrace

MAY 12, 2022

The title size of a tile has been moved from the dashboard definition to the dashboard metadata definition and included in the advanced settings UI for dashboards. Test connection button for CloudFoundry settings and Kubernetes cluster settings pages is now disabled for users with missing `settings:write permissions`.

Tuning 205

Tuning Metrics Cloud Mobile 205

Dynatrace

JULY 30, 2021

The first hands-on session is easy to accomplish the 5-minute success challenge, but things heat up in our second session as we walk attendees through either Codifying the SLOs in YAML or using a Dashboard-based definition approach. This is where the dashboard-based quality gate definition comes in. Hands-on 2: Codify your SLOs.

Cloud 214

Cloud DevOps Azure Virtualization 214

The Netflix TechBlog

MAY 19, 2023

Netflix application identities are fundamentally attribute based: e.g. an instance of the Data Processor runs in eu-west-1 in the test environment with a public shard. Why did Netflix Want Caveated Relationships? Authorizing these identities is done not only by application name, but by specifying specific attributes on which to match.

Cache 257

Cache Google Open Source Systems 257

CSS Wizardry

NOVEMBER 9, 2018

This is definitely a bug in WebKit/Blink—missing quotes shouldn’t hide the @import ed stylesheet from the Preload Scanner. Test, test, test. Everything I have outlined above adheres to specs or known/expected behaviour, but, as always, test everything yourself. Test and measure.

Network 279

Network Performance Media Cache 279

CSS Wizardry

AUGUST 14, 2024

A/B Testing and Experimentation blocking=render ’s application in client-side A/B testing is, for me, its most compelling use-case. Client-side A/B testing tools work by altering the DOM and presenting a variant of a component to a user. This is already happening and you don’t need blocking=render.

C++ 260

C++ Testing Tools Government Testing 260

Dynatrace

NOVEMBER 30, 2023

Below is a Dynatrace honeycomb chart depicting the performance of the synthetics tests tracked by the Dynatrace Business Insights team. These tests open the retail home pages from various locations across America on a consistent basis. This type of issue would definitely affect conversion rates on a retail site.

Retail 234

Retail Social Media Performance Benchmarking 234

Testsigma

MARCH 12, 2021

Robotic Process Automation and Test Automation are two confusing terms in testing processes. Similar to TDD and BDD processes, RPA and test automation seem like a single branch of the test segment which is common to be exchanged in communication during planning. What is Test Automation?

Artificial Intelligence 97

Artificial Intelligence Testing Energy Analytics 97

The Netflix TechBlog

FEBRUARY 16, 2021

Operational Efficiency: The majority of the changes require metadata configuration files and library code changes, usually taking days of testing and service release to adopt the updates. Overall, it simplified SKU selections and increased our testing and product delivery confidence.

Mobile 220

Mobile Engineering Infrastructure Scalability 220

The Netflix TechBlog

FEBRUARY 3, 2021

Instead, the schema gets generated at runtime based on definitions in code. Another key feature is support for lightweight query tests. These tests allow you to execute queries without the need to work with the HTTP endpoint. The tests look and feel like plain JUnit tests.

Open Source 246

Open Source Java Architecture Metrics 246

Dynatrace

APRIL 10, 2020

It was also interesting because the plugin – while definitely solving a good use case – wasn’t really used by our teams any longer. Our IAS team has also setup a Synthetic test to validate the performance of Jenkins and its different APIs our teams are using to automate our pipelines. Step #3 – Removing the offending plugin.

Java 259

Java Performance DevOps Engineering 259

Testsigma

APRIL 4, 2022

A common theme among most software testing organizations is their escalating interest in Test Automation. While test automation has grown in popularity, there are still many myths and biases surrounding it. Such myths can unknowingly create a self-limiting boundary and negatively impact the possibilities of test automation.

Testing 95

Testing Open Source IoT Programming 95

The Netflix TechBlog

AUGUST 22, 2019

Artisan Crafted Images In the Netflix full cycle DevOps culture the team responsible for building a service is also responsible for deploying, testing, infrastructure, and operation of that service. The configuration file, referenced scripts, and artifact dependency definitions all live in an internal git repository.

DevOps 211

DevOps AWS Tuning Infrastructure 211

Dynatrace

MARCH 31, 2020

By investigating these questions, we distilled these two pain points: Following definition of application detection rules, some users don’t see traffic from the correct URLs in the corresponding Dynatrace applications (i.e., Gain control over the setup and testing of your application detection rules. Prerequisites.

Traffic 173

Traffic Monitoring Mobile Design 173

Scalegrid

JANUARY 20, 2020

This extra cluster, known as a follower cluster, can be leveraged for multiple use cases, including for analyzing, optimizing and testing your application performance for MongoDB , MySQL and PostgreSQL. The ‘follower’ system is writable, so you can use it as a staging environment to test your application changes. Data Analytics.

Analytics 185

Analytics Database Storage Systems 185

DZone

NOVEMBER 9, 2021

Saving several hours preparing and doing a design review will cost hundreds (if not thousands of hours) of fixing issues down the road.nn> unit testsnnI don’t believe that I have to say that in 2021, but I have never seen a quality product without unit tests. We live in a time when everybody is irked by manual testing.

Software 245

Software Software Code Design 245

CSS Wizardry

SEPTEMBER 6, 2022

In a reduced test case like this, it’s blindingly obvious that Critical CSS is a wasted effort. We’ve fetched the file asynchronously but had zero impact on performance, because anything synchronous in the is render-blocking by definition. Test everything. before you were ready to go anyway. We’ve achieved nothing.

Media 356

Media Cache Network Website 356