article thumbnail

Test Planning Simplified

DZone

In my experiences of planning for testing in various environments, and across several teams and organizations, the value of that planning was never the document itself; rather, it was the thoughts and consideration of the activities, resources and potential risks and issues yet to be discovered.

Testing 203
article thumbnail

Ensuring the Successful Launch of Ads on Netflix

The Netflix TechBlog

In this blog post, we’ll discuss the methods we used to ensure a successful launch, including: How we tested the system Netflix technologies involved Best practices we developed Realistic Test Traffic Netflix traffic ebbs and flows throughout the day in a sinusoidal pattern. Basic with ads was launched worldwide on November 3rd.

Traffic 351
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Interpreting A/B test results: false positives and statistical significance

The Netflix TechBlog

Martin Tingley with Wenjing Zheng , Simon Ejdemyr , Stephanie Lane , and Colin McFarland This is the third post in a multi-part series on how Netflix uses A/B tests to inform decisions and continuously innovate on our products. Have a look at Part 1 (Decision Making at Netflix) and Part 2 (What is an A/B Test?). Need to catch up?

Testing 237
article thumbnail

Interpreting A/B test results: false negatives and power

The Netflix TechBlog

Martin Tingley with Wenjing Zheng , Simon Ejdemyr , Stephanie Lane , and Colin McFarland This is the fourth post in a multi-part series on how Netflix uses A/B tests to inform decisions and continuously innovate on our products. Have a look at Part 1 (Decision Making at Netflix), Part 2 (What is an A/B Test?), Need to catch up?

Testing 213
article thumbnail

Dynatrace completes 2024 FedRAMP Moderate reauthorization with Rev.5 transition

Dynatrace

FedRAMP assessments for Moderate and High systems now require an annual Red Team exercise (in addition to the previously required penetration tests). These exercises go beyond penetration testing by targeting multiple systems and potential avenues of attack.

article thumbnail

Recording on JMeter

DZone

This series helps you to learn Apache JMeter in a much simpler way with the relevant examples and exercises. To get started with application performance testing, the first step in JMeter is recording your business transactions. Recording the business flow helps to expedite the process of creating test plans. What Is Recording?

article thumbnail

Migrating Critical Traffic At Scale with No Downtime?—?Part 1

The Netflix TechBlog

This blog post will provide a detailed analysis of replay traffic testing, a versatile technique we have applied in the preliminary validation phase for multiple migration initiatives. In this testing strategy, we execute a copy (replay) of production traffic against a system’s existing and new versions to perform relevant validations.

Traffic 349