Remove Exercise Remove Strategy Remove Testing
article thumbnail

Ensuring the Successful Launch of Ads on Netflix

The Netflix TechBlog

In this blog post, we’ll discuss the methods we used to ensure a successful launch, including: How we tested the system Netflix technologies involved Best practices we developed Realistic Test Traffic Netflix traffic ebbs and flows throughout the day in a sinusoidal pattern. Basic with ads was launched worldwide on November 3rd.

Traffic 351
article thumbnail

Test Planning Simplified

DZone

In my experiences of planning for testing in various environments, and across several teams and organizations, the value of that planning was never the document itself; rather, it was the thoughts and consideration of the activities, resources and potential risks and issues yet to be discovered.

Testing 203
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Migrating Critical Traffic At Scale with No Downtime?—?Part 1

The Netflix TechBlog

This blog series will examine the tools, techniques, and strategies we have utilized to achieve this goal. This blog post will provide a detailed analysis of replay traffic testing, a versatile technique we have applied in the preliminary validation phase for multiple migration initiatives. This approach has a handful of benefits.

Traffic 349
article thumbnail

Interpreting A/B test results: false negatives and power

The Netflix TechBlog

Martin Tingley with Wenjing Zheng , Simon Ejdemyr , Stephanie Lane , and Colin McFarland This is the fourth post in a multi-part series on how Netflix uses A/B tests to inform decisions and continuously innovate on our products. Have a look at Part 1 (Decision Making at Netflix), Part 2 (What is an A/B Test?), Need to catch up?

Testing 213
article thumbnail

Panel Recap: How is your performance and reliability strategy aligned with your customer experience?

Dynatrace

I recently joined two industry veterans and Dynatrace partners, Syed Husain of Orasi and Paul Bruce of Neotys as panelists to discuss how performance engineering and test strategies have evolved as it pertains to customer experience. Dynatrace news. This blog summarizes our great conversation for the posed questions.

Strategy 190
article thumbnail

Site-Speed Topography

CSS Wizardry

Any time you run a test with WebPageTest, you’ll get this table of different milestones and metrics. Note the bottom row shows me the Standard Deviation of the tests’ results. The whole point of the exercise that follows is to allow me to move quickly, spotting patterns from afar, and not having to do any slow or meticulous work yet.

Speed 328
article thumbnail

Strategy

The Agile Manager

A few months ago I was asked to review a product strategy a team had put together. I had to give them the unfortunate feedback that what they had created was a document with a lot of words, but those words did not articulate a strategy. There is a formula for articulating strategy. The actions must be, well, actionable.