The Netflix TechBlog

MAY 4, 2023

This blog post will provide a detailed analysis of replay traffic testing, a versatile technique we have applied in the preliminary validation phase for multiple migration initiatives. In this testing strategy, we execute a copy (replay) of production traffic against a system’s existing and new versions to perform relevant validations.

Traffic 347

Traffic Latency Tuning Systems 347

DZone

NOVEMBER 28, 2021

In the process of testing a software application, test plans and test strategies are quite crucial. A strong test plan and strategy will always prevent errors in the application. As software testers, we should be aware of these 2 phrases, as they are critical in testing software applications.

Strategy 278

Strategy Testing Software Software 278

DZone

OCTOBER 14, 2020

Selenium Grid has been an integral part of automation testing, as it lets you perform test case execution on different combinations of browsers, operating systems (or platforms), and machines. It also enables you to perform parallel execution to expedite the cross-browser testing process.

Testing 203

Testing Operating System Performance Testing Architecture 203

Dynatrace

NOVEMBER 30, 2023

Below is a Dynatrace honeycomb chart depicting the performance of the synthetics tests tracked by the Dynatrace Business Insights team. These tests open the retail home pages from various locations across America on a consistent basis. For example, this year I was doing comparisons of headphones to purchase.

Retail 278

Retail Social Media Performance Benchmarking 278

Percona

MARCH 20, 2023

micro) The tests We will have very simple test cases. The second test will define how well the increasing load is served inside the previously identified range. Brief summary This test highlights that HAProxy and ProxySQL can reach a level of connection higher than the slowest runner in the game (MySQL Router).

Games 141

Games Latency Traffic Cache 141

DZone

MARCH 8, 2024

Finite state machines (FSMs) offer a solution by modeling system behavior as states and transitions, a useful tool that can help software engineers understand software behavior and design effective test cases. We will also make a short comparison between the usefulness and applicability of FSMs and program graphs in software testing.

Software 162

Software Software Testing Software Engineering 162

The Netflix TechBlog

JUNE 13, 2023

Our previous blog post presented replay traffic testing — a crucial instrument in our toolkit that allows us to implement these transformations with precision and reliability. Compared to replay testing, canaries allow us to extend the validation scope beyond the service level.

Traffic 285

Traffic Metrics Systems Strategy 285

Scalegrid

JUNE 4, 2020

PostgreSQL DigitalOcean Performance Test. Now, let’s take a look at the throughput and latency performance of our comparison. Next, we are going to test and compare the latency performance between ScaleGrid and DigitalOcean for PostgreSQL. We used 50% reads and 50% writes in this comparison. Compare Pricing. Throughput.

Database 230

Database Latency Benchmarking Performance 230

The Netflix TechBlog

AUGUST 28, 2020

Bitrate versus quality comparison For a sample of titles from the 4K collection, the following plots show the rate-quality comparison of the fixed-bitrate ladder and the optimized ladder. Acknowledgements We thank Lishan Zhu for help rendered during A/B testing. The 8-bit stream profiles go up to 1080p resolution.

Network 336

Network Storage Innovation Mobile 336

DZone

OCTOBER 11, 2022

A handy list of RSS readers with feature comparisons ( Hacker News). Improving testing by using real traffic from production ( Hacker News). Simpler UI Testing with CasperJS ( Architects Zone – Architectural Design Patterns & Best Practices). SAP to acquire Hybris to jumpstart its presence in e-commerce ( VentureBeat).

Java 244

Java Best Practices Google Analytics 244

Dynatrace

MAY 28, 2020

After a new build gets deployed and automated tests executed, SLIs are evaluated against their SLOs and, depending on that result, a build is considered good (promoted) or bad (rolled back). “ The app description and supporting files such as load testing scripts are on the Keptn Example GitHub. This is what this blog is all about.

Engineering 270

Engineering Performance Metrics Best Practices 270

Scalegrid

AUGUST 26, 2020

Check out our Benchmark Configuration section below the performance report to see how these tests were configured. Let’s take a look at the configurations we used in the performance benchmark: Configuration Comparison. MySQL Read-Intensive Performance. Benchmark configurations.

Azure 299

Azure Benchmarking Database Latency 299

DZone

FEBRUARY 27, 2021

There were languages I briefly read about, including other performance comparisons on the internet. According to other comparisons [Google for 'Performance of Programming Languages'] spread over the net, they clearly outshine others in all speed benchmarks. Input The input will contain several test cases (not more than 10).

Java 214

Java C++ Benchmarking Programming 214

Dynatrace

DECEMBER 27, 2022

Stable, well-calibrated SLOs pave the way for teams to automate additional processes and testing throughout the software delivery lifecycle. SLOs can be a great way for DevOps and infrastructure teams to use data and performance expectations to make decisions, such as whether to release and where engineers should focus their time.

Software 306

Software Software Benchmarking Latency 306

Dynatrace

NOVEMBER 28, 2023

This step is crucial as this environment is used for the final validation and testing phase before the code is released into production. Furthermore, augmenting test coverage to mirror the scenarios encountered in production is imperative. This stage ensures the code meets the required quality standards before it goes live.

Traffic 279

Traffic Best Practices Strategy Engineering 279

Smashing Magazine

JULY 19, 2021

Maintaining End-To-End Quality With Visual Testing. Maintaining End-To-End Quality With Visual Testing. Testing is a critical part of any developer’s workflow. But often automated tests can be a pain to manage. A Quick Look At Some Of The Types Of Automated Testing. Colby Fayock. 2021-07-19T10:30:00+00:00.

Testing 144

Testing Code Design Strategy 144

Scalegrid

APRIL 28, 2020

Here are the configurations for this comparison: Plan. See performance tests to determine the impact of the Meltdown CPU kernel patch on your MongoDB servers. Dedicated Hosting. MongoDB® Database. Replication Strategy. 2 Replicas + Arbiter. Meltdown Performance Impact on MongoDB: AWS, Azure & DigitalOcean. Learn more.

Azure 344

Azure AWS Database Latency 344

DZone

AUGUST 6, 2021

Introduction. As performance testers, we are often asked to compare the difference in the performance between two versions of an application. Whatever the changes made in the second version (i.e., usage of new libraries, change of technological stack, etc.),

Testing 246

Testing Technology Technology Performance 246

Dynatrace

JULY 13, 2021

As organizations aim for faster delivery of value to their customers, the frequency of releases inevitably increases, which introduces risks and uncertainty into production systems—unless automated tests and quality gates can be leveraged to provide confidence. Automated comparison of different timeframes based on SLIs and SLOs.

Cloud 246

Cloud DevOps Benchmarking Speed 246

Daniel Lemire

FEBRUARY 8, 2019

The divisibility test is similar… uint64_t c = 1 + UINT64_C ( 0xffffffffffffffff ) / d ; // given precomputed c, checks whether n % d == 0. To test it out, we did many things, but in one particular tests, we used a hashing function that depends on the computation of the remainder. . ; // your divisor > 0.

C++ 279

C++ Benchmarking Hardware Testing 279

Dynatrace

JULY 15, 2024

As HTTP and browser monitors cover the application level of the ISO /OSI model , successful executions of synthetic tests indicate that availability and performance meet the expected thresholds of your entire technological stack. into NAM test definitions. Our script, available on GitHub , provides details.

Availability 246

Availability Network Monitoring Infrastructure 246

Dynatrace

JANUARY 31, 2022

On the left side of the loop, teams plan, develop, and test software in pre-production. Shift-left is the practice of moving testing, quality, and performance evaluation early in the software development process, thus the process of shifting to the “left” side of the DevOps lifecycle.

DevOps 246

DevOps Testing Monitoring Speed 246

Dynatrace

JANUARY 31, 2022

On the left side of the loop, teams plan, develop, and test software in pre-production. Shift-left is the practice of moving testing, quality, and performance evaluation early in the software development process, thus the process of shifting to the “left” side of the DevOps lifecycle.

DevOps 246

DevOps Testing Monitoring Speed 246

CSS Wizardry

OCTOBER 16, 2023

In one test, I concatenated it all into one big file, and the other had the library split into 12 files. Read the complete test methodology. In our specific examples above, the one-big-file pattern incurred 201ms of latency, whereas the many-files approach accumulated 4,362ms by comparison. This will be referred to as css_time.

Cache 353

Cache Latency Strategy Speed 353

Dynatrace

FEBRUARY 10, 2021

Automated release inventory and version comparison , which allows teams to easily evaluate the performance of individual release versions, and as needed, roll back to a previous version. Automated release inventory and version comparison. ” – Wim Verhaeghe, KBI-Connect DevOps team lead at Inetum-Realdolmen.

Cloud 242

Cloud DevOps Speed Metrics 242

Dynatrace

MAY 24, 2023

Not only do operations personnel now have an easier time deploying synthetic tests faster with fewer resources, it’s also no longer necessary to track utilization. Kubernetes takes care of keeping the necessary minimum number of nodes alive for executing all the tests assigned to a location.

Scalability 246

Scalability Virtualization Monitoring Open Source 246

O'Reilly

DECEMBER 10, 2024

That seemed like something worth testing outor at least playing around withso when I heard that it very quickly became available in Ollama and wasnt too large to run on a moderately well-equipped laptop, I downloaded QwQ and tried it out. How do you test a reasoning model? But thats hardly a valid test.

C++ 102

C++ Design Google Games 102

Speed Curve

AUGUST 22, 2021

A short while ago we introduced the ability to bookmark and compare synthetic tests. Today we've made comparing tests even easier by including an option to compare directly from the chart you are focused on. While the capability to bookmark tests remains, this enhancement streamlines the process for quick comparison.

Testing 52

Testing Processing 52

The Netflix TechBlog

NOVEMBER 29, 2023

A vital aspect of such development is subjective testing with HDR encodes in order to generate training data. The pandemic, however, posed unique challenges in conducting a conventional in-lab subjective test with HDR encodes. A/B testing also allows us to get a read on the improvement in quality of experience (QoE).

Open Source 260

Open Source Software Engineering Internet Internet 260

Scalegrid

JUNE 22, 2020

We are going to use a common, popular plan size using the below configurations for this performance benchmark: Comparison Overview. In this benchmark, we compare equivalent plan sizes between ScaleGrid MySQL on DigitalOcean and DigitalOcean Managed Databases for MySQL. DigitalOcean. Instance Type. Medium: 4 vCPUs. Medium: 4 vCPUs.

Database 217

Database Benchmarking Latency Performance 217

Dynatrace

APRIL 21, 2022

In comparison, the Dynatrace platform reliably takes that burden off human operators by utilizing its causation-based AI engine, Davis. Some principles Microsoft provides to help organizations across this area include: Define and test availability targets such as service level agreements (SLAs) and SLOs.

Azure 246

Azure Monitoring Virtualization Metrics 246

Dynatrace

FEBRUARY 21, 2020

By running two app versions at the same time, our customers can leverage funnel charting for A/B testing. A/B testing enables Dynatrace customers to compare different journeys to see which one is more effective and then implement improvements accordingly. Understand which strategy works best by comparing different app versions.

Strategy 249

Strategy Monitoring Testing Software 249

Scalegrid

MARCH 23, 2020

As you can see, Pgpool and PgBouncer have rather differing strengths – in our final post of the series, we will do a head-to-head testing, and feature comparison! Stay tuned!

Cache 264

Cache Servers Architecture Processing 264

Smashing Magazine

MARCH 2, 2021

The State Of Mobile And Why Mobile Web Testing Matters. The State Of Mobile And Why Mobile Web Testing Matters. And to ensure the quality of a product, we always need to test — on a number of devices, and in a number of conditions. What’s a representative device to test on in 2021? Kelvin Omereshone. State Of Mobile 2021.

Mobile 142

Mobile Testing Website Benchmarking 142

Dynatrace

JANUARY 16, 2023

In comparison, on-premises clusters have more and larger nodes: on average, 9 nodes with 32 to 64 GB of memory. This trend shows that organizations are dedicating significantly more Kubernetes clusters to running software build, test, and deployment pipelines. Kubernetes infrastructure models differ between cloud and on-premises.

Open Source 358

Open Source Java Operating System Programming 358

Scalegrid

JULY 8, 2019

You’ll learn more about the best instance types and disks to use below, and you can check out this MySQL Provider Comparison to see the advantages and limitations of the top four managed MySQL solutions, ScaleGrid, Compose, Azure Database, and Amazon RDS. MySQL Dev/Test Environments: Standard Disks. High Availability Deployment.

Azure 219

Azure Cloud Virtualization Database 219

The Morning Paper

OCTOBER 1, 2020

To our knowledge, this is the first exploration of a practical general purpose real number type that both reflects the mathematical laws of the real numbers, and also supports exact comparisons in situations in which that’s normally expected. The scheme above gives arbitrary precision, but doesn’t let us test for equality.

Java 143

Java Open Source Hardware Testing 143