The Netflix TechBlog

NOVEMBER 12, 2024

Use Cases and Requirements At Netflix, our counting use cases include tracking millions of user interactions, monitoring how often specific features or experiences are shown to users, and counting multiple facets of data during A/B test experiments , among others.

Latency 251

Latency Cache Infrastructure Strategy 251

DZone

NOVEMBER 9, 2021

Saving several hours preparing and doing a design review will cost hundreds (if not thousands of hours) of fixing issues down the road.nn> unit testsnnI don’t believe that I have to say that in 2021, but I have never seen a quality product without unit tests. We live in a time when everybody is irked by manual testing.

Software 245

Software Software Code Design 245

Dynatrace

DECEMBER 23, 2020

Especially in dynamic microservices architectures, distributed tracing is essential to monitor, debug, and optimize distributed software architecture, such as microservices. Distributed tracing is one of several capabilities key to achieving the observability that modern enterprises demand. How does distributed tracing work?

Infrastructure 246

Infrastructure Cloud Monitoring Metrics 246

The Netflix TechBlog

DECEMBER 3, 2019

The infrastructure should allow them to exercise their freedom as data scientists but it should provide enough guardrails and scaffolding, so they don’t have to worry about software architecture too much. It allows data scientists to develop and test code quickly on your laptop, similar to any Python script.

Open Source 238

Open Source AWS Infrastructure Energy 238

Dynatrace

DECEMBER 23, 2020

Especially in dynamic microservices architectures, distributed tracing is essential to monitor, debug, and optimize distributed software architecture, such as microservices. Distributed tracing is one of several capabilities key to achieving the observability that modern enterprises demand. How does distributed tracing work?

Infrastructure 225

Infrastructure Cloud Monitoring Metrics 225

Dynatrace

SEPTEMBER 16, 2019

A state of ACM and NoOps is not something you can buy off the shelf or by combining a set of “cloud tools” It is a mind shifting change that improves on the way companies build, test, deliver and release software, introducing new technologies and changing how existing technologies are used. Not sure where to start?

Cloud 196

Cloud Education Monitoring Software Architecture 196

Percona

MARCH 21, 2023

Tenants Multi-tenancy is a software architecture pattern where a single instance of a software application serves multiple tenants, allowing them to share resources like storage, processing power, and memory while maintaining separate, secure access to their respective data.

Serverless 143

Serverless Software Architecture Virtualization Database 143

ScaleOut Software

JUNE 29, 2018

While the model alone does not provide specific APIs for predictive analytics or machine learning, its architecture provides an organizational structure for hosting application-specific algorithms so that they have immediate access to the context they need for deep introspection. This is the case with digital twins.

Software Architecture 40

Software Architecture Architecture Software Software 40

ScaleOut Software

JUNE 29, 2018

While the model alone does not provide specific APIs for predictive analytics or machine learning, its architecture provides an organizational structure for hosting application-specific algorithms so that they have immediate access to the context they need for deep introspection. This is the case with digital twins.

Software Architecture 40

Software Architecture Architecture Software Software 40

O'Reilly

OCTOBER 19, 2021

The applications must be integrated to the surrounding business systems so ideas can be tested and validated in the real world in a controlled manner. Software Architecture. They are often built by data scientists who are not software engineers or computer science majors by training. Why did something break?

DevOps 145

DevOps Software Engineering Infrastructure Open Source 145

Strategic Tech

NOVEMBER 1, 2021

or “How do software architecture, domains, Conway’s Law, Team Topologies, and value streams all fit together?”. Some teams have complicated branching and testing processes which need accentuating, especially when legacy systems are involved or deploying to app stores. The details can vary quite a lot.

Software Architecture 98

Software Architecture Architecture DevOps Software 98

O'Reilly

MARCH 2, 2020

Fetishizing unit testing. Development timelines for these projects aren’t as predictable as traditional software; they stretch the meaning of “testing” in strange ways; they aren’t deterministic. Progress in developing software tends to be slow, incremental, and fairly well understood.

Artificial Intelligence 27

Artificial Intelligence Software Architecture Programming C++ 27

O'Reilly

FEBRUARY 2, 2020

On one hand, ops groups are in a good position to do this; they’re already heavily invested in testing, monitoring, version control, reproducibility, and automation. This has important implications for testing. In the last two decades, a tremendous amount of work has been done on testing and building test suites.

Software Architecture 108

Software Architecture Monitoring Software Engineering Code 108

The Netflix TechBlog

DECEMBER 3, 2019

The infrastructure should allow them to exercise their freedom as data scientists but it should provide enough guardrails and scaffolding, so they don’t have to worry about software architecture too much. It allows data scientists to develop and test code quickly on your laptop, similar to any Python script.

Open Source 135

Open Source AWS Infrastructure Energy 135

The Netflix TechBlog

MAY 19, 2023

Netflix application identities are fundamentally attribute based: e.g. an instance of the Data Processor runs in eu-west-1 in the test environment with a public shard. Why did Netflix Want Caveated Relationships? Authorizing these identities is done not only by application name, but by specifying specific attributes on which to match.

Cache 255

Cache Google Open Source Systems 255

Adrian Cockcroft

MARCH 21, 2020

AB Testing?—?So The first thing I found was that every user visible change we made went through an A/B test. An oft-quoted study by Microsoft Bing found that of the changes they test, one-third prove effective, one-third have neutral results, and one-third have negative results. So You Know What Really Works ??Castillo

Testing 52

Testing Tuning Database Cache 52

O'Reilly

AUGUST 9, 2022

Copilot users still need to be programmers; they need to know whether the code that Copilot supplies is correct, and they need to know how to test it. Is the craft of software architecture different from the craft of programming? We don’t really have a good language for describing software design.

Programming 119

Programming Java C++ Design 119

Smashing Magazine

NOVEMBER 22, 2021

In particular, lab tests are critical for implementing performance budgets in order to prevent performance degradations. This requires the ability to test a very large number of configurations. Currently, WatchTower is able to execute up to 1,000 Lighthouse tests per minute.

Website 141

Website Performance Google Website Performance 141

O'Reilly

NOVEMBER 12, 2019

“Integration/testing is harder” ranked as the third biggest worry, noted by 30% of respondents. Testing is more complex and labor intensive for serverless architectures, with more scenarios to address and different types of dependencies (e.g., latency, startup, mocking, etc.) changing the integration landscape—at least for now.

Serverless 94

Serverless Architecture FinTech Infrastructure 94

O'Reilly

MAY 19, 2020

37% pro-experimentation, 63% anti—fewer respondent organizations have “experimented” with serverless computing, e.g., by evaluating vendors, scoping serverless scenarios, or testing serverless on a limited basis. It’s an important concept in software architecture, especially in next-generation regimes, such as microservice architecture.

Cloud 144

Cloud Serverless AWS DevOps 144

Apica

OCTOBER 17, 2022

All of these aspects of a digital user journey should be tested by a person. There’s nothing wrong with wanting the reassurance of good old-fashioned human-based user acceptance testing (UAT). Indeed, there was a time when applications were vertical stacks of software atop networks and servers wholly owned by the company.

Retail 52

Retail Website Infrastructure Software Architecture 52

Adrian Cockcroft

MARCH 21, 2020

When I joined Netflix in 2007 I was managing a team that built the personalized home page for the DVD shipping web site. The first thing I… Continue reading on The Startup ».

Testing 52

Testing Software Architecture Architecture Software 52

O'Reilly Software

APRIL 4, 2018

Here are five considerations every software architect and developer needs to take into account when setting the architectural foundations for a fast data platform. Determine requirements first.

Architecture 80

Architecture Scalability Google Operating System 80

Strategic Tech

AUGUST 26, 2018

Putting all my years of yoga practice to the test, I inhaled slowly, gracefully held the air in for a few seconds, and then slowly exhaled feeling at one with the universe. Upon arrival I frantically scanned the shelves looking for the chocolate sauce. First pass… nothing. I was so eager I couldn’t even see it.

Design 40

Design Software Architecture Architecture Software 40

Strategic Tech

JANUARY 9, 2024

Discovery is about building hypotheses and testing ideas to put into a backlog while development is working through that backlog to build new features. The solution space is then broken down two parts — discovery and development, which is akin to what used to be called dual track agile.

Development 98

Development Strategy Software Software 98

cdemi

DECEMBER 16, 2017

million on this mission and have the probe crash into the Martian atmosphere because two teams of software engineers, who both wrote great code, did not communicate together and did not follow specifications. Tests are fundamental. What a blow to space exploration it was to have spent $327.6

Software 73

Software Software Programming Software Engineering 73

Abhishek Tiwari

JULY 20, 2019

In this model, software architecture and code ownership is a reflection of the organisational model. In the current environment where business ideas can be easily cloned in months, features can be copied in days. You want to move fast.

Engineering 61

Engineering Retail Airlines Healthcare 61

Strategic Tech

MARCH 16, 2021

When interviewing software engineers, I always provide at-home coding tests which focus on design. Therefore, design mindset needs to be emphasised during the interviewing process for the benefit of the employer and the candidate.

Software Engineering 80

Software Engineering Design Engineering Software 80

The Agile Manager

SEPTEMBER 30, 2020

One school of thought is that the testing parameters were flawed: the sweeter taste of New Coke didn't pair as well with food as classic Coke, nor was a full can of the sweeter product as satisfying as one sip. The data didn't just indicate New Coke was a better Coke than Coke, the data indicated New Coke was a better Pepsi than Pepsi.

Hardware 52

Hardware Social Media Media Strategy 52

Tasktop

OCTOBER 30, 2019

Over the past months, a number of Fortune 100 customers have been testing Tasktop’s new product, Tasktop Viz , to implement the Flow Framework. Just look at how ugly that service-oriented architecture is!” Day two recap. Photo credit: @DOES_USA.

DevOps 8

DevOps Education Innovation Metrics 8

The Symphonia

MAY 22, 2018

In testing we have seen some advances in tools, and in mindset. Lambda and Azure functions both now offer some amount of local-integration testing. On the other hand I’m more convinced that for automated testing we should just be using real cloud environments. this is something even John and I don’t completely agree on.

Serverless 40

Serverless Architecture Lambda Azure 40

Strategic Tech

JULY 22, 2019

Domain Flow Storytelling One way to test the validity of your design and gain feedback on how to improve the design is to visualise how bounded contexts must collaborate to solve full business use cases for users of the system. For now, choose one to work with and make a note of the other possible models (they will be useful later).

Design 76

Design Systems Processing Strategy 76

Strategic Tech

FEBRUARY 16, 2022

Many of the practices that enable teams to move quickly are the same practices that enable highly-reliabile systems: automation, observability, testing, and design. It doesn’t need to be a choice of one over the other.

Innovation 52

Innovation Speed Google Strategy 52

Strategic Tech

AUGUST 1, 2019

Teams which own domain-specific contexts would create a pull-request containing changes in a configuration file (even better - code which compiles and is tested), which using the DSL, configures a mapping between a domain event to subscribe to and a notification to be sent.

Architecture 40

Architecture Design Engineering Best Practices 40

Strategic Tech

DECEMBER 2, 2018

It is hard to avoid planning ahead in order to understand which teams will be touching which parts of the codebase, as-well-as coordinating merging, testing, and releasing. High alignment is needed when teams are coupled for unnecessary technical reasons A begrudging partnership necessitates low alignment efficiency.

Efficiency 40

Efficiency Speed Innovation Transportation 40

Dynatrace

DECEMBER 16, 2019

Cloud-native software architectures provide the ability for deployment options , like Blue/Green, Canary, Dark Launches, and Feature Flagging – and make them easier. To recall sessions 1 – 4, see the blog Part 1. Key learning 5: Reduce risk and iterate faster – the right way to deploy canary, blue/green and feature flags.

DevOps 145

DevOps Software Software Best Practices 145

O'Reilly

NOVEMBER 26, 2024

Some other topics with high completion rates are ggplot (for data-driven graphics in R), GitHub, and Selenium (a software testing framework). Executives don’t like seeing their companies in the news for a security breach. SolidWorks is an outlier; SolidWorks courses have relatively few users, but almost all the users complete them.

Education 110

Education Azure AWS Java 110