The Netflix TechBlog

FEBRUARY 9, 2022

The design of a cron job is simple, you take some system command, you pick the schedule to run it on and you are done. The important thing is that this business logic can be built in a separate repository and maintained independently from the workflow definition. workflow ?—?see Example: 0 0 * * MON /home/alice/backup.sh

Storage 206

Storage Data Engineering Testing Code 206

Scalegrid

JANUARY 8, 2019

In Part I , we introduced a High Availability (HA) framework for MySQL hosting and discussed various components and their functionality. Semisynchronous replication, which is natively available in MySQL, helps the HA framework to ensure data consistency and redundancy for committed transactions. rpl_semi_sync_master_timeout.

Availability 113

Availability Tuning Speed Network 113

Dynatrace

NOVEMBER 24, 2021

All of this convenient visibility is available with just a few clicks. The Generic network device and the Cisco router extensions are designed to easily extend observability to all the basic and popular devices. Start monitoring in minutes. Begin network monitoring by simply deploying an extension with just a few clicks.

Network 246

Network Infrastructure Virtualization Metrics 246

Dynatrace

JUNE 15, 2021

The subject line said: “Success Story: Major Issue in single AWS Frankfurt Availability Zone!” The problem started at 1:24PM PDT, with the services starting to become available again about 3 hours later. Fact #4: Multi-node, multi-availability zone deployment architecture. Ready to learn more? Rack-aware Cassandra deployments.

AWS 246

AWS Traffic Architecture Azure 246

Dynatrace

OCTOBER 4, 2022

A data lakehouse addresses these limitations and introduces an entirely new architectural design. This unique, end-to-end data collection, together with Smartscape ® topology mapping, ensures Grail is fueled with all available data—in context—and ready for manual or AI-driven analytics tasks. This scenario is a thing of the past.

Artificial Intelligence 290

Artificial Intelligence Analytics Storage Architecture 290

The Netflix TechBlog

AUGUST 1, 2022

Data Mesh Overview A New Definition Of Data Mesh Previously, we defined Data Mesh as a fully managed, streaming data pipeline product used for enabling Change Data Capture (CDC) use cases. This design enables us to reuse and share data as much as possible. This article gives an overview of the system.

Processing 272

Processing Transportation Entertainment Tuning 272

DZone

FEBRUARY 27, 2021

As a Software Engineer, the mind is trained to seek optimizations in every aspect of development and ooze out every bit of available CPU Resource to deliver a performing application. This begins not only in designing the algorithm or coming out with efficient and robust architecture but right onto the choice of programming language.

Java 214

Java C++ Benchmarking Programming 214

O'Reilly Software

MARCH 1, 2018

This information is curated from the expert microservices material available on our online learning platform. Sam Newman provides a succinct definition of microservices in Building Microservices : “Microservices are small, autonomous services that work together.”. Continue reading Microservices: A quick and simple definition.

Architecture 80

Architecture Code Scalability Systems 80

Smashing Magazine

AUGUST 9, 2021

Smashing Podcast Episode 41 With Eva PenzeyMoog: Designing For Safety. Smashing Podcast Episode 41 With Eva PenzeyMoog: Designing For Safety. In this episode, we’re talking about designing for safety. What does it mean to consider vulnerable users in our designs? Design for Safety from A Book Apart. Drew McLellan.

Design 115

Design Education Network Processing 115

Dynatrace

NOVEMBER 17, 2021

This was one of the most demanded features, and with the introduction of security policies, this control mechanism is finally available. As of today, many settings are already available to be referenced in security policies. To find out which settings are available in your environment, check out the Settings/schemas API.

Availability 245

Availability Metrics Systems Design 245

The Netflix TechBlog

FEBRUARY 3, 2021

Instead, the schema gets generated at runtime based on definitions in code. At Netflix we strongly prefer schema-first development because: The schema design is front and center of the developer experience. link] Full documentation for the framework is available on the DGS Framework github repository.

Open Source 246

Open Source Java Architecture Metrics 246

Smashing Magazine

OCTOBER 15, 2021

Tips And Tricks For Evaluating UX/UI Designers. Tips And Tricks For Evaluating UX/UI Designers. When a company’s digital representation lacks a dedicated UX/UI design team, it can be hard to produce something that stands out from the crowd. That’s why you need a good UI/UX designer. Nataliya Sambir. And vice versa.

Design 116

Design Website Efficiency Processing 116

Smashing Magazine

NOVEMBER 11, 2021

From Good To Great In Dashboard Design: Research, Decluttering And Data Viz. From Good To Great In Dashboard Design: Research, Decluttering And Data Viz. Tossing out suboptimal parts of our design can be a daunting task, especially after you’ve invested hours of work into it. Definition. Design Validation.

Design 113

Design Best Practices Efficiency Testing 113

Dynatrace

DECEMBER 2, 2021

To get a better handle on this, let’s start with some definitions. These can include business metrics, such as conversion rates, uptime, and availability; service metrics, such as application performance; or technical metrics, such as dependencies to third-party services, underlying CPU, and the cost of running a service.

Metrics 246

Metrics Best Practices DevOps Infrastructure 246

Dynatrace

APRIL 8, 2021

Most organizations have a grab bag of monitoring tools, each designed for a specific use case. In this scenario, every team has an answer, but no one has the definitive answer. Various job roles such as DBAs, UX designers, and mobile app developers need access to different types of data to carry out their tasks.

Mobile 227

Mobile Monitoring Analytics Google 227

Dynatrace

MAY 5, 2021

Today we’re proud to announce the new Dynatrace Operator, designed from the ground up to handle the lifecycle of OneAgent, Kubernetes API monitoring, OneAgent traffic routing, and all future containerized componentry such as the forthcoming extension framework. Other Dynatrace components, like ActiveGate, are deployed separately.

Cloud 246

Cloud Traffic Monitoring Open Source 246

Smashing Magazine

JUNE 26, 2019

What Web Designers Can Do To Speed Up Mobile Websites. What Web Designers Can Do To Speed Up Mobile Websites. I recently wrote a blog post for a web designer client about page speed and why it matters. However, their focus has always been on making a great-looking and effective design. Suzanne Scacca.

Website 111

Website Speed Mobile Design 111

Dynatrace

MAY 20, 2020

The Metrics API v2 is the first v2 API available in Dynatrace. Metrics API v2 is designed in a RESTful way to allow you to discover which metrics are available, retrieve metadata, and to execute sophisticated time series queries. metrics/series ( Deprecated —available until September 2020). GET /metrics.

Metrics 246

Metrics Operating System Tuning Availability 246

The Netflix TechBlog

OCTOBER 18, 2022

Meson was based on a single leader architecture with high availability. We want users to rely on shared templates and reuse their workflow definitions across their team, saving time and effort on creating the same functionality. The scheduler on-call has to closely monitor the system during non-business hours.

Java 207

Java Scalability Traffic Engineering 207

The Netflix TechBlog

MARCH 25, 2019

You are designing a learning system to forecast Service Level Agreement (SLA) violations and would want to factor in all upstream dependencies and corresponding historical states. Design a flexible data model ? —?Represent Therefore, the ingestion approach for data lineage is designed to work with many disparate data sources.

Infrastructure 222

Infrastructure Big Data Transportation Architecture 222

Dynatrace

APRIL 10, 2023

We also couldn’t compromise on performance and availability.” But “the benefits are definitely worth the effort, provided you do it in a strategic way,” Bollampally said. Such testing is critical to identifying customer shopping patterns that inform decisions about application design and user experience.

Cloud 243

Cloud Ecommerce Performance Retail 243

Dynatrace

NOVEMBER 8, 2021

Organizations use APM to ensure system availability, optimize service performance and response times, and improve user experiences. G2 Research includes a clear definition of APM in its Grid Report for Application Performance Monitoring for Spring 2021. How to evaluate APM solutions. The Dynatrace approach: APM and beyond.

Artificial Intelligence 246

Artificial Intelligence Monitoring Infrastructure Cloud 246

The Netflix TechBlog

FEBRUARY 16, 2021

However, with our rapid product innovation speed, the whole approach experienced significant challenges: Business Complexity: The existing SKU management solution was designed years ago when the engagement rules were simple?—?three Rule owners are responsible for making sure the requirements match the rule definition and request context.

Mobile 214

Mobile Engineering Infrastructure Scalability 214

Alex Podelko

SEPTEMBER 8, 2020

While Federico definitely has good points there, there is some truth in these myths too. The open source load testing tools definitely advanced a lot in both maturity and functionality – but there are many areas where they are behind best commercial tools (and if it matters for a specific user is another subject – for some it may not).

Open Source 223

Open Source Performance Testing Testing Performance 223

Dynatrace

APRIL 21, 2022

If you still use the legacy version of Log Monitoring ( Log Monitoring v1 ), the Log Monitoring v1 documentation is still available, but we strongly encourage you to switch to the latest Dynatrace Log Monitoring version and gain direct access to the log content of all your mission-critical processes. General Availability (Build 1.239.178).

Azure 246

Azure Metrics AWS Monitoring 246

Dynatrace

JUNE 6, 2023

Thair elaborated on the concept of “designing for operations” with a car analogy. That’s not good design for Ops,” he said. One of the main roadblocks that arises with a broader definition for DevOps is responsibility. How do [developers] make the things that are most likely to break, easily accessible?”

DevOps 239

DevOps Engineering Innovation Best Practices 239

Dynatrace

SEPTEMBER 28, 2021

While DevOps is often referred to as “agile operations,” the widely quoted definition from Jez Humble, co-author of The DevOps Handbook, calls it “a cross-disciplinary community of practice dedicated to the study of building, evolving, and operating rapidly-changing resilient systems at scale.” App availability.

DevOps 246

DevOps Metrics Traffic Efficiency 246

Smashing Magazine

SEPTEMBER 5, 2019

Inspired Design Decisions: Alexey Brodovitch. Inspired Design Decisions: Alexey Brodovitch. Before writing Art Direction for the Web , I began to study Alexey Brodovitch when I became fascinated by editorial and magazine design. This book will make a fabulous addition to your design collection. Andrew Clarke.

Design 85

Design Media Website Development 85

The Netflix TechBlog

SEPTEMBER 18, 2024

Central to this infrastructure is our use of multiple online distributed databases such as Apache Cassandra , a NoSQL database known for its high availability and scalability. Data Model At its core, the KV abstraction is built around a two-level map architecture.

Latency 256

Latency Storage Cache Servers 256

Dynatrace

JULY 16, 2020

It would definitely make my life easier! This would also mean I need a service that detects any new environments, creates API tokens for them, refreshes API tokens on expiry and ensures that there is always a valid API token available. I wanted a rather lightweight design that is yet versatile. Concurrency, fan-out, fan-in.

Cache 277

Cache Serverless Efficiency Tuning 277

The Netflix TechBlog

APRIL 12, 2022

Sample GraphQL Schema Once entities like the above are available in the graph, it’s very common for folks to want to query for a particular entity based on attributes of related entities, e.g. give me all movies that are currently in photography with Ryan Reynolds as an actor.

Engineering 267

Engineering Architecture Java Infrastructure 267

Dynatrace

JUNE 18, 2019

“All configuration and pipeline” definition itself is designed to live in source control. Once sent to Dynatrace, the build events will be shown alongside the monitored services and can then be included and referenced as a possible root-cause when sleuthing performance and availability degradations.

Architecture 185

Architecture DevOps Open Source Java 185

The Netflix TechBlog

JANUARY 25, 2023

Annotations Sometimes people describe annotations as tags but that is a limited definition. All data should be also available for offline analytics in Hive/Iceberg. Data ingestions from the ML data pipelines are generally in bulk specifically when a new algorithm is designed and annotations are generated for the full catalog.

Scalability 287

Scalability Latency Media Architecture 287

High Scalability

FEBRUARY 19, 2021

In this article, we discuss the concepts of dependability and fault tolerance in detail and explain how the Ably platform is designed with fault tolerant approaches to uphold its dependability guarantees. As a basis for that discussion, first some definitions: Dependability The degree to which a product or service can be relied upon.

Engineering 165

Engineering Systems Availability Scalability 165

Dynatrace

JULY 10, 2019

For example, the number of threads of your process is already available in Dynatrace in most cases, so there is no need to spend the extra effort. With insights from Dynatrace into network latency and utilization of your cloud resources, you can design your scaling mechanisms and save on costly CPU hours.

Java 197

Java Best Practices Metrics Azure 197

Percona

MARCH 23, 2023

When it comes to enterprise-level databases, there are several options available in the market, but PostgreSQL stands out as one of the most popular and reliable choices. This makes it an excellent choice for mission-critical applications that require high availability. Download Percona Distribution for PostgreSQL Today!

Database 138

Database Open Source Traffic Small Business 138

The Netflix TechBlog

MARCH 2, 2021

Working on my PhD, I was using optimization techniques to design radiotherapy fractionation schemes to improve the results of clinical practices. My academic credentials definitely helped on the technical side. How do you, as a data scientist, fill in the pieces between product, engineering, and design?

Analytics 212

Analytics C++ Innovation Engineering 212