The Netflix TechBlog

SEPTEMBER 18, 2024

message IdempotencyToken ( Timestamp generation_time, String token ) At Netflix, client-generated monotonic tokens are preferred due to their reliability, especially in environments where network delays could impact server-side token generation. Either or both may be required by backing storage engines to de-duplicate mutations.

Latency 254

Latency Storage Cache Efficiency 254

Dynatrace

DECEMBER 13, 2024

The Collector is a versatile component thats able to ingest telemetry from a variety of sources, transform the received telemetry in a number of ways based on its configuration, and then export that processed data to any backend that accepts the OpenTelemetry data format (also referred to as OTLP , which stands for OpenTelemetry Protocol).

Java 183

Java Servers Code Metrics 183

Dynatrace

MAY 12, 2022

Remediation tracking now enables you to view the risk assessment for the process groups affected by a vulnerability. The title size of a tile has been moved from the dashboard definition to the dashboard metadata definition and included in the advanced settings UI for dashboards. Application Security. Dashboards. APM-368026).

Tuning 205

Tuning Metrics Cloud Mobile 205

The Netflix TechBlog

JULY 30, 2019

Many of the Netflix Content and Studio Engineering services rely on Conductor for efficient processing of their business flows. Adoption As of writing this blog, Conductor orchestrates 600+ workflow definitions owned by 50+ teams across Netflix. The Netflix Media Database (NMDB) is one such example.

Lambda 192

Lambda Media Open Source Metrics 192

Percona

OCTOBER 10, 2023

This is not a general rule, but as databases are responsible for a core layer of any IT system – data storage and processing — they require reliability. Why choose Percona Server for MongoDB? Why release Percona Server for MongoDB 7 now? which was released as Percona Server for MongoDB RC 7.0.2-1.

Availability 107

Availability Servers Database Open Source 107

Dynatrace

FEBRUARY 14, 2022

Multiple Prometheus servers might be required, creating significant maintenance efforts. Alternatively, if you’re already using a Prometheus Server to gather data from your distributed systems, you can now seamlessly make this data work for you in Dynatrace as well—use your Prometheus server as the endpoint for scraping metrics.

Technology 229

Technology Technology Metrics Infrastructure 229

Dynatrace

NOVEMBER 30, 2023

In the past, I tried to understand where in the page-loading process was the majority of time spent. When we look at the combined tests above, the average server-side response time (measured as first byte time, or the amount of time it takes to get the first packet of data in response to a request) is 397 milliseconds.

Retail 234

Retail Social Media Performance Benchmarking 234

The Netflix TechBlog

AUGUST 22, 2019

Baking Windows with Packer By Justin Phelps and Manuel Correa Customizing Windows images at Netflix was a manual, error-prone, and time consuming process. We looked at our process for creating a Windows AMI and discovered it was error-prone and full of toil. Last year, we decided to improve the AMI baking process.

DevOps 211

DevOps AWS Tuning Infrastructure 211

The Netflix TechBlog

FEBRUARY 9, 2021

In the process, we changed end-to-end identity propagation within the network of services to use a cryptographically-verifiable token-agnostic identity object. The API server orchestrates backend systems to authenticate the user. Critical identity data was being propagated throughout the server ecosystem in an inconsistent fashion.

Architecture 230

Architecture Latency Servers Systems 230

The Netflix TechBlog

MAY 19, 2023

A cleanup process to prune stale relationships from the database. The community’s excitement and interest became apparent through comments, reactions, and conversations on the SpiceDB Discord server. “can app bar in us-west-2 access this document.” What was problematic about this design? with which to experiment.

Cache 257

Cache Google Open Source Systems 257

The Netflix TechBlog

OCTOBER 14, 2024

This document details the intriguing process of debugging this issue, all the way from the UI down to the Linux kernel. Restarting the ipykernel process, which runs the Notebook, might temporarily alleviate the problem, but the frustration persists as more notebooks are run. the JupyterLab process) rather than the network.

Latency 217

Latency Virtualization Traffic Processing 217

The Netflix TechBlog

JUNE 13, 2023

Migrating Critical Traffic At Scale with No Downtime — Part 2 Shyam Gala , Javier Fernandez-Ivern , Anup Rokkam Pratap , Devang Shah Picture yourself enthralled by the latest episode of your beloved Netflix series, delighting in an uninterrupted, high-definition streaming experience.

Traffic 287

Traffic Metrics Systems Strategy 287

The Netflix TechBlog

NOVEMBER 4, 2019

By batching and parallelizing the requests to retrieve many creatives via a single query to the GraphQL server, we can optimize the index building process. At a minimum, we extract all of the type definitions from the GraphQL query and map them to a schema for Elasticsearch to use. The graph has two requirements. Search Indexer.

Cache 248

Cache Database Servers Performance 248

CSS Wizardry

DECEMBER 9, 2023

Connection overhead isn’t huge , but too many preconnect s that either a) aren’t critical, or b) don’t get used at all, is definitely wasteful. Further, opening and persisting connections has a CPU overhead on both the client and the server.

Speed 280

Speed Network Analytics Availability 280

Dynatrace

AUGUST 16, 2019

As microservices and automation continue to drive API usage, most organizations have either already introduced, or plan to introduce, an API testing process. By definition RESTful APIs should be stateless, meaning that each request should be individually validated for authentication/authorization by the receiving server.

Monitoring 158

Monitoring Tuning Google Testing 158

Dynatrace

JULY 11, 2023

IBM Power servers enable customers to respond faster to business demands, protect data from core to cloud, and streamline insights and automation. It simplifies the process of setting up and maintaining Dynatrace observability by encapsulating the necessary configuration and operational logic into a single entity.

Architecture 178

Architecture Availability Infrastructure Monitoring 178

Dynatrace

NOVEMBER 3, 2021

Monitoring , by textbook definition, is the process of collecting, analyzing, and using information to track a program’s progress toward reaching its objectives and to guide management decisions. Log entries describe events, such as starting a process, handling an error, or simply completing some part of a workload.

Monitoring 233

Monitoring Metrics DevOps Scalability 233

Dynatrace

APRIL 21, 2022

If you still use the legacy version of Log Monitoring ( Log Monitoring v1 ), the Log Monitoring v1 documentation is still available, but we strongly encourage you to switch to the latest Dynatrace Log Monitoring version and gain direct access to the log content of all your mission-critical processes. Kubernetes/OpenShift workload/pod details.

Azure 228

Azure Metrics AWS Monitoring 228

Scalegrid

JANUARY 20, 2020

And since the entire import is performed using storage snapshots, rather than a logical dump, the process is nearly instantaneous. If your application passes on the test dataset, it is definitely fit to deploy in production! With your development and QA clusters set to follow the production cluster, you can rest easy.

Analytics 185

Analytics Database Storage Systems 185

The Netflix TechBlog

OCTOBER 7, 2021

Hence, it became important to supplement our release decisions with strong evidence received from the field during the update process. In contrast, a server application runs on servers which are typically identical and a routing abstraction can serve sampled traffic to new versions.

Metrics 209

Metrics Mobile Testing Strategy 209

Randon ASCII

AUGUST 30, 2020

Sometimes tracking down a bug is as simple as paying attention to server dashboards, spending a few minutes in a profiler, or looking at compiler warnings. Server CPU Surprise. A few years ago I spent a few weeks doing some memory investigations on live game servers. The first server process that I profiled was… odd.

Games 142

Games Servers Code Monitoring 142

Dynatrace

JULY 15, 2024

Are the hosts on which OneAgent can’t be deployed for technical reasons (for example, a legacy OS) or security-related reasons (for example, systems processing financial information and third party vendors) up and running? into NAM test definitions. Are the corresponding services running on those hosts?

Availability 242

Availability Network Monitoring Infrastructure 242

Percona

APRIL 4, 2023

Those are a lot more common and may be in your table definitions, so your upgrade process will be harder. If you try to use a reserved word, the server will not explicitly admonish you that you are trying to use a reserved word. Instead, the server informs you that you have a syntax error. Yes, there is a workaround.

Open Source 122

Open Source Database Servers Scalability 122

Dynatrace

FEBRUARY 16, 2023

There are many definitions of environmental sustainability, most of which converge on a common theme: collectively and individually, we have a responsibility to act to protect global ecosystems and support health and wellbeing, now and in the future. Average cloud server idle time exceeds 70%.

Energy 194

Energy Airlines Analytics Transportation 194

Dynatrace

MAY 28, 2020

Keptn uses SLO definitions to automatically configure Dynatrace or Prometheus alerting rules. While Google’s SRE Handbook mostly focuses on the production use case for SLIs/SLOs, Keptn is “Shifting-Left” this approach and using SLIs/SLOs to enforce Quality Gates as part of your progressive delivery process.

Engineering 200

Engineering Performance Metrics Best Practices 200

Scalegrid

FEBRUARY 15, 2024

Each section is crafted to elevate your database’s security protocol, from acquiring the necessary SSL certificates to configuring server and client connections. Preparing SSL Certificates for MongoDB The SSL certificates are necessary for our MongoDB server to establish secure SSL/TLS communications.

Servers 130

Servers Best Practices Government Network 130

Dynatrace

MAY 17, 2023

When software runs in a monolithic stack on on-site servers, observability is manageable enough. For the HTTP request, we add the request headers we sent, as well as certain details from the response, such as the status code, the length of the response, and server information.

Metrics 192

Metrics Open Source Traffic Cache 192

Percona

DECEMBER 9, 2024

First things first, a couple of definitions to clear up: ETL: Extract, Transform, Load. Transforms data before loading it into the target system extract raw data from various sources use a secondary processing server to transform that data load that data into a target database ELT: Extra, Load, Transform.

Performance 85

Performance Database Servers Processing 85

Dynatrace

DECEMBER 15, 2022

Typically, these are streamed to a central syslog server. One option is to install OneAgent on that syslog server, which automatically discovers, instruments and sends the log data to the Dynatrace platform. Syslog is a popular standard for transporting and Ingesting log messages. Ingest AWS Fargate logs with Fluent Bit.

Strategy 192

Strategy AWS Open Source Transportation 192

Scalegrid

JUNE 14, 2024

Microsoft Power BI and MySQL are two powerful tools that can facilitate this process. In this article, we will explore the process of how to connect MySQL to Power BI, a leading business intelligence tool. This streamlined data integration simplifies the process of data analysis and ensures consistency and accuracy in reporting.

Database 130

Database Azure Efficiency Servers 130

Dynatrace

NOVEMBER 14, 2023

These small wins, such as implementing a blameless root cause analysis process, can take many forms and don’t necessarily involve numerical metrics. This is made possible through generative AI’s natural language processing capabilities. For organizations building business-centric SLOs, Aguiar had some recommendations. “If

Best Practices 204

Best Practices Engineering DevOps Software Engineering 204

Dynatrace

JULY 10, 2019

This article we help distinguish between process metrics, external metrics and PurePaths (traces). If you already have the OneAgent installed, and you’d like to bring in additional process metrics into Dynatrace , the OneAgent plugin is a good fit. To get more process metrics, use a OneAgent plugin. Use the OneAgent SDK.

Java 144

Java Best Practices Metrics Azure 144

KeyCDN

FEBRUARY 4, 2021

This query is performed by a Domain Name Server (DNS server) or servers nearby that have been assigned responsibility for that hostname. You can think of a DNS server as a phone book for the internet. A DNS server maintains a directory of domain names and translates them to IPs. So DNS services definitely go down!

Cache 134

Cache Website Internet Internet 134

SQL Performance

AUGUST 23, 2019

In traditional row-mode execution plans, SQL Server may introduce a Bitmap operator as part of performing early semi join reduction before a parallel hash or merge join. There have been major improvements since the first appearance of the batch mode execution engine in SQL Server 2012. Background. The Query Optimizer. Bitmap Choice.

Servers 75

Servers Engineering Efficiency Retail 75

SQL Performance

SEPTEMBER 8, 2021

To understand the circumstances where you would want to use the CHECK OPTION as part of a view’s definition, we’ll first examine what can happen when you don’t use it. For years I used to think of the CHECK OPTION in a view as serving the same function as a CHECK constraint in a base table’s definition. CHECK OPTION. FastOrders.

Servers 130

Servers Code Engineering Database 130

SQL Performance

FEBRUARY 10, 2021

I’ll do my testing in tempdb, enabling IO and TIME statistics: SET NOCOUNT ON ; USE tempdb ; SET STATISTICS IO , TIME ON ; The fastest solution from last month applies a join with a dummy table that has a columnstore index to get batch processing. With the above suggested function, you can create it as is with older versions of SQL Server.

C++ 124

C++ Servers Testing Code 124

SQL Performance

APRIL 14, 2021

Evaluating earlier solutions, one of the important factors in getting good performance was the ability to employ batch processing. Let’s examine the plans for two of the earlier solutions that utilized batch processing. Here’s the function’s definition: -- Helper dummy table. DROP TABLE IF EXISTS dbo. BatchMe ; GO.

C++ 112

C++ Servers Testing Code 112