Dynatrace

NOVEMBER 4, 2024

There’s a goldmine of business data traversing your IT systems, yet most of it remains untapped. Business events: Delivering the best data It’s been two years since we introduced business events , a special class of events designed to support even the most demanding business use cases. Business process monitoring and optimization.

Analytics 241

Analytics Airlines Metrics Monitoring 241

Dynatrace

OCTOBER 10, 2023

EdgeConnect provides a secure bridge for SaaS-heavy companies like Dynatrace, which hosts numerous systems and data behind VPNs. In this hybrid world, IT and business processes often span across a blend of on-premises and SaaS systems, making standardization and automation necessary for efficiency.

Systems 278

Systems Efficiency Internet Internet 278

Dynatrace

FEBRUARY 9, 2024

Recent platform enhancements in the latest Dynatrace, including business events powered by Grail™, make accessing the goldmine of business data flowing through your IT systems easier than ever. Business events can come from many sources, including OneAgent®, external business systems, RUM sessions, or log files.

Processing 246

Processing Monitoring Analytics Games 246

The Netflix TechBlog

AUGUST 1, 2022

A Data Movement and Processing Platform @ Netflix By Bo Lei , Guilherme Pires , James Shao , Kasturi Chatterjee , Sujay Jain , Vlad Sydorenko Background Realtime processing technologies (A.K.A stream processing) is one of the key factors that enable Netflix to maintain its leading position in the competition of entertaining our users.

Processing 272

Processing Transportation Entertainment Tuning 272

Dynatrace

OCTOBER 23, 2023

At financial services company, Soldo, efficiency and security by design are paramount goals. The platform helps companies manage corporate spending using automation, card (physical and virtual), and integrations with expense management systems and enterprise resource planning (ERP) systems, such as Netsuite, Concur, Zucchetti, and so on. “We

Design 264

Design Innovation DevOps Open Source 264

DZone

JUNE 5, 2024

Batch processing is a capability of App Connect that facilitates the extraction and processing of large amounts of data. Sometimes referred to as data copy , batch processing allows you to author and run flows that retrieve batches of records from a source, manipulate the records, and then load them into a target system.

Best Practices 240

Best Practices Processing Design Systems 240

Scalegrid

FEBRUARY 6, 2025

RabbitMQ is designed for flexible routing and message reliability, while Kafka handles high-throughput event streaming and real-time data processing. RabbitMQ follows a message broker model with advanced routing, while Kafkas event streaming architecture uses partitioned logs for distributed processing.

Latency 147

Latency Analytics Architecture Storage 147

DZone

DECEMBER 14, 2021

Metadata synchronization (sync) is a core feature in Alluxio that keeps files and directories consistent with their source of truth in under-storage systems, thus making it simple for users to reason the data retrieved from Alluxio. Meanwhile, understanding the internal process is important in order to tune the performance.

Design 244

Design Storage Tuning Systems 244

Dynatrace

MARCH 5, 2025

The newly introduced step-by-step guidance streamlines the process, while quick data flow validation accelerates the onboarding experience even for power users. Step-by-step setup The log ingestion wizard guides you through the prerequisites and provides ready-to-use command examples to start the installation process. Figure 5.

Open Source 211

Open Source IoT Cloud Azure 211

The Netflix TechBlog

MARCH 4, 2025

Part 3: System Strategies and Architecture By: VarunKhaitan With special thanks to my stunning colleagues: Mallika Rao , Esmir Mesic , HugoMarques This blog post is a continuation of Part 2 , where we cleared the ambiguity around title launch observability at Netflix. The request schema for the observability endpoint.

Traffic 160

Traffic Strategy Entertainment Innovation 160

Dynatrace

FEBRUARY 4, 2025

A production bug is the worst; besides impacting customer experience, you need special access privileges, making the process far more time-consuming. It also makes the process risky as production servers might be more exposed, leading to the need for real-time production data. This cumbersome process should not be the norm.

Open Source 223

Open Source Code Engineering Best Practices 223

Dynatrace

NOVEMBER 29, 2024

Protect data in multi-tenant architectures To bring you the most value by unifying observability and security in one analytics and automation platform powered by AI, Dynatrace SaaS leverages a multitenancy architecture, enabling efficient and scalable data ingestion, querying, and processing on shared infrastructure.

Storage 246

Storage AWS Azure Architecture 246

Dynatrace

OCTOBER 14, 2024

Manage the complexity of authorization systems Most modern authorization systems provide access management using Attribute-Based Access Control (ABAC). The system demands significant effort to design, manage, and maintain, especially as an organization’s needs evolve.

Monitoring 246

Monitoring Metrics Systems Scalability 246

The Netflix TechBlog

JANUARY 10, 2024

Future blogs will provide deeper dives into each service, sharing insights and lessons learned from this process. The Netflix video processing pipeline went live with the launch of our streaming service in 2007. The Netflix video processing pipeline went live with the launch of our streaming service in 2007.

Processing 233

Processing Media Latency Innovation 233

The Netflix TechBlog

JANUARY 6, 2025

This process involves: Identifying Stakeholders: Determine who is impacted by the issue and whose input is crucial for a successful resolution. In this case, the main stakeholders are: - Title Launch Operators Role: Responsible for setting up the title and its metadata into our systems. And how did we arrive at thispoint?

Scalability 215

Scalability Cache Engineering Systems 215

Scalegrid

FEBRUARY 24, 2025

Scaling RabbitMQ ensures your system can handle growing traffic and maintain high performance. Key Takeaways RabbitMQ improves scalability and fault tolerance in distributed systems by decoupling applications, enabling reliable message exchanges.

Best Practices 147

Best Practices Traffic Strategy Efficiency 147

The Netflix TechBlog

MARCH 7, 2024

The Machine Learning Platform (MLP) team at Netflix provides an entire ecosystem of tools around Metaflow , an open source machine learning infrastructure framework we started, to empower data scientists and machine learning practitioners to build and manage a variety of ML systems.

Systems 231

Systems Media Cache Open Source 231

Dynatrace

JANUARY 22, 2025

Enhanced observability and release validation Dynatrace already excels at delivering full-stack, end-to-end observability of your systems and user journeys. By integrating Dynatrace with GitHub Actions, you can proactively monitor for potential issues or slowdowns in the deployment processes.

Monitoring 242

Monitoring DevOps Metrics Virtualization 242

The Netflix TechBlog

DECEMBER 17, 2024

To achieve this, we are committed to building robust systems that deliver comprehensive observability, enabling us to take full accountability for every title on ourservice. Each title represents countless hours of effort and creativity, and our systems need to honor that uniqueness. Yet, these pages couldnt be more different.

Traffic 168

Traffic Scalability Strategy Monitoring 168

Dynatrace

APRIL 19, 2023

Creating an ecosystem that facilitates data security and data privacy by design can be difficult, but it’s critical to securing information. When organizations focus on data privacy by design, they build security considerations into cloud systems upfront rather than as a bolt-on consideration.

Design 246

Design Storage Programming Analytics 246

DZone

DECEMBER 18, 2023

Energy efficiency has become a paramount concern in the design and operation of distributed systems due to the increasing demand for sustainable and environmentally friendly computing solutions.

Energy 182

Energy Efficiency Systems IoT 182

Dynatrace

FEBRUARY 4, 2025

Building the dream package Observability for Developers, the newly introduced offering from Dynatrace, is designed to cater to developers’ specific needs and challenges. In a single view, developers get an instant overview of application performance, system health, logs, problems, deployment status, user interactions, and much more.

Development 235

Development Analytics Code Architecture 235

DZone

FEBRUARY 28, 2025

Grafana Loki is a horizontally scalable, highly available log aggregation system. It is designed for simplicity and cost-efficiency. Created by Grafana Labs in 2018, Loki has rapidly emerged as a compelling alternative to traditional logging systems, particularly for cloud-native and Kubernetes environments.

Architecture 130

Architecture Scalability Efficiency Cloud 130

Dynatrace

MARCH 5, 2025

Integration with existing systems and processes : Integration with existing IT infrastructure, observability solutions, and workflows often requires significant investment and customization. Actions resulting from the evaluation The certification process surfaced a few recommendations for improving the app.

Energy 223

Energy Analytics Traffic Cloud 223

DZone

JUNE 22, 2023

API performance optimization is the process of improving the speed, scalability, and reliability of APIs. It involves a combination of techniques and best practices aimed at reducing latency, improving user experience, and increasing the overall efficiency of the system. What Is API Performance Optimization?

Scalability 245

Scalability Design Best Practices Performance 245

The Netflix TechBlog

JANUARY 2, 2025

To better guide the design and budgeting of future campaigns, we are developing an Incremental Return on Investment model. Ideally, we would have causal estimates from an A/B test to use for validation, but since that is not available, we use another causal inference design as one of our ensemble of validation approaches.

Analytics 187

Analytics Engineering Games Entertainment 187

Dynatrace

FEBRUARY 28, 2025

Our detailed analysis not only illuminates the specifics of CVE-2024-53677 but also offers practical measures to secure your software systems against similar threats. Organizations can better protect their systems and data from exploitation by comprehensively addressing each phase.

Social Media 147

Social Media Java Media Open Source 147

The Netflix TechBlog

SEPTEMBER 29, 2022

Timestone: Netflix’s High-Throughput, Low-Latency Priority Queueing System with Built-in Support for Non-Parallelizable Workloads by Kostas Christidis Introduction Timestone is a high-throughput, low-latency priority queueing system we built in-house to support the needs of Cosmos , our media encoding platform. Over the past 2.5

Latency 217

Latency Systems Serverless Media 217

Scalegrid

MAY 13, 2020

Greenplum Database is a massively parallel processing (MPP) SQL database that is built and based on PostgreSQL. It’s architecture was specially designed to manage large-scale data warehouses and business intelligence workloads by giving you the ability to spread your data out across a multitude of servers. At a glance – TLDR.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

DZone

OCTOBER 9, 2024

The Scheduler service enables this and is designed to address the performance and scalability improvements on Actor reminders and the Workflow API. In this post, I am going to deep dive into the details of how the Scheduler service was designed and its implementation to give you some background. Prior to v1.14 Prior to v1.14

Scalability 318

Scalability Design Database Processing 318

Dynatrace

MARCH 5, 2025

Observability is no longer just for IT Ops Observability is no longer just about monitoring IT systems. Recently, I had the pleasure of speaking with Tiernan Ray for The Technology Letter ( subscribers can read here ) , where we discussed how observability is transforming and how Dynatrace is navigating industry changes.I

Innovation 189

Innovation Speed Efficiency Engineering 189

Dynatrace

AUGUST 13, 2024

Modern observability and security require comprehensive access to your hosts, processes, services, and applications to monitor system performance, conduct live debugging, and ensure application security protection. Changes are introduced on a controlled schedule, typically once a week, to reduce the risk of affecting customer systems.

Monitoring 279

Monitoring Open Source Testing Software 279

The Netflix TechBlog

DECEMBER 19, 2024

Many of these projects are under constant development by dedicated teams with their own business goals and development best practices, such as the system that supports our content decision makers , or the system that ranks which language subtitles are most valuable for a specific piece ofcontent.

Best Practices 200

Best Practices Cache Metrics Code 200

Dynatrace

JANUARY 26, 2021

DevSecOps is a cross-team collaboration framework that integrates security into DevOps processes from the start rather than waiting to address security in a separate silo. DevOps has gained ground in recent years as a way to combine key operational principles with development cycles, recognizing that these two processes must coexist.

DevOps 306

DevOps Best Practices Open Source Tuning 306

Dynatrace

OCTOBER 7, 2021

This means you no longer have to provision, scale, and maintain servers to run your applications, databases, and storage systems. Instead of worrying about infrastructure management functions, such as capacity provisioning and hardware maintenance, teams can focus on application design, deployment, and delivery.

Serverless 325

Serverless AWS Lambda Storage 325

The Netflix TechBlog

MARCH 14, 2023

User provides a sample image to find other similar images Prior engineering work Approach #1: on-demand batch processing Our first approach to surface these innovations was a tool to trigger these algorithms on-demand and on a per-show basis. Processing took several hours to complete. Maintaining disparate systems posed a challenge.

Media 295

Media Innovation Energy Architecture 295

DZone

JANUARY 31, 2024

At the heart of this decision lies a crucial question: should these teams lay the groundwork with a microservice architecture, known for its distributed and decentralized nature, or opt for a monolithic design, where the entire application is unified and interdependent?

Architecture 289

Architecture Scalability Design Engineering 289