DZone

DECEMBER 14, 2021

Meanwhile, understanding the internal process is important in order to tune the performance. This article describes the design and the implementation in Alluxio to keep metadata synchronized. Why is Metadata Sync Critical in Alluxio.

Design 244

Design Storage Tuning Systems 244

The Netflix TechBlog

NOVEMBER 20, 2023

by Jun He , Yingyi Zhang , and Pawan Dixit Incremental processing is an approach to process new or changed data in workflows. The key advantage is that it only incrementally processes data that are newly added or updated to a dataset, instead of re-processing the complete dataset.

Processing 221

Processing Big Data Efficiency Engineering 221

The Netflix TechBlog

SEPTEMBER 3, 2021

When we process a request it is often beneficial to know which fields the caller is interested in and which ones they ignore. How can we achieve a similar functionality when designing our gRPC APIs? By Alex Borysov , Ricky Gardiner Background At Netflix, we heavily use gRPC for the purpose of backend to backend communication.

Design 246

Design Java Code Servers 246

Dynatrace

AUGUST 29, 2023

Dynatrace has announced that it has successfully achieved the Google Cloud Ready – Cloud SQL designation for Cloud SQL, Google Cloud’s fully-managed, relational database service for MySQL, PostgreSQL, and SQL Server. This designation can also save time in evaluating Dynatrace solutions for organizations that are not already using them.

Google 216

Google Cloud Design Programming 216

Dynatrace

OCTOBER 23, 2023

At financial services company, Soldo, efficiency and security by design are paramount goals. Because Soldo is in a highly regulated industry, Domenella’s team adopted security by design from the beginning. What is security by design? The most efficient one we found was Dynatrace.”

Design 230

Design Innovation DevOps Open Source 230

Dynatrace

APRIL 13, 2021

” As in the case of regular SaaS services, software updates happen as soon as possible and are designed to go relatively unnoticed in the background. Therefore, regardless if you are a SaaS or Managed customer, we designed the OneAgent update experience to be smooth and automated following the release of each new version.

Processing 258

Processing Monitoring Performance Availability 258

DZone

JUNE 22, 2023

API performance optimization is the process of improving the speed, scalability, and reliability of APIs. The goal is to help developers, technical managers, and business owners understand the importance of API performance optimization and how they can improve the speed, scalability, and reliability of their APIs.

Scalability 245

Scalability Design Best Practices Performance 245

Dynatrace

APRIL 19, 2023

Creating an ecosystem that facilitates data security and data privacy by design can be difficult, but it’s critical to securing information. When organizations focus on data privacy by design, they build security considerations into cloud systems upfront rather than as a bolt-on consideration.

Design 204

Design Storage Programming Analytics 204

Dynatrace

JANUARY 31, 2024

Organizations choose data-driven approaches to maximize the value of their data, achieve better business outcomes, and realize cost savings by improving their products, services, and processes. Data is then dynamically routed into pipelines for further processing.

Analytics 203

Analytics Processing Transportation Storage 203

Scalegrid

MAY 13, 2020

Greenplum Database is a massively parallel processing (MPP) SQL database that is built and based on PostgreSQL. It’s architecture was specially designed to manage large-scale data warehouses and business intelligence workloads by giving you the ability to spread your data out across a multitude of servers. At a glance – TLDR.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

Dynatrace

DECEMBER 9, 2024

Processes are time-intensive. Slow processes introduce risk. The time has come to move beyond outdated practices and adopt solutions designed for the realities of Kubernetes environments. This empowers teams to efficiently deliver secure, compliant Kubernetes applications by design. Reactivity.

Best Practices 256

Best Practices Benchmarking DevOps Efficiency 256

DZone

OCTOBER 9, 2024

The Scheduler service enables this and is designed to address the performance and scalability improvements on Actor reminders and the Workflow API. In this post, I am going to deep dive into the details of how the Scheduler service was designed and its implementation to give you some background. Prior to v1.14 Prior to v1.14

Scalability 318

Scalability Design Database Processing 318

DZone

AUGUST 14, 2024

When building ETL data pipelines using Azure Data Factory (ADF) to process huge amounts of data from different sources, you may often run into performance and design-related challenges. This article will serve as a guide in building high-performance ETL pipelines that are both efficient and scalable.

Azure 306

Azure Cloud Scalability Efficiency 306

The Netflix TechBlog

MARCH 10, 2023

Hence we built the data pipeline that can be used to extract the existing assets metadata and process it specifically to each new use case. This feature support required a significant update in the data table design (which includes new tables and updating existing table columns). N, first N rows are fetched from the table.

Media 245

Media Traffic Processing Design 245

DZone

JANUARY 31, 2024

At the heart of this decision lies a crucial question: should these teams lay the groundwork with a microservice architecture, known for its distributed and decentralized nature, or opt for a monolithic design, where the entire application is unified and interdependent?

Architecture 289

Architecture Scalability Design Engineering 289

DZone

FEBRUARY 28, 2024

Mainframe architecture refers to the design and structure of a mainframe computer system, which is a powerful and reliable computing platform used for large-scale data processing, transaction processing, and enterprise applications.

Architecture 263

Architecture Design Processing Systems 263

The Netflix TechBlog

FEBRUARY 18, 2022

Event Prioritization Considering the use cases were wide ranging both in terms of their sources and their importance, we built segmentation into the event processing. We thus assigned a priority to each use case and sharded event traffic by routing to priority-specific queues and the corresponding event processing clusters.

Systems 334

Systems Traffic Architecture Mobile 334

Dynatrace

DECEMBER 3, 2024

This year’s AWS re:Invent will showcase a suite of new AWS and Dynatrace integrations designed to enhance cloud performance, security, and automation. This integration simplifies the process of embedding Dynatrace full-stack observability directly into custom Amazon Machine Images (AMIs).

AWS 256

AWS Cloud Performance Innovation 256

Dynatrace

JANUARY 26, 2021

DevSecOps is a cross-team collaboration framework that integrates security into DevOps processes from the start rather than waiting to address security in a separate silo. DevOps has gained ground in recent years as a way to combine key operational principles with development cycles, recognizing that these two processes must coexist.

DevOps 281

DevOps Best Practices Open Source Tuning 281

Dynatrace

OCTOBER 7, 2021

Instead of worrying about infrastructure management functions, such as capacity provisioning and hardware maintenance, teams can focus on application design, deployment, and delivery. Using a low-code visual workflow approach, organizations can orchestrate key services, automate critical processes, and create new serverless applications.

Serverless 293

Serverless AWS Lambda Storage 293

DZone

NOVEMBER 9, 2021

It’s much better to build your process around quality checks than retrofit these checks into the existent process. NIST did classic research to show that catching bugs at the beginning of the development process could be more than ten times cheaper than if a bug reaches production. There are so many benefits. A side note.

Software 245

Software Software Code Design 245

DZone

MARCH 1, 2023

“A small group of developers and I gathered to design and build a new internal tool and saw an opportunity to do more. We saw ourselves building something more substantial than another internal tool through that process. The above statement was said by Mark Otto, one of the developers of Bootstrap.

Social Media 274

Social Media Media Testing Website 274

Dynatrace

AUGUST 13, 2024

Modern observability and security require comprehensive access to your hosts, processes, services, and applications to monitor system performance, conduct live debugging, and ensure application security protection. It automatically discovers and monitors each host’s applications, services, processes, and infrastructure components.

Monitoring 258

Monitoring Open Source Testing Software 258

DZone

NOVEMBER 2, 2023

It’s an underlying web application architecture that makes this process possible. In this blog, you’ll discover what a web app architecture is, how a web application architecture diagram looks, and how you can design the right architecture for web apps. Moreover, it also ensures that valid data is present in all user requests.

Architecture 272

Architecture Mobile Website Servers 272

The Netflix TechBlog

NOVEMBER 12, 2024

By: Rajiv Shringi , Oleksii Tkachuk , Kartik Sathyanarayanan Introduction In our previous blog post, we introduced Netflix’s TimeSeries Abstraction , a distributed service designed to store and query large volumes of temporal event data with low millisecond latencies. This process can also be used to track the provenance of increments.

Latency 253

Latency Cache Infrastructure Strategy 253

Dynatrace

MAY 7, 2024

Fluent Bit is a telemetry agent designed to receive data (logs, traces, and metrics), process or modify it, and export it to a destination. Fluent Bit was designed to help you adjust your data and add the proper context, which can be helpful in the observability backend. Ask yourself, how much data should Fluent Bit process?

Best Practices 255

Best Practices IoT Metrics Storage 255

Dynatrace

SEPTEMBER 20, 2022

A DevSecOps approach advances the maturity of DevOps practices by incorporating security considerations into every stage of the process, from development to deployment. DevSecOps best practices provide guidelines to help organizations achieve efficient and secure application design, development, implementation, and management.

Best Practices 275

Best Practices DevOps Serverless Education 275

Dynatrace

NOVEMBER 29, 2024

This certification is specifically designed for Cloud Service Providers (CSPs) and builds upon the more generic approaches of ISO 27001 and SOC 2 Type II. Risk reduction : The certification process ensures that we have strong controls in place to mitigate security risks significantly, reducing the likelihood of breaches.

Benchmarking 220

Benchmarking Government Innovation Cloud 220

The Netflix TechBlog

SEPTEMBER 24, 2021

By Xiaomei Liu , Rosanna Lee , Cyril Concolato Introduction Behind the scenes of the beloved Netflix streaming service and content, there are many technology innovations in media processing. Packaging has always been an important step in media processing. Uploading and downloading data always come with a penalty, namely latency.

Cloud 242

Cloud Media Storage Cache 242

The Netflix TechBlog

MARCH 14, 2023

User provides a sample image to find other similar images Prior engineering work Approach #1: on-demand batch processing Our first approach to surface these innovations was a tool to trigger these algorithms on-demand and on a per-show basis. Processing took several hours to complete. Some ML algorithms are computationally intensive.

Media 301

Media Innovation Energy Architecture 301

Dynatrace

MARCH 29, 2024

In today’s rapidly evolving landscape, incorporating AI innovation into business strategies is vital, enabling organizations to optimize operations, enhance decision-making processes, and stay competitive. The annual Google Cloud Next conference explores the latest innovations for cloud technology and Google Cloud.

Google 273

Google Innovation Cloud Analytics 273

DZone

SEPTEMBER 6, 2022

For example, each deliverable in the project, like the requirements, design, code, documents, user interface, etc., Testing can also be divided based on the sub-stages or activities in testing, for instance, test case generation and design, test case execution and verification building of the testing database, etc. should be tested.

Testing 246

Testing Programming Design Code 246

DZone

OCTOBER 25, 2021

There are various steps in the SDLC paradigm, such as requirement gathering, analysis, coding, design, execution, testing, and deployment. All of these steps go through the software testing process's tiers of testing.

Software 246

Software Software Testing Efficiency 246

Scalegrid

SEPTEMBER 5, 2024

Ensuring high availability in PostgreSQL involves implementing automatic failover, a critical process that maintains database operability and preserves data accessibility when unexpected failures occur. It handles every transaction, ensuring that data modifications are correctly processed.

Availability 257

Availability Servers Database Open Source 257

The Netflix TechBlog

DECEMBER 11, 2020

Our goal was to design a GraphQL schema that was reflective of the domain itself, not the database model. Embracing a collaborative schema design approach was essential to achieving this goal. Embracing a collaborative schema design approach was essential to achieving this goal.

Architecture 257

Architecture Best Practices Engineering Open Source 257

Dynatrace

JUNE 26, 2024

The FedRAMP Moderate baseline is designed to protect sensitive data that, if compromised, could seriously adversely affect operations, assets, or individuals. They help organizations understand risks, improve processes, and boost security readiness. Understanding FedRAMP Moderate and transition to Rev.5 state and federal agencies.

Government 254

Government Programming Cloud Innovation 254

Dynatrace

OCTOBER 10, 2023

In this hybrid world, IT and business processes often span across a blend of on-premises and SaaS systems, making standardization and automation necessary for efficiency. Enterprises seek solutions that enable these processes to interact across their entire system landscape without compromising security.

Systems 233

Systems Efficiency Internet Internet 233