DZone

FEBRUARY 29, 2024

In the vibrant world of microservices and event-driven architectures, messaging queues have emerged as a critical component, enabling asynchronous communication, decoupling systems, and unlocking scalability. However, with a vibrant landscape of options, choosing the optimal queue can feel like navigating a complex maze.

Scalability 263

Scalability Architecture Processing Systems 263

Dynatrace

OCTOBER 1, 2021

As dynamic systems architectures increase in complexity and scale, IT teams face mounting pressure to track and respond to conditions and issues across their multi-cloud environments. Dynatrace news. As teams begin collecting and working with observability data, they are also realizing its benefits to the business, not just IT.

Metrics 363

Metrics Open Source Monitoring Cloud 363

Scalegrid

MAY 13, 2020

In this blog post, we explain what Greenplum is, and break down the Greenplum architecture, advantages, major use cases, and how to get started. It’s architecture was specially designed to manage large-scale data warehouses and business intelligence workloads by giving you the ability to spread your data out across a multitude of servers.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

Dynatrace

AUGUST 11, 2022

Before an organization moves to function as a service, it’s important to understand how it works, its benefits and challenges, its effect on scalability, and why cloud-native observability is essential for attaining peak performance. FaaS vs. monolithic architectures. How does function as a service affect scalability?

Development 257

Development Serverless Best Practices Lambda 257

The Netflix TechBlog

JUNE 7, 2021

Flow Exporter The Flow Exporter is a sidecar that uses eBPF tracepoints to capture TCP flows at near real time on instances that power the Netflix microservices architecture. Flow Collector consumes two data streams, the IP address change events from Sonar via Kafka and eBPF flow log data from the Flow Exporter sidecars. What is BPF?

Network 327

Network Transportation AWS Cloud 327

The Netflix TechBlog

APRIL 27, 2023

While we were able to put out the immediate fire by disabling the newly created alerts, this incident raised some critical concerns around the scalability of our alerting system. It became clear to us that we needed to solve the scalability problem with a fundamentally different approach. OK, Results?

Storage 298

Storage Cache Metrics Database 298

The Netflix TechBlog

MARCH 5, 2019

Challenges & Opportunities in the Infra Data Space Security Events Platform for Anomaly Detection How can we develop a complex event processing system to ingest semi-structured data predicated on schema contracts from hundreds of sources and transform it into event streams of structured data for downstream analysis?

Infrastructure 185

Infrastructure Cloud Scalability AWS 185

InfoQ

MARCH 7, 2024

Uber replaced a legacy architecture built using the WAMP protocol with a new solution that takes advantage of GraphQL subscriptions. By Rafal Gancarz

Scalability 128

Scalability Architecture Design Development 128

Dynatrace

DECEMBER 3, 2024

By embedding Dynatrace AI-driven observability and reliability checks into the deployment pipeline, organizations can proactively assess their cloud architectures against best practices, detecting and resolving potential issues before they impact production.

AWS 250

AWS Cloud Performance Innovation 250

All Things Distributed

JULY 14, 2015

In this blog post, I will explain how these three new capabilities empower you to build applications with distributed systems architecture and create responsive, reliable, and high-performance applications using DynamoDB that work at any scale. Amazon Redshift) and Elasticsearch machines. DynamoDB Cross-region Replication.

Database 158

Database Lambda AWS IoT 158

Dynatrace

OCTOBER 4, 2022

Grail architectural basics. The aforementioned principles have, of course, a major impact on the overall architecture. A data lakehouse addresses these limitations and introduces an entirely new architectural design. From the beginning, Grail was built to be fast and scalable to manage massive volumes of data.

Artificial Intelligence 273

Artificial Intelligence Analytics Storage Architecture 273

High Scalability

JANUARY 11, 2022

Architecture. We have chosen this NoSQL based solution over relational databases as it provides the scalability to have hierarchies which go beyond two levels and extensibility due to the schema-less behavior of NoSQL data storage. Sending and receiving messages from other users. High Level Design. Streaming Data Model.

Design 334

Design Media Storage Logistics 334

Dynatrace

JULY 11, 2023

We’re delighted to share that IBM and Dynatrace have joined forces to bring the Dynatrace Operator, along with the comprehensive capabilities of the Dynatrace platform, to Red Hat OpenShift on the IBM Power architecture (ppc64le). It also detects new containers and injects OneAgent code modules into application pods.

Architecture 174

Architecture Availability Infrastructure Monitoring 174

The Netflix TechBlog

OCTOBER 8, 2024

In previous blog posts, we introduced the Key-Value Data Abstraction Layer and the Data Gateway Platform , both of which are integral to Netflix’s data architecture. Instead, we focus on addressing the challenge of storing and accessing extremely high-throughput, immutable temporal event data in a low-latency and cost-efficient manner.

Latency 240

Latency Storage Traffic Tuning 240

InfoQ

MARCH 15, 2024

Hashnode created a scalable event-driven architecture (EDA) for composing feed data for thousands of users. The company used serverless services on AWS, including Lambda, Step Functions, EventBridge, and Redis Cache. The solution leverages Step Functions' distributed maps feature that enables high-concurrency processing.

Scalability 76

Scalability AWS Architecture Lambda 76

Dynatrace

OCTOBER 2, 2023

Transforming an application from monolith to microservices-based architecture can be daunting, and knowing where to start can be difficult. Unsurprisingly, organizations are breaking away from monolithic architectures and moving toward event-driven microservices. Migration is time-consuming and involved.

Architecture 239

Architecture Artificial Intelligence Cloud Open Source 239

The Netflix TechBlog

NOVEMBER 3, 2022

The original assumptions and architectural choices were no longer viable. Overview The figure below depicts a simplified high-level architecture of a single Titus cluster (a.k.a Let’s assume a sequence of events E?…E??, cell): Titus Job Coordinator is a leader elected process managing the active state of the system. of the data.

Cache 234

Cache Latency Traffic Systems 234

Dynatrace

AUGUST 16, 2021

Automatically collect and evaluate business, service, and architectural indicator metrics to promote or roll back deployments. Providing standardized self-service pipeline templates, best practices, and scalable automation for monitoring, testing, and SLO validation. Example #2 – Deployment information events. Annotation.

Software 246

Software Software Open Source Azure 246

Dynatrace

APRIL 7, 2023

Streaming raises the default 6 MB hard limit to a 20 MB soft limit, adding greater scalability and flexibility to their applications. Triggering the Lambda function is event-driven and could include changes in state or an update to a file. What is a Lambda serverless function? What is Lambda Response Streaming?

Lambda 222

Lambda AWS Serverless Latency 222

Dynatrace

JULY 29, 2021

Today’s digital businesses run on heterogeneous and highly dynamic architectures with interconnected applications and microservices deployed via Kubernetes and other cloud-native platforms. Common questions include: Where do bottlenecks occur in our architecture? How can we optimize for performance and scalability?

Analytics 246

Analytics Open Source Serverless Architecture 246

The Netflix TechBlog

DECEMBER 11, 2020

Our Journey so Far Over the past year, we’ve implemented the core infrastructure pieces necessary for a federated GraphQL architecture as described in our previous post: Studio Edge Architecture The first Domain Graph Service (DGS) on the platform was the former GraphQL monolith that we discussed in our first post (Studio API).

Architecture 256

Architecture Best Practices Engineering Open Source 256

Dynatrace

OCTOBER 6, 2023

Table name Default bucket logs default_logs events default_events metrics default_metrics bizevents default_bizevents dt.system.events dt_system_events entities spans (in the future) The default buckets let you ingest data immediately, but you can also create additional custom buckets to make the most of Grail.

Artificial Intelligence 266

Artificial Intelligence Metrics Analytics Storage 266

Dynatrace

NOVEMBER 28, 2022

The Dynatrace Software Intelligence Platform accelerates cloud operations, helping users achieve service-level objectives (SLOs) with automated intelligence and unmatched scalability. Understand and optimize your architecture. Built for enterprise scalability. Optimize timing hotspots. Simplify error analytics.

Lambda 230

Lambda AWS Serverless Latency 230

The Netflix TechBlog

AUGUST 30, 2021

In the Device Management Platform, this is achieved by having device updates be event-sourced through the control plane to the cloud so that NTS will always have the most up-to-date information about the devices available for testing. Upstream event sourcing was fully enabled on the producer side at around 2021–07–15 15:00 PST.

Latency 223

Latency Traffic Transportation Cloud 223

The Netflix TechBlog

OCTOBER 18, 2022

As Big data and ML became more prevalent and impactful, the scalability, reliability, and usability of the orchestrating ecosystem have increasingly become more important for our data scientists and the company. Motivation Scalability and usability are essential to enable large-scale workflows and support a wide range of use cases.

Java 212

Java Scalability Traffic Architecture 212

Dynatrace

APRIL 30, 2019

At its heart it uses Istio (for traffic control) and Knative (for event driven tool orchestration) and stores all configuration in Git – following the GitOps approach. Beyond basic metrics: Detecting Architectural Regressions. Use this to detect any architectural regressions introduced through code or config changes.

Architecture 126

Architecture Open Source Azure Metrics 126

The Netflix TechBlog

NOVEMBER 12, 2024

By: Rajiv Shringi , Oleksii Tkachuk , Kartik Sathyanarayanan Introduction In our previous blog post, we introduced Netflix’s TimeSeries Abstraction , a distributed service designed to store and query large volumes of temporal event data with low millisecond latencies. Today, we’re excited to present the Distributed Counter Abstraction.

Latency 251

Latency Cache Infrastructure Strategy 251

The Netflix TechBlog

MARCH 25, 2019

In the rest of this blog, we will a) touch on the complexity of Netflix cloud landscape, b) discuss lineage design goals, ingestion architecture and the corresponding data model, c) share the challenges we faced and the learnings we picked up along the way, and d) close it out with “what’s next” on this journey.

Infrastructure 225

Infrastructure Big Data Transportation Architecture 225

Dynatrace

NOVEMBER 9, 2021

Amplify PowerUP, our half-yearly global event to update our partner community, covered a lot of ground including key Partner Program announcements, Q2 earnings and partner contribution, market growth and momentum, Dynatrace platform capabilities, and the partner services offering the platform powers.

DevOps 224

DevOps Innovation Cloud Programming 224

All Things Distributed

MAY 10, 2016

If you are looking for more examples there are the Lambda Serverless Reference Architectures that can serve as the blueprint for building your own serverless applications. Mobile Backend Serverless Reference Architecture. Real-time File Processing Serverless Reference Architecture. IoT Backend Serverless Reference Architecture.

Lambda 91

Lambda Serverless AWS Architecture 91

Dynatrace

APRIL 20, 2023

Logs highlight observability challenges Ingesting, storing, and processing the unprecedented explosion of data from sources such as software as a service, multicloud environments, containers, and serverless architectures can be overwhelming for today’s organizations. ” Watch session now!

Analytics 194

Analytics Infrastructure Storage Architecture 194

Dynatrace

FEBRUARY 4, 2021

Site reliability engineering (SRE) is the practice of applying software engineering principles to operations and infrastructure processes to help organizations create highly reliable and scalable software systems. For more about this ongoing conversation, see A guide to event-driven SRE-inspired DevOps. Solving for SR.

Engineering 258

Engineering DevOps Government Latency 258

Dynatrace

JUNE 10, 2024

Improved compliance A better understanding of data security across multiple applications and environments provides a unified view of events and information. Security analytics vs. SIEM Security information and event management (SIEM) tools are staples of enterprise security. This offers two advantages for compliance.

Analytics 238

Analytics Network Open Source Hardware 238

InfoQ

FEBRUARY 1, 2024

Peter Lawrey discusses achieving vertical scalability by minimizing accidental complexity and using an event-driven architecture. By Peter Lawrey

Scalability 80

Scalability Efficiency Systems Architecture 80

The Netflix TechBlog

MAY 4, 2023

When undertaking system migrations, one of the main challenges is establishing confidence and seamlessly transitioning the traffic to the upgraded architecture without adversely impacting the customer experience. This blog series will examine the tools, techniques, and strategies we have utilized to achieve this goal.

Traffic 347

Traffic Latency Tuning Systems 347

Dynatrace

JULY 9, 2020

Autonomous Cloud Enablement (ACE) and Keptn – the Event-Driven Autonomous Cloud Control Plane – are helping our Dynatrace customers to automate their delivery and operations processes. This is now where Keptn, our Event-Driven Control Plane for Autonomous Cloud Control Plane, comes into the picture! Dynatrace news.

Cloud 193

Cloud DevOps Azure Architecture 193

All Things Distributed

JUNE 10, 2016

If you are looking for more examples there are the Lambda Serverless Reference Architectures that can serve as the blueprint for building your own serverless applications. Mobile Backend Serverless Reference Architecture. Real-time File Processing Serverless Reference Architecture. IoT Backend Serverless Reference Architecture.

Lambda 87

Lambda Serverless AWS Architecture 87