Event, Java and Scalability - Technology Performance Pulse

RabbitMQ vs. Kafka: Key Differences

Scalegrid

FEBRUARY 6, 2025

RabbitMQ is designed for flexible routing and message reliability, while Kafka handles high-throughput event streaming and real-time data processing. Kafka is optimized for high-throughput event streaming , excelling in real-time analytics and large-scale data ingestion. What is RabbitMQ?

Latency

Latency Analytics Architecture Storage

Title Launch Observability at Netflix Scale

The Netflix TechBlog

MARCH 4, 2025

In order to allow for this mimicking, many systems implement an event handling, where they convert our request into a call to the real service with properties enabled to log when titles are filtered out of their response and why. Conclusion Throughout this series, weve explored the journey of enhancing title launch observability at Netflix.

Traffic

Traffic Strategy Entertainment Innovation

Kubernetes in the wild report 2023

Dynatrace

JANUARY 16, 2023

Java, Go, and Node.js Through effortless provisioning, a larger number of small hosts provide a cost-effective and scalable platform. Messaging : RabbitMQ and Kafka are the two main messaging and event streaming systems used. Java, Go, and Node.js Java Virtual Machine (JVM)-based languages are predominant.

Open Source

Open Source Java Operating System Programming

Kubernetes OOMKilled troubleshooting: Diagnosing out-of-memory issues automatically

Dynatrace

DECEMBER 5, 2022

Both backend and report service are implemented in Java, but Robert found no Java runtime-related issues, either. Analyzing: Looking for unusual Kubernetes event activity. So Robert analyzed the data and events Dynatrace captured for the Kubernetes cluster responsible for keeping the pods running. But that’s about it.

Java

Java Traffic Education Testing

A Kubernetes platform engineering strategy tames Kubernetes complexity

Dynatrace

JULY 25, 2024

The company receives tens of thousands of requests per second on its edge layer and sees hundreds of millions of events per hour on its analytics layer. This created problems with both visibility and scalability. “For example, if most teams run Java, it might not make sense trying to support an outlier.

Strategy

Strategy Engineering Open Source Java

Radically speed up your code by fixing slow or frequent garbage collection

Dynatrace

APRIL 8, 2020

Java Memory Management, with its built-in garbage collection, is one of the language’s finest achievements. However, garbage collection is one of the main sources of performance and scalability issues in any modern Java application. T his feature requires Java 11+. . Dynatrace news. Save on CPU resources.

Speed

Speed Code Java Lambda

Embrace event-driven computing: Amazon expands DynamoDB with streams, cross-region replication, and database triggers

All Things Distributed

JULY 14, 2015

A more scalable option is to decouple these systems and build a pipe that connects these engines and feeds all change records from the source database to the data warehouse (e.g., Triggers are powerful mechanisms that react to events dynamically and in real time. Amazon Redshift) and Elasticsearch machines.

Database

Database Lambda AWS IoT

Orchestrating Data/ML Workflows at Scale With Netflix Maestro

The Netflix TechBlog

OCTOBER 18, 2022

As Big data and ML became more prevalent and impactful, the scalability, reliability, and usability of the orchestrating ecosystem have increasingly become more important for our data scientists and the company. Motivation Scalability and usability are essential to enable large-scale workflows and support a wide range of use cases.

Java

Java Scalability Traffic Architecture

Dynatrace and Google unleash cloud-native observability for GKE Autopilot

Dynatrace

AUGUST 30, 2023

Dynatrace’s collaboration with Google addresses these needs by providing simple, scalable, and innovative data acquisition for comprehensive analysis and troubleshooting. In this case, Davis found that a Java Spring Micrometer metric Failed Deliveries is highly correlated with CPU spikes.

Google

Google Cloud Innovation Infrastructure

Pinterest Open-Sources a Production-Ready PubSub Java Client for Kafka, Flink, and MemQ

InfoQ

FEBRUARY 11, 2024

The library helped the engineering teams by increasing developer velocity, and the scalability and stability of services using it. Over 90% of Java applications have migrated to PSC with minimal changes. Pinterest open-sourced its generic PubSub client library, PSC, which has been heavily used in production for a year and a half.

Open Source

Open Source Java Scalability Engineering

Data Reprocessing Pipeline in Asset Management Platform @Netflix

The Netflix TechBlog

MARCH 10, 2023

After reading the asset ids using one of the ways, an event is created per asset id to be processed synchronously or asynchronously based on the use case. For asynchronous processing, events are sent to Apache Kafka topics to be processed. Asynchronous Flow : Data processor consumes the data events sent by the data extractor.

Media

Media Traffic Processing Design

Keptn – The Autonomous Cloud control plane for Dynatrace explained

Dynatrace

JULY 9, 2020

Autonomous Cloud Enablement (ACE) and Keptn – the Event-Driven Autonomous Cloud Control Plane – are helping our Dynatrace customers to automate their delivery and operations processes. This is now where Keptn, our Event-Driven Control Plane for Autonomous Cloud Control Plane, comes into the picture! Dynatrace news.

Cloud

Cloud DevOps Azure Architecture

New analytics capabilities for messaging system-related anomalies

Dynatrace

JANUARY 12, 2022

Messaging systems can significantly improve the reliability, performance, and scalability of the communication processes between applications and services. An example of a critical event-based messaging service for many businesses is adding a product to a shopping cart. Dynatrace news.

Analytics

Analytics Systems DevOps Healthcare

What is Google Cloud Functions?

Dynatrace

OCTOBER 11, 2021

Scalability is a major feature of GCF. The Cloud Functions platform enables teams to craft functional, extensible applications that run code when triggered by preset conditions or events. GCF also enables teams to run custom-written code to connect multiple services in Node, Python, Go, Java,NET, Ruby, and PHP.

Google

Google Cloud Serverless Azure

Managing PostgreSQL® High Availability – Part I: PostgreSQL Automatic Failover

Scalegrid

SEPTEMBER 5, 2024

The key components of automatic failover include the primary server for write operations, standby servers for backup, and a monitor node for health checks and coordination of failover events. In the event of a primary server failure, standby servers are prepared to assume control, which helps reduce system downtime.

Availability

Availability Servers Database Open Source

DevOps observability: A guide for DevOps and DevSecOps teams

Dynatrace

JANUARY 18, 2023

Site reliability engineering (SRE) is a software operations methodology that enables organizations to create highly reliable and scalable applications. A CI/CD practice can offer a high level of scalability to organizations looking to innovate quickly and efficiently.

DevOps

DevOps Best Practices Innovation Strategy

How Netflix Scales its API with GraphQL Federation (Part 2)

The Netflix TechBlog

DECEMBER 11, 2020

This gives us access to Netflix’s Java ecosystem, while also giving us the robust language features such as coroutines for efficient parallel fetches, and an expressive type system with null safety. For storing schema changes, we use an internal library that implements the event sourcing pattern on top of the Cassandra database.

Architecture

Architecture Best Practices Engineering Open Source

DBLog: A Generic Change-Data-Capture Framework

The Netflix TechBlog

DECEMBER 17, 2019

In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events. Some of DBLog’s features are: Processes captured log events in-order. Interleaves log with dump events, by taking dumps in chunks. Hence, downstream consumers have confidence to receive change events as they occur on a source.

Database

Database Traffic Transportation Open Source

The road to observability demo part 3: Collect, instrument, and analyze telemetry data automatically with Dynatrace

Dynatrace

MAY 17, 2023

The beauty of OneAgent is it’s a drop-in solution and monitors every supported technology (for example,NET, Java, PHP, Node.js) with little to no manual work required from your side. Most importantly, this information does not only cover the server side, but, thanks to RUM, also the client side and events in the browser.

Metrics

Metrics Database Monitoring Network

DBLog: A Generic Change-Data-Capture Framework

The Netflix TechBlog

DECEMBER 17, 2019

In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events. Some of DBLog’s features are: Processes captured log events in-order. Interleaves log with dump events, by taking dumps in chunks. Hence, downstream consumers receive change events as they occur on a source.

Database

Database Traffic Transportation Open Source

Optimizing data warehouse storage

The Netflix TechBlog

DECEMBER 21, 2020

Both automatic (event-driven) as well as manual (ad-hoc) optimization. It decides what to do and when to do in response to an incoming event. It is responsible for listening to incoming events and requests and prioritizing different tables and actions to make the best usage of the available resources. Transparency to end-users.

Storage

Storage Latency Efficiency Data Engineering

Sponsored Post: Software Buyers Council, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

High Scalability

FEBRUARY 19, 2019

Fun and Informative Events. Advertise your event here! Client libraries are available for Node, Ruby, Python, PHP, Go, Java and.NET. If you are interested in a sponsored post for an event, job, or product, please contact us for more information. Make your job search O (1), not O ( n ). Apply here. Need excellent people?

Software

Software Software Analytics Infrastructure

Sponsored Post: Software Buyers Council, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

High Scalability

FEBRUARY 5, 2019

Fun and Informative Events. Advertise your event here! Client libraries are available for Node, Ruby, Python, PHP, Go, Java and.NET. If you are interested in a sponsored post for an event, job, or product, please contact us for more information. Make your job search O (1), not O ( n ). Apply here. Need excellent people?

Software

Software Software Infrastructure Engineering

Sponsored Post: Software Buyers Council, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

High Scalability

MARCH 19, 2019

Fun and Informative Events. Advertise your event here! Client libraries are available for Node, Ruby, Python, PHP, Go, Java and.NET. If you are interested in a sponsored post for an event, job, or product, please contact us for more information. Make your job search O (1), not O ( n ). Apply here. Need excellent people?

Software

Software Software Analytics Infrastructure

Sponsored Post: Software Buyers Council, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

High Scalability

FEBRUARY 5, 2019

Fun and Informative Events. Advertise your event here! Client libraries are available for Node, Ruby, Python, PHP, Go, Java and.NET. If you are interested in a sponsored post for an event, job, or product, please contact us for more information. Make your job search O (1), not O ( n ). Apply here. Need excellent people?

Software

Software Software Infrastructure Engineering

RabbitMQ vs. Kafka: Key Differences

Title Launch Observability at Netflix Scale

Trending Sources

Kubernetes in the wild report 2023

Kubernetes OOMKilled troubleshooting: Diagnosing out-of-memory issues automatically

A Kubernetes platform engineering strategy tames Kubernetes complexity

Radically speed up your code by fixing slow or frequent garbage collection

Embrace event-driven computing: Amazon expands DynamoDB with streams, cross-region replication, and database triggers

Orchestrating Data/ML Workflows at Scale With Netflix Maestro

Dynatrace and Google unleash cloud-native observability for GKE Autopilot

Pinterest Open-Sources a Production-Ready PubSub Java Client for Kafka, Flink, and MemQ

Data Reprocessing Pipeline in Asset Management Platform @Netflix

Keptn – The Autonomous Cloud control plane for Dynatrace explained

New analytics capabilities for messaging system-related anomalies

What is Google Cloud Functions?

Managing PostgreSQL® High Availability – Part I: PostgreSQL Automatic Failover

DevOps observability: A guide for DevOps and DevSecOps teams

How Netflix Scales its API with GraphQL Federation (Part 2)

DBLog: A Generic Change-Data-Capture Framework

Sponsored Post: InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

The road to observability demo part 3: Collect, instrument, and analyze telemetry data automatically with Dynatrace

DBLog: A Generic Change-Data-Capture Framework

Sponsored Post: PerfOps, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

Sponsored Post: PerfOps, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

Sponsored Post: ipdata, StackHawk, InterviewCamp.io, Educative, Triplebyte, Stream, Fauna

Sponsored Post: InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

Sponsored Post: pMD, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

Sponsored Post: InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

Sponsored Post: PerfOps, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

Sponsored Post: StackHawk, InterviewCamp.io, Educative, Triplebyte, Stream, Fauna

Sponsored Post: Twitch, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr, MemSQL

Sponsored Post: Twitch, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr, MemSQL

Sponsored Post: Ipdata, StackHawk, InterviewCamp.io, Educative, Triplebyte, Stream, Fauna

Optimizing data warehouse storage

Sponsored Post: Software Buyers Council, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

Sponsored Post: StackHawk, InterviewCamp.io, Educative, Triplebyte, Stream, Fauna

Sponsored Post: Twitch, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

Sponsored Post: Etleap, PerfOps, InMemory.Net, Triplebyte, Stream, Scalyr

Sponsored Post: Software Buyers Council, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

Sponsored Post: Software Buyers Council, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

Sponsored Post: Twitch, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr, MemSQL

Sponsored Post: Software Buyers Council, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

Sponsored Post: ipdata, StackHawk, InterviewCamp.io, Educative, Triplebyte, Stream, Fauna

Sponsored Post: IP2Location, Ipdata, StackHawk, InterviewCamp.io, Educative, Triplebyte, Stream, Fauna

Sponsored Post: IP2Location, Ipdata, StackHawk, InterviewCamp.io, Educative, Triplebyte, Stream, Fauna

Stay Connected