article thumbnail

Designing High-Performance APIs

DZone

Welcome back to our series on API design principles for optimal performance and scalability. In our previous blog post, we explored the importance of designing high-performance APIs and the key factors that influence API performance. In this article, we will build upon the concepts discussed in the previous blog post.

Design 277
article thumbnail

Article: Design Pattern Proposal for Autoscaling Stateful Systems

InfoQ

In this article, Rogerio Robetti discusses the challenges in auto-scaling stateful storage systems and proposes an opinionated design solution to automatically scale up (vertical) and scale out (horizontal) from a single node up to several nodes in a cluster with minimum configuration and interference of the operator.

Design 144
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Real-Time Presence Platform System Design

DZone

The system design of the Presence Platform depends on the design of the Real-Time Platform. I highly recommend reading the related article to improve your system design skills. The original article was published on systemdesign.one website. What Is the Real-Time Presence Platform?

Design 225
article thumbnail

Metadata Synchronization in Alluxio: Design, Implementation, and Optimization

DZone

This article describes the design and the implementation in Alluxio to keep metadata synchronized. Metadata synchronization (sync) is a core feature in Alluxio that keeps files and directories consistent with their source of truth in under-storage systems, thus making it simple for users to reason the data retrieved from Alluxio.

Design 244
article thumbnail

Architectural Insights: Designing Efficient Multi-Layered Caching With Instagram Example

DZone

This article will explore the concept of multi-layered caching from both architectural and development perspectives, focusing on real-world applications like Instagram, and provide insights into designing and implementing an efficient multi-layered cache system.

Cache 173
article thumbnail

Design Of A Modern Cache—Part Deux

High Scalability

The previous article described the caching algorithms used by Caffeine , in particular the eviction and concurrency models. This is a guest post by Benjamin Manes , who did engineery things for Google and is now doing engineery things as CTO of Vector.

Cache 200
article thumbnail

Essential Guidelines for Building Optimized ETL Data Pipelines in the Cloud With Azure Data Factory

DZone

When building ETL data pipelines using Azure Data Factory (ADF) to process huge amounts of data from different sources, you may often run into performance and design-related challenges. This article will serve as a guide in building high-performance ETL pipelines that are both efficient and scalable.

Azure 306