Article - Technology Performance Pulse

Evolution of search engines architecture - Algolia New Search Architecture Part 1

High Scalability

AUGUST 2, 2021

This is the first article in a series. In this article, we look at some key milestones in the evolution of search engine architecture. What would a totally new search engine architecture look like? Who better than Julien Lemoine , Co-founder & CTO of Algolia , to describe what the future of search will look like.

Architecture

Architecture Engineering Systems

Getting Started With NCache Java Edition (Using Docker)

DZone

MARCH 21, 2024

This article is made especially for beginners to make the ideas and steps of adding NCache to your Java applications clear and easy to understand. It doesn't matter if you've been developing for years or if you're new to caching , this article will help you get a good start with NCache Java Edition.

Java

Java Cache Technology Technology

How to Implement Client-Side Load Balancing With Spring Cloud

DZone

OCTOBER 21, 2024

In this article, you will learn how to use it to implement client-side load balancing in a Spring Boot project. In this article, we will discuss an example based on the client-side scenario. It is therefore important to distribute the load between those instances. The component that does this is the load balancer.

Cloud

Cloud Servers Systems

Implementation of the REDIS Cache in the.NET Core API

DZone

FEBRUARY 26, 2023

In this article, I cover caching and how it works in.NET Core. So, we look at the following things one by one: Introduction of Caching What is Cache? Types of Cache Installation of REDIS Cache Cache Implementation So, let’s get started!

Cache

Overcoming Challenges and Best Practices for Data Migration From On-Premise to Cloud

DZone

MARCH 29, 2023

This article discusses the challenges and best practices of data migration when transferring on-premise data to the cloud. The article will also explore the role of data engineering in ensuring successful data transfer and integration and different approaches to data migration.

Best Practices

Best Practices Cloud Data Engineering Storage

Implementing RBAC in Quarkus

DZone

APRIL 27, 2023

This article describes how we can protect REST APIs using Role-based access control (RBAC) in the Quarkus Java framework. The Quarkus Java framework comes with native support for RBAC, which will be the initial focus of this article. Additionally, the article will cover building a custom solution to secure REST endpoints.

Java

Java Open Source Cloud Design

Microservice Proliferation: Too Many Microservices

DZone

OCTOBER 9, 2024

detailed in this article ), it has gained significant traction in the software industry lately and organizations are building their applications following microservices architecture. Microservices architecture promotes the development of applications, as suites of small, independent, loosely coupled services.

Architecture

Architecture Strategy Scalability Software

O11y Guide, Cloud Native Observability Pitfalls: Controlling Costs

DZone

JANUARY 29, 2024

It was the first article in this series. In this article, you'll find the first pitfall discussion that's another common mistake organizations make. In the previous introduction , we looked at the problem facing everyone with cloud-native observability.

Cloud

Cloud DevOps Engineering

Consistent hashing algorithm

High Scalability

FEBRUARY 22, 2023

This is a guest article by NK. You can view the original article Consistent hashing explained on systemdesign.one website. How does consistent hashing work?

Virtualization

Virtualization Website Performance

Optimizing String Comparisons in Go

DZone

SEPTEMBER 21, 2020

In a previous article, we looked at How to compare strings in Go and did some benchmarking. Optimizing string comparisons in Go can improve your application’s response time and help scalability. Comparing two strings to see if they’re equal takes processing power, but not all comparisons are the same. We’re going to expand on that here.

Benchmarking

Benchmarking Programming Scalability Processing

How to Get Started With Istio in Kubernetes in 5 Steps

DZone

JUNE 20, 2023

In this article, we will briefly look at what Istio is and then see how to install Istio in Kubernetes in just 5 steps. Now, it is harder to configure communication between distributed services and secure the data in transit. So it is inevitable for organizations to use service mesh, specifically Istio.

Cloud

Cloud Development

Efficient Data Management With Offset and Cursor-Based Pagination in Modern Applications

DZone

JUNE 19, 2024

In this article, we will explore two pagination strategies, offset and cursor-based pagination, that are suited to different scenarios and requirements. Retrieval strategies play a crucial role in improving performance and scalability, especially when response times are critical. Pagination is a core technique used to manage data effectively.

Efficiency

Efficiency Strategy Scalability Technology

Automate Application Load Balancers With AWS Load Balancer Controller and Ingress

DZone

JANUARY 17, 2024

This article delves into the importance of automation using the AWS Load Balancer controller and Ingress template. Automating AWS Load Balancers is essential for managing cloud infrastructure efficiently.

AWS

AWS Infrastructure Efficiency Cloud

How To Collect and Ship Windows Events Logs With OpenTelemetry

DZone

FEBRUARY 17, 2023

In this article, we will be using observIQ’s distribution of the collector. A recent contribution of a distribution of the OpenTelemetry (OTel) Collector makes it much easier to monitor Windows Events with OpenTel. You can utilize this receiver either in conjunction with any OTel collector: including the OpenTelemetry Collector.

Operating System

Operating System Google Monitoring Cloud

Data Storage Formats for Big Data Analytics: Performance and Cost Implications of Parquet, Avro, and ORC

DZone

SEPTEMBER 9, 2024

This article explores the impact of different storage formats, specifically Parquet, Avro, and ORC on query performance and costs in big data environments on Google Cloud Platform (GCP). This article provides benchmarks, discusses cost implications, and offers recommendations on selecting the appropriate format based on specific use cases.

Big Data

Big Data Storage Analytics Benchmarking

Essential Guidelines for Building Optimized ETL Data Pipelines in the Cloud With Azure Data Factory

DZone

AUGUST 14, 2024

This article will serve as a guide in building high-performance ETL pipelines that are both efficient and scalable. When building ETL data pipelines using Azure Data Factory (ADF) to process huge amounts of data from different sources, you may often run into performance and design-related challenges.

Azure

Azure Cloud Scalability Efficiency

Scaling indexing and search - Algolia New Search Architecture Part 2

High Scalability

OCTOBER 11, 2021

This is the second article in a series. This article explains those drawbacks and introduces a new way to scale more quickly and efficiently by splitting Read and Write operations. What would a totally new search engine architecture look like? Here's Part 1. Rapid scaling is essential in most use cases. Anatomy of an index.

Architecture

Architecture Efficiency Engineering Performance

Configure Kubernetes Health Checks

DZone

FEBRUARY 27, 2023

This article will discuss Kubernetes probes, the different types available, and how to implement them in your Kubernetes environment. It is used to automate the deployment, scaling, and management of containerized applications. It is an efficient way to manage application health with Kubernetes probes. What Are Kubernetes Probes?

Open Source

Open Source Efficiency Cloud Monitoring

O11y Guide: Beginner's Guide To Open Source Instrumenting Java

DZone

JANUARY 3, 2024

Look no further, as this article provides you with an easy-to-understand guide to instrumenting your Java using open standards. Did you always want to know more about instrumentation, metrics, and your options for coding with open standards?

Open Source

Open Source Java Cloud Metrics

Low-Level Optimizations in ClickHouse: Utilizing Branch Prediction and SIMD To Speed Up Query Execution

DZone

SEPTEMBER 16, 2024

I’ll probably write a series of articles on different features of ClickHouse, and this article will be a general introduction with some interesting points that few people think about when using various databases.

Speed

Speed Database Systems

From Observability To Architectural Observability — Shifting Left for Resiliency

DZone

JULY 23, 2024

In my previous article, Managing Architectural Tech Debt , I talked about understanding and managing architectural technical debt. In this article, I want to dive deeper into one way to manage architectural technical debt (and technical debt as a whole) — architectural observability ( AO ).

Architecture

Architecture Performance

Using Raspberry PI in Virtualization: Unlocking New Possibilities

DZone

JANUARY 3, 2024

The exciting world of using a Raspberry Pi for virtualization will be explored in this article, along with the new opportunities it creates for businesses, educators, and hobbyists alike.

Virtualization

Virtualization Education Media Hardware

Open Dashboard and Visualization Workshop: Exploring Perses API

DZone

DECEMBER 12, 2023

These articles covered this fairly new open dashboard and visualization project targeting cloud-native environments. In the previous article , I kicked off with an introduction to and installation of Perses and provided links to the actual online workshop content.

Cloud

Top Three Docker Alternatives To Consider

DZone

FEBRUARY 2, 2023

In this article, we’ll discuss the following three Docker hub alternatives: Podman, Containerd, and LXD. Docker is a popular platform for creating and managing containerized applications; however, several alternatives for Docker can also be used for this purpose.

Operating System

Operating System Technology Technology Availability

Time Series Analysis: VAR-Model-As-A-Service Using Flask and MinIO

DZone

SEPTEMBER 25, 2023

It is the second of a series of articles that is built on top of that project, representing experiments with various statistical and machine learning models, data pipelines implemented using existing DAG tools, and storage services, both cloud-based and alternative on-premises solutions.

Storage

Storage AWS Architecture Cloud

Kubernetes Observability: Lessons Learned From Running Kubernetes in Production

DZone

OCTOBER 1, 2024

Editor's Note: The following is an article written for and published in DZone's 2024 Trend Report, Kubernetes in the Enterprise: Once Decade-Defining, Now Forging a Future in the SDLC.

Software Engineering

Software Engineering DevOps Cloud Architecture

Optimizing PgBench for CockroachDB Part 3

DZone

DECEMBER 1, 2023

Previous Articles Previous articles on PgBench and CockoachDB: Using PgBench with CockroachDB Serverless Optimizing PgBench for CockroachDB Part 1 Optimizing PgBench for CockroachDB Part 2 Motivation For the longest time, CockroachDB only supported serializable isolation. In our next release after 23.1,

Serverless

Serverless Performance

How to Handle Secrets in Kubernetes

DZone

MAY 21, 2023

In this article, we will delve into the world of secret management in Kubernetes, exploring various approaches and best practices to keep your sensitive data safe and accessible only to authorized components.

Best Practices

Best Practices Infrastructure Efficiency

Cloud Native Predictions 2024: Stress, Careers, and Costs

DZone

DECEMBER 13, 2023

I've done that every year on this blog with year-in-review articles. In this article, I plan to lay out three top predictions based on my experiences over 2023 in the cloud native domain, with a big focus on the observability arena.

Cloud

Cloud Open Source Technology Technology

A Five-Step Methodology for Maximizing Efficiency in Software Engineering Meetings

DZone

JANUARY 6, 2024

In this article, we will delve deeper into the issues associated with meetings in software engineering and explore the available data. Meetings are a crucial aspect of software engineering , serving as a collaboration, communication, and decision-making platform.

Software Engineering

Software Engineering Efficiency Engineering Software

O11y Guide: Building Your First Dashboard

DZone

FEBRUARY 16, 2023

If you missed any of the previous articles, head on back to the introduction for a quick update. After laying out the groundwork for this series in the initial article, I spent some time in the second article sharing who the observability players are.

Open Source

Open Source Cloud Monitoring Development

The Path From APIs to Containers

DZone

MARCH 23, 2023

This is an article from DZone's 2023 Software Integration Trend Report. For more: Read the Report In recent years, the rise of microservices has drastically changed the way we build and deploy software.

Scalability

Scalability Architecture Software Software

Improving Snowflake Performance by Mastering the Query Profile

DZone

AUGUST 21, 2024

In this article, I'll explain: Having worked with over 50 Snowflake customers across Europe and the Middle East, I've analyzed hundreds of Query Profiles and identified many issues including issues around performance and cost.

Performance

Best Practices for Building the Data Pipelines

DZone

DECEMBER 16, 2023

In my previous article ‘ Data Validation to Improve Data Quality ’, I shared the importance of data quality and a checklist of validation rules to achieve it. In this article, we focus on the best practices to employ while building the data pipelines to ensure data quality.

Best Practices

Fraud Detection With Apache Kafka, KSQL, and Apache Flink

DZone

JANUARY 26, 2023

This article explores case studies for fraud prevention from companies such as Paypal, Capital One, ING Bank, Grab, and Kakao Games that leverage stream processing technologies like Kafka Streams, KSQL, and Apache Flink. Fraud detection becomes increasingly challenging in a digital world across all industries.

Games

Games Technology Technology Processing

Machine Learning: A Revolutionizing Force in Cybersecurity

DZone

MARCH 13, 2024

This article delves into the potential of ML in cybersecurity, examining its various applications and exploring its strengths and limitations while highlighting its professional value. Introduction The digital age has fostered an intricate tapestry of interconnected systems upon which individuals and organizations increasingly rely.

Innovation

Innovation Strategy Systems

Network Guardians: Crafting a Spring Boot-Driven Anomaly Detection System

DZone

OCTOBER 11, 2024

This three-part article series will take you through the process of developing a network anomaly detection system using the Spring Boot framework in a robust manner. The series is organized as follows: Part 1: We’ll concentrate on the foundation and basic structure of our detection system, which has to be created.

Network

Network Systems Monitoring Technology

Choreography Pattern: Optimizing Communication in Distributed Systems

DZone

SEPTEMBER 30, 2023

The first, Service Orchestration , was discussed in my previous article. In this article, we will dig into the second methodology: Choreography. Successfully coordinating messages among these services is a fundamental aspect of their design. There are two popular methodologies available to tackle this challenge.

Systems

Systems Virtualization Architecture Scalability

How Ansible Automates JBoss Web Server Updates and Upgrades

DZone

JANUARY 3, 2024

In the previous article, Automate Red Hat JBoss Web Server deployments with Ansible , I discussed how to fully automate the deployment of Red Hat JBoss Web Server with Red Hat Ansible Automation Platform. In this article, we will cover, in detail, how to implement such automation.

Servers

Servers Java

Memphis.dev Cloud Performance and Load Testing

DZone

JANUARY 24, 2024

This article presents the most recent Memphis.dev Cloud, multi-region benchmark tests conducted in December 2023, explores how to carry out performance testing, detailing hands-on methods you can apply yourself, and provides recent benchmark data for your reference. The benchmark tool we used can be found here.

Cloud

Cloud Benchmarking Testing Performance

Reflections From a DBA

DZone

SEPTEMBER 26, 2023

This is an article from DZone's 2023 Database Systems Trend Report. In this article, we will dive into clouds and discuss their optimal suitability based on different types of organizational or individual needs.

Social Media

Social Media Artificial Intelligence Media Internet

Optimizing Software Quality: Unit Testing and Automation

DZone

AUGUST 4, 2024

In this article, I will shed some light on what differentiates unit testing from other methods and will bring examples of when we can or cannot do without unit testing. We'll also touch upon automation testing , which plays an important role in ensuring code reliability and quality.

Testing

Testing Software Software Code

From Docker Swarm to Kubernetes: Transitioning and Scaling

DZone

DECEMBER 4, 2023

This article delves into the nuances of transitioning from Docker Swarm to Kubernetes, focusing on best practices, strategic considerations, and the scaling advantages Kubernetes offers.

Best Practices

Best Practices Open Source Scalability Design

SRE vs AWS DevOps: A Personal Experience Comparison

DZone

FEBRUARY 8, 2023

In this article, I’ll give a brief overview of AWS DevOps and Google SRE , examine when they work best, delve into potential pitfalls to avoid, and provide tips for maximizing the benefits of each. In this article, I’ll focus on AWS DevOps, which, according to the AWS blog , merges development and operations teams into a single unit.

DevOps

DevOps AWS Google Scalability

Evolution of search engines architecture - Algolia New Search Architecture Part 1

Getting Started With NCache Java Edition (Using Docker)

Trending Sources

How to Implement Client-Side Load Balancing With Spring Cloud

Implementation of the REDIS Cache in the.NET Core API

Overcoming Challenges and Best Practices for Data Migration From On-Premise to Cloud

Implementing RBAC in Quarkus

Microservice Proliferation: Too Many Microservices

O11y Guide, Cloud Native Observability Pitfalls: Controlling Costs

Consistent hashing algorithm

Optimizing String Comparisons in Go

How to Get Started With Istio in Kubernetes in 5 Steps

Efficient Data Management With Offset and Cursor-Based Pagination in Modern Applications

Automate Application Load Balancers With AWS Load Balancer Controller and Ingress

How To Collect and Ship Windows Events Logs With OpenTelemetry

Data Storage Formats for Big Data Analytics: Performance and Cost Implications of Parquet, Avro, and ORC

Essential Guidelines for Building Optimized ETL Data Pipelines in the Cloud With Azure Data Factory

Scaling indexing and search - Algolia New Search Architecture Part 2

Configure Kubernetes Health Checks

O11y Guide: Beginner's Guide To Open Source Instrumenting Java

Low-Level Optimizations in ClickHouse: Utilizing Branch Prediction and SIMD To Speed Up Query Execution

From Observability To Architectural Observability — Shifting Left for Resiliency

Using Raspberry PI in Virtualization: Unlocking New Possibilities

Open Dashboard and Visualization Workshop: Exploring Perses API

Top Three Docker Alternatives To Consider

Time Series Analysis: VAR-Model-As-A-Service Using Flask and MinIO

Kubernetes Observability: Lessons Learned From Running Kubernetes in Production

Optimizing PgBench for CockroachDB Part 3

How to Handle Secrets in Kubernetes

Cloud Native Predictions 2024: Stress, Careers, and Costs

A Five-Step Methodology for Maximizing Efficiency in Software Engineering Meetings

O11y Guide: Building Your First Dashboard

The Path From APIs to Containers

Improving Snowflake Performance by Mastering the Query Profile

Best Practices for Building the Data Pipelines

Fraud Detection With Apache Kafka, KSQL, and Apache Flink

Machine Learning: A Revolutionizing Force in Cybersecurity

Network Guardians: Crafting a Spring Boot-Driven Anomaly Detection System

Choreography Pattern: Optimizing Communication in Distributed Systems

How Ansible Automates JBoss Web Server Updates and Upgrades

Memphis.dev Cloud Performance and Load Testing

Reflections From a DBA

Optimizing Software Quality: Unit Testing and Automation

From Docker Swarm to Kubernetes: Transitioning and Scaling

SRE vs AWS DevOps: A Personal Experience Comparison

Stay Connected