DZone

FEBRUARY 8, 2022

In a previous article , we explained how we built benchmarks to keep track of those three metrics: precision, recall, and the most important here, speed. So it wasn’t a surprise to find that our engine had the same problem: more power, less speed.

Processing 243

Processing Benchmarking Speed Engineering 243

DZone

JANUARY 12, 2021

There are different options to terminate a process in Unix/Linux flavor of operating systems. This article intends to list and provide examples of each option. You can use the kill command to terminate a process by passing the process id. PID is the process ID of the process that you want to terminate.

Processing 140

Processing Operating System Systems Open Source 140

High Scalability

JUNE 15, 2020

Over the last 3 years, the TripleLift data pipeline scaled from processing millions of events per day to processing billions. This processing can be summed up as the continuous aggregation and delivery of reporting data to users in a cost efficient manner.

Processing 206

Processing Data Engineering Engineering Efficiency 206

KeyCDN

SEPTEMBER 3, 2020

KeyCDN has significantly simplified the way images are transformed and delivered with our Image Processing service. Our Image Processing service makes it easy to do that. Our Image Processing service will automatically optimize the image quality and reduce the size of the image if no query string is provided.

Processing 127

Processing Cache Website Servers 127

DZone

SEPTEMBER 9, 2024

Efficient data processing is crucial for businesses and organizations that rely on big data analytics to make informed decisions. One key factor that significantly affects the performance of data processing is the storage format of the data.

Big Data 278

Big Data Storage Analytics Benchmarking 278

DZone

DECEMBER 10, 2019

I will talk about such a scenario in this article. After that, they came to us saying that they need a solution so that they can control the processing through control-m. Earlier we were directly polling on one location and getting data in the form of the files. After some transformation, we were sending those data (in XML) to a queue.

Processing 139

Processing Design Performance 139

DZone

AUGUST 2, 2019

Batch processing of data is an efficient way of processing large volumes of data where data is collected, processed and then batch results are produced. Batch processing can be applied in many use cases. In this article, I am going to demonstrate batch processing using one of the projects of Spring which is Spring Batch.

Processing 113

Processing Efficiency Performance 113

Uber Engineering

SEPTEMBER 23, 2021

This article focuses on how we … The post Real-Time Exactly-Once Ad Event Processing with Apache Flink, Kafka, and Pinot appeared first on Uber Engineering Blog. With this new ability came new challenges that needed to be solved at Uber, such as systems for ad auctions, bidding, attribution, reporting, and more.

Processing 135

Processing Engineering Systems Architecture 135

DZone

AUGUST 14, 2024

When building ETL data pipelines using Azure Data Factory (ADF) to process huge amounts of data from different sources, you may often run into performance and design-related challenges. This article will serve as a guide in building high-performance ETL pipelines that are both efficient and scalable.

Azure 306

Azure Cloud Scalability Efficiency 306

Official Blog - World Web Technology

DECEMBER 4, 2023

How does it contribute to the software development process ? This article will explain why most companies and their software developers use SDLC to manage their development process. SDLC is an essential framework for the total software development process as it aids in managing software development projects effectively.

Processing 64

Processing Software Software Development 64

DZone

OCTOBER 11, 2024

This three-part article series will take you through the process of developing a network anomaly detection system using the Spring Boot framework in a robust manner. The series is organized as follows: Part 1: We’ll concentrate on the foundation and basic structure of our detection system, which has to be created.

Network 289

Network Systems Monitoring Technology 289

DZone

AUGUST 4, 2024

This level of protection is essential as it lays the foundation for the following testing processes: integration tests, acceptance testing, and finally manual testing, including exploratory testing. Unit testing is the first line of defense against bugs.

Testing 288

Testing Software Software Code 288

DZone

MARCH 21, 2024

This article is made especially for beginners to make the ideas and steps of adding NCache to your Java applications clear and easy to understand. It doesn't matter if you've been developing for years or if you're new to caching , this article will help you get a good start with NCache Java Edition.

Java 319

Java Cache Technology Technology 319

DZone

OCTOBER 2, 2024

In this article, we’ll dive deep into the concept of database sharding, a critical technique for scaling databases to handle large volumes of data and high levels of traffic. This section will provide insights into the architecture and strategies to ensure efficient query processing in a sharded environment.

Database 279

Database Systems Scalability Traffic 279

Highly Scalable

AUGUST 20, 2013

The shortcomings and drawbacks of batch-oriented data processing were widely recognized by the Big Data community quite a long time ago. It became clear that real-time query processing and in-stream processing is the immediate need in many practical applications. Fault-tolerance. Interoperability with Hadoop.

Big Data 154

Big Data Processing Lambda Database 154

DZone

OCTOBER 3, 2023

This is an article from DZone's 2023 Data Pipelines Trend Report. To keep up, we require real-time analytics (RTA), which provides the immediacy that every user of data today expects and is based on stream processing. Stream processing is used to query a continuous stream of data and immediately process events in that stream.

Analytics 298

Analytics Database Cloud Processing 298

DZone

NOVEMBER 16, 2023

This article is intended for data scientists, AI researchers, machine learning engineers, and advanced practitioners in the field of artificial intelligence who have a solid grounding in machine learning concepts, natural language processing , and deep learning architectures.

Artificial Intelligence 264

Artificial Intelligence Architecture Network Engineering 264

DZone

AUGUST 29, 2024

Two methods that particularly help automate and simplify the software release process are continuous integration (CI) and continuous deployment (CD). This article explores the need for uniting log monitoring in DevOps, the associated difficulties, and approaches for achieving harmony in CI/CD processes.

DevOps 173

DevOps Monitoring Software Software 173

DZone

NOVEMBER 7, 2023

With businesses constantly in the race to stay ahead, the process of integrating this data becomes crucial. However, it's no longer enough to assimilate data in isolated, batch-oriented processes. Businesses were content with accumulating data over defined intervals and then processing it in scheduled batches.

Systems 287

Systems Analytics Architecture Engineering 287

DZone

MARCH 29, 2023

Data migration is the process of moving data from one location to another, which is an essential aspect of cloud migration. This article discusses the challenges and best practices of data migration when transferring on-premise data to the cloud. Data migration involves transferring data from on-premise storage to the cloud.

Best Practices 315

Best Practices Cloud Data Engineering Storage 315

DZone

JUNE 13, 2024

Relational Databases are the bedrock of any FinTech application, especially for OLTP (Online transaction Processing). This article will explore the FinTech case study, which has built a Lending Platform. This foundational component in any application architecture usually poses challenges around scaling as the business expands rapidly.

FinTech 262

FinTech Tuning AWS Database 262

Dynatrace

AUGUST 27, 2024

For example, look for vendors that use a secure development lifecycle process to develop software and have achieved certain security standards. Integration with existing processes. This can require process re-engineering to fill gaps and ensuring clear communication and collaboration across security, operations, and development teams.

Best Practices 275

Best Practices Government DevOps Analytics 275

DZone

NOVEMBER 29, 2023

As I mentioned in my previous article Part 1 , let's explore how such a transition can be effectively managed. This system is tasked with performing reimbursement calculations, typically running overnight through a batch process scheduled in SQL Server. This is particularly relevant in the domain of reimbursement calculation systems.

Systems 299

Systems C++ Scalability Architecture 299

DZone

SEPTEMBER 26, 2024

This article explores advanced strategies, the process of building data pipelines, and the pillars of a successful modern data strategy, with a focus on both real-time and batch data processing.

Strategy 147

Strategy Scalability Efficiency Technology 147

Smashing Magazine

JULY 8, 2021

Development Process. Development Process. Note: This article is aimed at both beginners and seasoned developers who want to better their Vue.js Keep in mind that most of what is learned in this article is centered on Vue.js Tools And Practices To Speed Up The Vue.js Tools And Practices To Speed Up The Vue.js Uma Victor.

Speed 135

Speed Processing Development Code 135

DZone

NOVEMBER 16, 2023

This is an article from DZone's 2023 Observability and Application Performance Trend Report. It allows teams to better identify areas of improvement, enabling them to make informed decisions about their development processes. Telemetry, being a critical part of observability, refers to the continuous nature of data collection.

Software 290

Software Software Processing Systems 290

DZone

NOVEMBER 25, 2023

In a detailed article, we've discussed how to align a NoSQL database with specific business needs. But if your application primarily revolves around batch processing of large datasets, then focusing on write speed could mislead your selection process.

Database 278

Database Latency Speed Metrics 278

DZone

MARCH 7, 2024

SIMD enables processors to perform the same operation on multiple data points simultaneously, making it ideal for tasks like numerical computations, image processing, and multimedia operations. In this article, we'll explore what the Vector API is, how it works, and provide examples demonstrating its usage.

Java 255

Java Processing Performance Development 255

DZone

FEBRUARY 17, 2023

Event Stream Processing refers to the action taken on generated Events. Event Streams are sometimes referred to as Data Streams within the developer community since they consist of continuous data points.

Processing 275

Processing Systems Development 275

DZone

JANUARY 26, 2023

Real-time data processing with Apache Kafka became the de facto standard to correlate and prevent fraud continuously before it happens. Fraud detection becomes increasingly challenging in a digital world across all industries.

Games 317

Games Technology Technology Processing 317

DZone

JUNE 15, 2023

It is worth noting that this data collection process does not impact the performance of the application. Moreover, the process of collecting these profiles introduces overhead during application runtime and necessitates the storage and visualization of significantly large datasets.

Latency 250

Latency Storage Strategy Metrics 250

DZone

JANUARY 18, 2024

They offer a high-level, declarative approach to data processing, but one of their most intriguing features is lazy evaluation. This article delves into what lazy evaluation means in the context of Java Streams and why it's beneficial, accompanied by practical examples.

Java 214

Java Processing 214

DZone

MARCH 11, 2024

This article delves deep into the essence of Istio, illustrating its pivotal role in a Kubernetes (KIND) based environment, and guides you through a Helm-based installation process, ensuring a comprehensive understanding of Istio's capabilities and its impact on microservices architecture.

Open Source 248

Open Source Traffic Architecture Monitoring 248

DZone

FEBRUARY 17, 2023

In this article, we will be using observIQ’s distribution of the collector. Windows Events logs record many different operating system processes, application activity, and account activity. A recent contribution of a distribution of the OpenTelemetry (OTel) Collector makes it much easier to monitor Windows Events with OpenTel.

Operating System 358

Operating System Google Monitoring Cloud 358

DZone

SEPTEMBER 18, 2023

This is an article from DZone's 2023 Automated Testing Trend Report. The demand for faster, more reliable, and efficient testing processes has grown exponentially with the increasing complexity of modern applications.

Artificial Intelligence 279

Artificial Intelligence Software Software Testing 279

DZone

MAY 10, 2023

This article aims to demystify the subject by providing a basic understanding of how class loading works in the JVM. What Are Classloaders In the Java Virtual Machine (JVM), classes are loaded dynamically and found through a process called class loading.

Java 263

Java Virtualization Processing Development 263

DZone

SEPTEMBER 11, 2024

This article explores why it's crucial to check for modality of performance test results, how to detect multimodal distributions, and how to handle them. For users of JMeter , a new plugin is introduced to help automate this process. In such cases, the traditional metrics like averages might be misleading.

Performance Testing 147

Performance Testing Testing Performance Metrics 147