DZone

JUNE 25, 2019

It’s really scary knowing that such corruptions are happening in the memory of our computers and servers – that is before they even reach the network and storage portions of the stack. That data must then be safely transported over a network to the storage system where it is written to disk.

Storage 131

Storage Systems Transportation Network 131

n0derunner

SEPTEMBER 15, 2023

Background For the past few months engineers from Nutanix have been participating in the MLPerftm Storage benchmark which is designed to measure the storage performance required for ML training workloads. appeared first on n0derunner.

Benchmarking 59

Benchmarking Storage Servers Engineering 59

DZone

SEPTEMBER 25, 2023

It is the second of a series of articles that is built on top of that project, representing experiments with various statistical and machine learning models, data pipelines implemented using existing DAG tools, and storage services, both cloud-based and alternative on-premises solutions.

Storage 264

Storage AWS Architecture Cloud 264

Percona

OCTOBER 10, 2023

This is not a general rule, but as databases are responsible for a core layer of any IT system – data storage and processing — they require reliability. Why choose Percona Server for MongoDB? Why release Percona Server for MongoDB 7 now? which was released as Percona Server for MongoDB RC 7.0.2-1.

Availability 106

Availability Servers Database Open Source 106

The Netflix TechBlog

OCTOBER 8, 2024

Flexible Storage : The service is designed to integrate with various storage backends, including Apache Cassandra and Elasticsearch , allowing Netflix to customize storage solutions based on specific use case requirements. Note : With Cassandra 4.x

Latency 236

Latency Storage Traffic Tuning 236

SQL Shack

JULY 14, 2020

This article explores the configuration of Windows failover clusters, storage controllers and quorum configurations for SQL Server Always On Availability Groups. Prerequisites In this series of articles, we will configure the SQL Server always on availability groups from end to end for your learning purpose.

Storage 75

Storage Availability Servers 75

The Netflix TechBlog

NOVEMBER 12, 2024

After selecting a mode, users can interact with APIs without needing to worry about the underlying storage mechanisms and counting methods. Let’s examine some of the drawbacks of this approach: Lack of Idempotency : There is no idempotency key baked into the storage data-model preventing users from safely retrying requests.

Latency 224

Latency Cache Infrastructure Strategy 224

Dynatrace

NOVEMBER 11, 2022

Therefore, they need an environment that offers scalable computing, storage, and networking. Hyperconverged infrastructure (HCI) is an IT architecture that combines servers, storage, and networking functions into a unified, software-centric platform to streamline resource management. What is hyperconverged infrastructure?

Infrastructure 214

Infrastructure Storage Virtualization Network 214

DZone

JUNE 24, 2024

Objectives Modern AI innovations require proper infrastructure, especially concerning data throughput and storage capabilities. While GPUs drive faster results, legacy storage solutions often lag behind, causing inefficient resource utilization and extended times in completing the project.

Systems 130

Systems Software Software Storage 130

DZone

JUNE 6, 2023

When building an IoT-based service, we need to implement a messaging mechanism that transmits data collected by the IoT devices to a hub or a server. When dealing with IoT, one of the first things that come to mind is the limited processing, networking, and storage capabilities these devices operate with.

IoT 305

IoT Tuning Storage Network 305

DZone

AUGUST 4, 2022

The host offered browser caching advantages, better stability, and storage on fast edge servers across strategic geolocations. The idea has been that a CDN has fast edge servers that cache content and deliver it based on the user’s geolocation. Not only did it have performance benefits, but it was also convenient for developers.

Cache 305

Cache Tuning Storage Website 305

The Morning Paper

JANUARY 28, 2020

Narrowing the gap between serverless and its state with storage functions , Zhang et al., Shredder is " a low-latency multi-tenant cloud store that allows small units of computation to be performed directly within storage nodes. " In from of them is a networking layer, and the in-memory storage layer holds the actual data.

Serverless 99

Serverless Storage Latency Cloud 99

DZone

AUGUST 16, 2023

Caching is the process of storing frequently accessed data or resources in a temporary storage location, such as memory or disk, to improve retrieval speed and reduce the need for repetitive processing. Bandwidth optimization: Caching reduces the amount of data transferred over the network, minimizing bandwidth usage and improving efficiency.

Cache 246

Cache Scalability Performance Latency 246

Percona

JUNE 29, 2023

Before Percona Server for MongoDB 4.4 PSMDB), the best practice to create an index was doing it in a rolling manner. Many folks used to create directly on Primary, resulting in the first index being created successfully on Primary and then replicated to Secondary nodes. Starting from PSMDB 4.4, internal", "port" : 27017, "version" : "4.4.22-21",

Servers 84

Servers C++ Storage Best Practices 84

Scalegrid

MAY 13, 2020

It can scale towards a multi-petabyte level data workload without a single issue, and it allows access to a cluster of powerful servers that will work together within a single SQL interface where you can view all of the data. High performance, query optimization, open source and polymorphic data storage are the major Greenplum advantages.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

SQL Shack

OCTOBER 6, 2021

This article gives an insight into the configuration of Min and Max memory for SQL Server Database instances. Introduction The server performance depends on various factors such as CPU, Memory, and Storage configurations. SQL Server works on top of the operating system and works closely with these resources.

Servers 88

Servers Database Operating System Storage 88

DZone

NOVEMBER 20, 2023

EC2 instances on AWS are virtual servers that can be used to run applications and services on the AWS cloud. They are characterized by resources such as CPU, RAM, storage capacity, or even bandwidth. Before you even begin exploring the different AWS EC2 instances , it is necessary to know your needs and your use cases.

AWS 189

AWS Virtualization Storage Cloud 189

Percona

MARCH 13, 2023

to MySQL 8, we could choose to do an in-place upgrade or set up another MySQL 8 server(s) from the existing running MySQL 5.7 server with Percona XtraBackup. In my lab, we have two test nodes: PRIMARY: mysql57 (192.168.56.111) with Percona Server 5.7 server instances are ready for an upgrade. On primary server mysql5.7,

Servers 110

Servers C++ Storage Systems 110

Percona

OCTOBER 8, 2024

There are various ways to backup and restore Percona Server for MongoDB clusters when you run them on Kubernetes. Percona Operator for MongoDB utilizes Percona Backup for MongoDB (PBM) to take physical and logical backups, continuously upload oplogs to object storage, and maintain the backup lifecycle.

Cloud 94

Cloud Storage Servers Software 94

DZone

MAY 7, 2023

By the end of the tutorial, you’ll have a running Spring Boot app that serves as an HTTP API server with ScyllaDB as the underlying data storage. Additionally, an HTTP API tool, Postman, is used to interact with our application and to test the API functionality. And you’ll learn how ScyllaDB can be used to store time series data.

Storage 275

Storage Servers Testing 275

Dynatrace

JANUARY 17, 2024

AI requires more compute and storage. Training AI data is resource-intensive and costly, again, because of increased computational and storage requirements. As a result, AI observability supports cloud FinOps efforts by identifying how AI adoption spikes costs because of increased usage of storage and compute resources.

Strategy 234

Strategy Artificial Intelligence Storage Cloud 234

Scalegrid

FEBRUARY 1, 2024

The biggest drawbacks are that a full backup can be time-consuming, and they require a significant amount of storage space. This backup type can save on storage space and reduce backup time by only capturing the changes made since the last backup. Therefore, it’s not the ideal choice if there are time or storage limitations.

Best Practices 130

Best Practices Storage Strategy Database 130

DZone

MARCH 2, 2023

Not only has near-infinitely scalable cloud storage reduced the burden of storing large video files, but CDNs (content delivery networks) deployed by video streaming and social media giants in this timeframe have all but eliminated those slow server-to-client buffering times, which initially plagued the user experience.

Social Media 279

Social Media Java Traffic Internet 279

Dynatrace

MAY 21, 2024

Masking at storage: Data is persistently masked upon ingestion into Dynatrace. Leverage three masking layers Masking at capture and masking at storage operations exclude targeted sensitive data points. When using Dynatrace OneAgent ® , captured data doesn’t leave the monitored environment.

Government 221

Government Storage Tuning Monitoring 221

Dynatrace

OCTOBER 7, 2021

Serverless architecture shifts application hosting functions away from local servers onto those managed by providers. This means you no longer have to provision, scale, and maintain servers to run your applications, databases, and storage systems. As data volumes rapidly increase, streamlined data storage is a top priority.

Serverless 294

Serverless AWS Lambda Storage 294

SQL Shack

AUGUST 17, 2020

In this article, we will discuss how to resolve I/O problems that is a very important point for the SQL Server troubleshooting. The storage subsystem is one of the significant performance factors for the databases. Detecting and identifying I/O problems in SQL Server can be a tough task for the database administrators (DBAs).

Servers 82

Servers Storage Database Performance 82

n0derunner

DECEMBER 22, 2020

With help from the Nutanix X-Ray team I have created an IO “benchmark” which simulates a “General Server Virtualization” workload. The post A Generalized workload generator for storage IO appeared first on n0derunner.

Storage 52

Storage Benchmarking Virtualization Servers 52

DZone

JANUARY 23, 2022

Hardware - servers/storage hardware/software faults such as disk failure, disk full, other hardware failures, servers running out of allocated resources, server software behaving abnormally, intra DC network connectivity issues, etc. Monitor the servers on various parameters and build redundancy.

Hardware 243

Hardware DevOps Network Storage 243

DZone

MAY 16, 2023

Virtualization is a technology that can create servers, storage devices, and networks all in virtual space. One area that virtualization technology is making a huge impact is the security sector. How Is Virtualization Technology Used? Devices connect to a virtual network to share data and resources.

Virtualization 195

Virtualization Hardware Storage Network 195

SQL Performance

JULY 19, 2022

Each log record has a fixed overhead so, sometimes, the Storage Engine breaks this rule by combining multiple changes into a single log record to reduce the total number of log records written to the log. There are between 70 and 100 log record types, depending on the version of SQL Server (there’s no documented list).

Servers 94

Servers Database Storage Engineering 94

Scalegrid

MARCH 28, 2024

Introduction Caching serves a dual purpose in web development – speeding up client requests and reducing server load. This article will explore how they handle data storage and scalability, perform in different scenarios, and, most importantly, how these factors influence your choice. Data transfer technology.

Cache 130

Cache Storage Architecture Scalability 130

Dynatrace

SEPTEMBER 5, 2024

Native support for Syslog messages Syslog messages are generated by default in Linux and Unix operating systems, security devices, network devices, and applications such as web servers and databases. The dashboard tracks a histogram chart of total storage utilized with logs daily. It also tracks the top five log producers by entity.

Innovation 273

Innovation AWS Analytics Storage 273

Dynatrace

OCTOBER 23, 2023

Secondly, determining the correct allocation of resources (CPU, memory, storage) to each virtual machine to ensure optimal performance without over-provisioning can be difficult. Firstly, managing virtual networks can be complex as networking in a virtual environment differs significantly from traditional networking.

Efficiency 227

Efficiency Virtualization Hardware Performance 227

SQL Performance

DECEMBER 17, 2019

One initial, easy step to moving your SQL Server on-premises workloads to the cloud is using Azure VMs to run your SQL Server workloads in an infrastructure as a service (IaaS) scenario. You will still have to maintain your operating system, SQL Server and databases just like you would in an on-premises scenario.

Azure 72

Azure Virtualization Servers Storage 72

DZone

JULY 3, 2023

Data engineering projects often require the setup and management of complex infrastructures that support data processing, storage, and analysis. Traditionally, this process involved manual configuration, leading to potential inconsistencies, human errors, and time-consuming deployments.

Data Engineering 150

Data Engineering Infrastructure Code Engineering 150

Scalegrid

MARCH 8, 2024

This article delivers a practical roadmap for using backups and binary logs to achieve accurate MySQL recovery, detailed steps for setting up your server, and tips for managing recovery and backups effectively without overwhelming you with complexity. Insert the ‘log-bin’ directive into your server’s configuration file (my.cnf or my.ini).

Database 162

Database Strategy Servers Best Practices 162

Scalegrid

AUGUST 30, 2024

Authentication Mechanisms in RabbitMQ RabbitMQ provides several authentication mechanisms to ensure the security of user-server connections, such as using a combination of username and password or employing X.509 When an authentication attempt fails in RabbitMQ, it terminates connections, and error messages are recorded in server logs.

Transportation 130

Transportation Virtualization Strategy Storage 130