Sat.Dec 16, 2023 - Fri.Dec 22, 2023

article thumbnail

Congestion Control in Cloud Scale Distributed Systems

DZone

Distributed systems are composed of multiple systems that are wired together to provide a specific functionality. Systems that operate at a cloud scale can get expected or unexpected surges of traffic from one or multiple callers and are expected to perform in a predictable manner. This article analyzes the effects of traffic surges on a distributed system.

Systems 290
article thumbnail

Automate CI/CD pipelines with Dynatrace: Part 3, Testing stage

Dynatrace

In the last blog post of this series, we delved into how Dynatrace, functioning as a deploy-stage orchestrator, solves the challenges confronted by Site Reliability Engineers (SREs) during the early of automating CI/CD processes. Having laid the foundation during the deployment stage, we’ll now explore the benefits of Dynatrace visibility and orchestration during the testing phase.

Testing 262
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Redis® Monitoring Strategies for 2024

Scalegrid

In today’s data-driven world, the ability to effectively monitor and manage data is of paramount importance. Redis®, a powerful in-memory data store, is no exception. With its widespread use in modern application architectures, understanding the ins and outs of Redis® monitoring is essential for any tech professional. Buckle up as we delve into the world of Redis® monitoring, exploring the most important Redis® metrics, discussing essential tools, and even peering into the future of Redis® perfo

Strategy 130
article thumbnail

Migrating from MySQL to PostgreSQL Using pgloader

Percona

These days, there’s been a lot of talk in the industry about setting up one’s database system on PostgreSQL. Most times, these are Greenfield projects where the bulk of the effort is on its design and architecture. But sometimes, more often than you’d think, decisions are being made to move from an existing platform to Postgres for purely business and economic reasons.

Database 124
article thumbnail

Best Practices for Building the Data Pipelines

DZone

In my previous article ‘ Data Validation to Improve Data Quality ’, I shared the importance of data quality and a checklist of validation rules to achieve it. Those validation rules alone may not guarantee the best data quality. In this article, we focus on the best practices to employ while building the data pipelines to ensure data quality. 1. Idempotency A data pipeline should be built in such a way that, when it is run multiple times, the data should not be duplicated.

article thumbnail

Improving customer experience with business process monitoring

Dynatrace

A business process is a collection of related, usually structured tasks or steps, performed in sequence, that achieve a defined business goal. Tasks may be manual or automatic, and many business processes will include a combination of both. Business processes are important because they improve the efficiency, consistency, and quality of the business outcome.

article thumbnail

InfoQ Dev Summit in Boston: Two Days of Talks for Senior Developers

InfoQ

InfoQ is delighted to announce a new two-day conference, InfoQ Dev Summit Boston 2024, taking place June 24-25, 2024. This event is designed to help senior developers navigate their immediate development challenges, focusing exclusively on the technical aspects that matter right now.

More Trending

article thumbnail

From Elasticsearch to Apache Doris: Upgrading an Observability Platform

DZone

Observability platforms are akin to the immune system. Just like immune cells are everywhere in human bodies, an observability platform patrols every corner of your devices, components, and architectures, identifying any potential threats and proactively mitigating them. However, I might have gone too far with that metaphor, because till these days, we have never invented a system as sophisticated as the human body, but we can always make advancements.

Speed 271
article thumbnail

Sustainable IT: Optimize your hybrid-cloud carbon footprint

Dynatrace

Growing awareness and increasing regulatory scrutiny have propelled carbon emissions data into the public consciousness. How will your organization respond to this global challenge? How can you reduce the carbon footprint of your hybrid cloud? A structured approach Reducing carbon emissions involves a combination of technology, practice, and planning.

Cloud 220
article thumbnail

Percona Monthly Bug Report: November 2023

Percona Community

At Percona, we operate on the premise that full transparency makes a product better. We strive to build the best open-source database products, but also to help you manage any issues that arise in any of the databases that we support. And, in true open-source form, report back on any issues or bugs you might encounter along the way. We constantly update our bug reports and monitor other boards to ensure we have the latest information, but we wanted to make it a little easier for you to keep trac

article thumbnail

Percona Monitoring and Management High Availability – A Proof of Concept

Percona

Percona Monitoring and Management (PMM) is a state-of-the-art piece of software that exists in part thanks to great open source projects like VictoriaMetrics, PostgreSQL, and ClickHouse. The integration of those projects, plus the years of Percona expertise in the database space, makes PMM one of the best database monitoring solutions on the market.

article thumbnail

Open Dashboard and Visualization Workshop: Advanced Perses Dashboard

DZone

Back in December of 2022, I started a series taking you on a tour of the Perses project. These articles covered this fairly new open dashboard and visualization project targeting cloud-native environments. I used a getting started workshop to guide you through this series and to provide a hands-on experience for those new to visualizing observability data.

Cloud 253
article thumbnail

What’s on the horizon for People and Culture organizations in 2024?

Dynatrace

Looking toward 2024, the corporate landscape is preparing for significant shifts fueled by the quickening pace of technology and shifting priorities of the workforce. Artificial intelligence is now set to power individualized employee growth and development. IAI can enhance the processes that nurture employee experiences and a healthy and motivated workforce.

article thumbnail

How to automatically performance test your pull requests and fight regressions

Speed Curve

As highlighted in our December product update , we've been making a lot of improvements in the area of CI/CD. In addition to the new Deployments dashboards and Notes updates, we've launched a new GitHub integration. Our purpose in building this integration is to lower the barrier for getting web performance feedback for your code changes, directly in the environment you are working in.

article thumbnail

Using Huge Pages with PostgreSQL Running Inside Kubernetes

Percona

Huge pages make PostgreSQL faster; can we implement it in Kubernetes? Modern servers operate with terabytes of RAM, and by default, processors work with virtual memory address translation for each 4KB page. OS maintains a huge list of allocated and free pages to make slow but reliable address translation from virtual to physical. Please check out the Why Linux HugePages are Super Important for Database Servers: A Case with PostgreSQL blog post for more information.

C++ 101
article thumbnail

Open Dashboard and Visualization Workshop: Finalizing Perses Dashboard

DZone

Back in December of 2022, I started a series taking you on a tour of the Perses project. These articles covered this fairly new open dashboard and visualization project targeting cloud-native environments. I used a getting started workshop to guide you through this series and to provide a hands-on experience for those new to visualizing observability data.

Cloud 182
article thumbnail

Tech Transforms podcast: SBOMs and the mission for federal government cybersecurity – down to the software supply chain

Dynatrace

On Episode 73 of the Tech Transforms podcast , MITRE’s Tracy Bannon and I sat down with Allan Friedman , a senior advisor and strategist at the Cybersecurity and Infrastructure Security Agency (CISA). We chatted about federal cybersecurity and Friedman’s mission to make the software bill of materials (SBOM) a boring, expected part of software delivery to the federal government.

article thumbnail

2023 recap: This year was all about making performance easy (well, easier)

Speed Curve

Every year feels like a big year here at SpeedCurve, and 2023 was no exception. Among other things, we turned ten ! Ten years is a lot of time to reflect, and over this past year our team has been thinking a lot about not just the "what" and "how" of web performance, but also the "why". Why should we – and you – care about delivering a fast, delightful experience to all your users?

article thumbnail

What’s New in Percona Toolkit 3.5.6

Percona

Percona Toolkit 3.5.6 was released on December 21, 2023. This blog post covers the main changes in this release. New tool: pt-galera-log-explainer We continue adding more instruments for the Support teams. pt - galera - log - explainer was written by my Percona Support colleague Yoann La Cancellera. pt - galera - log - explainer filters, aggregates, and summarizes multiple Galera library logs together.

article thumbnail

Energy Efficient Distributed Systems

DZone

Energy efficiency has become a paramount concern in the design and operation of distributed systems due to the increasing demand for sustainable and environmentally friendly computing solutions. As distributed systems play a critical role in various domains such as cloud computing , Internet of Things ( IoT ), and data centers, optimizing energy consumption has significant implications for reducing operational costs and mitigating the environmental impact.

Energy 182
article thumbnail

Observability engineering: Getting Prometheus metrics right for Kubernetes with Dynatrace and Kepler

Dynatrace

For busy site reliability engineers, ensuring system reliability, scalability, and overall health is an imperative that’s getting harder to achieve in ever-expanding, cloud-native, container-based environments. This challenge has given rise to the discipline of observability engineering, which concentrates on the details of telemetry data to fine-tune observability use cases.

Metrics 188
article thumbnail

Percona Bug Report: November 2023

Percona Community

At Percona, we operate on the premise that full transparency makes a product better. We strive to build the best open-source database products, but also to help you manage any issues that arise in any of the databases that we support. And, in true open-source form, report back on any issues or bugs you might encounter along the way. We constantly update our bug reports and monitor other boards to ensure we have the latest information, but we wanted to make it a little easier for you to keep trac

article thumbnail

Setting Up Percona Monitoring and Management Alerts for External Channels (Telegram, Slack, WebHook)

Percona

Setting up Percona Monitoring and Management (PMM) alerts for multiple channels can significantly enhance your monitoring strategy. In this blog post, we will talk about the steps to configure alerts for some well-known communication platforms like Telegram , Slack , and WebHook. Please note that I am not covering the basic alerting and configuration setup.

article thumbnail

Implementing Virtualization on a Mini PC

DZone

A new era of computing where portability and power are combined has arrived with the introduction of Mini PCs. These small but powerful devices are now more than just media centers or low-power workstations, which was their original function. Virtualization is one of the more complex tasks that Mini PCs can handle today. The technology of virtualization enables the creation of numerous virtual instances or machines on a single physical host.

article thumbnail

The evolution of single-core bandwidth in multicore systems — update

John McCalpin

In April 2023 I posted some results and comments The evolution of single-core bandwidth in multicore processors illustrating the (slow) growth in single-core memory bandwidth over time in Intel and AMD multicore processors. Here is an update to the summary chart, adding the AMD EPYC 4 (“Genoa”) processors. Genoa delivers about 40% higher single-core read bandwidth than the EPYC 3 “Milan” processors, giving AMD about a 2x advantage over the Intel “Sapphire Rapids

Systems 52
article thumbnail

Unlocking Efficiency: The Utility of Mini PCs in Virtualization

DZone

Virtualization has become a crucial element for companies and individuals looking to optimize their computing resources in today’s rapidly changing technological landscape. This ground-breaking method enables users to run multiple virtual machines on a single physical server, increasing flexibility, lowering hardware costs, and improving efficiency.

article thumbnail

AI and Automation

DZone

This is an article from DZone's 2023 Enterprise Security Trend Report. For more: Read the Report In recent years, developments in artificial intelligence (AI) and automation technology have drastically reshaped application security. On one hand, the progress in AI and automation has strengthened security mechanisms, reduced reaction times, and reinforced system resilience.

article thumbnail

5 Priority Areas That Will Define the Developer’s AI to-do List in 2024

DZone

AI adoption continues at an unstoppable pace across countless industry sectors, and for good reason. AI applications can transform the enterprise with stronger decision support, predictive capabilities, and automation that drastically improve production quality and scale business processes. There are more and more AI products on the market to choose from that streamline this adoption path.

article thumbnail

How To Make Legacy Code More Testable

DZone

Much has already been said about the importance of automated tests: they provide a great safety net when modifying system components, alerting to issues much earlier in the development lifecycle. As a result, bugs are prevented from ever reaching production environments. When we're working with legacy code that has very low automated test coverage (or no test coverage at all), building automated tests can be difficult and frustrating.

Code 147
article thumbnail

Python OpenTelemetry Project Setup on Windows Platform Using WSL

DZone

OpenTelemetry is a collection of APIs, SDKs, and tools. Use it to instrument, generate, collect, and export telemetry data (metrics, logs, and traces) to help you analyze your software’s performance and behavior. OpenTelemetry code is supported by many popular programming languages like C++ , C#/.NET , Erlang/Elixir , Go , Java , JavaScript , PHP , Python , Ruby , Rust , Swift , and Other languages.

C++ 147
article thumbnail

The Pros and Cons of Wildcard Indexes on MongoDB

Percona

​​MongoDB is a schemaless database that is extremely flexible. When you create a collection, you don’t have to specify a structure in advance, providing field names and data types. Just start inserting JSON documents, and MongoDB will store them, no matter which fields and data types you provide. As a consequence, a collection can store completely different documents.

article thumbnail

How to Monitor Online InnoDB Buffer Pool Resizing

Percona

The InnoDB buffer pool acts as a powerhouse for MySQL, caching frequently accessed data and index pages in memory to accelerate query performance. In this blog post, we will go through the process of InnoDB buffer pool resizing online, covering why it is important to monitor its progress and how to monitor it. Importance of monitoring the InnoDB buffer pool resize Since MySQL 5.7.5, we have been able to resize the InnoDB buffer pool online, which allows administrators to adjust the buffer pool s

article thumbnail

Percona Monitoring and Management 2.41.0, Percona Distribution for PostgreSQL 14.10, and More: Release Roundup December 18, 2023

Percona

Percona is a leading provider of unbiased, performance-first, open source database solutions that allow organizations to easily, securely, and affordably maintain business agility, minimize risks, and stay competitive, free from vendor lock-in. Percona software is designed for peak performance, uncompromised security, limitless scalability, and disaster-proofed availability.

article thumbnail

Using the Transparent Data Encryption Extension PG_TDE With PostgreSQL

Percona

PG_TDE (PostgreSQL Transparent Data Encryption) is an experimental transparent data encryption access method for PostgreSQL 16, available on GitHub as an extension for vanilla PostgreSQL. Since our previous blog post, Adding Transparent Data Encryption to PostgreSQL with pg_tde: Please Test , it received new features such as TOAST data encryption and HashiCorp Vault support for key storage.