DZone

JUNE 19, 2024

Managing large datasets efficiently is essential in software development. Retrieval strategies play a crucial role in improving performance and scalability, especially when response times are critical. Pagination is a core technique used to manage data effectively. It is essential for optimizing performance and resource management. In this article, we will explore two pagination strategies, offset and cursor-based pagination, that are suited to different scenarios and requirements.

Efficiency 327

Efficiency Strategy Scalability Technology 327

Dynatrace

JUNE 26, 2024

Understanding FedRAMP Moderate and transition to Rev.5 FedRAMP (Federal Risk and Authorization Management Program) is a government program that provides a standardized approach to security assessment, authorization, and continuous monitoring for cloud products and services for U.S. state and federal agencies. The FedRAMP Moderate baseline is designed to protect sensitive data that, if compromised, could seriously adversely affect operations, assets, or individuals.

Government 254

Government Programming Cloud Innovation 254

The Netflix TechBlog

JUNE 20, 2024

A summary of sessions at the first Data Engineering Open Forum at Netflix on April 18th, 2024 The Data Engineering Open Forum at Netflix on April 18th, 2024. At Netflix, we aspire to entertain the world, and our data engineering teams play a crucial role in this mission by enabling data-driven decision-making at scale. Netflix is not the only place where data engineers are solving challenging problems with creative solutions.

Data Engineering 209

Data Engineering Engineering Entertainment Software Engineering 209

All Things Distributed

JUNE 18, 2024

After a few code reviews from Rustaceans at Amazon and a bit of polishing, I'm ready to share the Distill CLI. An open-source tool written in Rust for summarizing meetings and other media that uses AWS services, such as S3, Transcribe, and Bedrock.

Media 160

Media Efficiency Open Source AWS 160

O'Reilly

JUNE 18, 2024

Last month, TheNew York Times claimed that tech giants OpenAI and Google have waded into a copyright gray area by transcribing the vast volume of YouTube videos and using that text as additional training data for their AI models despite terms of service that prohibit such efforts and copyright law that the Times argues places them in dispute. The Times also quoted Meta officials as saying that their models will not be able to keep up unless they follow OpenAI and Google’s lead.

Social Media 141

Social Media Media Open Source Traffic 141

Percona

JUNE 10, 2024

Some 15 years ago, when Oracle acquired Sun, and hence MySQL, there was a lot of talk on the internet over when Oracle was going to “Kill MySQL” Multiple theories were circled around, ranging from killing MySQL altogether, so there is less competition to proprietary Oracle, or just killing it as an open source project, […]

Open Source 141

Open Source Internet Internet Database 141

DZone

JUNE 3, 2024

While I was coding for a performance back-end competition , I tried a couple of tricks, and I was wondering if there was a faster validator for Java applications, so I started a sample application. I used a very simple scenario: just validate the user's email.

Java 278

Java Code Performance 278

Scalegrid

JUNE 28, 2024

RabbitMQ is an open-source message broker facilitating the connection between different applications within a distributed setup. It is widely utilized across various industries, such as finance, telecommunications, and e-commerce, for managing activities, including transaction processing, data streaming, and instantaneous messaging. Key Takeaways RabbitMQ is an open-source message broker facilitating seamless data exchange across diverse systems.

IoT 130

IoT Healthcare Programming Open Source 130

Abstracta

JUNE 19, 2024

Learn how the latest version of the JMeter Correlation Recorder plugin can make correlating dynamic values easier and minimize errors in performance testing. The post JMeter Correlation Recorder 2.5: An Approach to the New Plugin Version appeared first on Blog about Software Development, Testing, and AI | Abstracta.

Performance Testing 105

Performance Testing Testing Software Software 105

O'Reilly

JUNE 11, 2024

At O’Reilly, we’re not just building training materials about AI. We’re also using it to build new kinds of learning experiences. One of the ways we are putting AI to work is our update to Answers. Answers is a generative AI-powered feature that aims to answer questions in the flow of learning. It’s in every book, on-demand course, and video, and will eventually be available across our entire learning platform.

Design 106

Design Open Source Database Programming 106

Percona

JUNE 13, 2024

At Percona, we monitor our users’ needs and try to accommodate them. One aspect we monitor is the MySQL version distribution/utilization. Observing that, we identified a very interesting trend: the lack of migration from 5.7 to 8.x, or better yet, the need of many to remain on 5.7.

Monitoring 123

Monitoring Google Benchmarking AWS 123

DZone

JUNE 3, 2024

In an era where data is the new oil, effectively utilizing data is crucial for the growth of every organization. This is especially the case when it comes to taking advantage of vast amounts of data stored in cloud platforms like Amazon S3 - Simple Storage Service, which has become a central repository of data types ranging from the content of web applications to big data analytics.

Big Data 278

Big Data AWS Storage Analytics 278

Dynatrace

JUNE 17, 2024

In an article published by The Register’s Tom Claburn, Dynatrace chief technology strategist Alois Reitbauer shares his insights on the transformative role Kubernetes played in initiating the cloud-native movement. He explains how this open source project has set the industry standard for container orchestration since its inception. The article, titled “ K8s celebrates KuberTENes: A decade of working together ,” applauds the collective efforts of more than 88,000 members of a committed communi

Open Source 245

Open Source Government Google Innovation 245

Scalegrid

JUNE 21, 2024

The end of support and updates for a particular MongoDB version is called its ‘end of life’. This event, often called ‘ MongoDB End of Life ‘, signifies the termination of security enhancements and compliance assistance, affecting your system’s integrity. In the article, we will explore the implications of MongoDB’s end-of-life scenario and what it entails and guide you in preparing for this phase.

Database 130

Database Efficiency Strategy Tuning 130

InfoQ

JUNE 7, 2024

Scott Meyer discusses LIquid, the graph database built to host LinkedIn, serving a ~15Tb graph at ~2M QPS.

Database 100

Database Data Engineering Scalability Engineering 100

Speed Curve

JUNE 24, 2024

Our customers often tell us how much they appreciate the user-friendliness of the articles we create for them, so we recently decided to make them available to everyone (not just SpeedCurve users). Introducing the Web Performance Guide ! The Web Performance Guide is – as its name suggests – a collection of articles we've been writing over the years to answer the most common questions we field about performance topics like site speed, why it matters, how it's measured, website monitor

Performance 98

Performance Speed Best Practices Metrics 98

Percona

JUNE 12, 2024

Percona Toolkit 3.6.0 has been released on June 12, 2024. The most important updates in this version are: The possibility to resume pt-online-schema-change if it is interrupted. eu-stack support in pt-pmp that significantly improves this tool’s performance and decreases the load it causes on production servers. New tool pt-eustack-resolver Packages for Ubuntu 24.

Servers 119

Servers Performance Software Software 119

DZone

JUNE 20, 2024

In the vast realm of software development, there's a pursuit for software systems that are not only robust and efficient but can also "heal" themselves. Self-healing software systems represent a significant stride towards automation and resilience. They are designed to detect, diagnose, and resolve issues without human intervention, allowing for higher uptime and reliability. 4 Key Strategies for Building Self-Healing Software Systems 1.

Strategy 264

Strategy Systems Software Software 264

Dynatrace

JUNE 10, 2024

As organizations scale to modern multicloud environments, they’re met with increased complexity that makes managing security far more difficult. Vulnerabilities can enter the software development lifecycle (SDLC) at any stage and can have significant impact if left undetected. As a result, organizations are implementing security analytics to manage risk and improve DevSecOps efficiency.

Analytics 243

Analytics Network Open Source Hardware 243

Scalegrid

JUNE 14, 2024

In today’s data-driven world, organizations rely heavily on data analysis and visualization to make informed decisions and gain a competitive edge. Microsoft Power BI and MySQL are two powerful tools that can facilitate this process. In this article, we will explore the process of how to connect MySQL to Power BI, a leading business intelligence tool.

Database 130

Database Azure Efficiency Servers 130

O'Reilly

JUNE 18, 2024

We’re planning a live virtual event later this year, and we want to hear from you. Are you using a powerful AI technology that seems like everyone ought to be using? Here’s your opportunity to show the world ! AI is too often seen as a “first world” enterprise of, by, and for the wealthy. We’re going to take a look at a Digital Green ’s Farmer.Chat , a generative AI bot that was designed to help small-scale farmers in developing countries access critical agricultural information.

Social Media 95

Social Media Open Source Government Azure 95

Sutter's Mill

JUNE 7, 2024

Also in April, I was interviewed by Jordi Mon Companys for Software Engineering Daily, and that interview was just published on the SE Daily podcast. Here is a copy of the page’s additional details, including a transcript link at bottom. The U.S. government recently released a report calling on the technical community to proactively reduce the attack surface area of software infrastructure.

Software Engineering 96

Software Engineering Engineering Software Software 96

Percona

JUNE 17, 2024

I got quite a response to my article on whether Oracle is Killing MySQL, including a couple of great write-ups on The Register (1, 2) on the topic. There are a few questions in this discussion that I think are worth addressing.

AWS 110

AWS Cloud Open Source Database 110

DZone

JUNE 3, 2024

When I think about technical debt , I still remember the first application I created that made me realize the consequences of an unsuitable architecture. It happened back in the late 1990s when I was first getting started as a consultant. The client had requested the use of the Lotus Notes platform to build a procurement system for their customers. Using the Lotus Notes client and a custom application, end-users could make requests that would be tracked by the application and fulfilled by the pr

Architecture 266

Architecture Systems Development 266

Dynatrace

JUNE 4, 2024

The latest release of the Site Reliability Guardian incorporates assistance from Dynatrace Davis® AI to automatically derive appropriate threshold targets and adjust them over time to protect your quality improvements. This process, known as auto-adaptive thresholding, eliminates the need to define a static threshold upfront. Instead, it derives the suitable thresholds from previous validation results.

Metrics 244

Metrics Engineering Code Tuning 244

Scalegrid

JUNE 7, 2024

RabbitMQ is an open-source message broker that simplifies inter-service communication by ensuring messages are effectively queued, delivered, and processed across diverse applications. It employs the Advanced Message Queuing Protocol (AMQP) to provide reliable, scalable message passing, crucial for modern applications dealing with large-scale, complex data flows.

IoT 130

IoT Software Architecture Architecture Scalability 130

Uber Engineering

JUNE 6, 2024

Dive into how we tackled flakiness among thousands of tests in our CI pipelines with a modularized and configurable approach across our diverse codebase, strengthening reliability of testing infrastructure, improving efficiency in identifying and resolving issues.

Testing 91

Testing Infrastructure Efficiency Engineering 91

InfoQ

JUNE 26, 2024

Microsoft has introduced a significant enhancement to its Azure Functions platform with the Flex Consumption plan, designed to handle high HTTP scale efficiently. This new plan supports customizable per-instance concurrency, allowing users to achieve high throughput while managing costs effectively. In practical tests, Azure Functions Flex demonstrated the ability to scale from zero to 32,000 RPS.

Azure 80

Azure Design Efficiency Testing 80

Percona

JUNE 26, 2024

Is your MySQL database running at its best? While MySQL is known for its reliability and ease of use, ensuring top-notch performance is crucial. One way to do that is through performance monitoring, an essential practice for identifying bottlenecks, maintaining optimal speed, and guaranteeing a seamless user experience.

Best Practices 109

Best Practices Monitoring Performance Speed 109

DZone

JUNE 13, 2024

In today’s Information Technology (IT) digital transformation world, many applications are getting hosted in cloud environments every day. Monitoring and maintaining these applications daily is very challenging and we need proper metrics in place to measure and take action. This is where the importance of implementing SLAs, SLOs, and SLIs comes into the picture and it helps in effective monitoring and maintaining the system performance.

Metrics 264

Metrics Cloud Monitoring Technology 264

Dynatrace

JUNE 14, 2024

Since March 2024, the Dynatrace ® platform has been available on AWS in Tokyo, allowing customers to leverage the latest Dynatrace capabilities from Japan. Customers benefit from the extensive set of capabilities of the new Dynatrace, including the Dynatrace Grail™ data lakehouse, Dynatrace ® AppEngine , and the new Dynatrace user experience, including powerful dashboarding capabilities and interactive Dynatrace Notebooks.

AWS 238

AWS Government Azure Healthcare 238

O'Reilly

JUNE 14, 2024

The latest release of O’Reilly Answers is the first example of generative royalties in the AI era, created in partnership with Miso. This new service is a trustworthy source of answers for the O’Reilly learning community and a new step forward in the company’s commitment to the experts and authors who drive knowledge across its learning platform. Generative AI may be a groundbreaking new technology, but it’s also unleashed a torrent of complications that undermine its trustworthiness, many of wh

Open Source 79

Open Source Media Tuning Engineering 79

Percona Community

JUNE 13, 2024

Hi, the Percona Everest 1.0.0-rc1 release was published on GitHub. Percona Everest is the first open source cloud-native platform for provisioning and managing PostgreSQL, MongoDB and MySQL database clusters. I want to tell you how to install it so you can try it out. RC builds aren’t meant for the general public; we don’t support upgrading from RC to stable versions.

Open Source 79

Open Source Database Cloud Testing 79

Sutter's Mill

JUNE 4, 2024

Many thanks to ACCU for inviting me back again this April. It was my first time back to ACCU (and only my second trip to Europe) since the pandemic began, and it was a delight to see many ACCUers in person again for the first time in a few years. I gave this talk, which is now up on YouTube here: It’s an evolved version of my March essay “C++ safety, in context.” I don’t like just repeating material, so the essay and the talk each covers things that the other doesn’

C++ 72

C++ Code Performance 72

Percona

JUNE 24, 2024

We have been promoting and using Patroni as the best high availability framework for PostgreSQL, and Etcd was the preferred/recommended DCS for the Patroni cluster. Both Patroni and Etcd have been part of PostgreSQL distribution from Percona for years now.

Availability 108

Availability 108

DZone

JUNE 13, 2024

Relational Databases are the bedrock of any FinTech application, especially for OLTP (Online transaction Processing). This foundational component in any application architecture usually poses challenges around scaling as the business expands rapidly. So, it is imperative that all database activities are monitored closely in the production environment and issues like long-running queries are tracked and resolved.

FinTech 262

FinTech Tuning AWS Database 262

Dynatrace

JUNE 11, 2024

Dynatrace Grail™ data lakehouse provides contextual analytics across unified observability, security, and business data. It allows you to query and combine data anytime using the Dynatrace Query Language (DQL). This enables exploratory data analysis and the ability to collaborate visually on the results with your colleagues. Anomaly detection in Notebooks You likely encounter “why” questions in your daily work.

Analytics 237

Analytics Monitoring Mobile Availability 237