Sat.Mar 04, 2023 - Fri.Mar 10, 2023

article thumbnail

11 Observability Tools You Should Know

DZone

When organizations move toward the cloud, their systems also lean toward distributed architectures. One of the most common examples is the adoption of microservices. However, this also creates new challenges when it comes to observability. You need to find the right tools to monitor, track and trace these systems by analyzing outputs through metrics, logs, and traces.

article thumbnail

Answer-driven DevOps automation: Automation use cases that accelerate insights

Dynatrace

As organizations mature on their digital transformation journey, they begin to realize that automation – specifically, DevOps automation – is critical for rapid software delivery and reliable applications. But as multicloud environments grow, they become increasingly complex and generate massive amounts of data. In turn, manual approaches to identifying code issues and troubleshooting are not scalable.

DevOps 245
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Data ingestion pipeline with Operation Management

The Netflix TechBlog

by Varun Sekhri , Meenakshi Jindal , Burak Bacioglu Introduction At Netflix, to promote and recommend the content to users in the best possible way there are many Media Algorithm teams which work hand in hand with content creators and editors. Several of these algorithms aim to improve different manual workflows so that we show the personalized promotional image, trailer or the show to the user.

Media 269
article thumbnail

Why you need to know your site's performance poverty line (and how to find it)

Speed Curve

"I made my pages faster, but my business and user engagement metrics didn't change. WHY???" "How do I know how fast my pages should be?" "How can I demonstrate the business value of performance to people in my organization?" If you've ever asked yourself any of these questions, then you could find the answers in identifying and understanding the performance poverty line for your site.

article thumbnail

How To Use Linux Containers

DZone

Linux containers are a powerful solution for: Software standardization Acceleration of development and testing Effective resource management throughout the whole lifecycle of an application Here, we will provide a step-by-step guide to building Linux containers with applications intended for Cloud deployment. As an example, we will use BellSoft’s open-source Alpaquita Stream containers hosted on the Docker Hub Container Image Library.

article thumbnail

Introducing Percona Builds for Serverless PostgreSQL

Percona

Recently, “serverless” has become a buzzword, and for good reason. The goal is to simplify the provisioning and management of database capacity. One approach is to separate compute and storage to allow for independent scaling. We are thrilled to announce our collaboration with Neon ( Neon – Serverless, Fault-Tolerant, Branchable Postgres ) to provide a Serverless PostgreSQL that you can control and manage yourself.

article thumbnail

Elasticsearch Indexing Strategy in Asset Management Platform (AMP)

The Netflix TechBlog

By Burak Bacioglu , Meenakshi Jindal Asset Management at Netflix At Netflix, all of our digital media assets (images, videos, text, etc.) are stored in secure storage layers. We built an asset management platform (AMP), codenamed Amsterdam , in order to easily organize and manage the metadata, schema, relations and permissions of these assets. It is also responsible for asset discovery, validation, sharing, and for triggering workflows.

Strategy 262

More Trending

article thumbnail

Testing Your Monitoring Configurations

DZone

Monitoring is a small aspect of our operational needs; configuring, monitoring, and checking the configuration of tools such as Fluentd and Fluentbit can be a bit frustrating, particularly if we want to validate more advanced configuration that does more than simply lift log files and dump the content into a solution such as OpenSearch. Fluentd and Fluentbit provide us with some very powerful features that can make a real difference operationally.

article thumbnail

Capped Collection in MongoDB

Percona

In this blog post, we will discuss the capped collection of MongoDB. Capped collection is a fixed-type collection that inserts docs in a circular fashion. This means once allocated files are full, data at the beginning of the first file is overwritten. Consider this: we define a capped collection of size 1GB, it will purge out the oldest document if the allocated size of the collection is full and we have to insert a new document.

article thumbnail

Data Reprocessing Pipeline in Asset Management Platform @Netflix

The Netflix TechBlog

By Meenakshi Jindal Overview At Netflix, we built the asset management platform (AMP) as a centralized service to organize, store and discover the digital media assets created during the movie production. Studio applications use this service to store their media assets, which then goes through an asset cycle of schema validation, versioning, access control, sharing, triggering configured workflows like inspection, proxy generation etc.

Media 241
article thumbnail

How We Unified Configuration Distribution Across Systems at Uber

Uber Engineering

Uber’s configuration platform team talks about how they consolidated the infrastructure for multiple configuration systems into a unified, next-gen distribution platform, reducing CPU usage by an order of magnitude.

Systems 94
article thumbnail

Green Software and Carbon Hack

DZone

In November 2022, the Green Software Foundation organized its first hackathon, “Carbon Hack 2022,” with the aim of supporting software projects whose objective is to reduce carbon emissions. I participated in this hackathon with the Carbon Optimised Process Scheduler project along with my colleagues Kamlesh Kshirsagar and Mayur Andulkar, in which we developed an API to optimize job scheduling in order to reduce carbon emissions, and we won the “Most Insightful” project prize.

Software 244
article thumbnail

Dealing With “Too Many Connections” Error in MySQL 8

Percona

Over the years of being a DBA, I had to deal with all kinds of problems in the database. One of the most common problems I faced is the one related to the well-known error “ERROR 1040 (08004): Too many connections”. A lot has been written about this error. Still, the users keep falling into this trap, maybe because of a poorly configured database, a change in the application components, or just because of a sudden increase of connections in the application.

C++ 100
article thumbnail

Backups for MySQL With mysqldump

Percona Community

Basic Usage mysqldump is a client utility that can be used for doing logical backups. It will generate the necessary SQL statements to reproduce the original database. Backup by Nick Youngson CC BY-SA 3.0 Pix4free The following statements are some common uses of mysqldump: mysqldump -u username -p database_name [table_name] > dump.sql mysqldump -u username -p --databases db1_name db2_name > dump.sql mysqldump -u username -p --all-databases > dump.

article thumbnail

Why you need to know your site's performance plateau (and how to find it)

Speed Curve

"I made my pages faster, but my business and user engagement metrics didn't change. WHY???" "How do I know how fast my pages should be?" "How can I demonstrate the business value of performance to people in my organization?" If you've ever asked yourself any of these questions, then you could find the answers in identifying and understanding the performance plateau for your site.

article thumbnail

Write Optimized Spark Code for Big Data Applications

DZone

Apache Spark is a powerful open-source distributed computing framework that provides a variety of APIs to support big data processing. PySpark is the Python API for Apache Spark , which allows Python developers to write Spark applications using Python instead of Scala or Java. In addition, pySpark applications can be tuned to optimize performance and achieve better execution time, scalability, and resource utilization.

Big Data 173
article thumbnail

How To Calculate a Good MySQL Redo Log Size in MySQL 8

Percona

MySQL uses Redo Logs internally during crash recovery to correct data written by incomplete transactions. But how do you know what the right Redo Log size is? We will walk through how to figure that out in this blog. We already have a couple of posts related to this topic. “ How to calculate a good InnoDB log file size ” and “ How to Choose the MySQL innodb_log_file_size.

Tuning 96
article thumbnail

Monitor your databases with Open Source tools like PMM

Percona Community

In this post, we will cover the value of database monitoring and how we can use Open Source tools like PMM Percona Monitoring and Management to monitor and manage databases effectively. Why should I care about database monitoring? Once you have passed the installation and configuration of your databases and it is well underway, you have to start monitoring it, and not only the database but the elements related to it.

article thumbnail

USPS as an ISP

Nick Desaulniers

While on a hike with colleagues, one asked a thought provoking question: Should the United States Post Service (USPS) operate as an Internet Service Provider (ISP)? This post is an opinion piece playing with that idea; here are my thoughts. It’s far from a hot take, and has been discussed before.

article thumbnail

The Evolution of Development and Coding

DZone

I had the opportunity to catch up with Andi Grabner , DevOps Activist at Dynatrace during day two of Dynatrace Perform. I've know Andi for seven years and he's one of the people that has helped me understand DevOps since I began writing for DZone. We covered several topics that I'll share in a series of articles.

Code 147
article thumbnail

5 Things to Know About Open API Adoption

VoltDB

The post 5 Things to Know About Open API Adoption appeared first on Volt Active Data.

article thumbnail

How Can Developers Contribute Towards Cloud Cost Optimization?

DZone

Cloud cost optimization refers to the process of analyzing resources to identify areas where unused or wasted resources can be optimized to reduce expenses. This involves a variety of tasks, including resource analysis, identification, monitoring, and management of instances. However, the process of optimizing cloud costs doesn’t end with resource monitoring and management.

Cloud 130
article thumbnail

The Power of Zero-Knowledge Proofs: Exploring the New ConsenSys zkEVM

DZone

It’s well-known that Ethereum needs support in order to scale. A variety of L2s ( layer twos ) have launched or are in development to improve Ethereum’s scalability. Among the most popular L2s are zero-knowledge-based rollups (also known as zk-rollups). Zk-rollups offer a solution that has both high scalability and minimal costs. In this article, we’ll define what zk-rollups are and review the latest in the market, the new ConsenSys zkEVM.

article thumbnail

Building a Certificate Authority (CA) Server for Your Servers and Applications Free of Cost

DZone

In any organization, it is a best security practice to have an SSL certificate installed on servers, applications, and databases. To get an SSL certificate, the first step is to have or build a Certificate Authority (CA). SSL Certificates and CA make communication secure between client and server or application. If you do not have a CA ready internally or externally, you can not issue the certificate to any internal or external application.

Servers 130
article thumbnail

Software Testing Tutorial: A Comprehensive Guide With Examples And Best Practices

DZone

Software testing is the process of verifying the working of the software system or application. In other words, it ensures the software application is bug-free and addresses the technical and user requirements. It not only focuses on finding bugs or errors in the software but also considers measures to enhance the software quality in terms of usability, accuracy, and efficiency.