DZone

JUNE 20, 2024

In the vast realm of software development, there's a pursuit for software systems that are not only robust and efficient but can also "heal" themselves. Self-healing software systems represent a significant stride towards automation and resilience. 4 Key Strategies for Building Self-Healing Software Systems 1.

Strategy 264

Strategy Systems Software Software 264

DZone

FEBRUARY 26, 2024

Embedded systems have become an integral part of our daily lives, from smartphones and home appliances to medical devices and industrial machinery. These systems are designed to perform specific tasks efficiently, often in real-time, without the complexities of a general-purpose computer.

Operating System 195

Operating System Systems Automotive Design 195

DZone

NOVEMBER 20, 2023

For more: Read the Report Employing cloud services can incur a great deal of risk if not planned and designed correctly. This is an article from DZone's 2023 Observability and Application Performance Trend Report. In fact, this is really no different than the challenges that are inherit within a single on-premises data center implementation.

Cloud 298

Cloud Architecture Systems Network 298

The Netflix TechBlog

MARCH 7, 2024

The Machine Learning Platform (MLP) team at Netflix provides an entire ecosystem of tools around Metaflow , an open source machine learning infrastructure framework we started, to empower data scientists and machine learning practitioners to build and manage a variety of ML systems. ETL workflows), as well as downstream (e.g.

Systems 238

Systems Media Cache Open Source 238

DZone

DECEMBER 14, 2021

Metadata synchronization (sync) is a core feature in Alluxio that keeps files and directories consistent with their source of truth in under-storage systems, thus making it simple for users to reason the data retrieved from Alluxio. This article describes the design and the implementation in Alluxio to keep metadata synchronized.

Design 244

Design Storage Tuning Systems 244

DZone

SEPTEMBER 11, 2024

Regarding contemporary software architecture, distributed systems have been widely recognized for quite some time as the foundation for applications with high availability, scalability, and reliability goals. Spring Boot's default codes and annotation setup lessen the time it takes to design an application.

Systems 249

Systems Java Software Architecture Programming 249

Dynatrace

OCTOBER 23, 2023

At financial services company, Soldo, efficiency and security by design are paramount goals. The platform helps companies manage corporate spending using automation, card (physical and virtual), and integrations with expense management systems and enterprise resource planning (ERP) systems, such as Netsuite, Concur, Zucchetti, and so on. “We

Design 230

Design Innovation DevOps Open Source 230

DZone

SEPTEMBER 30, 2023

Successfully coordinating messages among these services is a fundamental aspect of their design. While this architectural approach offers scalability, reusability, and adaptability, it also presents a unique challenge: effectively managing communication between these microservices.

Systems 286

Systems Virtualization Architecture Scalability 286

Dynatrace

OCTOBER 10, 2023

EdgeConnect provides a secure bridge for SaaS-heavy companies like Dynatrace, which hosts numerous systems and data behind VPNs. In this hybrid world, IT and business processes often span across a blend of on-premises and SaaS systems, making standardization and automation necessary for efficiency.

Systems 233

Systems Efficiency Internet Internet 233

DZone

DECEMBER 18, 2023

Energy efficiency has become a paramount concern in the design and operation of distributed systems due to the increasing demand for sustainable and environmentally friendly computing solutions.

Energy 182

Energy Efficiency Systems IoT 182

DZone

JUNE 22, 2023

It involves a combination of techniques and best practices aimed at reducing latency, improving user experience, and increasing the overall efficiency of the system. API performance optimization is the process of improving the speed, scalability, and reliability of APIs.

Scalability 245

Scalability Design Best Practices Performance 245

Dynatrace

APRIL 19, 2023

Creating an ecosystem that facilitates data security and data privacy by design can be difficult, but it’s critical to securing information. When organizations focus on data privacy by design, they build security considerations into cloud systems upfront rather than as a bolt-on consideration.

Design 204

Design Storage Programming Analytics 204

The Netflix TechBlog

SEPTEMBER 29, 2022

Timestone: Netflix’s High-Throughput, Low-Latency Priority Queueing System with Built-in Support for Non-Parallelizable Workloads by Kostas Christidis Introduction Timestone is a high-throughput, low-latency priority queueing system we built in-house to support the needs of Cosmos , our media encoding platform. Over the past 2.5

Latency 224

Latency Systems Media Serverless 224

DZone

FEBRUARY 27, 2024

This article will explore the concept of multi-layered caching from both architectural and development perspectives, focusing on real-world applications like Instagram, and provide insights into designing and implementing an efficient multi-layered cache system.

Cache 173

Cache Efficiency Architecture Design 173

DZone

SEPTEMBER 17, 2024

As a developer, I designed, developed, and maintained various features for the desktop and mobile web versions of a social network across backend, frontend, and mobile application APIs. I want to touch upon the following aspects:

Network 162

Network Systems Development Mobile 162

DZone

OCTOBER 9, 2024

The Scheduler service enables this and is designed to address the performance and scalability improvements on Actor reminders and the Workflow API. In this post, I am going to deep dive into the details of how the Scheduler service was designed and its implementation to give you some background. Prior to v1.14 Prior to v1.14

Scalability 318

Scalability Design Database Processing 318

DZone

JANUARY 31, 2024

At the heart of this decision lies a crucial question: should these teams lay the groundwork with a microservice architecture, known for its distributed and decentralized nature, or opt for a monolithic design, where the entire application is unified and interdependent?

Architecture 289

Architecture Scalability Design Engineering 289

DZone

JUNE 24, 2024

Traditional enterprise storage or HPC-focused parallel file systems are costly and challenging to manage for AI-scale deployments. High-performance storage systems can significantly reduce AI model training time. Delays in data access can also impact AI model accuracy, highlighting the critical role of storage performance.

Systems 130

Systems Software Software Storage 130

DZone

OCTOBER 21, 2021

Circuit breaker design pattern is used to detect failures and encapsulates the logic of preventing a failure from constantly recurring during maintenance, temporary external system failure, or unexpected system difficulties. How Does Circuit Breaker Design Pattern Work?

Design 246

Design Systems Performance 246

The Netflix TechBlog

MARCH 14, 2023

We implemented a batch processing system for users to submit their requests and wait for the system to generate the output. This limited pilot system greatly reduced the time spent by our users to manually analyze the content. Dawn Chenette , Design Lead This approach had several benefits for product engineering.

Media 301

Media Innovation Energy Architecture 301

Scalegrid

MAY 13, 2020

It’s architecture was specially designed to manage large-scale data warehouses and business intelligence workloads by giving you the ability to spread your data out across a multitude of servers. Greenplum uses an MPP database design that can help you develop a scalable, high performance deployment. Greenplum Architectural Design.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

DZone

JANUARY 24, 2024

These storage alternatives have been designed to meet a range of requirements, including performance, scalability, durability, and price. This comprehensive essay will look at the many storage types that are often used in cloud computing systems. Cloud computing platforms have transformed the way businesses handle and access data.

Storage 278

Storage Cloud Scalability Design 278

Dynatrace

AUGUST 13, 2024

Modern observability and security require comprehensive access to your hosts, processes, services, and applications to monitor system performance, conduct live debugging, and ensure application security protection. Changes are introduced on a controlled schedule, typically once a week, to reduce the risk of affecting customer systems.

Monitoring 258

Monitoring Open Source Testing Software 258

The Netflix TechBlog

NOVEMBER 12, 2024

By: Rajiv Shringi , Oleksii Tkachuk , Kartik Sathyanarayanan Introduction In our previous blog post, we introduced Netflix’s TimeSeries Abstraction , a distributed service designed to store and query large volumes of temporal event data with low millisecond latencies. Today, we’re excited to present the Distributed Counter Abstraction.

Latency 253

Latency Cache Infrastructure Strategy 253

DZone

FEBRUARY 28, 2024

Mainframe architecture refers to the design and structure of a mainframe computer system, which is a powerful and reliable computing platform used for large-scale data processing, transaction processing, and enterprise applications.

Architecture 263

Architecture Design Processing Systems 263

The Netflix TechBlog

MAY 19, 2023

By Chris Wolfe , Joey Schorr , and Victor Roldán Betancort Introduction The authorization team at Netflix recently sponsored work to add Attribute Based Access Control (ABAC) support to AuthZed’s open source Google Zanzibar inspired authorization system, SpiceDB. What was problematic about this design?

Cache 257

Cache Google Open Source Systems 257

DZone

JANUARY 10, 2021

If the backend service is not available for some time, then what kind of fail-proof system should you implement? This is where the Circuit Breaker design pattern comes in. Consider that you’re running a web service that requires input and delivers it to another backend service.

Design 263

Design Availability Systems Performance 263

DZone

JANUARY 23, 2022

Building resilient systems requires comprehensive error management. Errors could occur in any part of the system / or its ecosystem and there are different ways of handling these e.g. Datacenter - data center failure where the whole DC could become unavailable due to power failure, network connectivity failure, environmental catastrophe, etc.

Hardware 243

Hardware DevOps Network Storage 243

DZone

NOVEMBER 16, 2023

In this article, we will explore one of the most common and useful resilience patterns in distributed systems: the circuit breaker. The circuit breaker is a design pattern that prevents cascading failures and improves the overall availability and performance of a system. What Is a Circuit Breaker?

Latency 264

Latency Network Database Monitoring 264

DZone

NOVEMBER 9, 2021

If you start catching bugs early, it will save you tons of time fixing them later.nn> Design reviewnnIt’s a very powerful tool when used in a good way. I really like what one of the smartest people with whom I worked said: “A good design is a design where you can see the code”. You may think that you know how the system works.

Software 245

Software Software Code Design 245

DZone

FEBRUARY 29, 2024

Traditional methods often fall short in managing this kind of volume and scale, leading to bottlenecks impacting the performance of the system. Simple Notification Service (SNS), a native pub/sub messaging service from AWS can be leveraged to design a distributed messaging platform.

Efficiency 264

Efficiency AWS Scalability Architecture 264

Dynatrace

JANUARY 26, 2021

This includes custom, built-in-house apps designed for a single, specific purpose, API-driven connections that bridge the gap between legacy systems and new services, and innovative apps that leverage open-source code to streamline processes. Each has its own role to play in successfully implementing this tactical trifecta at scale.

DevOps 281

DevOps Best Practices Open Source Tuning 281

DZone

MARCH 20, 2023

Microservices architecture has gained popularity recently as a technique for creating sophisticated and scalable software systems. Making it easier for these services to communicate with one another is one of the major problems with a microservices design. HTTP and messaging are two popular methods for microservices communication.

Scalability 264

Scalability Architecture Network Design 264

DZone

OCTOBER 11, 2021

Today I want to tell you a few words about how you can describe your system through mathematical equations — at least to some degree. This article is more focused on overall system design and architecture than any other written by me till today — so consider yourself warned.

Software 246

Software Software Architecture Design 246

Dynatrace

SEPTEMBER 20, 2023

The principle of “security by design” plays a major role in these efforts. The DOE has designated a national lab to implement security by design and improve understanding. They’re really focusing on hardware and software systems together,” Dunkin said. There are too many interconnections between our systems.

Energy 229

Energy Strategy Government Hardware 229

DZone

APRIL 14, 2023

This workshop is for you, designed to expand your knowledge and understanding of open-source observability tooling that is available to you today. Prometheus is an open-source systems monitoring and alerting tool kit that enables you to hit the ground running with discovering, collecting, and querying your observability today.

Open Source 278

Open Source Metrics Monitoring Design 278

DZone

JULY 21, 2021

Systems Engineering is the discipline of integrating parts into a functioning whole. In the early 2000s, members of the International Council on Systems Engineering (INCOSE) and the Object Management Group (OMG) joined together to create a graphical modeling language that was tailored to the needs of systems engineers.

Engineering 246

Engineering Systems Design Software 246