DZone

SEPTEMBER 30, 2023

While this architectural approach offers scalability, reusability, and adaptability, it also presents a unique challenge: effectively managing communication between these microservices. Successfully coordinating messages among these services is a fundamental aspect of their design.

Systems 286

Systems Virtualization Architecture Scalability 286

The Netflix TechBlog

MARCH 7, 2024

The Machine Learning Platform (MLP) team at Netflix provides an entire ecosystem of tools around Metaflow , an open source machine learning infrastructure framework we started, to empower data scientists and machine learning practitioners to build and manage a variety of ML systems. ETL workflows), as well as downstream (e.g.

Systems 238

Systems Media Cache Open Source 238

DZone

JANUARY 20, 2023

Having a distributed and scalable graph database system is highly sought after in many enterprise scenarios. Do Not Be Misled Designing and implementing a scalable graph database system has never been a trivial task.

Scalability 210

Scalability Big Data Hardware Internet 210

Smashing Magazine

JANUARY 3, 2022

Composition-Based Design System In Figma. Composition-Based Design System In Figma. Working as a designer on a design system for a large product has taught me how precious the time you spend on a single task/component is. Is it for consistency, scalability, creativity or maintainability?

Design 141

Design Systems Code Scalability 141

DZone

OCTOBER 9, 2024

The Scheduler service enables this and is designed to address the performance and scalability improvements on Actor reminders and the Workflow API. In this post, I am going to deep dive into the details of how the Scheduler service was designed and its implementation to give you some background. Prior to v1.14 Prior to v1.14

Scalability 318

Scalability Design Database Processing 318

InfoQ

JANUARY 25, 2023

In this article, Rogerio Robetti discusses the challenges in auto-scaling stateful storage systems and proposes an opinionated design solution to automatically scale up (vertical) and scale out (horizontal) from a single node up to several nodes in a cluster with minimum configuration and interference of the operator.

Design 144

Design Systems Storage Data Engineering 144

DZone

JANUARY 31, 2024

At the heart of this decision lies a crucial question: should these teams lay the groundwork with a microservice architecture, known for its distributed and decentralized nature, or opt for a monolithic design, where the entire application is unified and interdependent?

Architecture 289

Architecture Scalability Design Engineering 289

DZone

JANUARY 24, 2024

These storage alternatives have been designed to meet a range of requirements, including performance, scalability, durability, and price. This comprehensive essay will look at the many storage types that are often used in cloud computing systems.

Storage 278

Storage Cloud Scalability Design 278

High Scalability

APRIL 9, 2020

Google added another book into their excellent SRE series: Building Secure and Reliable Systems. Copy/pasting a few paragraphs: "In this book we talk generally about systems, which is a conceptual way of thinking about the groups of components that cooperate to perform some function. It's free to download, so don't be shy.

Google 208

Google Systems Best Practices Strategy 208

High Scalability

FEBRUARY 19, 2021

In this article, we discuss the concepts of dependability and fault tolerance in detail and explain how the Ably platform is designed with fault tolerant approaches to uphold its dependability guarantees. Fault tolerant design approaches address these shortfalls to provide continuity both to business and to the user experience.

Engineering 165

Engineering Systems Availability Scalability 165

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. This guide delves into how these systems work, the challenges they solve, and their essential role in businesses and technology.

Storage 130

Storage Systems Big Data Azure 130

Dynatrace

MARCH 29, 2024

As organizations continue to expand within cloud-native environments using Google Cloud, ensuring scalability becomes a top priority. Visit Dynatrace booth #1141 during the event to explore how its real-time insights and optimization capabilities ensure seamless scalability and performance.

Google 273

Google Innovation Cloud Analytics 273

DZone

MARCH 20, 2023

Microservices architecture has gained popularity recently as a technique for creating sophisticated and scalable software systems. Microservices are scalable, independently deployable services that talk to one another across a network. HTTP and messaging are two popular methods for microservices communication.

Scalability 264

Scalability Architecture Network Design 264

High Scalability

SEPTEMBER 28, 2018

Never inflict a distributed system on yourself unless you have too." Or, maybe, they can succeed as in getting comfy job at IBM, but their designs don't translate into useful products. seconds with the system. Hey, it's HighScalability time: @danielbryantuk : "A LAMP stack is a good thing. mipsytipsy #CloudNativeLondon.

Internet 35

Internet Internet Scalability Blockchain 35

DZone

FEBRUARY 29, 2024

Traditional methods often fall short in managing this kind of volume and scale, leading to bottlenecks impacting the performance of the system. Simple Notification Service (SNS), a native pub/sub messaging service from AWS can be leveraged to design a distributed messaging platform.

Efficiency 264

Efficiency AWS Scalability Architecture 264

DZone

DECEMBER 27, 2023

As organizations increasingly embrace the microservices approach, the need for a resilient testing framework becomes important for the reliability, scalability , and security of these distributed systems. What Is MRTF? In embracing a holistic and collaborative approach, let’s start by explaining the cornerstones of MRTF.

Testing 228

Testing Scalability Architecture Design 228

Dynatrace

OCTOBER 7, 2021

This means you no longer have to provision, scale, and maintain servers to run your applications, databases, and storage systems. Instead of worrying about infrastructure management functions, such as capacity provisioning and hardware maintenance, teams can focus on application design, deployment, and delivery. Scalability.

Serverless 293

Serverless AWS Lambda Storage 293

DZone

OCTOBER 10, 2023

Enter IoT device management — the suite of tools and practices designed to monitor, maintain, and update these interconnected devices. Why IoT Device Management Matters Scalability : As industries and consumers increasingly adopt IoT, the number of devices can surge into the billions.

IoT 310

IoT Internet Internet Network 310

Scalegrid

MAY 13, 2020

It’s architecture was specially designed to manage large-scale data warehouses and business intelligence workloads by giving you the ability to spread your data out across a multitude of servers. Greenplum uses an MPP database design that can help you develop a scalable, high performance deployment. At a glance – TLDR.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

DZone

MARCH 22, 2023

Then, we will discuss the system's architecture, the problems it solves, and the model employed to manage containerized deployments and scaling. Kubernetes (sometimes called K8s) is an open-source container-orchestration system that simplifies the deployment, scaling, and management of containerized applications. What Is Kubernetes?

Open Source 253

Open Source Scalability Architecture Cloud 253

DZone

JULY 10, 2024

In today’s digital landscape, APIs have become the backbone of modern software architecture, enabling seamless integration and communication among disparate systems. Effective API management is critical to ensuring that these interfaces are secure, scalable, and maintainable.

Best Practices 227

Best Practices Software Architecture Strategy Scalability 227

DZone

DECEMBER 28, 2020

The system could work efficiently with a specific number of concurrent users; however, it may get dysfunctional with extra loads during peak traffic. Performances testing helps establish the scalability, stability, and speed of the software application. Confirming scalability, dependability, stability, and speed of the app is crucial.

Performance Testing 230

Performance Testing Testing Tools Testing Performance 230

Dynatrace

OCTOBER 1, 2021

As dynamic systems architectures increase in complexity and scale, IT teams face mounting pressure to track and respond to conditions and issues across their multi-cloud environments. The architects and developers who create the software must design it to be observed. Dynatrace news. But what is observability? What is observability?

Metrics 363

Metrics Open Source Monitoring Cloud 363

High Scalability

DECEMBER 21, 2018

It's HighScalability time: Have a very scalable Xmas everyone! odrotbohm : I’ve seen microservice based systems more deranged after 2 years than any 1,5 decades old monolith could ever have been. See you in the New Year. Do you like this sort of Stuff? Please support me on Patreon. I'd really appreciate it. Me : Nothing special.

Internet 137

Internet Internet Scalability Serverless 137

Dynatrace

MARCH 14, 2023

Amazon’s new general-purpose Linux for AWS is designed to provide a secure, stable, and high-performance execution environment to develop and run cloud applications. AL2023 is supported by Dynatrace on day one and has been thoroughly tested by our installations team. How does Dynatrace help?

AWS 292

AWS Lambda Serverless Virtualization 292

The Netflix TechBlog

MARCH 25, 2019

You are designing a learning system to forecast Service Level Agreement (SLA) violations and would want to factor in all upstream dependencies and corresponding historical states. Let’s review a few of these principles: Ensure data integrity ?—?Accurately Enable seamless integration?—?

Infrastructure 226

Infrastructure Big Data Transportation Architecture 226

The Netflix TechBlog

MAY 19, 2023

By Chris Wolfe , Joey Schorr , and Victor Roldán Betancort Introduction The authorization team at Netflix recently sponsored work to add Attribute Based Access Control (ABAC) support to AuthZed’s open source Google Zanzibar inspired authorization system, SpiceDB. What was problematic about this design?

Cache 257

Cache Google Open Source Systems 257

The Netflix TechBlog

DECEMBER 17, 2024

To achieve this, we are committed to building robust systems that deliver comprehensive observability, enabling us to take full accountability for every title on ourservice. Each title represents countless hours of effort and creativity, and our systems need to honor that uniqueness. Yet, these pages couldnt be more different.

Traffic 174

Traffic Scalability Strategy Monitoring 174

The Netflix TechBlog

FEBRUARY 9, 2021

In particular, it’s our job to design and build the systems and protocols that enable customers from all over the world to sign up for Netflix with the plan features and incentives that best suit their needs. Let’s take a deeper look at the architecture, protocols, and systems involved.

Engineering 146

Engineering Scalability Architecture Innovation 146

Dynatrace

MARCH 6, 2024

IBM i, formerly known as iSeries, is an operating system developed by IBM for its line of IBM i Power Systems servers. It is based on the IBM AS/400 system and is known for its reliability, scalability, and security features. The extension runs remotely from your Dynatrace ActiveGates and connects to your IBM i system.

Monitoring 246

Monitoring Infrastructure Metrics Operating System 246

The Netflix TechBlog

MARCH 14, 2023

We implemented a batch processing system for users to submit their requests and wait for the system to generate the output. This limited pilot system greatly reduced the time spent by our users to manually analyze the content. Dawn Chenette , Design Lead This approach had several benefits for product engineering.

Media 301

Media Innovation Energy Architecture 301

DZone

JANUARY 2, 2024

The Publish/Subscribe (Pub/Sub) pattern is a widely-used software architecture paradigm, particularly relevant in the design of distributed, messaging-driven systems. The communication framework is decoupled, scalable, and dynamic, making it useful for addressing complex software requirements in modern application development.

Architecture 193

Architecture Software Architecture Scalability Design 193

Dynatrace

AUGUST 8, 2024

Ransomware encrypts essential data, locking users out of systems and halting operations until a ransom is paid. Remote code execution (RCE) vulnerabilities, such as the Log4Shell incident in 2021, allow attackers to run malicious code on a remote system without requiring authentication or user interaction.

Software 260

Software Software Infrastructure Network 260

All Things Distributed

MARCH 23, 2021

Back then, Amazon was ~2% of its size today, and was growing faster than traditional IT systems could support. We had to rethink everything previously known about building scalable systems. As we laid it out in the original S3 press release, we needed a storage service that met the following design criteria:

Ecommerce 210

Ecommerce Retail Storage Scalability 210

Smashing Magazine

JANUARY 5, 2022

Ten Tips For The Aspiring Designer Beginners (Part 1). Ten Tips For The Aspiring Designer Beginners (Part 1). In this article, I want to share ten tips that helped me grow and become a better designer, and I hope these tips will also help you while you’re trying to find more solid ground under your feet. Luis Ouriach.

Design 128

Design Website Social Media Best Practices 128

The Netflix TechBlog

JULY 22, 2024

What is Maestro Maestro is a general-purpose, horizontally scalable workflow orchestrator designed to manage large-scale workflows such as data pipelines and machine learning model training pipelines. The transition was seamless, and Maestro has met our design goals by handling our ever-growing workloads.

Strategy 260

Strategy Scalability Code Engineering 260

Dynatrace

NOVEMBER 29, 2024

Protect data in multi-tenant architectures To bring you the most value by unifying observability and security in one analytics and automation platform powered by AI, Dynatrace SaaS leverages a multitenancy architecture, enabling efficient and scalable data ingestion, querying, and processing on shared infrastructure.

Storage 202

Storage AWS Azure Architecture 202