SQL Performance

JULY 8, 2021

I spend a large amount of time translating software requirements into schema and queries. I want to talk about UI design choices that lead to data access patterns that are awkward to implement using SQL Server. The post UI Design Patterns That Don't Scale appeared first on SQLPerformance.com. Sort By Column. Conclusion.

Design 92

Design Software Architecture Database Servers 92

Dynatrace

MAY 23, 2022

Traditional monolithic architectures are built around the concept of large applications that are self-contained, independent, and incorporate myriad capabilities. As developers move to microservice-centric designs, components are broken into independent services to be developed, deployed, and maintained separately. Microservices cons.

Architecture 263

Architecture DevOps Monitoring Programming 263

Scalegrid

JUNE 7, 2024

RabbitMQ is an open-source message broker that simplifies inter-service communication by ensuring messages are effectively queued, delivered, and processed across diverse applications. RabbitMQ allows web applications to create and place messages in a message queue for further processing.

IoT 130

IoT Software Architecture Architecture Scalability 130

O'Reilly

FEBRUARY 18, 2020

Software architecture, infrastructure, and operations are each changing rapidly. The shift to cloud native design is transforming both software architecture and infrastructure and operations. R was designed for use in academic, scientific, and, more recently, commercial use cases.

Software Architecture 145

Software Architecture DevOps Data Engineering Architecture 145

The Netflix TechBlog

MARCH 10, 2020

by Damir Svrtan and Sergii Makagon As the production of Netflix Originals grows each year, so does our need to build apps that enable efficiency throughout the entire creative process. We decided to build our app based on principles behind Hexagonal Architecture and Uncle Bob’s Clean Architecture.

Architecture 346

Architecture Transportation Java Strategy 346

Strategic Tech

MARCH 16, 2021

There are a few qualities that differentiate average from high performing software engineering organisations. I believe that attitude towards the design of code and architecture is one of them. Both valuing design and striving for continuous delivery are necessary. So we need to make it part of everything we do.

Software Engineering 80

Software Engineering Design Engineering Software 80

The Netflix TechBlog

MAY 19, 2023

To do so Netflix’s design required: An event based mechanism that could ingest information about application autoscaling groups. A cleanup process to prune stale relationships from the database. What was problematic about this design? Their attributes are used to scope permissions to varying degrees.

Cache 255

Cache Google Open Source Systems 255

Strategic Tech

JULY 29, 2021

If you would like to learn or practice how to break up a large business into domains and use them as the foundation for your software architecture and team organization, I have created a strategic domain-driven design kata that you may find useful. Who to invite? I recommend organising attendees into groups of 4–5 people.

Design 52

Design Software Architecture Architecture Strategy 52

Strategic Tech

OCTOBER 3, 2020

Use them as a starting point for design and discovery, and then bend them to your needs. If you’re not familiar with the Bounded Context Canvas it is a tool for visualising the key design choices of a Bounded Context or a sub-system in your software architecture. What happens if we explore the free design option?

Software Architecture 97

Software Architecture Design Best Practices Architecture 97

Strategic Tech

JULY 22, 2019

In Domain-Driven Design, a large system is decomposed into bounded contexts , which become natural boundaries in code as microservices and as teams in the organisation. The Bounded Context Design Canvas I designed this canvas based on the typical flow of strategic DDD workshops I run publicly and privately.

Design 76

Design Systems Processing Strategy 76

Scalegrid

JUNE 28, 2024

It is widely utilized across various industries, such as finance, telecommunications, and e-commerce, for managing activities, including transaction processing, data streaming, and instantaneous messaging. RabbitMQ’s versatile use cases range from web application backend services and distributed systems to PDF processing.

IoT 130

IoT Healthcare Programming Open Source 130

ScaleOut Software

JUNE 29, 2018

It is our job as software platform architects to look for these opportunities and hopefully integrate them into our architectures in a skillful manner. The digital twin model for stateful stream-processing is a case in point. One indicator of a useful software architecture is that it provides unexpected benefits.

Software Architecture 40

Software Architecture Architecture Software Software 40

O'Reilly

OCTOBER 19, 2021

While there isn’t an authoritative definition for the term, it shares its ethos with its predecessor, the DevOps movement in software engineering: by adopting well-defined processes, modern tooling, and automated workflows, we can streamline the process of moving from development to robust production deployments.

DevOps 145

DevOps Software Engineering Infrastructure Open Source 145

ScaleOut Software

JUNE 29, 2018

It is our job as software platform architects to look for these opportunities and hopefully integrate them into our architectures in a skillful manner. The digital twin model for stateful stream-processing is a case in point. One indicator of a useful software architecture is that it provides unexpected benefits.

Software Architecture 40

Software Architecture Architecture Software Software 40

Strategic Tech

MAY 24, 2019

Over the past few years I have focused much of my learning and work choices around learning about the design of sociotechnical systems?—?how how to design software architectures and organise teams around them. As part of good design, we should consider the effects of changing all of these variables.

Design 45

Design Software Architecture Strategy Technology 45

O'Reilly

MARCH 2, 2020

When a project is going off track because some requirement wasn’t understood properly, you need to fix that as soon as possible—not after a year-long development process. This has to do with the concept of bounded context from Domain Driven Design.). When processes change, who wins, who loses, and why?

Artificial Intelligence 27

Artificial Intelligence Software Architecture Programming C++ 27

Strategic Tech

NOVEMBER 1, 2021

or “How do software architecture, domains, Conway’s Law, Team Topologies, and value streams all fit together?”. The utility comes from zooming in and visualizing the real complexity using value stream maps which show more granular steps combined with the processing time of each step and the wait time before each step.

Software Architecture 98

Software Architecture Architecture DevOps Software 98

The Netflix TechBlog

DECEMBER 3, 2019

mainly because of mundane reasons related to software engineering. We heard many stories about difficulties related to data access and basic data processing. By design, Metaflow is a deceptively simple Python library: Data scientists can structure their workflow as a Directed Acyclic Graph of steps, as depicted above.

Open Source 135

Open Source AWS Infrastructure Energy 135

O'Reilly

SEPTEMBER 12, 2023

Designing security in from the start almost always leads to a simpler result than bolting security on as an afterthought, and the complexity will stay manageable if new features and security grow together. That code may take the form of dozens of microservices running as asynchronous processes and communicating over a network.

Software 139

Software Software Development Programming 139

cdemi

MAY 8, 2016

This post is part of a Design Patterns series. It may be beneficial to have the application prepopulate the cache as part of the startup process. An item in the data store may be changed at any time by an external process, and this change might not be reflected in the cache until the next time the item is loaded into the cache.

Cache 54

Cache Design C++ Processing 54

All Things Distributed

NOVEMBER 15, 2010

From financial processing and traditional oil & gas exploration HPC applications to integrating complex 3D graphics into online and mobile applications, the applications of GPU processing appear to be limitless. Because of its focus on latency, the generic CPU yielded rather inefficient system for graphics processing.

AWS 125

AWS Programming Latency Architecture 125

All Things Distributed

APRIL 27, 2011

Look inside a current textbook on software architecture, and youll find few patterns that we dont apply at Amazon. For example, our Simple Storage Service, Elastic Block Store, and SimpleDB all derive their basic architecture from unique Amazon technologies. It is deeply integrated into everything we do. Recent Entries.

Technology 127

Technology Technology AWS Storage 127

Sutter's Mill

OCTOBER 22, 2010

Elements of Design. At C++ and Beyond next week (and in December) I’ll also be giving a brand-new half-day talk on Elements of Design. Although those areas are pretty diverse, they also have a lot of commonalities, and the insights and learnings apply directly to mainstream classes-and-libraries production software design.

Design 40

Design Lambda C++ Software Architecture 40

Strategic Tech

AUGUST 26, 2018

A trip to the supermarket can teach you a lot about designing software systems and shaping teams to build them… I was recently in need of some chocolate sauce. The Chocolate Sauce Heuristic for Software Design There are a few lessons about software development we can learn from this story, but I want to focus on design.

Design 40

Design Software Architecture Architecture Software 40

Strategic Tech

JULY 18, 2018

There are thousands of ways we can shape the software systems we build and organise our teams around them. Yet there is no flowchart we can simply follow to find the optimal design. The products themselves are software systems which grow harder and harder to reason about as they scale and age.

Design 40

Design Architecture Software Architecture Systems 40

O'Reilly

AUGUST 9, 2022

Designing the prompts to get DALL-E to do something extraordinary requires a new kind of technique that’s very different from understanding pigments and brushes. You have to know what you want to do; you have to have a design in mind. Is the craft of software architecture different from the craft of programming?

Programming 116

Programming Java C++ Design 116

Smashing Magazine

NOVEMBER 22, 2021

Now, let’s take a deeper look into the actions and processes we put in place in order to achieve these significant results. There are more challenges for us in addition to scale and diversity: Retaining existing design and behavior. In other words, we needed to find a way to automate the process of preventing performance degradations.

Website 141

Website Performance Google Website Performance 141

Strategic Tech

DECEMBER 20, 2020

Team Topologies has significantly advanced the discussion on organisation design for technology companies. My goal is to create common ground so that we can discuss the trade-offs of organisational design patterns. Domains are synonymous with business capabilities from the business architecture world.

Architecture 98

Architecture Design Technology Technology 98

cdemi

DECEMBER 4, 2016

The service retrieves the messages from the queue and processes them. Requests from a number of different tasks, which can be generated at a highly variable rate , can be passed to the service through the same message queue and will be processed at a constant rate that the service can work at. Considerations.

Design 47

Design Azure Scalability Java 47

cdemi

MAY 6, 2016

I have decided to write a series on some common and modern Design Patterns that are useful in today's horizontally scalable (such as cloud-hosted) applications. The Competing Consumer Pattern enables a system to process multiple messages concurrently to optimize throughput, to improve scalability and availability.

Design 40

Design Cache Scalability Architecture 40

Adrian Cockcroft

JANUARY 17, 2022

I did a few talks on this subject early in the year, and linked this to the sustainability advantages of serverless architectures. The need for systems to be resilient is still increasing, and chaos engineering tools and techniques are developing as a key way to validate that resilience is working as designed. primarily virtual?—?and

Serverless 98

Serverless Hardware AWS Architecture 98

cdemi

DECEMBER 7, 2016

Building on the Queue-Based Load Leveling Pattern , the Competing Consumer Pattern enables a system to process multiple messages concurrently to optimize throughput, to improve scalability and availability, and to balance the workload. Systems that use the Competing Consumer Pattern should ensure that message processing is idempotent.

Design 40

Design Scalability Processing Systems 40

Strategic Tech

SEPTEMBER 18, 2021

Evolving the Domain Landscape A primary purpose of domain discovery techniques, like big picture event storming, is to map out the current state of the landscape, capturing concepts like business processes, socio-technical structures, and roles like customers and colleagues. You can apply the same techniques to your own landscape.

Strategy 97

Strategy Technology Technology Design 97

Strategic Tech

FEBRUARY 19, 2020

I’ve been disappointed for a long time with the way in which companies organise software development teams. I remember as a young, naive software developer, I assumed there would be structured processes and patterns similar to those used for designing a software architecture.

Architecture 64

Architecture Strategy Design Software Architecture 64

O'Reilly

MAY 19, 2020

A strict definition of “cloud” must also include software-as-a-service (SaaS) and platform-as-a-service (PaaS) offerings of all kinds—including email (Google G Suite email; Microsoft Exchange Online), office productivity suites (Google Docs and Sheets; Microsoft Office 365), and similar offerings. Take observability , for example.

Cloud 144

Cloud Serverless AWS DevOps 144

Strategic Tech

FEBRUARY 14, 2020

The architecture of the software could be sliced up into a Leasing context and a Car Pool context. Leasing is responsible for managing the leasing process and keeping a historial record of all leases. If the answer is yes, it should probably not be coupled to your specific business process steps.

Architecture 98

Architecture Government Design Availability 98

Strategic Tech

SEPTEMBER 30, 2020

It is a database of domain, business, and architectural information. We should be able to click a few buttons and get 100% accurate visualisations of the domain model, business processes, and architecture. A self-documenting architecture would reduce the learning curve.

Architecture 75

Architecture Design Programming Software 75