DZone

JANUARY 20, 2023

It has been a norm to perceive that distributed databases use the method of adding cheap PC(s) to achieve scalability (storage and computing) and attempt to store data once and for all on demand. However, doing the same cannot achieve equivalent scalability without massively sacrificing query performance on graph systems.

Scalability 210

Scalability Big Data Hardware Internet 210

The Netflix TechBlog

NOVEMBER 15, 2022

But it’s not easy: to pull this off, VFX studios need to build and operate serious technical infrastructure (compute, storage, networking, and software licensing), otherwise known as a “ render farm.” Every VFX studio has a slightly different architecture and workflow, and a one-size-fits-all solution often isn’t enough to bridge the gap.

Cloud 291

Cloud Entertainment AWS Infrastructure 291

Scalegrid

FEBRUARY 24, 2025

This decoupling is crucial in modern architectures where scalability and fault tolerance are paramount. The architecture of RabbitMQ is meticulously designed for complex message routing, enabling dynamic and flexible interactions between producers and consumers.

Best Practices 147

Best Practices Traffic Strategy Scalability 147

Dynatrace

DECEMBER 15, 2022

Besides the traditional system hardware, storage, routers, and software, ITOps also includes virtual components of the network and cloud infrastructure. Although modern cloud systems simplify tasks, such as deploying apps and provisioning new hardware and servers, hybrid cloud and multicloud environments are often complex.

Artificial Intelligence 246

Artificial Intelligence DevOps Hardware Virtualization 246

The Morning Paper

MARCH 8, 2020

Building an elastic query engine on disaggregated storage , Vuppalapati, NSDI’20. This paper presents Snowflake design and implementation along with a discussion on how recent changes in cloud infrastructure (emerging hardware, fine-grained billing, etc.) But the ephemeral storage service for intermediate data is not based on S3.

Storage 112

Storage Engineering Cache Serverless 112

Adrian Cockcroft

JANUARY 27, 2025

We had some fun getting hardware figured out, and I used a 3D printer to make some cases, but the whole project was interrupted by the delivery of the iPhone by Apple in late 2007. We currently have four of them around the house and I still have my day 1 iPad in storage somewhere. I use mine most days to watch videos.

C++ 88

C++ Mobile Hardware Java 88

Dynatrace

JANUARY 16, 2023

On-premises data centers invest in higher capacity servers since they provide more flexibility in the long run, while the procurement price of hardware is only one of many cost factors. Redis is an in-memory key-value store and cache that simplifies processing, storage, and interaction with data in Kubernetes environments.

Open Source 358

Open Source Java Operating System Programming 358

VoltDB

DECEMBER 11, 2024

Use hardware-based encryption and ensure regular over-the-air updates to maintain device security. Data Overload and Storage Limitations As IoT and especially industrial IoT -based devices proliferate, the volume of data generated at the edge has skyrocketed. Key issues include: Limited storage capacity on edge devices.

IoT 52

IoT Energy Logistics Latency 52

Dynatrace

NOVEMBER 15, 2021

Log monitoring, log analysis, and log analytics are more important than ever as organizations adopt more cloud-native technologies, containers, and microservices-based architectures. Logs can include data about user inputs, system processes, and hardware states. Dynatrace news. billion in 2020 to $4.1 What are logs?

Analytics 264

Analytics Monitoring DevOps Artificial Intelligence 264

The Polyglot Developer

FEBRUARY 10, 2017

So I was researching object storage and I came across the open source distributed object storage software, Minio. After all they are both object storage solutions. The difference here is that Minio can be deployed on your own hardware.

Storage 72

Storage Open Source Hardware Architecture 72

High Scalability

NOVEMBER 14, 2018

New topics range from additional workloads like video streaming, machine learning, and public cloud to specialized silicon accelerators, storage and network building blocks, and a revised discussion of data center power and cooling, and uptime.

Design 54

Design Education Google Internet 54

ACM Sigarch

NOVEMBER 1, 2019

This blog post gives a glimpse of the computer systems research papers presented at the USENIX Annual Technical Conference (ATC) 2019, with an emphasis on systems that use new hardware architectures. As a consequence, the vast majority of the papers in the past has usually focused on conventional X86 or GPU-accelerated architectures.

Architecture 12

Architecture Hardware Cache Storage 12

Brendan Gregg

NOVEMBER 29, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance. I'd expect between 0.1%

Virtualization 110

Virtualization AWS Hardware Storage 110

All Things Distributed

MARCH 7, 2013

Shazam needed to handle an enormous increase in traffic for the duration of the Super Bowl and used DynamoDB as part of their architecture. This rapid adoption has allowed us to benefit from the scale economies inherent in our architecture. Indexed Storage costs : We are lowering the price of indexed storage by 75%.

Ecommerce 121

Ecommerce Storage Scalability Database 121

All Things Distributed

MARCH 11, 2016

The expectation was that with each order or two of magnitude, we would need to revisit and revise the architecture to make sure we could address the issues of scale. We needed to build such an architecture that we could introduce new software components without taking the service down. Primitives not frameworks.

AWS 127

AWS Hardware Retail Virtualization 127

ACM Sigarch

NOVEMBER 4, 2019

The technical program, put together by program chairs Tor Aamodt and Reetuparna Das , showcased key innovations across a wide range of computer architecture topics, from domain-specific accelerators to in/near-memory computing and from security to quantum computing. . This year’s MICRO had three inspiring keynote talks.

Hardware 18

Hardware Architecture Programming Innovation 18

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. If a primary server fails, a backup server can take over and continue to serve requests.

Availability 132

Availability Database Open Source Hardware 132

High Scalability

OCTOBER 24, 2022

Each cloud-native evolution is about using the hardware more efficiently. You can even go old school and use non cloud-native architectures. Nitro is a revolutionary combination of purpose-built hardware and software designed to provide performance and security. You can switch between clouds with effort. It has been done.

Cloud 187

Cloud Hardware Infrastructure Innovation 187

The Netflix TechBlog

FEBRUARY 9, 2021

This requires an asset storage solution. Asset Storage We refer to asset storage and management simply as asset management. However, it would be cost-inefficient to leverage this same hardware for lightweight and more consistent traffic patterns that an asset management service requires.

Engineering 172

Engineering Storage Latency Entertainment 172

All Things Distributed

NOVEMBER 15, 2010

Building general purpose architectures has always been hard; there are often so many conflicting requirements that you cannot derive an architecture that will serve all, so we have often ended up focusing on one side of the requirements that allow you to serve that area really well. From CPU to GPU. General Purpose GPU programming.

AWS 125

AWS Programming Latency Architecture 125

Percona

AUGUST 22, 2023

We’ll also look at the differences, as it’s important to know what architecture(s) will help you best meet your unique requirements for maximizing data assets and achieving continuous uptime. Redundancy provides backups and safeguards against data loss in case of hardware failures. there cannot be high availability.

Availability 98

Availability Hardware Open Source Database 98

Scalegrid

DECEMBER 6, 2023

This type of database offers scalability with no downtime along with giving businesses control over what resources they use through customization capabilities such as choosing hardware infrastructure options or building security measures around it. These advantages come at an expense.

Database 130

Database Cloud Hardware Storage 130

All Things Distributed

JANUARY 18, 2012

This architectural pattern was a response to the scaling challenges that had challenged Amazon.com through its first 5 years, when direct database access was one of the major bottlenecks in scaling and operating the business. Most importantly, direct database access to the data from outside its respective service is not allowed.

Scalability 162

Scalability Database Ecommerce Latency 162

KeyCDN

FEBRUARY 22, 2023

The goal of WebAssembly is to execute at native speeds by taking advantage of common hardware features available on a variety of platforms. With cloud-based infrastructure, organizations can easily scale their web applications to handle increased traffic or demand without the need for expensive hardware upgrades.

Artificial Intelligence 111

Artificial Intelligence Development Serverless Website 111

Scalegrid

JANUARY 5, 2024

The DBMS is key to maintaining these aspects by offering a storage system that allows users to perform operations such as data insertion, deletion, and selection, thereby promoting enhanced data integration across diverse applications and platforms. This is significant for modern business environments. <p>The </p>

Efficiency 147

Efficiency Storage Database Scalability 147

All Things Distributed

AUGUST 16, 2012

An apples to apples comparison of the costs associated with running various usage patterns on-premises and with AWS requires more than a simple comparison of hardware expense versus always-on utility pricing for compute and storage. Total Cost of Ownership and the Return on Agility. By Werner Vogels on 16 August 2012 10:00 AM.

AWS 99

AWS Hardware Traffic Best Practices 99

ACM Sigarch

AUGUST 3, 2023

(Editor’s Note: This post was submitted as a rebuttal to Andrew Chien’s July 24 SIGARCH Blog Post ) The recent post “ Why Embodied Carbon is a poor Architecture Design metric, and Operational Carbon remains an important Problem ” by Prof. Andrew Chien rightfully raises awareness of the challenges of reducing operational carbon.

Energy 98

Energy Architecture Hardware Metrics 98

The Netflix TechBlog

FEBRUARY 13, 2020

There is a potential benefit in reusing the hardware in place for video compression/decompression. Image decoding in hardware may not be a primary motivator, given the peculiarities of OS dependent UI composition, and architectural implications of moving uncompressed image pixels around.

Code 220

Code Metrics Open Source Efficiency 220

All Things Distributed

OCTOBER 8, 2014

The best part is that we are also significantly expanding the free tier many of you already enjoy by increasing the storage to 25 GB and throughput to 200 million requests per month. More than a decade ago, Amazon embarked on a mission to build a distributed system that challenged conventional methods of data storage and querying.

Availability 124

Availability Performance Scalability AWS 124

Percona

JULY 7, 2023

Unfortunately, using certain open source database software as part of an HA architecture can present significant challenges. Downtime due to SPOFs can also be attributed to bottlenecks from architectures designed for applications instead of databases. Despite all its upside, PostgreSQL software presents such challenges.

Availability 98

Availability Open Source Architecture Database 98

Highly Scalable

APRIL 2, 2012

From the business logic point of view, this was a pretty typical eCommerce service for hierarchical and faceted navigation, although not without peculiarities, but high performance requirements led us to the quite advanced architecture and technical design. Deployment Schema and High-Level Architecture.

Ecommerce 100

Ecommerce Cache Storage Architecture 100

The Morning Paper

OCTOBER 4, 2020

Three different 5G phones are used, including a ZTE Axon10 Pro with powerful communication (SDX 50 5G modem) and compute (Qualcomm Snapdragon TM855) capabilities together with 256GB of storage. This is a feature of the NSA architecture which requires dropping off of 5G onto 4G, doing a handover on 4G, and then upgrading to 5G again.

Energy 130

Energy Latency Performance Network 130

All Things Distributed

JULY 13, 2010

Additionally, many high-end HPC applications take advantage of knowing their in-house hardware platforms to achieve major speedup by exploiting the specific processor architecture. There is no more need for hardware tinkering to keep the clusters up and running (I spent many nights doing this; there is no glory in it).

Cloud 98

Cloud AWS Automotive Latency 98

Scalegrid

JANUARY 8, 2024

Understanding Multi-Cloud and Hybrid Cloud Cloud computing has revolutionized the IT industry, offering a host of advantages including cost-effectiveness, increased agility, and access to cutting-edge hardware. In this scenario, two notable models – multi-cloud and hybrid cloud have emerged. But what do these entail?

Cloud 147

Cloud Strategy Scalability Artificial Intelligence 147

Percona

JUNE 30, 2023

Architecture Operator SDK is now used to build and package the Operator. In addition to that: Run up to four pgBackrest repositories Bootstrap the cluster from the existing backup through Custom Resource Azure Blob Storage support Operations Deploying complex topologies in Kubernetes is not possible without affinity and anti-affinity rules.

Availability 107

Availability Open Source Azure Hardware 107

Scalegrid

JANUARY 21, 2025

With its widespread use in modern application architectures, understanding the ins and outs of Redis monitoring is essential for any tech professional. Taking protective measures like these now could protect both your data and hardware from future harm down the line. Redis, a powerful in-memory data store, is no exception.

Strategy 130

Strategy Monitoring Latency DevOps 130

ACM Sigarch

OCTOBER 4, 2018

This is the first post in a series of posts on different approaches to systems security especially as they apply to hardware and architectural security. Naively securing this system would require a large amount of trust; “guns and guards”, trusted personnel, and trusted software and hardware. His website is [link].

Systems 48

Systems Hardware Storage Architecture 48