The Netflix TechBlog

JANUARY 13, 2022

This blog will explore these two systems and how they perform auto-diagnosis and remediation across our Big Data Platform and Real-time infrastructure. This has led to a dramatic reduction in the time it takes to detect issues in hardware or bugs in recently rolled out data platform software.

Big Data 241

Big Data Infrastructure Metrics Hardware 241

Dynatrace

DECEMBER 15, 2022

Besides the traditional system hardware, storage, routers, and software, ITOps also includes virtual components of the network and cloud infrastructure. Although modern cloud systems simplify tasks, such as deploying apps and provisioning new hardware and servers, hybrid cloud and multicloud environments are often complex.

Artificial Intelligence 213

Artificial Intelligence DevOps Hardware Virtualization 213

The Morning Paper

MAY 14, 2019

Seer: leveraging big data to navigate the complexity of performance debugging in cloud microservices Gan et al., When a QoS violation is predicted to occur and a culprit microservice located, Seer uses a lower level tracing infrastructure with hardware monitoring primitives to identify the reason behind the QoS violation.

Big Data 45

Big Data Cloud Performance Hardware 45

Dynatrace

JANUARY 16, 2023

On-premises data centers invest in higher capacity servers since they provide more flexibility in the long run, while the procurement price of hardware is only one of many cost factors. Specifically, they provide asynchronous communications within microservices architectures and high-throughput distributed systems.

Open Source 350

Open Source Java Operating System Programming 350

ACM Sigarch

MAY 31, 2023

Introduction Memory systems are evolving into heterogeneous and composable architectures. Heterogeneous and Composable Memory (HCM) offers a feasible solution for terabyte- or petabyte-scale systems, addressing the performance and efficiency demands of emerging big-data applications. Using emulation (e.g.

Latency 52

Latency Hardware Cache Architecture 52

Adrian Cockcroft

NOVEMBER 18, 2024

Discover data sources to gain insights into your resource efficiency and environmental impact, including the AWS Customer Carbon Footprint Tool and proxy metrics from the AWS Cost & Usage Reports. This lightning talk explores how companies can cut costs and carbon emissions through architectural best practices and workload optimization.

AWS 98

AWS Energy Lambda Government 98

Abhishek Tiwari

DECEMBER 27, 2017

A common theme across all these trends is to remove the complexity by simplifying data management as a whole. In 2018, we anticipate that ETL will either lose relevance or the ETL process will disintegrate and be consumed by new data architectures. Unified data management architecture.

Big Data 49

Big Data Artificial Intelligence Storage Hardware 49

Uber Engineering

OCTOBER 30, 2018

Cluster management, a common software infrastructure among technology companies, aggregates compute resources from a collection of physical hosts into a shared resource pool, amplifying compute power and allowing for the flexible use of data center hardware.

Hardware 103

Hardware Infrastructure Engineering Technology 103

ACM Sigarch

NOVEMBER 1, 2019

This blog post gives a glimpse of the computer systems research papers presented at the USENIX Annual Technical Conference (ATC) 2019, with an emphasis on systems that use new hardware architectures. As a consequence, the vast majority of the papers in the past has usually focused on conventional X86 or GPU-accelerated architectures.

Architecture 12

Architecture Hardware Cache Storage 12

Percona

JANUARY 19, 2023

ProxySQL: It is a feature-rich open-source MySQL proxy solution, that allows query routing for the most common MySQL architectures (PXC/Galera, Replication, Group Replication, etc.). It was developed for optimizing data storage and access for big data sets. It is available under a paid subscription.

Open Source 91

Open Source Storage Database Big Data 91

Uber Engineering

OCTOBER 30, 2018

Cluster management, a common software infrastructure among technology companies, aggregates compute resources from a collection of physical hosts into a shared resource pool, amplifying compute power and allowing for the flexible use of data center hardware.

Hardware 62

Hardware Infrastructure Engineering Technology 62

All Things Distributed

NOVEMBER 15, 2010

Building general purpose architectures has always been hard; there are often so many conflicting requirements that you cannot derive an architecture that will serve all, so we have often ended up focusing on one side of the requirements that allow you to serve that area really well. From CPU to GPU. General Purpose GPU programming.

AWS 127

AWS Programming Latency Architecture 127

All Things Distributed

SEPTEMBER 6, 2013

Shell leverages AWS for big data analytics to help achieve these goals. It makes use of the Eagle Genomics platform running on AWS, resulting in that Unilever’s digital data program now processes genetic sequences twenty times faster—without incurring higher compute costs.

Cloud 106

Cloud Energy AWS Healthcare 106

All Things Distributed

DECEMBER 20, 2017

Marketers use big data and artificial intelligence to find out more about the future needs of their customers. should ponder how we can organize the 'production' of data in such a way so that we ultimately come out with a competitive advantage. These mechanisms need to be lean, seamless and effective.

Artificial Intelligence 71

Artificial Intelligence Social Media Logistics AWS 71

All Things Distributed

JULY 13, 2010

Additionally, many high-end HPC applications take advantage of knowing their in-house hardware platforms to achieve major speedup by exploiting the specific processor architecture. Given the specialized nature of these platforms, they require dedicated resources to maintain and operate and put a big burden on the IT organization.

Cloud 102

Cloud AWS Automotive Latency 102

ACM Sigarch

APRIL 8, 2019

Computer architecture is an important and exciting field of computer science, which enables many other fields (eg. big-data processing, machine learning, quantum computing, and so on). For those of us who pursued computer architecture as a career, this is well understood. Why is that? Should we be alarmed as a community?

Architecture 74

Architecture Open Source Hardware Software Engineering 74

All Things Distributed

NOVEMBER 15, 2016

The reality is that many traditional BI solutions are built on top of legacy desktop and on-premises architectures that are decades old. The cost and complexity to implement, scale, and use BI makes it difficult for most companies to make data analysis ubiquitous across their organizations. Enter Amazon QuickSight.

Analytics 130

Analytics Availability Media Social Media 130