The Netflix TechBlog

MAY 4, 2023

When undertaking system migrations, one of the main challenges is establishing confidence and seamlessly transitioning the traffic to the upgraded architecture without adversely impacting the customer experience. This blog series will examine the tools, techniques, and strategies we have utilized to achieve this goal.

Traffic 342

Traffic Latency Tuning Systems 342

Scalegrid

JANUARY 8, 2024

This article delves into the specifics of how AI optimizes cloud efficiency, ensures scalability, and reinforces security, providing a glimpse at its transformative role without giving away extensive details. Exploring artificial intelligence in cloud computing reveals a game-changing synergy.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

Dynatrace

FEBRUARY 10, 2023

Data proliferation—as well as a growing need for data analysis—has accelerated. From data lakehouse to an analytics platform Traditionally, to gain true business insight, organizations had to make tradeoffs between accessing quality, real-time data and factors such as data storage costs. That’s where a data lakehouse can help.

Efficiency 271

Efficiency Performance Analytics DevOps 271

All Things Distributed

JUNE 10, 2016

If you are looking for more examples there are the Lambda Serverless Reference Architectures that can serve as the blueprint for building your own serverless applications. Mobile Backend Serverless Reference Architecture. Real-time File Processing Serverless Reference Architecture. IoT Backend Serverless Reference Architecture.

Lambda 102

Lambda Serverless AWS Architecture 102

All Things Distributed

MAY 10, 2016

If you are looking for more examples there are the Lambda Serverless Reference Architectures that can serve as the blueprint for building your own serverless applications. Mobile Backend Serverless Reference Architecture. Real-time File Processing Serverless Reference Architecture. IoT Backend Serverless Reference Architecture.

Lambda 102

Lambda Serverless AWS Architecture 102

Dynatrace

JANUARY 22, 2024

Software developers can use causal analysis to identify the root causes of bugs or application performance issues and to predict potential system failures or performance degradations. Data lakehouses combine a data lake’s flexible storage with a data warehouse’s fast performance. Software development.

Artificial Intelligence 202

Artificial Intelligence Healthcare Retail Government 202

Dynatrace

NOVEMBER 2, 2020

IT infrastructure is the heart of your digital business and connects every area – physical and virtual servers, storage, databases, networks, cloud services. This shift requires infrastructure monitoring to ensure all your components work together across applications, operating systems, storage, servers, virtualization, and more.

Infrastructure 195

Infrastructure Monitoring Virtualization Serverless 195

Dynatrace

JANUARY 16, 2023

Through effortless provisioning, a larger number of small hosts provide a cost-effective and scalable platform. Redis is an in-memory key-value store and cache that simplifies processing, storage, and interaction with data in Kubernetes environments. This report reflects Kubernetes adoption statistics based on the analysis of 4.1

Open Source 339

Open Source Java Operating System Programming 339

Dynatrace

DECEMBER 15, 2022

While engaging the automatic instrumentation of the Dynatrace OneAgent makes log ingestion automatic and scalable , our customers have set up multiple other log ingestion methods. But there are cases where you might be limited in setting up a dedicated syslog server with OneAgent because of environment architecture or resources.

Strategy 176

Strategy AWS Open Source Transportation 176

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. Understanding distributed storage is imperative as data volumes and the need for robust storage solutions rise.

Storage 130

Storage Systems Big Data Azure 130

ScaleOut Software

JULY 19, 2021

Today’s streaming analytics architectures are not equipped to make sense of this rapidly changing information and react to it as it arrives. Incoming data is saved into data storage (historian database or log store) for query by operational managers who must attempt to find the highest priority issues that require their attention.

IoT 78

IoT Analytics Big Data Architecture 78

Dynatrace

APRIL 20, 2023

Modern organizations ingest petabytes of data daily, but legacy approaches to log analysis and management cannot accommodate this volume of data. Traditional log analysis evaluates logs and enables organizations to mitigate myriad risks and meet compliance regulations. Grail enables 100% precision insights into all stored data.

Analytics 182

Analytics Infrastructure Storage Architecture 182

Dynatrace

DECEMBER 5, 2023

Without observability, the benefits of ARM are lost Over the last decade and a half, a new wave of computer architecture has overtaken the world. ARM architecture, based on a processor type optimized for cloud and hyperscale computing, has become the most prevalent on the planet, with billions of ARM devices currently in use.

Efficiency 261

Efficiency Architecture Energy Monitoring 261

Dynatrace

SEPTEMBER 17, 2019

PostgreSQL & Elastic for data storage. MaaSS for Cloud Architects: Deployment and Architecture Validations. Validate correct architecture, configuration and deployment by looking at Service Flow! Their technology stack looks like this: Spring Boot-based Microservices. NGINX as an API Gateway. REDIS for caching.

AWS 127

AWS Monitoring Ecommerce Lambda 127

The Netflix TechBlog

MAY 21, 2019

Solution We built a system called Lerner that consists of a set of microservices and a python library that allows scalable agent training and inference for test case scheduling. We wanted the to tool be available as a standalone library as well as scalable API service. which allows fast deployment times and rapid scalability.

Testing 163

Testing AWS Lambda Network 163

ScaleOut Software

JULY 21, 2020

Designed to help scalable applications deliver high performance, it stores live, fast-changing data in memory (DRAM) for fast updates and retrieval. Instead of querying objects from the IMDG and analyzing them in the client, applications can now simply run this analysis within the IMDG itself using APIs available in ScaleOut StateServer Pro.

Analytics 52

Analytics Airlines Cache Scalability 52

ScaleOut Software

JULY 21, 2020

Designed to help scalable applications deliver high performance, it stores live, fast-changing data in memory (DRAM) for fast updates and retrieval. Instead of querying objects from the IMDG and analyzing them in the client, applications can now simply run this analysis within the IMDG itself using APIs available in ScaleOut StateServer Pro.

Analytics 52

Analytics Airlines Cache Scalability 52

Dynatrace

OCTOBER 4, 2022

Modern IT environments — whether multicloud, on-premises, or hybrid-cloud architectures — generate exponentially increasing data volumes. Still, it is critical to collect, store, and make easily accessible these massive amounts of log data for analysis. Teams have introduced workarounds to reduce storage costs.

Analytics 229

Analytics Artificial Intelligence Storage Serverless 229

ScaleOut Software

APRIL 3, 2020

An innovative new software approach called “real-time digital twins” running on a cloud-hosted, highly scalable, in-memory computing platform can help address this challenge. Within seconds, the software performs aggregate analysis of this data for all real-time digital twins. How many ventilators currently are in repair by make?”.

Logistics 52

Logistics Analytics Scalability Cloud 52

ScaleOut Software

APRIL 3, 2020

An innovative new software approach called “real-time digital twins” running on a cloud-hosted, highly scalable, in-memory computing platform can help address this challenge. Within seconds, the software performs aggregate analysis of this data for all real-time digital twins. How many ventilators currently are in repair by make?”.

Logistics 52

Logistics Analytics Scalability Cloud 52

Dynatrace

OCTOBER 7, 2021

To get a better understanding of AWS serverless, we’ll first explore the basics of serverless architectures, review AWS serverless offerings, and explore common use cases. Serverless architecture: A primer. Serverless architecture shifts application hosting functions away from local servers onto those managed by providers.

Serverless 275

Serverless AWS Lambda Storage 275

O'Reilly Software

JUNE 12, 2018

In fact, before we even had the word microservices in our lexicon, back when it was just good old-fashioned service-oriented architecture, we were talking about data: how to access it, where it lives, who “owns” it. As I expanded upon in my book, Building Microservices , a shared database creates a huge coupling point in your architecture.

Database 72

Database Cache Architecture Latency 72

Dynatrace

OCTOBER 4, 2022

Grail architectural basics. The aforementioned principles have, of course, a major impact on the overall architecture. A data lakehouse addresses these limitations and introduces an entirely new architectural design. This decoupling ensures the openness of data and storage formats, while also preserving data in context.

Artificial Intelligence 263

Artificial Intelligence Analytics Storage Architecture 263

Tasktop

MARCH 16, 2021

roles to build a solution for just one product value stream, as well as laying the architectural foundations to scale across multiple value streams in your portfolio. Data Analyst : Performs analysis of data from the various tools, transforming and aligning them to generate value stream metrics.

Metrics 52

Metrics Healthcare Automotive Innovation 52

Scalegrid

DECEMBER 21, 2023

With its widespread use in modern application architectures, understanding the ins and outs of Redis® monitoring is essential for any tech professional. This Command Line Interface (CLI) can be used for basic activity metrics and offers powerful real-time data analysis tools, giving you more control over the performance of your servers.

Strategy 130

Strategy Monitoring Latency DevOps 130

ScaleOut Software

JANUARY 9, 2020

Traditional platforms for streaming analytics don’t offer the combination of granular data tracking and real-time aggregate analysis that logistics applications in operational environments such as these require.

Logistics 52

Logistics Retail Analytics Azure 52

ScaleOut Software

JANUARY 9, 2020

Traditional platforms for streaming analytics don’t offer the combination of granular data tracking and real-time aggregate analysis that logistics applications in operational environments such as these require.

Logistics 52

Logistics Retail Analytics Azure 52

ScaleOut Software

JANUARY 9, 2020

Traditional platforms for streaming analytics don’t offer the combination of granular data tracking and real-time aggregate analysis that logistics applications such as these require. It’s not enough to just pick out interesting events from an aggregated data stream and then send them to a database for offline analysis using Spark.

Logistics 52

Logistics Retail Analytics Azure 52

All Things Distributed

AUGUST 16, 2012

Werner Vogels weblog on building scalable and robust distributed systems. An apples to apples comparison of the costs associated with running various usage patterns on-premises and with AWS requires more than a simple comparison of hardware expense versus always-on utility pricing for compute and storage. All Things Distributed.

AWS 114

AWS Hardware Traffic Best Practices 114

Tasktop

MARCH 16, 2021

roles to build a solution for just one product value stream, as well as laying the architectural foundations to scale across multiple value streams in your portfolio. Data Analyst : Performs analysis of data from the various tools, transforming and aligning them to generate value stream metrics.

Metrics 40

Metrics Healthcare Automotive Innovation 40

Brendan Gregg

APRIL 30, 2018

LISA originally stood for "Large Installation System Administration," where "large" meant systems with more than a gigabyte of storage, or with more than 100 users. In fact, we’d link to the first LISA conference website for reference, but this conference not only predates the Wayback Machine – it also predates the World Wide Web!

DevOps 42

DevOps Network Best Practices Programming 42

Adrian Cockcroft

JUNE 21, 2022

I became the Sun UK local specialist in performance and hardware, and as Sun transitioned from a desktop workstation company to sell high end multiprocessor servers I was helping customers find and fix scalability problems. I was looking for a new challenge, so joined the program and ended up getting certified as a “black belt”.

Tuning 52

Tuning Benchmarking Engineering C++ 52

Brendan Gregg

APRIL 29, 2018

LISA originally stood for "Large Installation System Administration," where "large" meant systems with more than a gigabyte of storage, or with more than 100 users. In fact, we’d link to the first LISA conference website for reference, but this conference not only predates the Wayback Machine – it also predates the World Wide Web!

DevOps 40

DevOps Network Best Practices Programming 40

Dynatrace

JANUARY 11, 2023

Cloud monitoring tools unify data from applications and dependent resources across distributed channels to achieve the following: better detect anomalies; perform root-cause analysis; and. Cloud storage monitoring. Measure cloud resource consumption to ensure resources are scalable and keep up with business requirements.

Cloud 218

Cloud Monitoring Best Practices Infrastructure 218

Dynatrace

AUGUST 21, 2023

A traditional log management solution uses an often manual and siloed approach, which limits scalability and ultimately hinders organizational innovation. Additionally, a unified log management solution can help to automate many of the tasks associated with log management, such as correlation and analysis.

Analytics 143

Analytics Innovation Infrastructure Scalability 143

Dynatrace

NOVEMBER 20, 2023

Across the cloud operations lifecycle, especially in organizations operating at enterprise scale, the sheer volume of cloud-native services and dynamic architectures generate a massive amount of data.  Using fault-tree analysis, this kind of AI provides critical detail about how its models arrive at a given conclusion.

AWS 204

AWS Artificial Intelligence Cloud Analytics 204

Dynatrace

NOVEMBER 11, 2022

Therefore, they need an environment that offers scalable computing, storage, and networking. Hyperconverged infrastructure (HCI) is an IT architecture that combines servers, storage, and networking functions into a unified, software-centric platform to streamline resource management. What is hyperconverged infrastructure?

Infrastructure 196

Infrastructure Storage Virtualization Network 196