The Netflix TechBlog

NOVEMBER 15, 2022

But it’s not easy: to pull this off, VFX studios need to build and operate serious technical infrastructure (compute, storage, networking, and software licensing), otherwise known as a “ render farm.” Without cloud-based rendering, this ambitious project would not have met its targeted delivery date!

Cloud 291

Cloud Entertainment AWS Infrastructure 291

Dynatrace

APRIL 19, 2023

Creating an ecosystem that facilitates data security and data privacy by design can be difficult, but it’s critical to securing information. When organizations focus on data privacy by design, they build security considerations into cloud systems upfront rather than as a bolt-on consideration.

Design 246

Design Storage Programming Analytics 246

The Netflix TechBlog

NOVEMBER 12, 2024

By: Rajiv Shringi , Oleksii Tkachuk , Kartik Sathyanarayanan Introduction In our previous blog post, we introduced Netflix’s TimeSeries Abstraction , a distributed service designed to store and query large volumes of temporal event data with low millisecond latencies. Today, we’re excited to present the Distributed Counter Abstraction.

Latency 251

Latency Cache Infrastructure Strategy 251

Dynatrace

OCTOBER 7, 2021

For many companies, the journey to modern cloud applications starts with serverless. This means you no longer have to provision, scale, and maintain servers to run your applications, databases, and storage systems. Dynatrace news. Amazon Web Services (AWS), offers a wide range of serverless solutions. Reliability. Scalability.

Serverless 325

Serverless AWS Lambda Storage 325

Scalegrid

MAY 13, 2020

It’s architecture was specially designed to manage large-scale data warehouses and business intelligence workloads by giving you the ability to spread your data out across a multitude of servers. Greenplum uses an MPP database design that can help you develop a scalable, high performance deployment. Greenplum Architectural Design.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

Dynatrace

DECEMBER 8, 2021

As cloud environments become increasingly complex, legacy solutions can’t keep up with modern demands. As a result, companies run into the cloud complexity wall – also known as the cloud observability wall – as they struggle to manage modern applications and gain multicloud observability with outdated tools.

Cloud 246

Cloud Serverless Hardware Operating System 246

Smashing Magazine

JANUARY 7, 2025

How To Design For High-Traffic Events And Prevent Your Website From Crashing How To Design For High-Traffic Events And Prevent Your Website From Crashing Saad Khan 2025-01-07T14:00:00+00:00 2025-01-07T22:04:48+00:00 This article is sponsored by Cloudways Product launches and sales typically attract large volumes of traffic.

Traffic 86

Traffic Website Design Cache 86

Dynatrace

AUGUST 27, 2020

Cloud deployments have grown rapidly in recent years, and enterprise hybrid and multicloud environments have become the new standard, resulting in new challenges such as: Keeping up with dynamic, autoscaling environments where instances, applications and microservices come and go fast. AWS Storage Gateway. Dynatrace news. AWS OpsWorks.

AWS 279

AWS Cloud IoT Database 279

Scalegrid

FEBRUARY 6, 2025

RabbitMQ is designed for flexible routing and message reliability, while Kafka handles high-throughput event streaming and real-time data processing. Message brokers handle validation, routing, storage, and delivery, ensuring efficient and reliable communication. What is RabbitMQ?

Latency 147

Latency Analytics Architecture Storage 147

Dynatrace

JUNE 27, 2023

Logs complement metrics and enable automation Cloud practitioners agree that observability, security, and automation go hand in hand. The increasing complexity of cloud service architectures requires a rock-solid understanding of the activity, health status, and security of cloud services.

AWS 246

AWS Cloud Lambda Analytics 246

Dynatrace

MARCH 11, 2025

Whether you’re using OpenTelemetry or OneAgent, operating in the cloud or on-premiseswe’ve got you covered. Say hello to advanced trace an alytics and new data storage and capture options. This precision reduces storage costs while ensuring you retain the data that matters most. But why stop there?

Analytics 165

Analytics Games Innovation Metrics 165

High Scalability

DECEMBER 16, 2022

Explain cloud computing to me at a professional level? Cloud computing is a model of computing that delivers computing services over the internet, including storage, data processing, and networking. Another key benefit of cloud computing is its reliability and availability. Which cloud provider would you recommend?

Cloud 201

Cloud Serverless Internet Internet 201

Dynatrace

NOVEMBER 11, 2022

Therefore, they need an environment that offers scalable computing, storage, and networking. Hyperconverged infrastructure (HCI) is an IT architecture that combines servers, storage, and networking functions into a unified, software-centric platform to streamline resource management. Hyperconverged vs. cloud: Consider the differences.

Infrastructure 264

Infrastructure Storage Virtualization Network 264

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. Understanding distributed storage is imperative as data volumes and the need for robust storage solutions rise.

Storage 130

Storage Systems Big Data Azure 130

All Things Distributed

AUGUST 20, 2012

Expanding the Cloud â?? Managing Cold Storage with Amazon Glacier. With the introduction of Amazon Glacier , IT organizations now have a solution that removes the headaches of digital archiving and provides extremely low cost storage. All Things Distributed. By Werner Vogels on 21 August 2012 12:01 AM. Comments ().

Storage 114

Storage Cloud AWS Media 114

All Things Distributed

MARCH 13, 2019

Aurora's design preserves the core transactional consistency strengths of relational databases. It innovates at the storage layer to create a database built for the cloud that can support modern workloads without sacrificing performance.

Database 135

Database Design Cloud AWS 135

Dynatrace

JANUARY 17, 2024

Growing AI adoption brings rising cloud costs There are three key reasons that AI costs can spiral out of control: AI consumes additional resources. Running artificial intelligence models and querying data requires massive amounts of computational resources in the cloud, which results in higher cloud costs. Use containerization.

Strategy 288

Strategy Artificial Intelligence Storage Cloud 288

All Things Distributed

MARCH 13, 2019

Aurora's design preserves the core transactional consistency strengths of relational databases. It innovates at the storage layer to create a database built for the cloud that can support modern workloads without sacrificing performance.

Database 132

Database Design Cloud AWS 132

Dynatrace

AUGUST 11, 2022

Before an organization moves to function as a service, it’s important to understand how it works, its benefits and challenges, its effect on scalability, and why cloud-native observability is essential for attaining peak performance. Cloud providers then manage physical hardware, virtual machines, and web server software management.

Development 279

Development Serverless Best Practices Lambda 279

Dynatrace

SEPTEMBER 5, 2024

Seamless integration with AWS Firehose Dynatrace is also enhancing our observability logs offerings for AWS services for cloud-native applications. Dynatrace supports scalable data ingestion, ensuring your observability infrastructure grows with your cloud environment.

Innovation 290

Innovation AWS Analytics Storage 290

Scalegrid

JANUARY 8, 2024

Confused about multi-cloud vs hybrid cloud and which is the right strategy for your organization? Multicloud harnesses diverse cloud services to boost flexibility, while hybrid cloud merges public and private clouds for enhanced control. What is Multi-Cloud? But what do these entail?

Cloud 147

Cloud Strategy Scalability Artificial Intelligence 147

High Scalability

OCTOBER 24, 2022

There's a move to regulate cloud providers by vertically separating the services they offer. Like railroads of yore, who were not allowed to provide freight services on top of their base services, cloud providers would not be allowed to provide services on top of their base platform services. The job of a cloud is to run workloads.

Cloud 187

Cloud Hardware Infrastructure Innovation 187

Dynatrace

OCTOBER 4, 2022

A data lakehouse addresses these limitations and introduces an entirely new architectural design. This architecture offers rich data management and analytics features (taken from the data warehouse model) on top of low-cost cloud storage systems (which are used by data lakes). Grail is built for such analytics, not storage.

Artificial Intelligence 290

Artificial Intelligence Analytics Storage Architecture 290

Dynatrace

JUNE 10, 2024

Two-thirds say vulnerability management is becoming harder because of complex supply chain and cloud ecosystems. Increased visibility Security analytics can help make connections between multiple applications, services, and clouds. Security analytics tools can be any combination of on-prem, in the cloud, or both.

Analytics 264

Analytics Network Open Source Hardware 264

Dynatrace

AUGUST 1, 2022

Kubernetes was initially designed with a strong focus on stateless workloads, meaning these workloads do not need to store any persistent data. You quickly realize that it will take ages to fill up the overprovisioned database storage. Two days later, your database runs out of storage in the middle of the night. Dynatrace news.

Storage 246

Storage Database Network Metrics 246

All Things Distributed

NOVEMBER 28, 2012

Expanding the Cloud â?? Today, we are excited to announce the limited preview of Amazon Redshift , a fast and powerful, fully managed, petabyte-scale data warehouse service in the cloud. The nodes themselves are designed specifically for data warehousing workloads. By Werner Vogels on 28 November 2012 09:00 AM. Comments ().

Cloud 152

Cloud Storage Architecture Scalability 152

DZone

JANUARY 23, 2022

Hardware - servers/storage hardware/software faults such as disk failure, disk full, other hardware failures, servers running out of allocated resources, server software behaving abnormally, intra DC network connectivity issues, etc. In today's world, cloud providers take care of the rest usually. Again the approach here is the same.

Hardware 243

Hardware DevOps Network Storage 243

InfoQ

OCTOBER 14, 2023

Google recently announced various improvements to Cloud Spanner, its distributed, decoupled relational database service with a “50% increase in throughput and 2.5 times the storage per node than before” without a price change. By Steef-Jan Wiggers

Google 105

Google Storage Cloud Database 105

The Morning Paper

MARCH 8, 2020

Building an elastic query engine on disaggregated storage , Vuppalapati, NSDI’20. This paper describes the design decisions behind the Snowflake cloud-based data warehouse. have altered the many assumptions that guided the design and optimization of the Snowflake system. From shared-nothing to disaggregation.

Storage 112

Storage Engineering Cache Serverless 112

The Netflix TechBlog

SEPTEMBER 18, 2024

In this post, we dive deep into how Netflix’s KV abstraction works, the architectural principles guiding its design, the challenges we faced in scaling diverse use cases, and the technical innovations that have allowed us to achieve the performance and reliability required by Netflix’s global operations.

Latency 260

Latency Storage Cache Servers 260

Dynatrace

AUGUST 24, 2020

But there are other related components and processes (for example, cloud provider infrastructure) that can cause problems in applications running on Kubernetes. Similarly, integrations for Azure and VMware are available to help you monitor your infrastructure both in the cloud and on-premises. Monitoring your i nfrastructure.

Analytics 305

Analytics Infrastructure AWS Operating System 305

Dynatrace

OCTOBER 4, 2022

Data warehouses offer a single storage repository for structured data and provide a source of truth for organizations. Unlike data warehouses, however, data is not transformed before landing in storage. A data lakehouse provides a cost-effective storage layer for both structured and unstructured data. Data management.

Artificial Intelligence 246

Artificial Intelligence Storage Analytics Government 246

Dynatrace

OCTOBER 17, 2023

The rise of cloud-native microservice architectures further exacerbates this change. Dynatrace has developed the purpose-built data lakehouse, Grail , eliminating the need for separate management of indexes and storage. All data is readily accessible without storage tiers, such as costly solid-state drives (SSDs).

Retail 264

Retail Storage Best Practices Architecture 264

Dynatrace

NOVEMBER 20, 2023

In this AWS re:Invent 2023 guide, we explore the role of generative AI in the issues organizations face as they move to the cloud: IT automation, cloud migration and digital transformation, application security, and more. In general, generative AI can empower AWS users to further accelerate and optimize their cloud journeys.

AWS 277

AWS Artificial Intelligence Cloud Analytics 277

Dynatrace

JUNE 6, 2023

Containerized microservices have made it easier for organizations to create and deploy applications across multiple cloud environments without worrying about functional conflicts or software incompatibilities. Therefore, they are built to be non-persistent by design. Containers need to spin up and down easily.

Open Source 246

Open Source Storage Analytics Innovation 246

Percona

FEBRUARY 24, 2023

If you’re using PostgreSQL in the cloud, there’s a good chance you’re spending more than you need in order to get the results you need for your business. Usage reduction: What to look for to reduce PostgreSQL cloud costs The first step in cost reduction is to use what you need and not more. Don’t pay for capacity you don’t use or need.

Cloud 133

Cloud Serverless AWS Storage 133

Dynatrace

MAY 7, 2024

Fluent Bit is a telemetry agent designed to receive data (logs, traces, and metrics), process or modify it, and export it to a destination. Fluent Bit was designed to help you adjust your data and add the proper context, which can be helpful in the observability backend. Plan to avoid out-of-memory situations.

Best Practices 279

Best Practices IoT Metrics Storage 279