All Things Distributed

JANUARY 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The original Dynamo design was based on a core set of strong distributed systems principles resulting in an ultra-scalable and highly reliable database system.

Scalability 162

Scalability Database Ecommerce Latency 162

High Scalability

APRIL 26, 2019

They'll learn a lot and hold you in even greater awe. $30 30 million : Apple's per month AWS bill ( a ~50% reduction ); 73% : Azure YoY growth; 3,500 : times per day andon cords are pulled at Toyota; $1 trillion : size of micromobility market; $1 billion : cryptopiracy is the new sea piracy; $702 million : Tesla fist quarter loss; $5.0

Internet 28

Internet Internet Scalability Azure 28

The Netflix TechBlog

MARCH 5, 2019

All these micro-services are currently operated in AWS cloud infrastructure. Can we adjust our auto-scaling policies to be more efficiency without risking our availability during traffic spikes? A majority of the Netflix product features are either partially or completely dependent on one of our many micro-services (e.g.,

Infrastructure 185

Infrastructure Cloud Scalability AWS 185

High Scalability

NOVEMBER 16, 2018

AWS Redshift FTW! Sheera Frenkel : “We’re not going to traffic in your personal life,” Tim Cook, Apple’s chief executive, said in an MSNBC interview. yishengdd : However from my own experience, AWS Amplify is 10x better than Google Firebase. “Privacy to us is a human right.

Internet 28

Internet Internet Scalability Energy 28

Dynatrace

SEPTEMBER 30, 2021

Cloud services platforms like AWS, Azure, and GCP are reshaping how organizations deliver value to their customers, making cloud migration an increasingly attractive option for running applications. Increased scalability. In case of a spike in traffic, you can automatically spin up more resources, often in a matter of seconds.

Cloud 241

Cloud Traffic Best Practices Strategy 241

Dynatrace

SEPTEMBER 17, 2019

AWS EKS for Integration and Production. When focusing on the LanguageController service we learn that it’s currently deployed in three pods across three EKS nodes across two AWS Availability Zones (AZ). 4 AWS EFS monitoring. Their technology stack looks like this: Spring Boot-based Microservices. NGINX as an API Gateway.

AWS 170

AWS Monitoring Ecommerce Lambda 170

Dynatrace

OCTOBER 31, 2019

With these additional availability zones you’ll get: More scalability and load-balancing options. Some organizations require adding IP addresses to security configurations to allow traffic from and to them. your website or application) needs to accept traffic from the IP addresses of our synthetic locations.

Scalability 29

Scalability Traffic Monitoring Benchmarking 29

High Scalability

SEPTEMBER 21, 2018

Aria Bracci : Using a previously established, peer-reviewed technique, the team conducted more than half a million data traffic tests across 161 countries. They'll love you even more. ” @mjpt777 : "Patterson indicated that rewriting Python into C gets you a 50 times speedup in performance". More quotes.

Internet 126

Internet Internet Scalability Traffic 126

All Things Distributed

JUNE 20, 2017

Today, I am very excited to announce our plans to open a new AWS Region in Hong Kong! The new region will give Hong Kong-based businesses, government organizations, non-profits, and global companies with customers in Hong Kong, the ability to leverage AWS technologies from data centers in Hong Kong.

AWS 126

AWS Logistics Cloud Social Media 126

High Scalability

AUGUST 27, 2018

The number of services that compose our product in order to scale our organization and handle the increases in traffic went from under 10 to over 30 services. We doubled-down decided to use a single cloud provider for each of our environments and moved all our public cloud infrastructure to AWS. Core service architecture.

Architecture 244

Architecture Cloud Traffic Infrastructure 244

All Things Distributed

APRIL 4, 2017

Today, I am very excited to announce our plans to open a new AWS Region in the Nordics! The new region will give Nordic-based businesses, government organisations, non-profits, and global companies with customers in the Nordics, the ability to leverage the AWS technology infrastructure from data centers in Sweden.

AWS 107

AWS Airlines Latency Games 107

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! Netflix shares how Amazon EC2 Auto Scaling allows its infrastructure to automatically adapt to changing traffic patterns in order to keep its audience entertained and its costs on target.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! Netflix shares how Amazon EC2 Auto Scaling allows its infrastructure to automatically adapt to changing traffic patterns in order to keep its audience entertained and its costs on target.

AWS 100

AWS Entertainment Open Source Benchmarking 100

High Scalability

JUNE 22, 2018

. $40 million : Netflix monthly spend on cloud services; 5% : retention increase can increase profits 25%; 50+% : Facebook's IPv6 traffic from the U.S, Quite contrary, this was the era of the 250GB / month cap from Comcast and we could observe clearly that they were throttling Netflix traffic. There are more quotes, more everything.

Internet 113

Internet Internet Scalability Artificial Intelligence 113

The Netflix TechBlog

OCTOBER 19, 2020

An additional implication of a lenient sampling policy is the need for scalable stream processing and storage infrastructure fleets to handle increased data volume. The next challenge was to stream large amounts of traces via a scalable data processing platform. Mantis is our go-to platform for processing operational data at Netflix.

Infrastructure 238

Infrastructure Transportation Storage Open Source 238

High Scalability

JULY 20, 2018

Don't miss all that the Internet has to say on Scalability, click below and become eventually consistent with all scalability knowledge (which means this post has many more items to read so please keep on reading). Cliff Click : The JVM is very good at eliminating the cost of code abstraction, but not the cost of data abstraction.

Internet 121

Internet Internet Scalability Automotive 121

High Scalability

JULY 6, 2018

ThousandEyes : The Internet is made up of thousands of autonomous networks that are interdependent on one another to deliver traffic from point to point across the globe. tyingq : This is why AWS and Azure continue to gain market share in cloud, while Google remains relativity stagnant, despite (in many cases) superior technology.

Internet 110

Internet Internet Scalability Google 110

The Netflix TechBlog

OCTOBER 18, 2022

As Big data and ML became more prevalent and impactful, the scalability, reliability, and usability of the orchestrating ecosystem have increasingly become more important for our data scientists and the company. Motivation Scalability and usability are essential to enable large-scale workflows and support a wide range of use cases.

Java 211

Java Scalability Traffic Architecture 211

All Things Distributed

JUNE 21, 2018

As I have talked about before, one of the reasons why we built Amazon DynamoDB was that Amazon was pushing the limits of what was a leading commercial database at the time and we were unable to sustain the availability, scalability, and performance needs that our growing Amazon.com business demanded. The opposite is true.

Database 167

Database AWS Games Latency 167

All Things Distributed

AUGUST 16, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - The AWS GovCloud (US) Region. Today AWS announced the launch of the AWS GovCloud (US) Region. The concept of regions gives AWS customers control over the placement of their resources and services. All Things Distributed.

AWS 90

AWS Government Big Data Cloud 90

Dynatrace

NOVEMBER 17, 2020

PurePath 4 supports serverless computing out-of-the-box, including Kubernetes services from Amazon Web Services (AWS) , Microsoft Azure , and Google Cloud Platform (GCP). FaaS like AWS Lambda and Azure Functions are seamlessly integrated with no code changes. Technical scalability without limits.

Analytics 236

Analytics Technology Technology Cloud 236

The Netflix TechBlog

NOVEMBER 3, 2022

With traffic growth, a single leader node handling all request volume started becoming overloaded. Doing so would require a substantial migration effort to move all clients off the old API with questionable value to the affected teams (except for helping us solve Titus' internal scalability problems). queries/sec.

Cache 233

Cache Latency Traffic Systems 233

The Netflix TechBlog

MARCH 7, 2024

Compute: Titus Whereas open-source users of Metaflow rely on AWS Batch or Kubernetes as the compute backend , we rely on our centralized compute-platform, Titus. We have talked about the importance of a production-grade workflow orchestrator in the context of Metaflow when we released support for AWS Step Functions years ago.

Systems 235

Systems Media Cache Open Source 235

All Things Distributed

OCTOBER 2, 2017

We were pushing the limits of what was a leading commercial database at the time and were unable to sustain the availability, scalability and performance needs that our growing Amazon business demanded. So, we set out to build a fully hosted AWS database service based upon the original Dynamo design.

Internet 111

Internet Internet AWS Performance 111

Percona

OCTOBER 19, 2023

Welcome to the first installment of our series: Scalable Solutions with Percona Distribution for PostgreSQL. Then, in the upcoming part of this post, Scalable Solutions with Percona Distribution for PostgreSQL (Part 2): Using Citus , we will use these worker nodes to establish a multi-node Citus cluster and implement sharding techniques.

Scalability 107

Scalability Database Open Source Traffic 107

All Things Distributed

JUNE 21, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Amazon DynamoDB is the fastest growing new service in the history of AWS. In the five months since it launched in January, DynamoDB , our fast and scalable NoSQL database service, has been setting AWS growth records. Comments ().

Games 115

Games Scalability AWS Database 115

Dynatrace

AUGUST 5, 2019

In this role, I am leading a global team that works closely with our strategic partners such as AWS, Microsoft, Google, Pivotal, Red Hat and others. Resource consumption & traffic analysis. What is the network traffic going to be between services we migrate and those that have to stay in the current data center?

Cloud 38

Cloud Traffic Database Network 38

All Things Distributed

NOVEMBER 26, 2013

As I discussed in my re:Invent keynote earlier this month, I am now happy to announce the immediate availability of Amazon RDS Cross Region Read Replicas , which is another important enhancement for our customers using or planning to use multiple AWS Regions to deploy their applications. Cross Region Read Replicas are available for MySQL 5.6

Cloud 111

Cloud AWS Traffic Latency 111

Percona

FEBRUARY 24, 2023

Figure 1: PMM Home Dashboard From the Amazon Web Services (AWS) documentation , an instance is considered over-provisioned when at least one specification of your instance, such as CPU, memory, or network, can be sized down while still meeting the performance requirements of your workload and no specification is under-provisioned.

Cloud 133

Cloud Serverless AWS Storage 133

Dynatrace

MAY 17, 2023

It is available for the major OS and cloud platforms (for example, Windows, Linux, Solaris, AWS, Azure, and more) and only requires the deployment of a single service to monitor its environment. OneAgent is the native telemetry data collector and monitoring solution of Dynatrace.

Metrics 243

Metrics Database Monitoring Network 243

The Netflix TechBlog

AUGUST 16, 2023

That’s a significant amount and certainly more than is necessary relative to the traffic on most clusters. More acutely, if a traffic spike occurs and Zuul instances scale up, it exponentially increases connections open to origins. There is effectively no churn of connections, even at peak traffic.

Traffic 178

Traffic Servers Google Metrics 178

Scalegrid

JANUARY 8, 2024

Key Takeaways Multi-cloud involves using services from multiple cloud providers to gain flexibility and reduce vendor lock-in, while hybrid cloud combines private and public cloud resources to balance control and scalability. But what is the purpose behind this model? One downside of the hybrid cloud is related to downtime.

Cloud 147

Cloud Strategy Scalability Artificial Intelligence 147

Scalegrid

APRIL 5, 2024

It enhances scalability and manages traffic surges, though it requires specific client support and limits multi-key operations to a single hash slot. It offers automatic data sharding, master-replica configurations for high availability, and a scalable and flexible architecture to maintain consistent performance.

Scalability 130

Scalability Java Efficiency Database 130

All Things Distributed

MARCH 11, 2016

The epoch of AWS is the launch of Amazon S3 on March 14, 2006, now almost 10 years ago. Looking back over the past 10 years, there are hundreds of lessons that we’ve learned about building and operating services that need to be secure, reliable, scalable, with predictable performance at the lowest possible cost.

AWS 127

AWS Hardware Retail Virtualization 127

The Netflix TechBlog

DECEMBER 17, 2019

Nonetheless, we found a number of limitations that could not satisfy our requirements e.g. stalling the processing of log events until a dump is complete, missing ability to trigger dumps on demand, or implementations that block write traffic by using table locks. Blocking write traffic by locking tables. Writing events to any output.

Database 221

Database Traffic Transportation Open Source 221

All Things Distributed

NOVEMBER 12, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Today, Amazon Web Services has greater worldwide coverage with the launch of a new AWS Region in Sydney, Australia. Many young businesses as well as established enterprises are already using AWS, many of them targeting customers globally. Comments ().

Cloud 93

Cloud AWS Ecommerce Latency 93

The Netflix TechBlog

DECEMBER 17, 2019

Nonetheless, we found a number of limitations that could not satisfy our requirements e.g. stalling the processing of log events until a dump is complete, missing ability to trigger dumps on demand, or implementations that block write traffic by using table locks. Blocking write traffic by locking tables. Writing events to any output.

Database 206

Database Traffic Transportation Open Source 206