Percona

MAY 1, 2023

Want to save money on your AWS RDS bill? I’ll show you some MySQL settings to tune to get better performance, and cost savings, with AWS RDS. This message is normally a side effect of a storage subsystem that is not capable of keeping up with the number of writes (e.g., The settings might not be optimal.

AWS 124

AWS Hardware Storage Tuning 124

Dynatrace

JULY 31, 2020

While to-date it’s been possible to integrate Dynatrace Managed for intelligent monitoring of services running on AWS and Azure, today we’re excited to announce the release of our Dynatrace Managed marketplace listing for the Google Cloud Platform. For more details, see Dynatrace Managed hardware and systems requirements.

Cloud 216

Cloud Availability Azure Google 216

Dynatrace

AUGUST 11, 2022

Cloud providers then manage physical hardware, virtual machines, and web server software management. Cloud providers such as Google, Amazon Web Services, and Microsoft also followed suit with frameworks such as Google Cloud Functions , AWS Lambda , and Microsoft Azure Functions. How does function as a service work?

Development 257

Development Serverless Best Practices Lambda 257

Dynatrace

DECEMBER 8, 2021

You may be using serverless functions like AWS Lambda , Azure Functions , or Google Cloud Functions, or a container management service, such as Kubernetes. As the entire application shares the same computing environment, it collects all logs in the same location, and developers can gain insight from a single storage area.

Cloud 232

Cloud Serverless Hardware Operating System 232

All Things Distributed

DECEMBER 12, 2018

In April 2017, Amazon Web Services announced that it would launch a new AWS infrastructure region Region in Sweden. Today, I'm happy to announce that the AWS Europe (Stockholm) Region, our 20th Region globally, is now generally available for use by customers. Public sector.

AWS 120

AWS Cloud Games Serverless 120

Dynatrace

NOVEMBER 3, 2022

Serverless container offerings such as AWS Fargate enable companies to manage and modify containers while abstracting server layers to offer customization without increased complexity. IaaS provides direct access to compute resources such as servers, storage, and networks. In FaaS environments, providers manage all the hardware.

Serverless 222

Serverless Azure Hardware Transportation 222

Dynatrace

JANUARY 16, 2023

Most Kubernetes clusters in the cloud (73%) are built on top of managed distributions from the hyperscalers like AWS Elastic Kubernetes Service (EKS), Azure Kubernetes Service (AKS), or Google Kubernetes Engine (GKE). Cloud-hosted Kubernetes clusters are on par to overtake on-premises deployments in 2023.

Open Source 347

Open Source Java Operating System Programming 347

The Morning Paper

MARCH 8, 2020

Building an elastic query engine on disaggregated storage , Vuppalapati, NSDI’20. This paper presents Snowflake design and implementation along with a discussion on how recent changes in cloud infrastructure (emerging hardware, fine-grained billing, etc.) But the ephemeral storage service for intermediate data is not based on S3.

Storage 112

Storage Engineering Cache Serverless 112

All Things Distributed

MARCH 11, 2016

The epoch of AWS is the launch of Amazon S3 on March 14, 2006, now almost 10 years ago. Given that AWS is a pioneer in building and operating these services world-wide, these lessons have been of crucial importance to our business. This is a given, whether you are using the highest quality hardware or lowest cost components.

AWS 127

AWS Hardware Retail Virtualization 127

Dynatrace

NOVEMBER 15, 2021

Driving this growth is the increasing adoption of hyperscale cloud providers (AWS, Azure, and GCP) and containerized microservices running on Kubernetes. Logs can include data about user inputs, system processes, and hardware states. In fact, the global log management market is expected to grow from 1.9 billion in 2020 to $4.1

Analytics 216

Analytics Monitoring Artificial Intelligence DevOps 216

High Scalability

OCTOBER 24, 2022

Each cloud-native evolution is about using the hardware more efficiently. For example, AWS created Nitro. Nitro is a revolutionary combination of purpose-built hardware and software designed to provide performance and security. Would Nitro have been invented if AWS was restricted to being a platform provider?

Cloud 187

Cloud Hardware Infrastructure Innovation 187

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. Note that my predictions in this talk may be wrong, but they should be thought provoking.

Performance 121

Performance Latency Hardware Storage 121

All Things Distributed

JANUARY 18, 2012

Amazon DynamoDB stores data on Solid State Drives (SSDs) and replicates it synchronously across multiple AWS Availability Zones in an AWS Region to provide built-in high availability and data durability. Customers can typically achieve average service-side in the single-digit milliseconds. History of NoSQL at Amazon â??

Scalability 164

Scalability Database Ecommerce Latency 164

Percona

FEBRUARY 24, 2023

Figure 1: PMM Home Dashboard From the Amazon Web Services (AWS) documentation , an instance is considered over-provisioned when at least one specification of your instance, such as CPU, memory, or network, can be sized down while still meeting the performance requirements of your workload and no specification is under-provisioned.

Cloud 123

Cloud Serverless AWS Storage 123

All Things Distributed

NOVEMBER 15, 2010

The early GPU systems were very vendor specific and mostly consisted of graphic operators implemented in hardware being able to operate on data streams in parallel. Programming the GPU evolved in a similar fashion; it started with the early APIs being mainly pass-through to the operations programmed in hardware. Contact Info.

AWS 127

AWS Programming Latency Architecture 127

All Things Distributed

AUGUST 16, 2012

The best practices that we are collecting in the AWS Economics Center are there to help our customers get a total view on their IT cost such that they can accurately compare on-premise and cloud. The AWS Economics Center now features the TCO of Web Applications whitepaper. Total Cost of Ownership.

AWS 99

AWS Hardware Traffic Best Practices 99

All Things Distributed

OCTOBER 8, 2014

The best part is that we are also significantly expanding the free tier many of you already enjoy by increasing the storage to 25 GB and throughput to 200 million requests per month. More than a decade ago, Amazon embarked on a mission to build a distributed system that challenged conventional methods of data storage and querying.

Availability 126

Availability Performance Scalability AWS 126

All Things Distributed

MAY 8, 2012

s announcement of Amazon RDS for Microsoft SQL Server and.NET support for AWS Elastic Beanstalk marks another important step in our commitment to increase the flexibility for AWS customers to use the choice of operating system, programming language, development tools and database software that meet their application requirements.

Cloud 94

Cloud Development AWS Servers 94

The Netflix TechBlog

FEBRUARY 9, 2021

This requires an asset storage solution. Asset Storage We refer to asset storage and management simply as asset management. We can leverage high performance VMs in AWS to generate the assets. We felt it would be beneficial to create a separate microservice for asset management for 2 reasons.

Engineering 172

Engineering Storage Latency Entertainment 172

All Things Distributed

OCTOBER 7, 2015

In AWS’ quest to enable the best data storage options for engineers, we have built several innovative database solutions like Amazon RDS, Amazon RDS for Aurora, Amazon DynamoDB, and Amazon Redshift. However, the data infrastructure to collect, store and process data is geared toward developers (e.g., Big data challenges.

Cloud 116

Cloud Big Data AWS Analytics 116

Dynatrace

AUGUST 5, 2019

In this role, I am leading a global team that works closely with our strategic partners such as AWS, Microsoft, Google, Pivotal, Red Hat and others. Lift & Shift is where you basically just move physical or virtual hosts to the cloud – essentially you just run your host on somebody else’s hardware.

Cloud 31

Cloud Traffic Database Network 31

All Things Distributed

AUGUST 24, 2012

The AWS team launched this week Amazon Glacier , a cold storage archive service at the very low price point of $0.01 In 1997 Jim revisted his caculations with the help of Goetz Graefe , and it details the impact of 10 years of hardware and pricing progress. By Werner Vogels on 24 August 2012 04:00 PM. Comments (). per GB/month.

Storage 87

Storage Hardware AWS Data Engineering 87

All Things Distributed

JULY 13, 2010

Additionally, many high-end HPC applications take advantage of knowing their in-house hardware platforms to achieve major speedup by exploiting the specific processor architecture. There is no more need for hardware tinkering to keep the clusters up and running (I spent many nights doing this; there is no glory in it). until today.

Cloud 99

Cloud AWS Automotive Latency 99

Scalegrid

JANUARY 8, 2024

Understanding Multi-Cloud and Hybrid Cloud Cloud computing has revolutionized the IT industry, offering a host of advantages including cost-effectiveness, increased agility, and access to cutting-edge hardware. In this scenario, two notable models – multi-cloud and hybrid cloud have emerged. But what do these entail?

Cloud 147

Cloud Strategy Scalability Artificial Intelligence 147

All Things Distributed

APRIL 5, 2012

Empowering innovation is at the heart of everything we do at Amazon Web Services (AWS). I often get to meet, discuss, and learn from innovators how they are using AWS to deliver transformative applications to their users, customers and partners. Troy: We moved our service from internal servers to AWS.

Innovation 116

Innovation AWS Education Network 116

All Things Distributed

SEPTEMBER 6, 2013

This spring I travelled through Europe for the AWS Global Summit series. Europe is a continent with much diversity and for each country there are great AWS customer examples to tell. To reach those goals, Shell in 2010 began using AWS. Shell leverages AWS for big data analytics to help achieve these goals.

Cloud 104

Cloud Energy AWS Healthcare 104

All Things Distributed

MARCH 11, 2015

AWS is enabling innovations in areas such as healthcare, automotive, life sciences, retail, media, energy, robotics that it is mind boggling and humbling. For example many of the Internet of Things innovations that we have seen come to life in the past years on AWS all have a significant analytics components to it.

Analytics 111

Analytics Cloud Healthcare Retail 111

Brendan Gregg

NOVEMBER 28, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. I'd expect between 0.1%

Virtualization 40

Virtualization AWS Hardware Storage 40

KeyCDN

FEBRUARY 22, 2023

The goal of WebAssembly is to execute at native speeds by taking advantage of common hardware features available on a variety of platforms. With cloud-based infrastructure, organizations can easily scale their web applications to handle increased traffic or demand without the need for expensive hardware upgrades.

Artificial Intelligence 111

Artificial Intelligence Development Serverless Website 111

Percona

JULY 1, 2023

Now that Database-as-a-service (DBaaS) is in high demand, there are multiple questions regarding AWS services that cannot always be answered easily: When should I use Aurora and when should I use RDS MySQL ? Amazon Aurora is a proprietary, cloud-native, fully managed relational database service developed by Amazon Web Services (AWS).

AWS 52

AWS Database Serverless Storage 52

The Polyglot Developer

MARCH 5, 2017

Not too long ago I wrote about an open source object storage software called Minio and how I was using it on my Raspberry Pi for backups. The great thing about Minio is it shares the same APIs as AWS S3, but can be deployed to your own hardware, eliminating Amazon as a dependency.

Storage 40

Storage Cloud Open Source Hardware 40

Scalegrid

JUNE 14, 2024

By employing techniques like indexing, query optimization, denormalization, and proper hardware configuration in MySQL, data retrieval operations can be significantly improved. Optimizing Data Models Optimizing data models in MySQL and Power BI is crucial for enhancing database performance and achieving faster data analysis and reporting.

Database 130

Database Azure Efficiency Servers 130

The Morning Paper

MARCH 3, 2020

It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. For Physalia, and for AWS more generally, the guiding principle is minimise the blast radius. NSDI’20.

Database 106

Database AWS Network Design 106

Percona

NOVEMBER 3, 2023

PostgreSQL Cluster One coordinator node citus-coord-01 Three worker nodes citus1 citus2 citus3 Hardware AWS Instance Ubuntu Server 20.04, SSD volume type 64-bit (x86) c5.xlarge The “wal_level” is set at logical. Redundancy can potentially decrease overall performance.

Database 109

Database Benchmarking Latency C++ 109

Brendan Gregg

FEBRUARY 28, 2023

Make sure your system can handle next-generation DRAM,” [link] Nov 2011 - [Hruska 12] Joel Hruska, “The future of CPU scaling: Exploring options on the cutting edge,” [link] Feb 2012 - [Gregg 13] Brendan Gregg, “Blazing Performance with Flame Graphs,” [link] 2013 - [Shimpi 13] Anand Lal Shimpi, “Seagate to Ship 5TB HDD in 2014 using Shingled Magnetic (..)

Performance 103

Performance Latency Cache Virtualization 103

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. Note that my predictions in this talk may be wrong, but they should be thought-provoking.

Performance 52

Performance Latency Hardware Storage 52

The Morning Paper

MAY 28, 2019

We don’t talk about energy as often as we probably should on this blog, but it’s certainly true that our data centres and various IT systems consume an awful lot of it. The goal is to produce a low-energy hardware classifier for embedded applications doing local processing of sensor data.

Energy 52

Energy Hardware Efficiency Architecture 52