Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. Ford, et al., “TCP

Performance 121

Performance Latency Hardware Storage 121

High Scalability

SEPTEMBER 14, 2018

72 : signals sensed from a distant galaxy using AI; 12M : reddit posts per month; 10 trillion : per day Google generated test inputs with 100s of servers for several months using OSS-Fuzz; 200% : growth in Cloud Native technologies used in production; $13 trillion : potential economic impact of AI by 2030; 1.8 They'll love you even more.

Internet 30

Internet Internet Scalability Education 30

Dynatrace

JUNE 1, 2023

Note : you might hear the term latency used instead of response time. Both latency and response time are critical to ensure reliability. Latency typically refers to the time it takes for a single request to travel from its source to its destination. Latency primarily focuses on the time spent in transit.

Traffic 173

Traffic Website Latency DevOps 173

High Scalability

DECEMBER 21, 2018

Tim Bray : How to talk about [Serverless Latency] · To start with, don’t just say “I need 120ms.” And if you know someone with hearing problems they might find Live CC useful. 202,157 flights tracked! Whether it’s database or message queues it’s a really weird combo of licenses and features for hostage.

Internet 137

Internet Internet Scalability Serverless 137

Dynatrace

AUGUST 5, 2019

In this role, I am leading a global team that works closely with our strategic partners such as AWS, Microsoft, Google, Pivotal, Red Hat and others. Remember: This is a critical aspect as you do not want to migrate a service and suddenly introduce high latency or costs to a system that you forgot about having a dependency with!

Cloud 38

Cloud Traffic Database Network 38

High Scalability

JULY 20, 2018

A typical example of modern "microservices-inspired" Java application would function along these lines: Netflix : We observed during experimentation that RAM random read latencies were rarely higher than 1 microsecond whereas typical SSD random read speeds are between 100–500 microseconds.

Internet 121

Internet Internet Scalability Automotive 121

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 103

Performance Latency Cache Virtualization 103

The Morning Paper

SEPTEMBER 10, 2019

Anchored in the primary use case of supporting Google’s YouTube business, what we’re looking at here could well be the future of data processing at Google. Google already has Dremel , Mesa , Photon , F1 , PowerDrill , and Spanner , so why did they need yet another data processing system? Procella system overview.

Analytics 75

Analytics Latency Cache Google 75

The Morning Paper

JUNE 23, 2019

Coupled with stateless application servers to execute business logic and a database-like system to provide persistent storage, they form a core component of popular data center service archictectures. The network latency of fetching data over the network, even considering fast data center networks. Who knew! ;). From RInK to LInK.

Cache 79

Cache Latency Google Network 79

Scalegrid

JANUARY 12, 2024

Examples include associations with Google Docs, Facebook chat group interactions, streaming live forex market feeds, and managing trading notices. Storage is a critical aspect to consider when working with cloud workloads. Just like a conductor orchestrating an ensemble of instruments to play at specific times for optimal performance.

Cloud 130

Cloud Virtualization Storage Efficiency 130

Scalegrid

MARCH 14, 2024

Public Cloud Infrastructure Third-party providers run public cloud services, delivering a broad array of offerings like computing power, storage solutions, and network capabilities that enhance the functionality of a hybrid cloud architecture. We will examine each of these elements in more detail.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

Alex Russell

JULY 14, 2021

Google's Search App and Facebook's various apps for Android undermine these choices in slightly different ways. [3] Developers also suffer higher costs and reduced opportunities to escape Google, Facebook, and Apple's walled gardens. Et Tu, Google? #. For a browser to serve as the user's agent, it must also receive navigations.

Google 134

Google Mobile Engineering Internet 134

Scalegrid

JANUARY 8, 2024

Artificial intelligence can automate tasks ranging from: data analysis resource provisioning system maintenance decision-making natural language processing This not only improves accuracy and reliability but also frees up valuable time for IT teams to focus on strategic tasks, such as resource management on platforms like Google Cloud.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

Smashing Magazine

SEPTEMBER 28, 2022

There are millions of sites, and you are in close competition with every one of those Google search query results. Caching partially stores your data and is not used as permanent storage. Using the cache as permanent storage is an anti-pattern. Agustinus Theodorus. 2022-09-27T14:00:00+00:00. 2022-09-27T16:33:12+00:00.

Cache 141

Cache Performance Servers Architecture 141

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. Ford, et al., “TCP

Performance 52

Performance Latency Hardware Storage 52

O'Reilly

NOVEMBER 12, 2019

latency, startup, mocking, etc.) Serverless presents a conceptually simpler path to deploying software for those in development roles with no need to manage servers and storage. customers who already like and use Azure or Google Cloud Platform are likely to find the same advantages hold with Azure Functions and Google Cloud Functions.

Serverless 94

Serverless Architecture FinTech Infrastructure 94

Smashing Magazine

NOVEMBER 9, 2021

Cloudinary is ideal to optimize performance, for two main reasons: The images are served via a CDN, located near the user browsing the site, greatly reducing the latency of the request; The service automatically compresses the images to the most optimal version, sparing this effort to the team. In both accounts, Cloudinary can help us out.

Website 122

Website Social Media Media Design 122

The Morning Paper

FEBRUARY 23, 2020

Our approach differs substantially by (1) providing economic incentives for data to be contributed and integrated into existing schemas, (2) offering a SQL interface instead of graph based approaches, (3) including the computational and storage infrastructure in the architectural vision. An embodiment for structured data for IoT.

Blockchain 94

Blockchain Internet Internet IoT 94

Alex Russell

APRIL 29, 2021

Chrome has missed several APIs for 3+ years: Storage Access API. It's possible that Amazon Luna , NVIDIA GeForce Go , Google Stadia , and Microsoft xCloud could have been built years earlier. A standard version of an approach demonstrated in Google's web applications to dramatically improve security. Where Chrome Has Lagged.

Media 145

Media Games Education Engineering 145

Dotcom-Montior

MAY 12, 2020

Websites are now more than just the storage and retrieval of information to present content to users. Network latency. Network Latency. With the evolution of cloud technologies, such as Single Page Applications (SPAs), Web APIs, and Model View Controller (MVC), network latency has become a crucial factor to be monitored.

Monitoring 63

Monitoring Entertainment Hardware Traffic 63

Dotcom-Montior

OCTOBER 6, 2021

The term site reliability engineering first came into existence at Google in 2003 when a site reliability team was created. One minute an SRE might be provisioning storage in AWS, the next minute an SRE might have to talk to customers or go write some Python code for a new project. Performance. Monitoring. Incident Response.

Engineering 67

Engineering DevOps Monitoring Google 67

O'Reilly

DECEMBER 2, 2019

For applications like communication between AVs, latency–how long it takes to get a response–is more likely to be a bigger limitation than raw bandwidth, and is subject to limits imposed by physics. There are impressive estimates for latency for 5G, but reality has a tendency to be harsh on such predictions.

Wireless 55

Wireless Serverless IoT Artificial Intelligence 55

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Alex Russell

MARCH 6, 2021

A then-representative $200USD device had 4-8 slow (in-order, low-cache) cores, ~2GiB of RAM, and relatively slow MLC NAND flash storage. Sadly, data on latency is harder to get, even from Google's perch, so progress there is somewhat more difficult to judge. The Moto G4 , for example.

Performance 127

Performance Network Mobile Metrics 127

Abhishek Tiwari

DECEMBER 27, 2017

It offers reliability and performance of a data warehouse, real-time and low-latency characteristics of a streaming system, and scale and cost-efficiency of a data lake. Delta implements the unified data management layer by extending the Amazon S3 object storage for ACID transactions and automatic data indexing.

Big Data 49

Big Data Artificial Intelligence Storage Hardware 49

Abhishek Tiwari

JULY 12, 2018

These nodes and edges require a good amount of compute and storage which is typically distributed across a large number servers either running in the cloud or your own data center. Every time data spikes - a phenomenon which will be not predictable in most cases - overall latency to process the data using data pipeline will go up.

Latency 63

Latency Analytics Scalability Engineering 63

Abhishek Tiwari

NOVEMBER 3, 2018

Using CDN for the whole website, you can offload most of the website traffic to your CDN which will handle not only large traffic spikes but also reduce the latency of content delivery. Alternatively, you can upload output directory to cloud object/blob storage such as Amazon S3 or Azure Blob Storage and serve your site from there.

Systems 63

Systems Cache Website Network 63

Percona

JULY 1, 2023

It efficiently manages read and write operations, optimizes data access, and minimizes contention, resulting in high throughput and low latency to ensure that applications perform at their best. While RDS MySQL supports multiple storage engines with varying capabilities, not all of them are optimized for crash recovery and data durability.

AWS 52

AWS Database Serverless Storage 52

Alex Russell

OCTOBER 22, 2017

Our metrics at Google show a conflicted picture (which I’m working to get to clarity on). It simulates a link with a 400ms RTT and 400-600Kbps of throughput (plus latency variability and simulated packet loss). Simulated packet loss and variable latency, however, can make benchmarking extremely difficult and slow.

Performance 74

Performance Network Benchmarking Mobile 74

Smashing Magazine

JANUARY 11, 2021

Assets Optimizations Brotli, AVIF, WebP, responsive images, AV1, adaptive media loding, video compression, web fonts, Google fonts. Run performance experiments and measure outcomes — both on mobile and on desktop (for example, with Google Analytics ). Adjust the argument depending on the group of stakeholders you are speaking to.

Performance 145

Performance Cache Metrics Media 145

Smashing Magazine

JANUARY 6, 2020

Run performance experiments and measure outcomes — both on mobile and on desktop (for example, with Google Analytics ). Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Adjust the argument depending on the group of stakeholders you are speaking to.

Performance 112

Performance Cache Servers Network 112

Smashing Magazine

JANUARY 7, 2019

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. In 2015, Google introduced Brotli , a new open-source lossless data format, which is now supported in all modern browsers. Unless you can use Google Fonts with Cloudflare Workers , of course. Assets Optimizations.

Performance 111

Performance Cache Network Metrics 111

Testsigma

FEBRUARY 12, 2021

By 2021, a distributed cloud would help companies physically put all services closely together, thereby addressing low-latency challenges, minimising the expense of storage and ensuring that data standards are consistent with the laws in a given geographical region. million Google Play Store applications, followed by 1.96

Artificial Intelligence 92

Artificial Intelligence Software Software IoT 92