article thumbnail

Stuff The Internet Says On Scalability For September 14th, 2018

High Scalability

NSF : When the HL-LHC reaches full capability in 2026, it is expected to produce more than 1 billion particle collisions every second, marking a 10-fold increase that will require a similar 10-fold increase in data processing and storage, including tools to collect, analyze, and record the most relevant events.

article thumbnail

Stuff The Internet Says On Scalability For December 21st, 2018

High Scalability

And if you know someone with hearing problems they might find Live CC useful. 202,157 flights tracked! The first time we've tracked more than 200,000 flights in a single day on.

Internet 137
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Stuff The Internet Says On Scalability For July 20th, 2018

High Scalability

During our testing using the storage optimized EC2 instances (I3.2xlarge) we noticed that we were able to perform over 200K IOPS of 1K byte items thus meeting our throughput goals with latency rarely exceeding 1 millisecond.

Internet 121
article thumbnail

Stuff The Internet Says On Scalability For June 15th, 2018

High Scalability

They'll love you even more. 1.6x : better deep learning cluster scheduling on k8s; 100,000 : Large-scale Diverse Driving Video Database; 3rd : reddit popularity in the US; 50% : increase in Neural Information Processing System papers, AI bubble?

Internet 113
article thumbnail

Stuff The Internet Says On Scalability For June 22nd, 2018

High Scalability

using them to respond to storage events on s3 or database events or auth events is super easy and powerful. Three major roadmap updates in 29 days with serious spec changes, and it got worse from there. Xtracerx : for me the biggest value to serverless functions is how nicely they tie in to the ecosystem of a cloud provider.

Internet 113
article thumbnail

USENIX LISA2021 Computing Performance: On the Horizon

Brendan Gregg

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on.

article thumbnail

Stuff The Internet Says On Scalability For February 1st, 2019

High Scalability

Glacier is cheap because it isn't "always ready" storage. . $10.9B : Apple's Q1 services revenue; 5 million : homes on Airbnb; 2.5-5% They are trying to publish, to get jobs and promotions, to secure grants and so forth, but advancing science is a secondary concern. da_667 : The moral of the story here is that the cloud is NOT revolutionary.

Internet 146