Brendan Gregg

OCTOBER 8, 2018

eBPF was created by Alexei Starovoitov while at PLUMgrid (he's now at Facebook) as a generic in-kernel virtual machine, with software defined networks as the primary use case. Here's key differences as of August 2018: Type DTrace bpftrace. eBPF does more. eBPF is hard to use directly, so bcc was created as a Python front-end.

C++ 105

C++ Virtualization Programming Latency 105

High Scalability

OCTOBER 19, 2018

four petabytes : added to Internet Archive per year; 60,000 : patents donated by Microsoft to the Open Invention Network; 30 million : DuckDuckGo daily searches; 5 seconds : Google+ session length; 1 trillion : ARM device goal; $40B : Softbank investment in 5G; 30 : Happy Birthday IRC!; They'll love it and you'll be their hero forever.

Internet 123

Internet Internet Scalability Lambda 123

CSS Wizardry

MAY 31, 2019

This is exactly what Rawgit did in October 2018, yet (at the time of writing) a crude GitHub code search still yielded over a million references to the now-sunset service, and almost 20,000 live sites are still linking to it! Penalty: Network Negotiation. On a high latency connection, network overhead totals a whopping 5.037s.

Cache 275

Cache Latency Infrastructure Website 275

High Scalability

SEPTEMBER 21, 2018

From this data, the team found that internet service providers are “giving a fixed amount of bandwidth—typically something in the range of one and a half megabits per second to four megabits per second—to video traffic, but they don’t impose these limits on other network traffic.”

Internet 126

Internet Internet Scalability Traffic 126

The Netflix TechBlog

FEBRUARY 5, 2020

For our mobile environment, AV1 follows on our work with VP9, which we released as part of our mobile encodes in 2016 and further optimized with shot-based encodes in 2018. Selected titles are now available to stream in AV1 for customers who wish to reduce their cellular data usage by enabling the “Save Data” feature.

Media 169

Media Open Source Mobile Hardware 169

The Netflix TechBlog

FEBRUARY 5, 2020

For our mobile environment, AV1 follows on our work with VP9, which we released as part of our mobile encodes in 2016 and further optimized with shot-based encodes in 2018. Selected titles are now available to stream in AV1 for customers who wish to reduce their cellular data usage by enabling the “Save Data” feature.

Media 169

Media Open Source Mobile Hardware 169

High Scalability

JULY 6, 2018

ThousandEyes : The Internet is made up of thousands of autonomous networks that are interdependent on one another to deliver traffic from point to point across the globe. All that work to get two computers talking to each other and they ended up in the very same master-slave situation the network was supposed to eliminate.

Internet 110

Internet Internet Scalability Google 110

High Scalability

JUNE 22, 2018

OpenConnect, the ability to deploy the CDN directly into the internal network of these ISPs served multiple purposes--not the least of which was to expose the fact that they were holding Netflix for ransom. So, to say that was the executive foreseeing things is a bit of revisionist history.

Internet 113

Internet Internet Scalability Artificial Intelligence 113

High Scalability

JANUARY 24, 2019

For the first time in history, a VC-backed startup in 2018 was more likely to sell to a PE buyer than a fellow VC-backed company. Stand under Explain the Cloud Like I'm 10 (35 nearly 5 star reviews). 10% : Netflix captured screen time in US; 8.3 7x : faster PyPy python; 9B : gallons of water/day for lawns; 2.6

Internet 29

Internet Internet Scalability Games 29

The Netflix TechBlog

DECEMBER 23, 2020

In addition to the default Docker namespaces (mount, network, UTS, IPC, and PID), we employ user namespaces for added layers of isolation. By the end of 2018, we had moved all of our containers to run in unprivileged user namespaces successfully. We call this model “System Services”?—?one Why is this useful?

Media 297

Media Metrics Systems Processing 297

All Things Distributed

NOVEMBER 13, 2018

ENEL is using AWS to transform its entire business, closing all of their data centers by 2018, migrating workloads from over 6,000 on-premises servers onto AWS in nine months, and using AWS IoT services to better manage and understand energy consumption. This helps support over 50 million searches every month on its networks across Italy.

AWS 165

AWS Energy Automotive Traffic 165

High Scalability

MARCH 22, 2019

BrentToderian : What city went from 14% of all trips by bike in 2001, to 22% by 2012, then leaped to 30% in 3 years by 2015, & 35% by 2018? It has 41 mostly 5 star reviews. They'll learn a lot and love you even more.5 5 billion : weekly visits to Apple App store; $500m : new US exascale computer; $1.7

Internet 134

Internet Internet Scalability Wireless 134

O'Reilly

FEBRUARY 18, 2020

Growth is still strong for such a large topic, but usage slowed in 2018 (+13%) and cooled significantly in 2019, growing by just 7%. But sustained interest in cloud migrations—usage was up almost 10% in 2019, on top of 30% in 2018—gets at another important emerging trend. ML + AI are up, but passions have cooled. Security is surging.

Software Architecture 136

Software Architecture DevOps Data Engineering Architecture 136

The Netflix TechBlog

NOVEMBER 9, 2021

The specification of AV1 was published in 2018. We were very pleased to see that AV1 streaming improved members’ viewing experience, particularly under challenging network conditions. The improvement is particularly significant among sessions that experience serious network congestion and the lowest visual quality.

Media 246

Media Open Source Software Engineering Efficiency 246

High Scalability

JANUARY 4, 2019

By replacing branch-heavy algorithms with neural networks, the DBMS can profit from these hardware trends.". Explain the Cloud Like I'm 10 (34 almost 5 star reviews). copyconstruct : "GPUs will increase 1000× in performance by 2025, whereas Moore’s law for CPUs essentially is dead.

Internet 29

Internet Internet Scalability Healthcare 29

The Netflix TechBlog

FEBRUARY 20, 2019

Real-time scheduler run queue latency and tcp throughput charts after starting a wget download Many thanks to the great work by Andreas during his 2018 Google Summer of Code project. 10–20 MB/sec (it is, unsurprisingly, receiving lots of data). This allows us to create more complex single-pane dashboards. Charts are now resizable and movable.

Performance 217

Performance Latency Open Source Metrics 217

Dynatrace

APRIL 3, 2020

Starting with OneAgent 1.191, the USER parameter of the OneAgent installer will accept the following special value parameters: no_create : This parameter has been available since OneAgent version 1.145, released in June 2018.

Operating System 185

Operating System Monitoring Systems Code 185

Scalegrid

JULY 13, 2020

Recognized as the fastest growing database by popularity, PostgreSQL was named the DBMS of the year in both 2018 and 2017 by DB-Engines, and continues to grow in popularity in 2019. PostgreSQL is an open source object-relational database system with over 30 years of active development. In fact, PostgreSQL is so popular, 11.5%

Open Source 244

Open Source Tuning C++ Database 244

High Scalability

AUGUST 13, 2018

We do have new decentalized services : Bitcoin(2009), Minecraft(2009), Ethereum(2104), IPFS(2015), Mastadon(2016), and PeerTube(2018). The reason why decentralization came first is clear from a picture of the very first ARPA (Advanced Research Projects Agency) network, which later evolved into the internet we know and sometimes love today:

Internet 116

Internet Internet Google Scalability 116

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on.

Performance 121

Performance Latency Hardware Storage 121

The Netflix TechBlog

JANUARY 10, 2024

Cosmos As a response, in 2018 the CIS and ET teams started developing the next-generation platform, Cosmos. For the streaming use case, the generated videos are deployed to our content delivery network (CDN) for Netflix members to consume. The platform that had once served us well was now becoming a drag on development.

Processing 240

Processing Media Latency Innovation 240

Smashing Magazine

FEBRUARY 12, 2019

Webhosting Compared: Testing The Uptime Of 32 Hosts In 2018. Webhosting Compared: Testing The Uptime Of 32 Hosts In 2018. If you’re into each month overviews with more detailed data, take a look at these pages below: Detailed Google Spredsheet (1st of January to 31st of December 2018). John Stevens. 2019-02-12T12:00:22+01:00.

Testing 50

Testing Website Servers Availability 50

Brendan Gregg

APRIL 30, 2018

The CFP for LISA18 is open now, and we’d love for you to submit talks and tutorials ideas by May 24th, 2018. In 2018, for the first time, LISA will be in Nashville, Tennessee, October 29-31, and will be hosted at the Omni Nashville Hotel , next to the Country Music Hall of Fame and Museum.

DevOps 41

DevOps Network Best Practices Programming 41

Brendan Gregg

APRIL 29, 2018

The CFP for LISA18 is open now, and we’d love for you to submit talks and tutorials ideas by May 24th, 2018. In 2018, for the first time, LISA will be in Nashville, Tennessee, October 29-31, and will be hosted at the Omni Nashville Hotel , next to the Country Music Hall of Fame and Museum.

DevOps 40

DevOps Network Best Practices Programming 40

ACM Sigarch

APRIL 26, 2018

They use the graph as the basic representation for many AI-related algorithms, including neural network, Bayesian network, Markov Field, and some other emerging methods. More details can be found in their recent talk in Scaled Machine Learning in March 2018. GPU can also be considered as a special SPU.

Hardware 99

Hardware Artificial Intelligence Architecture Google 99

Dynatrace

MAY 9, 2019

This previous version of OneAgent for AIX introduced improved detection of IP addresses for network interfaces. LTS)—Oracle discontinued Premium Support in September 2018. LTS)—Oracle discontinued Premium Support in September 2018. For more information about monitoring modes, see Get started with infrastructure monitoring.

Java 100

Java AWS Cloud Monitoring 100

DZone

MARCH 27, 2020

Generally, we can say that: Web services are packet sized applications that communicate with each other via network but in a precise format. Web Service and Mobile App Testing. The output of one software used as an input to another reciprocally and the whole process executed with interface language like XML.

Mobile 147

Mobile Testing Hardware Network 147

Jos

JUNE 2, 2018

presented in Google IO 2018 ( source ) These tools make it easier to determine where we need to put emphasis to improve our sites. Simulate bad network conditions and slow CPUs and make your project resilient. They can be run as a one-off or integrated in our development and deployment pipelines. A screenshot of Lighthouse 3.0,

Performance 237

Performance Speed Google Media 237

Daniel Lemire

MARCH 18, 2019

Data structures like indexes can be saved to disk or transmitted over the network in such a form. get ( recipient ) ; Here is the time required to convert 1 million 32-bit integers on my 4.2GHz 2018 iMac: DataInputStream. It is common for binary data to be serialized to bytes. That is the case, for example, of a Roaring bitmap.

Java 124

Java C++ Code Speed 124

All Things Distributed

SEPTEMBER 25, 2017

Plus another AWS GovCloud (US) Region in the United States is coming online by the end of 2018. I'm also excited to announce today that we are launching an AWS Edge Network Location in the United Arab Emirates (UAE) in the first quarter of 2018.

Cloud 122

Cloud Education Energy Government 122

Abhishek Tiwari

DECEMBER 27, 2017

There are several emerging data trends that will define the future of ETL in 2018. In 2018, we anticipate that ETL will either lose relevance or the ETL process will disintegrate and be consumed by new data architectures. With the arrival of new cloud-native tools and platform, ETL is becoming obsolete. More details on this approach.

Big Data 49

Big Data Artificial Intelligence Storage Hardware 49

All Things Distributed

DECEMBER 13, 2016

By 2018, CARASSO is expected to process data collected by a fleet of 100,000 vehicles traveling more than eight billion kilometers. BMW built its new car-as-a-sensor (CARASSO) service in only six months leveraging several AWS services. We look forward to broadening this portfolio to include more services over the next several quarters.

AWS 157

AWS Cloud Artificial Intelligence IoT 157

All Things Distributed

APRIL 11, 2018

With Fargate, you don't need to stand up a control plane, choose the right instance type, or configure all the other components of your application stack like networking, scaling, service discovery, load balancing, security groups, permissions, or secrets management. This is the vision behind AWS Fargate.

Cloud 118

Cloud AWS Innovation Traffic 118

Dynatrace

OCTOBER 17, 2019

BOSH loves YAML (so it’s in good company with Kubernetes) and follows a declarative approach for defining the desired state of Cloud Foundry’s various components as well as the underlying virtual machines, networks, and storage devices.

Cloud 104

Cloud Virtualization Internet Internet 104

Alex Russell

JANUARY 30, 2024

It's time once again to update our priors regarding the global device and network situation. seconds on the target device and network profile, consuming 120KiB of critical path resources to become interactive, only 8KiB of which is script. What's changed since last year? and 75KiB of JavaScript. These are generous targets.

Performance 98

Performance Network Mobile Speed 98

The Morning Paper

FEBRUARY 11, 2020

ISRG subsequently established its own root trust anchor which was accepted into all major browser and platform root programs as of August 2018. Today, ISRG has more diverse funding sources; in 2018 it received 83% of its funding from corporate sponsors, 14% from grants and major gifts, and 3% from individual giving. The ACME protocol.

Internet 119

Internet Internet Open Source Transportation 119

Brendan Gregg

FEBRUARY 28, 2023

Make sure your system can handle next-generation DRAM,” [link] Nov 2011 - [Hruska 12] Joel Hruska, “The future of CPU scaling: Exploring options on the cutting edge,” [link] Feb 2012 - [Gregg 13] Brendan Gregg, “Blazing Performance with Flame Graphs,” [link] 2013 - [Shimpi 13] Anand Lal Shimpi, “Seagate to Ship 5TB HDD in 2014 using Shingled Magnetic (..)

Performance 103

Performance Latency Cache Virtualization 103