High Scalability

OCTOBER 19, 2018

four petabytes : added to Internet Archive per year; 60,000 : patents donated by Microsoft to the Open Invention Network; 30 million : DuckDuckGo daily searches; 5 seconds : Google+ session length; 1 trillion : ARM device goal; $40B : Softbank investment in 5G; 30 : Happy Birthday IRC!; They'll love it and you'll be their hero forever.

Internet 123

Internet Internet Scalability Lambda 123

Brendan Gregg

JULY 15, 2019

BPF (eBPF) tracing is a superpower that can analyze everything, and I'll show you how in my upcoming book BPF Performance Tools: Linux System and Application Observability , coming soon from Addison Wesley. A time where you can pose arbitrary questions of the system, and it can answer them.

Systems 111

Systems Performance Education Technology 111

Brendan Gregg

OCTOBER 8, 2018

Created by Alastair Robertson , bpftrace is an open source high-level tracing front-end that lets you analyze systems in custom ways. eBPF (extended Berkeley Packet Filter) is in the Linux kernel and is the new hotness in systems engineering. Here's key differences as of August 2018: Type DTrace bpftrace. eBPF does more.

C++ 105

C++ Virtualization Programming Latency 105

High Scalability

SEPTEMBER 21, 2018

From this data, the team found that internet service providers are “giving a fixed amount of bandwidth—typically something in the range of one and a half megabits per second to four megabits per second—to video traffic, but they don’t impose these limits on other network traffic.” More quotes.

Internet 126

Internet Internet Scalability Traffic 126

High Scalability

JANUARY 24, 2019

For the first time in history, a VC-backed startup in 2018 was more likely to sell to a PE buyer than a fellow VC-backed company. The Smalltalk group is astonishingly insular, almost childlike, but is just now opening up, looking at other systems with open-eyed curiosity and fascination. 10% : Netflix captured screen time in US; 8.3

Internet 29

Internet Internet Scalability Games 29

O'Reilly

FEBRUARY 18, 2020

Growth is still strong for such a large topic, but usage slowed in 2018 (+13%) and cooled significantly in 2019, growing by just 7%. But sustained interest in cloud migrations—usage was up almost 10% in 2019, on top of 30% in 2018—gets at another important emerging trend. ML + AI are up, but passions have cooled. Security is surging.

Software Architecture 145

Software Architecture DevOps Data Engineering Architecture 145

The Netflix TechBlog

NOVEMBER 9, 2021

The specification of AV1 was published in 2018. We were very pleased to see that AV1 streaming improved members’ viewing experience, particularly under challenging network conditions. The improvement is particularly significant among sessions that experience serious network congestion and the lowest visual quality.

Media 246

Media Open Source Software Engineering Efficiency 246

High Scalability

MARCH 22, 2019

µs of replication latency on lossy Ethernet, which is faster than or comparable to specialized replication systems that use programmable switches, FPGAs, or RDMA.". BrentToderian : What city went from 14% of all trips by bike in 2001, to 22% by 2012, then leaped to 30% in 3 years by 2015, & 35% by 2018? We achieve 5.5

Internet 134

Internet Internet Scalability Wireless 134

All Things Distributed

NOVEMBER 13, 2018

ENEL is using AWS to transform its entire business, closing all of their data centers by 2018, migrating workloads from over 6,000 on-premises servers onto AWS in nine months, and using AWS IoT services to better manage and understand energy consumption. This helps support over 50 million searches every month on its networks across Italy.

AWS 164

AWS Energy Automotive Traffic 164

The Netflix TechBlog

JANUARY 10, 2024

This architecture shift greatly reduced the processing latency and increased system resiliency. By integrating with studio content systems, we enabled the pipeline to leverage rich metadata from the creative side and create more engaging member experiences like interactive storytelling.

Processing 238

Processing Media Latency Innovation 238

High Scalability

AUGUST 13, 2018

Decentralized systems will continue to lose to centralized systems until there's a driver requiring decentralization to deliver a clearly superior consumer experience. For all the idealistic technical reasons I laid out long ago in Building Super Scalable Systems: Blade Runner Meets Autonomic Computing In The Ambient Cloud.

Internet 116

Internet Internet Google Scalability 116

The Netflix TechBlog

FEBRUARY 20, 2019

Having the right metrics available on demand and at a high resolution is key to understanding how a system behaves and helps to quickly troubleshoot performance issues. Vector is an open-source host-level performance monitoring framework which we have been using for some time. 10–20 MB/sec (it is, unsurprisingly, receiving lots of data).

Performance 216

Performance Latency Open Source Metrics 216

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 121

Performance Latency Hardware Storage 121

All Things Distributed

JUNE 20, 2017

The new AWS Asia Pacific (Hong Kong) Region will have three Availability Zones and be ready for customers for use in 2018. As well as AWS Regions, we also have 21 AWS Edge Network Locations in Asia Pacific. AWS Partner Network (APN) Consulting Partners in Hong Kong help customers migrate to the cloud.

AWS 126

AWS Logistics Cloud Social Media 126

Brendan Gregg

APRIL 30, 2018

USENIX’s LISA conference is the premier event for topics in production system engineering. The CFP for LISA18 is open now, and we’d love for you to submit talks and tutorials ideas by May 24th, 2018. Join us for 3 days in Nashville at LISA'18. Post by Brendan Gregg and Rikki Endsley.

DevOps 41

DevOps Network Best Practices Programming 41

Brendan Gregg

APRIL 29, 2018

USENIX’s LISA conference is the premier event for topics in production system engineering. The CFP for LISA18 is open now, and we’d love for you to submit talks and tutorials ideas by May 24th, 2018. Join us for 3 days in Nashville at LISA'18. Post by Brendan Gregg and Rikki Endsley.

DevOps 40

DevOps Network Best Practices Programming 40

All Things Distributed

DECEMBER 13, 2016

By 2018, CARASSO is expected to process data collected by a fleet of 100,000 vehicles traveling more than eight billion kilometers. BMW built its new car-as-a-sensor (CARASSO) service in only six months leveraging several AWS services. Fraud.net is a good example of this.

AWS 155

AWS Cloud Artificial Intelligence IoT 155

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 103

Performance Latency Cache Virtualization 103

ACM Sigarch

MARCH 18, 2019

Computer systems, from the Internet-of-Things devices to datacenters, are complex and optimizing them can enhance capability and save money. Developing simulators, however, is time-consuming and requires a great deal of infrastructure development regarding a prospective system. an instruction or network transaction).

Systems 61

Systems Latency Performance Analytics 61

Abhishek Tiwari

DECEMBER 27, 2017

There are several emerging data trends that will define the future of ETL in 2018. In 2018, we anticipate that ETL will either lose relevance or the ETL process will disintegrate and be consumed by new data architectures. To achieve this, organizations are utilizing distributed messaging system such as Apache Kafka.

Big Data 49

Big Data Artificial Intelligence Storage Hardware 49

Speed Curve

FEBRUARY 10, 2025

Photo by Freepik Part of the answer is this: You have a lot of control over the design and code for the pages on your site, plus a decent amount of control over the first and middle mile of the network your pages travel over. The computer is a MacBook Pro they bought in 2018, so it still feels newish to them. Consider this scenario.

Hardware 52

Hardware Internet Internet Speed 52

All Things Distributed

APRIL 11, 2018

With Fargate, you don't need to stand up a control plane, choose the right instance type, or configure all the other components of your application stack like networking, scaling, service discovery, load balancing, security groups, permissions, or secrets management. This is the vision behind AWS Fargate.

Cloud 115

Cloud AWS Innovation Traffic 115

All Things Distributed

SEPTEMBER 25, 2017

Plus another AWS GovCloud (US) Region in the United States is coming online by the end of 2018. I'm also excited to announce today that we are launching an AWS Edge Network Location in the United Arab Emirates (UAE) in the first quarter of 2018.

Cloud 119

Cloud Education Energy Government 119

O'Reilly

JANUARY 13, 2020

As we noted last year, the release of Java 11 in September 2018 brought a raft of new features, including many that give the release a significant, clear advantage for using containers. “Originally, we were hoping async/await syntax could be part of the 2018 edition of Rust, but it took longer to get things right.”

Programming 144

Programming Java Google C++ 144

All Things Distributed

APRIL 4, 2017

The new AWS EU (Stockholm) Region will have three Availability Zones and will be ready for customers to use in 2018. As well as AWS Regions, we also have 24 AWS Edge Network Locations in Europe. AWS Partner Network (APN) Consulting Partners in the Nordics help customers migrate to the cloud.

AWS 107

AWS Airlines Latency Games 107

All Things Distributed

DECEMBER 12, 2018

We launched Edge Network locations in Denmark, Finland, Norway, and Sweden. In 2018, we launched the first Pop-Up Loft in Stockholm, offering a co-working space and access to technology and business experts to support the growth of Nordic organizations. Our AWS Europe (Stockholm) Region is open for business now.

AWS 119

AWS Cloud Games Serverless 119

Abhishek Tiwari

JANUARY 6, 2018

Kube-ops-view provides read-only system dashboard. Sysdig is container troubleshooting tool which captures system calls and events from the Linux kernel. Sysdig instruments your physical and virtual machines at the OS level by installing into the Linux kernel and capturing system calls and other OS events. Kube-ops-view.

Open Source 111

Open Source DevOps Engineering Storage 111

ACM Sigarch

MARCH 25, 2019

The M/M/1 queue also assumes that the arrival rate is not affected by the unbounded number of tasks in the queue (called an “open system”). Assume that a computer must handle network packets arriving unscheduled at a rate R = 10 packets/second with a goal of handling each packet with a total latency (including waiting) of L = 100 ms.

Systems 54

Systems Latency Performance C++ 54

All Things Distributed

DECEMBER 18, 2017

Over the last 11 years, AWS has expanded its physical presence in the country, opening an office in La Defense and launching Edge Network Locations in Paris and Marseille. In January 2018, customers will be able to connect via Equinix Paris in January and later in the year via Interxion Paris.

AWS 86

AWS Artificial Intelligence Education Energy 86

Testsigma

NOVEMBER 11, 2020

Having an effective test automation system is an absolute necessity in today’s agile software development environments. Network Disconnections. Network disconnection is a common automation challenge that a QA team faces wherein they find it hard to access databases, VPN, third party services, APIs, specific testing environments, etc.

Testing 85

Testing Mobile Network Analytics 85

Alex Russell

JANUARY 30, 2024

It's time once again to update our priors regarding the global device and network situation. seconds on the target device and network profile, consuming 120KiB of critical path resources to become interactive, only 8KiB of which is script. What's changed since last year? and 75KiB of JavaScript. These are generous targets.

Performance 98

Performance Network Mobile Speed 98

Smashing Magazine

OCTOBER 31, 2023

The truth is that the two tools were fairly distinct until PSI was updated in 2018 to use Lighthouse reporting. Chrome DevTools includes a separate “Performance” tab where the testing environment’s CPU and network connection can be artificially throttled to mirror a specific testing condition, such as slow internet speeds.

Speed 117

Speed Google Website Metrics 117

Tasktop

MAY 24, 2021

Citing the Navy’s “leadership factory”, he encouraged attendees to focus on tuning a system for building leaders, to give them the responsibility and ownership to hone their skills and come back “stronger” from missions. The admiral would no doubt admire what Jason Cox, Director of Platform & Systems Reliability, is doing at Disney.

DevOps 91

DevOps Metrics Healthcare Innovation 91

Brendan Gregg

OCTOBER 7, 2018

Created by Alastair Robertson , bpftrace is an open source high-level tracing front-end that lets you analyze systems in custom ways. eBPF (extended Berkeley Packet Filter) is in the Linux kernel and is the new hotness in systems engineering. Here's key differences as of August 2018: Type DTrace bpftrace. eBPF does more.

C++ 40

C++ Virtualization Programming Latency 40

Alex Russell

APRIL 29, 2021

After 20 years of neck-in-neck competition, often starting from common code lineages, there just isn't that much left to wring out of the system. Consistent improvement is the name of the game, and it can still have positive impacts, particularly as users lean on the system more heavily over time. Delayed five years. Gamepad API.

Media 145

Media Games Education Engineering 145

Smashing Magazine

DECEMBER 2, 2021

With the goals of sharing, openness and mentoring, you’re in for some great articles about systems administration topics written by fellow sysadmins. Tune in each day for an article that explores the wide range of topics in system administration. Christmas Experiments (2018). SysAdvent is back this year! ?? SysAdvent on Twitter.

Design 120

Design Development Programming Website 120

Smashing Magazine

SEPTEMBER 6, 2021

Next, we’ll look at how to set up servers and clients (that’s the hard part unless you’re using a content delivery network (CDN)). Using just a few (but still more than one), however, could nicely balance congestion growth with better performance, especially on high-speed networks. Servers and Networks.

Network 120

Network Servers Cache Traffic 120