Dynatrace

JUNE 15, 2023

If your application runs on servers you manage, either on-premises or on a private cloud, you’re responsible for securing the application as well as the operating system, network infrastructure, and physical hardware. What are some key characteristics of securing cloud applications? These alerts tend to slow down development.

Cloud 245

Cloud Open Source Architecture Monitoring 245

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 121

Performance Latency Hardware Storage 121

O'Reilly

FEBRUARY 18, 2020

Up until 2017, the ML+AI topic had been amongst the fastest growing topics on the platform. After several years of steady climbing—and after outstripping Java in 2017—Python-related interactions now comprise almost 10% of all usage. Not necessarily: Java-related searches increased by 5% between 2017 and 2018. Coincidence?

Software Architecture 145

Software Architecture DevOps Data Engineering Architecture 145

Brendan Gregg

DECEMBER 31, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. A video of the talk is on youtube : The slides are on slideshare : I love this talk as I get to share more about what the Performance and Operating Systems team at Netflix does, rather than just my work.

Tuning 53

Tuning AWS Best Practices Network 53

Brendan Gregg

SEPTEMBER 5, 2017

What follows are topics that may be of interest to anyone looking to migrate their systems and skillset: scan these to find topics that interest you. ## ZFS ZFS is available for Linux via the [zfsonlinux] and [OpenZFS] projects, and more recently was included in Canonical's Ubuntu Linux distribution: Ubuntu Xenial 16.04 LTS (April 2016).

Virtualization 75

Virtualization AWS Engineering Hardware 75

Dynatrace

OCTOBER 17, 2019

Everything as Code can be described as a methodology or practice which consists of extending the idea of how applications are treated as code and applying these concepts to all other IT components like operating systems, network configurations, and pipelines. We went from managing five EC2 instances in 2011 to around 1,000 in 2017.

Code 167

Code Infrastructure DevOps Cloud 167

Brendan Gregg

DECEMBER 30, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. A video of the talk is on youtube : The slides are on slideshare : I love this talk as I get to share more about what the Performance and Operating Systems team at Netflix does, rather than just my work.

Tuning 52

Tuning AWS Best Practices Network 52

The Netflix TechBlog

JANUARY 22, 2021

channel surround sound in 2010, Dolby Atmos in 2017 , and adaptive bitrate audio in 2019. By using metadata and decode-side gain to normalize loudness, Netflix leverages xHE-AAC to minimize the total number of gain stages in the end-to-end system, maximizing audio quality. We began streaming 5.1

Programming 275

Programming Mobile Testing Network 275

All Things Distributed

NOVEMBER 13, 2018

Since then, AWS has added another PoP in Palermo in 2017. This helps support over 50 million searches every month on its networks across Italy. AWS also has a vibrant partner ecosystem in Italy as part of the AWS Partner Network (APN).

AWS 164

AWS Energy Automotive Traffic 164

The Netflix TechBlog

SEPTEMBER 13, 2021

Written by Jose Fernandez , Arthur Gonigberg , Julia Knecht , and Patrick Thomas In 2017, Netflix Studios was hitting an inflection point from a period of merely rapid growth to the sort of explosive growth that throws “how do we scale?” into every conversation. Examples include legacy mTLS and various webhook schemes?.

Internet 227

Internet Internet Cloud Traffic 227

All Things Distributed

OCTOBER 25, 2018

That's where we built many pioneering networking technologies, our next-generation software for customer support, and the technology behind our compute service, Amazon EC2. In 2017, we brought the Amazon Global Network to Africa, through AWS Direct Connect. Since then, we have seen an acceleration in AWS adoption.

AWS 167

AWS Cloud Education Programming 167

All Things Distributed

SEPTEMBER 29, 2016

The new region in France will be ready for customers to use in 2017. Our CDN and DNS network now has 18 points of presence across Europe, we have added a third AZ in Ireland, a second infrastructure region in Frankfurt and a third region in the UK (due in coming months). Cette nouvelle région sera disponible pour les clients dès 2017.

AWS 158

AWS IoT Internet Internet 158

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 103

Performance Latency Cache Virtualization 103

All Things Distributed

MAY 19, 2017

We decided to use our inventive powers to design and build a new database engine that would give database systems such as MySQL and PostgreSQL reliability and performance at scale, at a level that could serve even the most demanding OLTP applications.

Database 89

Database Design Cloud Storage 89

Scalegrid

AUGUST 27, 2024

Key features of RabbitMQ, such as message acknowledgments, complex routing, and asynchronous processing, contribute to system reliability and performance. By decoupling applications, message queues enable them to operate independently and asynchronously, which is crucial for maintaining efficiency and flexibility in complex systems.

Ecommerce 130

Ecommerce IoT Games Scalability 130

Brendan Gregg

NOVEMBER 28, 2017

In this configuration, the AMI and boot is paravirt (PV), the kernel is making hypercalls instead of privileged instructions, and the system is using paravirt network and storage drivers. But not all workloads: some are network bound (proxies) and storage bound (databases). ## 5. AWS called this [enhanced networking].

Virtualization 40

Virtualization AWS Hardware Storage 40

The Netflix TechBlog

JULY 1, 2019

Surface Cache Surface cache is a reserved pool in main memory (or separate graphics memory on a minority of systems) that the Netflix app uses for storing textures (decoded images and cached resources). those running the 2017 SDK?—?also The SNG files have a relatively large download size at ~1.5MB each.

Cache 167

Cache Design Testing Development 167

Brendan Gregg

OCTOBER 28, 2017

For my first trip to Paris I gave the closing keynote at [EuroBSDcon 2017] on performance methodologies, using FreeBSD 11.1 In the past I've shared similar methodologies applied to other operating systems, and finished porting them to BSD for this talk. EuroBSDcon 2017]: [link] [thread state analysis]: [link] [tstates.d]: [link]

Systems 47

Systems Performance C++ Operating System 47

All Things Distributed

SEPTEMBER 25, 2017

I'm also excited to announce today that we are launching an AWS Edge Network Location in the United Arab Emirates (UAE) in the first quarter of 2018. 2017 continues a busy year for AWS in the Middle East. The BIPA has moved their Learning Management System to AWS, reducing costs by over 90%.

Cloud 119

Cloud Education Energy Government 119

All Things Distributed

DECEMBER 12, 2018

In April 2017, Amazon Web Services announced that it would launch a new AWS infrastructure region Region in Sweden. We launched Edge Network locations in Denmark, Finland, Norway, and Sweden. The AWS Europe (Stockholm) Region is our fifth European Region, joining Dublin, Frankfurt, London, and Paris.

AWS 119

AWS Cloud Games Serverless 119

SQL Server According to Bob

MAY 19, 2019

The reduction effort started when we shipped SQL Server 2017 ( [link].) Partitioning allows SQL Server to scale to the largest systems with record-setting performance. When promoted to a super-latch on a 64 CPU system the memory requirement becomes 32 + (32 *64) = 2080 bytes. Networking Pump Threads. Async Pump Threads.

IoT 61

IoT Servers Development Cache 61

All Things Distributed

OCTOBER 2, 2017

With these requirements in mind, and a willingness to question the status quo, a small group of distributed systems experts came together and designed a horizontally scalable distributed database that would scale out for both reads and writes to meet the long-term needs of our business. This was the genesis of the Amazon Dynamo database.

Internet 111

Internet Internet AWS Performance 111

Alex Russell

JANUARY 30, 2024

It's time once again to update our priors regarding the global device and network situation. seconds on the target device and network profile, consuming 120KiB of critical path resources to become interactive, only 8KiB of which is script. What's changed since last year? and 75KiB of JavaScript. These are generous targets.

Performance 98

Performance Network Mobile Speed 98

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 52

Performance Latency Hardware Storage 52

Alex Russell

OCTOBER 22, 2017

We constrain ourselves to a real-world baseline device + network configuration to measure progress. — Alex Russell (@slightlylate) October 4, 2017. Budgets are scaled to a benchmark network & device. Tools and CI systems help them monitor progress & prevent regressions. The median user is on a slow network.

Performance 74

Performance Network Benchmarking Mobile 74

Percona

APRIL 12, 2023

Instead of relational (SQL) databases defined primarily through a hierarchy of related sets via tables and columns, their non-relational structure used a system of collections and documents. 2017: MongoDB goes public, trading as MDB. They came up with a horizontally scalable NoSQL database.

Open Source 98

Open Source Programming Database Servers 98

O'Reilly Software

APRIL 4, 2018

Are there inherent time relationships in the messages that need to be preserved as they travel across the system? As Tyler Akiadu, from Google, explained in his Strata NY 2017 presentation, “ Foundations of streaming SQL ”: “Streams are the in-motion form of data, both bounded and unbounded.” Clean and reprocess it? At least once?

Architecture 80

Architecture Scalability Google Operating System 80

Percona

JULY 7, 2023

Also, in general terms, a high availability PostgreSQL solution must cover four key areas: Infrastructure: This is the physical or virtual hardware database systems rely on to run. Without enough infrastructure (physical or virtualized servers, networking, etc.), there cannot be high availability.

Availability 98

Availability Open Source Architecture Database 98

Brendan Gregg

JULY 14, 2019

BPF (eBPF) tracing is a superpower that can analyze everything, and I'll show you how in my upcoming book BPF Performance Tools: Linux System and Application Observability , coming soon from Addison Wesley. A time where you can pose arbitrary questions of the system, and it can answer them.

Systems 40

Systems Performance Education Technology 40

Adrian Cockcroft

JANUARY 29, 2023

There is no way to model how much more traffic you can send to that system before it exceeds it’s SLA. This is unfortunate, because we’d really like to be able to build systems that have an SLA that we can share with the consumers of our interfaces, and be able to measure how well we are doing.

Lambda 98

Lambda Latency Cache C++ 98

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Alex Russell

APRIL 29, 2021

After 20 years of neck-in-neck competition, often starting from common code lineages, there just isn't that much left to wring out of the system. Consistent improvement is the name of the game, and it can still have positive impacts, particularly as users lean on the system more heavily over time. Delayed five years. Gamepad API.

Media 145

Media Games Education Engineering 145

Sutter's Mill

FEBRUARY 13, 2017

Additionally, low latency increasingly matters at all scales: In user interfaces, low latency means responsive apps and productive users without the dreaded “wait…” donut; in financial trading, low latency regularly saves large amounts of cash; in embedded real-time systems, low latency is crucial to meeting deadlines and can even save lives.

Latency 48

Latency C++ Hardware Performance 48

Alex Russell

MARCH 31, 2022

De-duplication can prevent multiple copies on disk, but we're out of luck on reducing network costs. Shared caches must make sense within this value system. Multiple factors contribute, including the pain of updates on slow networks and devices, systems that are out of disk space, and harmful interactions with AV software.

Cache 89

Cache Government Traffic Network 89

Abhishek Tiwari

DECEMBER 1, 2017

At re:Invent 2017, Amazon Web Services (AWS) announced Amazon Time Sync Service which provides a highly accurate and reliable global time reference. To use this service, AWS recommends to uninstall your default Network Time Protocol (NTP) package first and then install Chrony which is an alternative implementation of the NTP.

AWS 55

AWS Google Database Virtualization 55

Testsigma

JANUARY 29, 2021

That’s not all, the global mobile traffic is expected to increase sevenfold between 2017 and 2022. It also lets you perform mobile website testing on throttling network conditions – a scenario that is so real in today’s world where the usage of mobile internet is rising at an alarming rate! Mobile Friendliness Testing.

Website 98

Website Mobile Testing Strategy 98

SQL Performance

SEPTEMBER 17, 2019

For years SSRS was bundled with the installation of SQL Server, which helped add to some of the confusion around licensing and support for the product, so beginning with SSRS 2017, the installation package for Reporting Services is a separate download. Unlike the system database tempdb, ReportServerTempDB is not recreated at startup.

Tuning 67

Tuning Servers Database Best Practices 67