Dynatrace

JUNE 10, 2024

They can also develop proactive security measures capable of stopping threats before they breach network defenses. For example, an organization might use security analytics tools to monitor user behavior and network traffic. But, observability doesn’t stop at simply discovering data across your network.

Analytics 264

Analytics Network Open Source Hardware 264

Dynatrace

MAY 1, 2023

This operational data could be gathered from live running infrastructures using software agents, hypervisors, or network logs, for example. Additionally, ITOA gathers and processes information from applications, services, networks, operating systems, and cloud infrastructure hardware logs in real time. Apache Spark.

Analytics 246

Analytics Artificial Intelligence Big Data Open Source 246

The Netflix TechBlog

NOVEMBER 9, 2021

We were very pleased to see that AV1 streaming improved members’ viewing experience, particularly under challenging network conditions. AV1 playback on TV platforms relies on hardware solutions, which generally take longer to be deployed. Throughout 2020 the industry made impressive progress on AV1 hardware solutions.

Media 246

Media Open Source Software Engineering Efficiency 246

Scalegrid

FEBRUARY 24, 2025

Imagine a bustling city with a network of well-coordinated traffic signals; RabbitMQ ensures that messages (traffic) flow smoothly from producers to consumers, navigating through various routes without congestion. Quorum queues can still function during a network partition as long as most nodes communicate.

Best Practices 147

Best Practices Traffic Strategy Scalability 147

Adrian Cockcroft

FEBRUARY 9, 2023

There are three current underlying reasons for the platform engineering meme today. The layers of platforms start at the bottom with hardware choices such as which CPU architectures and vendors you want to use. We used this model effectively at Netflix when I was their cloud architect from 2010 through 2013.

Engineering 136

Engineering Serverless Lambda AWS 136

The Morning Paper

NOVEMBER 10, 2019

Snap: a microkernel approach to host networking Marty et al., This paper describes the networking stack, Snap , that has been running in production at Google for the last three years+. You need a lot of software engineers and the willingness to rewrite a lot of software to entertain that idea. The little engine that could.

Network 92

Network Transportation Latency Entertainment 92

Dynatrace

NOVEMBER 1, 2022

These metrics help to keep a network system up and running?, Mean time to recovery (MTTR) measures the entire amount of time it takes to get a downed network or system back up and running. MTTF measures the reliability of a network and durability of its hardware. a critical task that’s easier said than done.

DevOps 276

DevOps Artificial Intelligence Metrics Network 276

Dynatrace

JUNE 29, 2022

They use the same hardware, APIs, tools, and management controls for both the public and private clouds. Amazon Web Services (AWS) Outpost : This offering provides pre-configured hardware and software for customers to run native AWS computing, networking, and services on-premises in a cloud-native manner.

Infrastructure 246

Infrastructure Cloud Azure AWS 246

Adrian Cockcroft

JANUARY 27, 2025

We had some fun getting hardware figured out, and I used a 3D printer to make some cases, but the whole project was interrupted by the delivery of the iPhone by Apple in late 2007. One of the Java engineers on my teamJian Wujoined me to help figure out the API. In September 2008 Netflix ran an internal hack day event.

C++ 88

C++ Mobile Hardware Java 88

Dynatrace

APRIL 5, 2021

You will likely need to write code to integrate systems and handle complex tasks or incoming network requests. As a bonus, operations staff never needs to update operating systems or hardware, because AWS manages servers with no stoppage of application functionality. Customizing and connecting these services requires code.

Lambda 258

Lambda AWS Serverless Hardware 258

Dynatrace

NOVEMBER 22, 2022

Five-nines availability has long been the goal of site reliability engineers (SREs) to provide system availability that is “always on.” Site reliability engineering teams often measure system availability in percentages in the pursuit of 100% uptime. Five-nines availability: The ultimate benchmark of system availability.

Infrastructure 246

Infrastructure Availability Systems Retail 246

The Netflix TechBlog

JUNE 4, 2019

The idea CFS operates by very frequently (every few microseconds) applying a set of heuristics which encapsulate a general concept of best practices around CPU hardware use. We could then feed this information directly into the optimization engine to move towards a more supervised learning approach.

Cache 258

Cache Latency Airlines Logistics 258

VoltDB

DECEMBER 11, 2024

By bringing computation closer to the data source, edge-based deployments reduce latency, enhance real-time capabilities, and optimize network bandwidth. Use hardware-based encryption and ensure regular over-the-air updates to maintain device security. Inconsistent network performance affecting data synchronization.

IoT 52

IoT Energy Logistics Latency 52

Dynatrace

SEPTEMBER 30, 2021

It requires purchasing, powering, and configuring physical hardware, training and retaining the staff capable of servicing and securing the machines, operating a data center, and so on. They need enough hardware to serve their anticipated volume and keep things running smoothly without buying too much or too little. Reduced cost.

Cloud 241

Cloud Traffic Best Practices Strategy 241

CSS Wizardry

OCTOBER 27, 2018

Things always always feel fast when we’re developing because, more often than not, we’re working on high-spec machines on dedicated networks, and also serving from localhost which removes the bulk of the latency and bandwidth issues that a real user would suffer. Who: Engineers. Who: Engineers, Product Owners.

Performance Testing 211

Performance Testing Testing Performance Strategy 211

The Morning Paper

NOVEMBER 15, 2020

An IDS/IPS monitors network flows and matches incoming packets (or more strictly, Protocol Data Units, PDUs) against a set of rules. Regular expression matching is well studied, but state of the art hardware algorithms don’t reach the performance and memory targets needed for Pigasus. IDS/IPS requirements. MPSM: First things first.

Servers 128

Servers Hardware Latency Design 128

The Netflix TechBlog

FEBRUARY 25, 2021

In all these cases, prior to being delivered through our content delivery network Open Connect , our award-winning TV shows, movies and documentaries like The Crown need to be packaged to enable crucial features for our members. Decryption modules need to be initialized with the appropriate scheme and initialization vector. We’re hiring!

Technology 190

Technology Technology Open Source Media 190

All Things Distributed

MARCH 11, 2016

Marvin Theimer, Amazon Distinguished Engineer, once jokingly said that the evolution of Amazon S3 could best be described as starting off as a single engine Cessna plane, but over time the plane was upgraded to a 737, then a group of 747s, all the way to the large fleet of Airbus 380s that it is now. The importance of the network.

AWS 127

AWS Hardware Retail Virtualization 127

The Morning Paper

MARCH 8, 2020

Building an elastic query engine on disaggregated storage , Vuppalapati, NSDI’20. This paper presents Snowflake design and implementation along with a discussion on how recent changes in cloud infrastructure (emerging hardware, fine-grained billing, etc.) From shared-nothing to disaggregation.

Storage 112

Storage Engineering Cache Serverless 112

Dynatrace

AUGUST 29, 2024

Real-time flight data monitoring setup using ADS-B (using OpenTelemetry) and Dynatrace The hardware We’ll delve into collecting ADS-B data with a Raspberry Pi, equipped with a software-defined radio receiver ( SDR ) acting as our IoT device, which is a RTL2832/R820T2 based dongle , running an ADS-B decoder software ( dump1090 ).

IoT 264

IoT Analytics Transportation Metrics 264

Brendan Gregg

NOVEMBER 29, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance. I'd expect between 0.1%

Virtualization 110

Virtualization AWS Hardware Storage 110

All Things Distributed

JULY 20, 2015

The pool of resources, at this time, is the CPU, memory, and networking resources of Amazon EC2 instances as partitioned by containers. networks ports, memory, CPU, etc). To be robust and scalable, this key/value store needs to be distributed for durability and availability, to protect against network partitions or hardware failures.

Latency 156

Latency Architecture AWS Open Source 156

Scalegrid

JULY 13, 2020

Recognized as the fastest growing database by popularity, PostgreSQL was named the DBMS of the year in both 2018 and 2017 by DB-Engines, and continues to grow in popularity in 2019. Oracle support for hardware and software packages is typically available at 22% of their licensing fees. In fact, PostgreSQL is so popular, 11.5%

Open Source 244

Open Source Tuning C++ Database 244

The Netflix TechBlog

DECEMBER 23, 2020

In addition to the default Docker namespaces (mount, network, UTS, IPC, and PID), we employ user namespaces for added layers of isolation. Our Media Cloud Engineering team wanted to leverage containers for a new platform they were building, called Archer.

Media 295

Media Metrics Processing Systems 295

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. Without enough infrastructure (physical or virtualized servers, networking, etc.),

Availability 132

Availability Database Open Source Hardware 132

Adrian Cockcroft

JANUARY 17, 2022

There were five trends and topics for 2021, Serverless First, Chaos Engineering, Wardley Mapping, Huge Hardware, Sustainability. The need for systems to be resilient is still increasing, and chaos engineering tools and techniques are developing as a key way to validate that resilience is working as designed.

Serverless 98

Serverless Hardware AWS Architecture 98

DZone

JANUARY 16, 2021

CPU consumption in Unix/Linux operating systems is broken down into 8 different metrics: User CPU time , System CPU time , nice CPU time , Idle CPU time , Waiting CPU time , Hardware Interrupt CPU time , Software Interrupt CPU time , and Stolen CPU time. In this article, let us study ‘waiting CPU time’. What Is ‘Waiting’ CPU Time?

Operating System 124

Operating System Hardware Network Metrics 124

All Things Distributed

MARCH 19, 2018

This post lifts the veil on some of the scientific, system design, and engineering decisions we made along the way. Amazon SageMaker training supports powerful container management mechanisms that include spinning up large numbers of containers on different hardware with fast networking and access to the underlying hardware, such as GPUs.

Scalability 129

Scalability Hardware AWS Tuning 129

All Things Distributed

APRIL 4, 2017

As well as AWS Regions, we also have 24 AWS Edge Network Locations in Europe. After finding it cost prohibitive to use colocation centers in local markets where their users are based, iZettle decided to give up hardware. In making the switch to AWS, WOW air has saved between $30,000 and $45,000 on hardware, and software licensing.

AWS 107

AWS Airlines Latency Games 107

Alex Russell

APRIL 29, 2021

Apple forces developers of competing browsers to use their engine for all browsers on iOS , restricting their ability to deliver a better version of the web platform. They are, pound for pound, some of the best engine developers globally and genuinely want good things for the web. So is speedy resolution and agreement.

Media 145

Media Games Education Engineering 145

Dotcom-Montior

OCTOBER 6, 2021

A site reliability engineer, or SRE, is a role that that encompasses aspects of both software engineering and operations/infrastructure. The term site reliability engineering first came into existence at Google in 2003 when a site reliability team was created. At that time, the team was made up of software engineers.

Engineering 67

Engineering DevOps Monitoring Google 67

All Things Distributed

APRIL 5, 2012

From tax preparation to safe social networks, Amazon RDS brings new and innovative applications to the cloud. Recently I had great conversations with Troy Otillio, Senior Development Manager at Intuit and Jack Murgia, Senior DevOps Engineer at Edmodo. Jack and his engineers have created a safe social app for teachers and students.

Innovation 112

Innovation AWS Education Network 112

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 121

Performance Latency Hardware Storage 121

CSS - Tricks

JULY 25, 2019

Lighthouse uses Chrome’s Remote Debugging Protocol to read network request information, measure JavaScript performance, observe accessibility standards and measure user-focused timing metrics like First Contentful Paint , Time to Interactive or Speed Index. Lighthouse is an open source project run by a dedicated team from Google Chrome.

Google 73

Google Engineering Speed Mobile 73

Dotcom-Montior

NOVEMBER 24, 2021

There was a time when standing up a website or application was simple and straightforward and not the complex networks they are today. These systems can include physical servers, containers, virtual machines, or even a device, or node, that connects and communicates with the network. The recipe was straightforward. Peer-to-Peer.

Systems 74

Systems Monitoring Hardware Network 74

All Things Distributed

JULY 13, 2010

Customers with complex computational workloads such as tightly coupled, parallel processes, or with applications that are very sensitive to network performance, can now achieve the same high compute and networking performance provided by custom-built infrastructure while benefiting from the elasticity, flexibility and cost advantages of Amazon EC2.

Cloud 98

Cloud AWS Automotive Latency 98

O'Reilly

SEPTEMBER 19, 2023

Doubly so as hardware improved, eating away at the lower end of Hadoop-worthy work. And that brings our story to the present day: Stage 3: Neural networks High-end video games required high-end video cards. Google goes a step further in offering compute instances with its specialized TPU hardware.

Hardware 135

Hardware Storage Big Data Blockchain 135