Dynatrace

FEBRUARY 4, 2021

Site reliability engineering (SRE) is the practice of applying software engineering principles to operations and infrastructure processes to help organizations create highly reliable and scalable software systems. For more about this ongoing conversation, see A guide to event-driven SRE-inspired DevOps.

Engineering 245

Engineering DevOps Government Latency 245

The Netflix TechBlog

NOVEMBER 3, 2022

In that scenario, the system would need to deal with the data propagation latency directly, for example, by use of timeouts or client-originated update tracking mechanisms. We started seeing increased response latencies and leader servers running at dangerously high utilization. The query rate in this test is set to 1K requests/second.

Cache 233

Cache Latency Traffic Systems 233

Dynatrace

NOVEMBER 6, 2023

In a recent webinar , Dynatrace DevOps activist Andi Grabner and senior software engineer Yarden Laifenfeld explored developer observability. Dynatrace enables teams to specify SLOs, such as latency, uptime, availability, and more. How do you know if this problem has business impact?

Development 290

Development DevOps Programming Cloud 290

Dynatrace

JULY 18, 2023

To handle this challenge, enterprises need to automate and streamline the onboarding and lifecycle of tool configurations in the software development processes, including aspects of observability, security, alerting, and remediation. Development teams must set up tailored configurations for each tool and component they’re responsible for.

Best Practices 246

Best Practices Code Infrastructure Latency 246

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 209 File system as a service at Netflix Kishore Kasi , Senior Software Engineer Abstract : As Netflix grows in original content creation, its need for storage is also increasing at a rapid pace. Technology advancements in content creation and consumption have also increased its data footprint. Wednesday?—?December

AWS 38

AWS Entertainment Open Source Benchmarking 38

The Netflix TechBlog

FEBRUARY 9, 2021

By offloading token processing from these systems to the central Edge Authentication Services, downstream systems saw significant gains in CPU, request latency, and garbage collection metrics, all of which help reduce cluster footprint and cloud costs. And, we’re hiring Senior Software Engineers !

Architecture 228

Architecture Latency Servers Website 228

Dynatrace

JANUARY 18, 2023

Site reliability engineering (SRE) is a software operations methodology that enables organizations to create highly reliable and scalable applications. SRE applies software engineering principles to operations and infrastructure processes. Site reliability engineers, or SREs, lead these efforts.

DevOps 246

DevOps Best Practices Innovation Strategy 246

The Netflix TechBlog

MAY 14, 2021

We are expected to process 1,000 watermarks for a single distribution in a minute, with non-linear latency growth as the number of watermarks increases. The goal is to process these documents as fast as possible and reliably deliver them to recipients while offering strong observability to both our users and internal teams.

Traffic 166

Traffic Java Latency Google 166

The Netflix TechBlog

APRIL 26, 2022

Low-latency Queries To avoid downloading all of the fact data from s3 in a spark executor and then dropping it, we analyzed our query patterns and figured out that there is a way to only access the data that we are interested in. and we had no additional information to optimize our queries.

Storage 195

Storage Design Scalability Latency 195

The Morning Paper

NOVEMBER 10, 2019

It’s been clear for a while that software designed explicitly for the data center environment will increasingly want/need to make different design trade-offs to e.g. general-purpose systems software that you might install on your own machines. The desire for CPU efficiency and lower latencies is easy to understand. Enter Google!

Network 92

Network Transportation Latency Entertainment 92

The Netflix TechBlog

FEBRUARY 9, 2021

Server-generated assets, since client-side generation would require the retrieval of many individual images, which would increase latency and time-to-render. To reduce latency, assets should be generated in an offline fashion and not in real time. Different assets for different device types and screen sizes.

Engineering 172

Engineering Storage Latency Entertainment 172

The Netflix TechBlog

NOVEMBER 20, 2023

As our business scales globally, the demand for data is growing and the needs for scalable low latency incremental processing begin to emerge. It serves thousands of users, including data scientists, data engineers, machine learning engineers, software engineers, content producers, and business analysts, in various use cases.

Processing 219

Processing Big Data Efficiency Engineering 219

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 209 File system as a service at Netflix Kishore Kasi , Senior Software Engineer Abstract : As Netflix grows in original content creation, its need for storage is also increasing at a rapid pace. Technology advancements in content creation and consumption have also increased its data footprint. Wednesday?—?December

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 209 File system as a service at Netflix Kishore Kasi , Senior Software Engineer Abstract : As Netflix grows in original content creation, its need for storage is also increasing at a rapid pace. Technology advancements in content creation and consumption have also increased its data footprint. Wednesday?—?December

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

JULY 12, 2019

This data-propagation latency was unacceptable?—?we The Tangible Result With the data propagation latency issue solved, we were able to re-implement the Gatekeeper system to eliminate all I/O boundaries. Traditional Hollow usage The problem with this total-source-of-truth iteration model is that it can take a long time.

Cache 184

Cache Architecture Engineering Latency 184

O'Reilly

MARCH 25, 2025

Were also betting that this will be a time of software development flourishing. With the advent of generative AI, therell be significant opportunities for product managers, designers, executives, and more traditional software engineers to contribute to and build AI-powered software. We tested both retrieval quality (e.g.,

Systems 67

Systems Development Tuning Monitoring 67

The Morning Paper

MARCH 3, 2020

The core algorithms (chain-replication, Paxos-based consensus) aren’t the stars of the show here, instead the paper focuses on how these algorithms are deployed, and the software engineering practices behind the creation of a mission-critical production system employing them. A guiding principle. Cells have seven nodes.

Database 106

Database AWS Network Design 106

The Morning Paper

JULY 4, 2019

Two failure modes we focus on are a service becoming slower (increase in response latency) or a service failing outright (returning errors). The criticality score is combined with a safety score and experiment weight (failure experiments, then latency, than failure inducing latency) to produce the final prioritization score.

Latency 77

Latency Engineering Metrics Traffic 77

O'Reilly

NOVEMBER 12, 2019

More than a fifth of the respondents work in the software industry—skewing results toward the concerns of software companies, and helping explain the preponderance of those with software engineering roles. As noted earlier, the majority of survey respondents are software engineers.

Serverless 94

Serverless Architecture FinTech Infrastructure 94

The Netflix TechBlog

AUGUST 16, 2023

System Metrics Given the significant reduction in connections, we saw reduced CPU utilization (~4%), heap usage (~15%), and latency (~3%) on Zuul, as well. In this case, we went from a subset size of 100 for 400 servers (a division of 4) to 50 (a division of 8).

Traffic 178

Traffic Servers Google Metrics 178

DZone

DECEMBER 8, 2021

A good SRE engineer will tell you your service is never down. A great SRE engineer will tell you that’s not what you should be measuring. In fact, they’ll tell you their job is customer service.

Engineering 245

Engineering Scalability Systems Traffic 245

Dotcom-Montior

OCTOBER 6, 2021

A site reliability engineer, or SRE, is a role that that encompasses aspects of both software engineering and operations/infrastructure. The term site reliability engineering first came into existence at Google in 2003 when a site reliability team was created. At that time, the team was made up of software engineers.

Engineering 67

Engineering DevOps Monitoring Google 67

The Netflix TechBlog

FEBRUARY 9, 2021

It also means fewer engineering teams are required to support initiatives in this space. Lower latency as a result of fewer service calls, which means fewer errors for our visitors. Configuration instead of code for updating SKU data, which improves innovation velocity. The world is constantly changing.

Engineering 145

Engineering Scalability Architecture Innovation 145

VoltDB

DECEMBER 8, 2017

As vendors and CSPs are faced with building these virtualized systems, it’s imperative to look at the software engineering methodologies that the IT industry has successfully applied to challenges at comparable scale. It’s accepted that new tooling is required, but there’s no consensus yet on standards.

Latency 40

Latency Virtualization Cloud Software Engineering 40

VoltDB

DECEMBER 8, 2017

As vendors and CSPs are faced with building these virtualized systems, it’s imperative to look at the software engineering methodologies that the IT industry has successfully applied to challenges at comparable scale. It’s accepted that new tooling is required, but there’s no consensus yet on standards.

Latency 40

Latency Virtualization Cloud Software Engineering 40

Randon ASCII

MARCH 20, 2019

And, FMA instructions often have lower latency than a multiply followed by an add instruction. On the Xbox 360 CPU the latency and throughput of FMA was the same as for fmul or fadd so using an FMA instead of an fmul followed by a dependent fadd would halve the latency. Emulating FMA. Hypothetically.

Games 48

Games Latency Software Engineering Programming 48

The Morning Paper

JANUARY 26, 2020

If the server-side responder is also being replayed, then Reverb inserts a new request into the server-side log… When the response is generated, Reverb buffers it and uses a model of network latency to determine where to inject the response into the client-side log.

Programming 86

Programming Servers Network Latency 86

O'Reilly

JULY 20, 2021

While techniques like federated learning are on the horizon, to avoid latency issues and mass data collection, it remains to be seen whether those techniques are satisfactory for companies that collect data. Is there a benefit to both organizations and their customers to limit or obfuscate the transmission of data away from the device?

Google 132

Google Games Technology Technology 132

Adrian Cockcroft

NOVEMBER 18, 2019

OPN304 Learnings from migrating a service from JDK 8 to JDK 11 AWS Lambda improved latency by migrating to JDK 11 with Amazon Corretto. Software Engineer, AWS Serverless Applications, and Yishai Galatzer, Senior Manager Software Development.

Open Source 40

Open Source AWS Lambda Serverless 40

Adrian Cockcroft

NOVEMBER 18, 2019

OPN304 Learnings from migrating a service from JDK 8 to JDK 11 AWS Lambda improved latency by migrating to JDK 11 with Amazon Corretto. Software Engineer, AWS Serverless Applications, and Yishai Galatzer, Senior Manager Software Development.

Open Source 40

Open Source AWS Lambda Serverless 40

Abhishek Tiwari

NOVEMBER 3, 2018

Using CDN for the whole website, you can offload most of the website traffic to your CDN which will handle not only large traffic spikes but also reduce the latency of content delivery. Secondly, having a CDN in front of origin (static site or APIs) reduces the global and regional latency.

Systems 63

Systems Cache Website Network 63