Dynatrace

OCTOBER 2, 2023

Use SLAs, SLOs, and SLIs as performance benchmarks for newly migrated microservices. As an AI-driven, unified observability and security platform, Dynatrace uses topology and dependency mapping and artificial intelligence to automatically identify all entities and their dependencies.

Architecture 278

Architecture Artificial Intelligence Cloud Open Source 278

O'Reilly

MARCH 25, 2025

Evaluation : How do we evaluate such systems, especially when outputs are qualitative, subjective, or hard to benchmark? Iteration: Iterate quickly using prompt engineering, embeddings, tool use, fine-tuning, business logic, and more! Iteration : We know we need to experiment with and iterate on these system. How do we do so?

Systems 67

Systems Development Tuning Monitoring 67

O'Reilly

JULY 25, 2023

Perhaps future AI tool developers could use Swift Papers as a benchmark to assess how well their tool performs on an example real-real-world programming task. Right now, widely-used benchmarks for AI code generation (e.g., Right now, widely-used benchmarks for AI code generation (e.g.,

Programming 98

Programming Code Design Benchmarking 98