EvalHub is an evaluation orchestration service for large language models (LLMs) on Red Hat AI. The service provides a versioned REST API to unify multi-framework testing by executing benchmarks within isolated, horizontally scalable Kubernetes jobs. By managing these workflows automatically, the platform tracks experiment lineage in MLflow and persists immutable performance metrics as Open Contain...