Open Source Summit Korea 2026

Machine learning is increasingly used in high-energy physics, particularly in trigger systems that process data at rates of 100 kHz while making real-time event selection decisions. The latency and reliability requirements demand highly optimized inference pipelines. While portable solutions such as ONNX Runtime simplify deployment, many applications rely on hardware-specific libraries like NVIDIA TensorRT and MIGraphX (via ROCm) for optimal performance. Code-generation approaches such as SOFIE offer additional efficiency but introduce integration complexity.

We present a unified inference interface that abstracts backend-specific details while preserving performance. It enables execution across multiple inference libraries without data copies or user-side configuration changes. An offline processor converts trained models into backend-optimized plans, and a lightweight runtime loads and executes them through a common API with direct data access for heterogeneous environments.