11-12, August 2026 Seoul, South Korea View More Details & Registration Note: The schedule is subject to change.
The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for Open Source Summit Korea 2026 to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.
This schedule is automatically displayed in Korea Standard Time (KST), UTC +9. To see the schedule in your preferred timezone, please select from the drop-down menu to the right.
Sign up or log in to add sessions to your schedule and sync them to your phone or calendar.
Standard FP8 formats suffer from frequent gradient overflows and heavy reliance on complex Delayed Scaling, which often lead to training instability or suboptimal convergence in large models. This session introduces HiFloat8 (HiF8) — a tapered precision format that offers an alternative approach to managing dynamic range. This "natural" alignment with neural network weight/gradient distributions allows HiF8 to capture high-magnitude outliers without the aggressive scaling required by standard FP8.We explore how HiF8 can works in the training and inference procedure.We will demonstrate the implementation of HiF8 within the ecosystem. They allow developers to evaluate performance of Hif8 on GPUs. Also, we will give an analysis of training stability and final loss parity where HiF8 provides relatively the same accuracy and 1.5-1.7 times GEMM performance than FP16. Finally, we will share insights from our ongoing collaboration on dedicated hardware support for HiF8.
