Knowledge Distillation

We propose SiNGER, a nullspace-guided LoRA framework that suppresses artifacts in Vision Transformer distillation while preserving informative representations, achieving state-of-the-art student performance.

Development of vision foundtaion model distillation method for real-time inference on mobility.