Three optimizations raise Ling-3.0-flash throughput on DGX Spark
NVIDIA tested three combined techniques for mixture-of-experts inference on a single DGX Spark: Humming MXFP4 MoE kernels, an FP8 version of the language-model head, and built-in NEXTN speculative decoding. The test used Ant Group inclusionAI’s Ling-3.0-flash-fp4, a 124B-parameter model with 5.1B active parameters per token, running at batch size one on a system with 128 GB of unified memory.