UniSpark: Exploring Hybrid Attention for Multimodal Understanding and Generation
UniSpark combines full and linear attention to unify image understanding, generation, editing, and interleaved context. Its strongest gains appear in multimodal understanding.