
Nous Research Proposes Lighthouse Attention: A Training-Only Selection-Based Hierarchical Attention That Delivers 1.4–1.7× Pretraining Speedup at Long Context
Nous Research introduces Lighthouse Attention, a hierarchical attention mechanism that reduces computational complexity...
















