Simon Schug

smonsays

·

https://smn.one

smonsays

AI & ML interests

Postdoctoral researcher @Princeton

Recent Activity

updated a Space about 21 hours ago

smonsays/sgatlin

published a Space about 22 hours ago

smonsays/sgatlin

authored a paper 3 days ago

Discovering modular solutions that generalize compositionally

View all activity

Organizations

updated a Space about 21 hours ago

Sparsely gated tiny linear experts

A compute-efficient and interpretable transformer FFN layer

published a Space about 22 hours ago

Sparsely gated tiny linear experts

A compute-efficient and interpretable transformer FFN layer

authored 3 papers 3 days ago

Discovering modular solutions that generalize compositionally

Paper • 2312.15001 • Published Dec 22, 2023

Scaling can lead to compositional generalization

Paper • 2507.07207 • Published Oct 23, 2025

Sparsely gated tiny linear experts

Paper • 2606.07414 • Published 26 days ago