arxiv:2504.18919
Rafael Mosquera
remg1997
AI & ML interests
NLP, Speech, Diffusion
Recent Activity
updated a model 1 day ago
remg1997/modernbert-small-factorized-linear-dual-babylm2026 published a model 1 day ago
remg1997/modernbert-small-factorized-linear-dual-babylm2026 updated a model 1 day ago
remg1997/modernbert-small-phase7-zipfian-centering-babylm2026Organizations
models 22
remg1997/modernbert-small-factorized-linear-dual-babylm2026
Fill-Mask • 24.3M • Updated
remg1997/modernbert-small-phase7-zipfian-centering-babylm2026
Fill-Mask • 25.3M • Updated • 179
remg1997/modernbert-small-phase6-composition-frequency-shuffled-babylm2026
Fill-Mask • 25.3M • Updated • 55
remg1997/modernbert-small-phase6-composition-babylm2026
Fill-Mask • 21.4M • Updated • 176
remg1997/modernbert-small-modernbert-small-factorized-linear-babylm2026
Fill-Mask • 35.9M • Updated
remg1997/modernbert-small-phase7-zipfian-whitening-babylm2026
25.3M • Updated • 189
remg1997/modernbert-small-phase6-composition-residual-babylm2026
25.3M • Updated • 191
remg1997/modernbert-small-phase6-composition-frequency-babylm2026
25.3M • Updated • 118
remg1997/modernbert-small-muon-factorized-mlp-dual-babylm2026
24.3M • Updated • 1
remg1997/modernbert-small-muon-factorized-linear-dual-babylm2026
24.3M • Updated • 1