Sathya77/telecom_plans
Viewer • Updated • 125 • 8
Santosh Kompella PRO
Sathya77
AI & ML interests
LLMs
Natural Language Processing (NLP)
Transformers
Deep Learning
Machine Learning
Recent Activity
posted an update 3 days ago
Built a ViT for ×4 image super-resolution from scratch in PyTorch — sharing the model.
No pretrained weights. Every component implemented from scratch: strided Conv2d patch embedding, multi-head self-attention across 1,024 tokens, 6 pre-norm transformer blocks, and a PixelShuffle reconstruction head for learned upsampling.
Trained on real-images from LSDIR dataset with fp16 AMP on a laptop GPU. Tiled inference handles arbitrary input sizes.
Current architecture: patch size 2, embed dim 64, 4 attention heads, 6 transformer blocks, ~786K parameters — test PSNR 23.30 dB.
The model handles broad structure well — fine textures and sharp edges need more capacity. Working on a larger configuration next.
🤗 Space: https://huggingface.co/spaces/Sathya77/ViT-ISR-Tiny-LSDIR
Feedback welcome — especially on the architecture choices. updated a model 4 days ago
Sathya77/ViT-ISR-Tiny-LSDIR published a model 4 days ago
Sathya77/ViT-ISR-Tiny-LSDIROrganizations
None yet