kashif/xtoken-distillation-bucket
Updated • 26
Kashif Rasul
kashif
AI & ML interests
Time Series Forecasting, Denoising Diffusion, Generative Modeling, Reinforcement Learning
Recent Activity
reacted to sergiopaniego's post with 🤗 about 10 hours ago
you can train DiffusionGemma (a block-diffusion LLM) in TRL! and we're sharing an example for it
TRL trainers are made to be easily extended and adapted to different real-world use cases.
in this one, with a single method overridden in SFTTrainer (compute_loss), you can train this model
> example: https://github.com/huggingface/trl/blob/main/examples/scripts/sft_diffusion_gemma.py upvoted a paper about 14 hours ago
Skillful joint probabilistic weather forecasting from marginals upvoted an article 1 day ago
Hugging Face on AMD Instinct MI455X: First Transformers ResultsOrganizations
