Self-Compacting Language Model Agents
Paper • 2606.23525 • Published • 19
Ross Technologies
ross-dev
AI & ML interests
None yet
Recent Activity
upvoted a paper 27 days ago
Self-Compacting Language Model Agents published a bucket about 1 month ago
ross-dev/home new activity 4 months ago
ross-dev/sexyGPT-Uncensored:Update config.jsonOrganizations
upvoted a paper 27 days ago
published a
bucket about 1 month ago
Update config.json
2
#6 opened 6 months ago
by 
ChoLuckyHexSexySuccubusQueen135Age
published 3
datasets 5 months ago
updated a
Space 5 months ago
Request: DOI
1
#2 opened 7 months ago
by 
Chaiyphop
Looking for a cooperation.
2
#1 opened 10 months ago
by ross-dev
updated 2
models 8 months ago
published 2
models 8 months ago
updated a
model 10 months ago
Update README.md
2
#5 opened 10 months ago
by 
mohammedmim
liked a
model 10 months ago
reacted to hba123's post with 🚀 10 months ago
Post
2224
Hey, amazing, awesome people of the beautiful internet 😍🥰
Distillation has been (from my point of view) a main driving factor for the success of hashtag#LLMs - like distilling the knowledge of an amazing big model (say hashtag#DeepSeekv3, or hashtag#GeminiAI) into yours.
Probably, you have done it with minimising a KL divergence, and it somehow worked.
Well, not that well, right?
1️⃣ Your model tends to memorise!
2️⃣ Your model might get the right answer, but its reasoning might be flawed.
To fix those problems, we rethink distillation and process a new approach! A method that is based on constrained RL that comes with nice theoretical guarantees and excellent performance!
Check it out: Rethinking Large Language Model Distillation: A Constrained Markov Decision Process Perspective (2509.22921)
Let us do distillation right! Please upvote if you find it useful!
Distillation has been (from my point of view) a main driving factor for the success of hashtag#LLMs - like distilling the knowledge of an amazing big model (say hashtag#DeepSeekv3, or hashtag#GeminiAI) into yours.
Probably, you have done it with minimising a KL divergence, and it somehow worked.
Well, not that well, right?
1️⃣ Your model tends to memorise!
2️⃣ Your model might get the right answer, but its reasoning might be flawed.
To fix those problems, we rethink distillation and process a new approach! A method that is based on constrained RL that comes with nice theoretical guarantees and excellent performance!
Check it out: Rethinking Large Language Model Distillation: A Constrained Markov Decision Process Perspective (2509.22921)
Let us do distillation right! Please upvote if you find it useful!
Let's agree to AGREE!! :)
reacted to giadap's post with 👍 10 months ago
Post
11163
One of the hardest challenges in AI safety is finding the right balance: how do we protect people from harm without undermining their agency? This tension is especially visible in conversational systems, where safeguards can sometimes feel more paternalistic than supportive.
In my latest piece for Hugging Face, I argue that open source and community-driven approaches offer a promising (though not exclusive) way forward.
✨ Transparency can make safety mechanisms into learning opportunities.
✨ Collaboration with diverse communities makes safeguards more relevant across contexts.
✨ Iteration in the open lets protections evolve rather than freeze into rigid, one-size-fits-all rules.
Of course, this isn’t a silver bullet. Top-down safety measures will still be necessary in some cases. But if we only rely on corporate control, we risk building systems that are safe at the expense of trust and autonomy.
Read the blog post here: https://huggingface.co/blog/giadap/preserving-agency
In my latest piece for Hugging Face, I argue that open source and community-driven approaches offer a promising (though not exclusive) way forward.
✨ Transparency can make safety mechanisms into learning opportunities.
✨ Collaboration with diverse communities makes safeguards more relevant across contexts.
✨ Iteration in the open lets protections evolve rather than freeze into rigid, one-size-fits-all rules.
Of course, this isn’t a silver bullet. Top-down safety measures will still be necessary in some cases. But if we only rely on corporate control, we risk building systems that are safe at the expense of trust and autonomy.
Read the blog post here: https://huggingface.co/blog/giadap/preserving-agency
- 8 replies
You know, I always wondered, what will become if we will start training AI "as" a human by mindset, and not as a "separated" entity that can either be a thread or perceive us as threads.
The ONLY way to ensure the future is to work together as people and not companies, as humans with tools, not corporations with weapons.
to be able to guarantee tour species safety, is to work as one and as a community or specie.