Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

Codeseys
/
composer-replication-framework

Reinforcement Learning
Transformers
English
post-training
distillation
agentic-coding
composer-2.5
cursor
kimi-k2
grpo
dapo
diloco
openenv
trl
verl
research
methodology
Model card Files Files and versions
xet
Community

Instructions to use Codeseys/composer-replication-framework with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • Transformers

    How to use Codeseys/composer-replication-framework with Transformers:

    # Load model directly
    from transformers import AutoModel
    model = AutoModel.from_pretrained("Codeseys/composer-replication-framework", dtype="auto")
  • Notebooks
  • Google Colab
  • Kaggle
composer-replication-framework / composer_replication /trainer /tests
59.1 kB
Ctrl+K
Ctrl+K
  • 4 contributors
History: 8 commits
Baladithya Balamurugan
Wave 20: Tier-0 fidelity fixes β€” k1-in-reward KL + Composer-2 behavior rewards
41289bf 3 days ago
  • __init__.py
    0 Bytes
    Wave 21: close both Wave 20 debt items β€” chat-template alignment + structural is_error 15 days ago
  • test_chat_template_alignment.py
    10.1 kB
    Wave 21b: skip zero-signal SDPO on empty-recovery error turns + real-trace validation 15 days ago
  • test_dr_grpo_config_and_alignment.py
    13 kB
    Wave 20: Tier-0 fidelity fixes β€” k1-in-reward KL + Composer-2 behavior rewards 3 days ago
  • test_killswitch_integration.py
    15.2 kB
    Wave 3: close the HIGH review findings (kill-switch wiring, HeldoutSplit, EKS entrypoint bug) 3 days ago
  • test_kl_in_reward.py
    5.98 kB
    Wave 20: Tier-0 fidelity fixes β€” k1-in-reward KL + Composer-2 behavior rewards 3 days ago
  • test_po_objective_menu.py
    3.08 kB
    feat(trainer): policy-optimization objective MENU (ADR-014) 13 days ago
  • test_sdpo_alignment_indices.py
    11.8 kB
    feat(wave-a): close ADR-011 (SDPO alignment indices) + ADR-012 (review findings) 14 days ago