Companion models for Rearchitecting LLMs (Manning). Pruning, Distillation, Fine-Tuning, Attention Optimization & Activation Analysis for efficient SLM
Pere Martra
oopere
AI & ML interests
AI Research Engineer | Structured Pruning & LLM Efficiency | Fairness-Aware Optimization | Author “Rearchitecting LLMs” @Manning | 2K GitHub ⭐
Recent Activity
updated a dataset about 15 hours ago
oopere/clinical-ner-qdora updated a model about 15 hours ago
oopere/gemma-3-270m-14L-distilled updated a model about 15 hours ago
oopere/llama-3.2-3b-attn-drop-3Organizations
Companion models for Rearchitecting LLMs (Manning). Pruning, Distillation, Fine-Tuning, Attention Optimization & Activation Analysis for efficient SLM
FinLLMOpt is a comprehensive collection of optimized Financial Large Language Models (FinLLMs) designed to address various tasks in the financial doma
Created by pruning the MLP (feedforward) layers, reducing the size of Llama models while improving their performance.