arxiv:2401.17461
Yelaman Abdullin
eabdullin
AI & ML interests
Research engineer working on generative and multimodal AI. Interested in LLMs, evaluation, post-training, reasoning, and custom model experiments.
Recent Activity
repliedto their post about 2 hours ago
I’m doing a PhD in AI, which sounds impressive until you realize it mostly means I spend three years trying to make a computer say something slightly less stupid than it said yesterday.
People hear "AI researcher" and they think I’m building the future. No. I’m in a basement at 2 a.m. Googling, "CUDA error what the f**k does this mean."
And the worst part about AI research now is compute. You don’t even ask, "Is this idea good?" anymore. You ask, "Can I afford for this idea to be wrong?"
My advisor comes to me one day and says, "I think we should fine-tune our own language model."
I said, "Professor, with what money? I’m a PhD student. I have two bank accounts: checking and emotionally checking."
He goes, "Don’t worry. We have compute."
Now, in academia, "don’t worry" is never the beginning of a good sentence.
I said, "What do you mean we have compute?"
He said, "My friend knows the cluster admin. He can get us on the GPUs."
I said, "Okay… what do we have to do?"
He goes, "Nothing crazy. Just be very grateful in the acknowledgements."
I said, "How grateful?"
He said, "Maybe put him as co-author."
I said, "Co-author? Are we using the cluster, or is the cluster using us?"
Because at that point, that’s not a favor. That’s academic child support.
So I go to the server room, and the cluster admin walks up to me and goes, "So you’re the NLP student."
And in my head I’m like, "No, tonight you’re the principal investigator. You’re the provider. I’m just a little token waiting to be attended to."
Because whoever controls the GPUs controls the relationship. That’s lab romance.
He starts setting things up, and I’m trying to act casual, but I don’t understand any of the numbers he’s saying.
He’s like, "Yeah, I can probably give you four H100s for the weekend."
I’m nodding like, "Mmm. Four. Weekend. H. One hundred. Absolutely."
Inside I’m like, "Is that good? Is that prison time? Why did he say it like he was offering me organs?"
[Continue in comments...] posted an update about 2 hours ago
I’m doing a PhD in AI, which sounds impressive until you realize it mostly means I spend three years trying to make a computer say something slightly less stupid than it said yesterday.
People hear "AI researcher" and they think I’m building the future. No. I’m in a basement at 2 a.m. Googling, "CUDA error what the f**k does this mean."
And the worst part about AI research now is compute. You don’t even ask, "Is this idea good?" anymore. You ask, "Can I afford for this idea to be wrong?"
My advisor comes to me one day and says, "I think we should fine-tune our own language model."
I said, "Professor, with what money? I’m a PhD student. I have two bank accounts: checking and emotionally checking."
He goes, "Don’t worry. We have compute."
Now, in academia, "don’t worry" is never the beginning of a good sentence.
I said, "What do you mean we have compute?"
He said, "My friend knows the cluster admin. He can get us on the GPUs."
I said, "Okay… what do we have to do?"
He goes, "Nothing crazy. Just be very grateful in the acknowledgements."
I said, "How grateful?"
He said, "Maybe put him as co-author."
I said, "Co-author? Are we using the cluster, or is the cluster using us?"
Because at that point, that’s not a favor. That’s academic child support.
So I go to the server room, and the cluster admin walks up to me and goes, "So you’re the NLP student."
And in my head I’m like, "No, tonight you’re the principal investigator. You’re the provider. I’m just a little token waiting to be attended to."
Because whoever controls the GPUs controls the relationship. That’s lab romance.
He starts setting things up, and I’m trying to act casual, but I don’t understand any of the numbers he’s saying.
He’s like, "Yeah, I can probably give you four H100s for the weekend."
I’m nodding like, "Mmm. Four. Weekend. H. One hundred. Absolutely."
Inside I’m like, "Is that good? Is that prison time? Why did he say it like he was offering me organs?"
[Continue in comments...] commentedon a paper 11 months ago
Energy-Based Transformers are Scalable Learners and ThinkersOrganizations
None yet