vesteinns.bsky.social
PhD student at the University of Copenhagen
Visiting researcher at ETH Zurich '24-'25
ELLIS student doing NLP, CV, ML
https://vesteinn.is
1 posts
834 followers
739 following
Getting Started
comment in response to
post
LoQT: Low-Rank Adapters for Quantized Pretraining: neurips.cc/virtual/2024...
Authors: @sloeschcke.bsky.social, @madstoftrup.bsky.social, @mkastoryano.bsky.social, @serge.belongie.com, @vesteinns.bsky.social
🗓️ West Ballroom A-D #6104 - Thu 12 Dec 4:30 p.m. PST — 7:30 p.m. PST
(2/5)
comment in response to
post
Excited to see LoQT adopted in memory-constrained settings, lowering the barrier to training models such as LLMs!
Great collaboration with @mabeto5p, @mjkastoryano, @sergebelongie.bsky.social , @vesteinns.bsky.social
Code: github.com/sebulo/LoQT 💻
Paper: arxiv.org/abs/2405.16528 📄