Insane AI progress New method fine tunes language models with...

New method fine tunes language models with minimal data, achieving equal or better accuracy than traditional methods while using over 300–400x fewer parameters.
Engineers at UC San Diego developed a new method to fine tune large language models using far less data and computing power.
Instead of retraining all parameters, the approach updates only the most important ones, making it cheaper, faster, and better at generalizing.
In tests on protein language models, it achieved equal or better accuracy than traditional methods while using over 300–400x fewer parameters.
"With our method, even small labs and startups without huge budgets, supercomputer-level resources or large datasets can adapt large AI models for their own needs"

