LoRA trained 10,000 times fewer parameters with comparable quality.
Teams fine-tune whole models to adapt them to a domain, needing big GPU clusters and long runs.
Researchers at Microsoft showed that LoRA trains 10,000 times fewer parameters and still does as well. GreenCode's own AI uses small, tuned models.
GreenCode helps tackle this by keeping its own AI lean: small fine-tuned models, retrieval so a model reads only what it needs, each request sent to the smallest part that can do it, and heavy jobs held for cleaner power. More on this.
Share this