Anyone got a success story they can share about fine-tuning an LLM?...

I'm looking for examples that produced commercial value beyond what could be achieved by prompting an existing hosted model - or waiting a month for the next generation of hosted models to solve the same problem

I haven't seen a writeup, but also heard from friends at Ramp that they got a lot of lift out of finetuning an OS model for extraction, a while ago
Jane Street did this as well for OCaml: youtube.com/watch?v=0ML7ZL…

x.com/brendanh0gan/s…

We did this explicitly for latency and cost purposes: the feature actually translates as you type in the UI, which required both <500ms latency, and would have been wasteful to do on a pay-per-token model like the hosted providers. We run it on our own pay-per-hour GPUs, allowing real time translation. Any UX that’s trying to feel like a tab-completion model (fast, user accept/reject) likely would benefit from similar approaches
docs.datadoghq.com/logs/explorer/…

Some details here:
vercel.com/blog/v0-compos…

blog.picnic.nl/adding-eyes-to…

From product taxonomy here: shopify.engineering/leveraging-mul…
To bespoke SQL generation for our agent. See ICML icml.cc/virtual/2025/4…
