What the study found
> A new ArXiv preprint (arXiv:2609.27262v1) from the Computation and Language category studies how to fine-tune LLMs for customer-support skills such as intent classification, question answering, summarization, and tool-use decisions. The authors say multi-task full fine-tuning was the strongest operational default at every model size they tested. Specialist models performed well on their own tasks but often degraded sharply off-task, which the authors say makes reliable routing important. [1]
Methods and other strategies
> The experiments covered thirteen models from five families — Qwen3, Qwen3.5, Gemma-3, Llama-3.1, and Mistral — ranging from 0.6B to 32B parameters, across eight customer-support datasets (four public, four proprietary; roughly 74.5k training and 8.7k evaluation samples). The authors say they trained more than 200 checkpoints under a fixed protocol. They report that sequential Low-Rank Adaptation (LoRA) preserved earlier skills better than sequential full fine-tuning, and that merging a specialist with its base model improved off-task robustness with limited same-task loss for larger models. These are the authors' own reported results, not independently verified benchmarks. The preprint closes with practical guidelines for choosing fine-tuning strategies. [1]
Sources
- Can One Adapted Model Do It All? Fine-Tuning Strategy Selection for Customer Support LLMs
ArXiv CS.CL (Computation and Language) · Reporting ·