# ArXiv study: Multi-task fine-tuning beats specialists for customer-support LLMs

> An ArXiv preprint tested 13 LLMs on eight customer-support datasets and found multi-task full fine-tuning works best across model sizes.

- **Topic**: Models
- **Published**: 2026-09-24T07:50:00.562Z
- **Canonical URL**: https://highsignal.sh/stories/arxiv-study-multi-task-fine-tuning-beats-specialists-for-customer-support-llms-139b86d8

## Why It Matters

Practical guidance for teams deciding whether to deploy one support model or several specialist ones.

## Key Findings & Analysis

### What the study found

> A new ArXiv preprint (arXiv:2609.27262v1) from the Computation and Language category studies how to fine-tune LLMs for customer-support skills such as intent classification, question answering, summarization, and tool-use decisions. The authors say multi-task full fine-tuning was the strongest operational default at every model size they tested. Specialist models performed well on their own tasks but often degraded sharply off-task, which the authors say makes reliable routing important.

### Methods and other strategies

> The experiments covered thirteen models from five families — Qwen3, Qwen3.5, Gemma-3, Llama-3.1, and Mistral — ranging from 0.6B to 32B parameters, across eight customer-support datasets (four public, four proprietary; roughly 74.5k training and 8.7k evaluation samples). The authors say they trained more than 200 checkpoints under a fixed protocol. They report that sequential Low-Rank Adaptation (LoRA) preserved earlier skills better than sequential full fine-tuning, and that merging a specialist with its base model improved off-task robustness with limited same-task loss for larger models. These are the authors' own reported results, not independently verified benchmarks. The preprint closes with practical guidelines for choosing fine-tuning strategies.

## Primary Sources & Citations

- [Can One Adapted Model Do It All? Fine-Tuning Strategy Selection for Customer Support LLMs](https://arxiv.org/abs/2609.27262) — *ArXiv CS.CL (Computation and Language)* (Reporting)

---

[← Back to front page](https://highsignal.sh/) | [Daily Brief](https://highsignal.sh/brief) | [All stories](https://highsignal.sh/latest)