What the paper claims
- ArXiv CS.LG published a preprint (arXiv:2609.25836v1) introducing In-Context Guidance Multitask Optimization (ICG-MTO), a framework for few-shot multitask optimization. The paper says conventional methods suffer from inaccurate inter-task relationship estimation under limited evaluation budgets, leading to negative transfer — ArXiv CS.LG (Machine Learning), the paper's authors, as stated in the abstract. Details are the authors' claims, not independent findings; this is an unverified preprint. The framework has three stages, per the abstract: build an algorithm-specific in-context query from evaluated solutions; use a frozen foundational model to infer a guidance signal describing predictive relationships among tasks; translate that signal into algorithm-specific guidance for maximum-a-posteriori coupling estimation. The authors say this regularizes the early, data-scarce stage and gradually relinquishes control as task-specific observations accumulate. [1]
Instantiations and evaluation
- The authors instantiate ICG-MTO in multitask Bayesian optimization as ICG-MTBO, using directional fitness-class queries to guide inter-task coupling estimation — ArXiv CS.LG, the paper's authors. They report a second instantiation in MFEA-II, using decision-space-overlap queries to guide random mating probability estimation — same source. They report experiments across synthetic benchmarks and a real-world robot arm control problem, plus evaluations under different acquisition functions and evolutionary multitasking, and describe the results as showing effectiveness and generality for few-shot multitask optimization — the authors' evaluation, on their own chosen tasks and baselines, not independently reproduced. [1]
Sources
- In-Context Guidance: Learning Inter-Task Synergies via Numerical Foundational Models for Few-Shot Multitask Optimization
ArXiv CS.LG (Machine Learning) · Reporting ·