Back to research

Tools Instead of Guessing: Why Small Models Can Answer More Reliably

Engineering

Models become unreliable when they are asked to invent facts that a tool could retrieve exactly. Small models can be effective tool coordinators when the system gives them clear permissions and validated inputs.

Measured systems for practical intelligence - geisten

Generated language is useful for explanation and synthesis. It is not the right source of truth for stock levels, schedules, prices or calculations. A reliable system routes those requests to an authorised database, API or deterministic tool.

Reasoning and retrieval are different jobs

The system should distinguish between information that needs interpretation and information that needs lookup. A model can decide which tool is appropriate, formulate a query and explain the result. The tool remains responsible for the factual value.

Why compact models fit the role

Tool orchestration is usually a narrow task: recognise intent, choose an allowed action, validate parameters and present the response. A smaller model with a well-defined tool schema can perform this efficiently and locally.

What this means for organisations

Start with the authoritative systems already in use. Define the operations the model may request, log every call and create a clear path for uncertainty or missing data. This turns an assistant into a controlled interface to real work.

Conclusion

Reliable AI does not require a model to know everything. It requires the system to know when to retrieve, calculate, ask for help or abstain.