On reliability, Almeida says he values robustness more: if the meaning of the question has not changed, the judgment should not change drastically just because irrelevant characters are added, rather than merely pursuing the same output for the same input. On version management, he says deployed models will not be silently modified, because the API is a dependency in other people's programs; but new versions will be released quickly, and currently he cannot promise permanent maintenance of every old version.
On evaluation, he explicitly dislikes public leaderboards, one reason being that they are easy to game. He says the team compares cost and capability through internal evaluations, pursuing stronger at the same cost and cheaper at the same capability, and what he opposes is optimizing around leaderboards, letting scores drift away from real value. He advises developers to put the model into their own workflows and measure actual performance, not just look at price, speed, or a single overall score.
On task organization, he suggests breaking complex tasks into the smallest, independently judgeable semantic units, providing necessary information through structured input, and then letting code control the final behavior: Choice corresponds to selection branches, Noul corresponds to conditional judgments, Score corresponds to scoring, ranking, and filtering; each step can be evaluated separately, thresholds adjusted, and when capability is insufficient, handed off to humans or not deployed for now. The four application directions he outlines are: analyzing dark data left idle because processing costs are too high, providing fast judgments for real-time processes, checking other models' calls and outputs, and embedding intelligent judgment into the core logic of software, with particular optimism about dark data analysis and coding agents.