Torah Temimah cites Rashi.
“And he shall restore” — that which is subject to restitution; to exclude less than a perutah.
Miyut of sub-perutah — less than a perutah excluded.
Below a perutah there is no restitution duty and therefore no asham after denial and admission. The structure of this chapter requires a monetary amount that is subject to return.