Torah Temimah cites Shevuos 6b.
The Sages taught: From where that the verse speaks only of tumas Mikdash and its kodashim?
The Gemara limits the liability of this verse to the scenario in which, after contact with tumas adam and with he’elem, the person enters the Mikdash or eats kodashim.