I'm not sure the sensor is heat soaking Tim (well, maybe its part of what you are seeing).
At idle, your blower is still creating boost (heat), and that bypass valve is open. With the valve open, the boosted (heated) air is recirculating.
Honestly, at low load you have nothing to worry about...