As RickyG mentioned, those little lights cannot be turned OFF. It has been asked before. FYI, I don't even notice them when driving at night.
As for the passenger seatbelt light, I don't know if it will turn OFF if you buckle up the belt or not. That is another warning light I don't notice.
You likely notice them now because you are subconsciously fixated on them.
Peter