I've read somewhere that if I only overstay my tourist visa or 30 day stamp for one day, I don't need to pay the usual fine of 500 Baht per day. Is this true ?

If you leave by air this should be true but you will likely still receive the red stamp in your passport.