It’s not simply the passport check, which in any case are not applied to EU passports returning from the UK.
There’s the whole problem of traffic jams on the UK side of the port.
A few hundred thousand fewer tourist, it’s not like the UK economy needs the money.