I, like many, are still paying tax in the UK. If you have a state and private pension you will be paying tax if it exceed your personal allowance.
Okay I do not spend any of my money in the UK but equally I do not use any of its services such as the NHS.
The UK government discriminates based on your address.