Hi there, long time no see
Imo, all is depends on the situation.
Indeed, it can be funny when speak the language with your partner. It can be really rough, or can be nasty and even revenge. If you have an argument, probably you want to scream to the other side by using your native language. Finally, I don't think that speaking onther language is unrespectful per se