I agree with your second sentence.
I live in a village. I get on well with my in laws, all 50 or so of them, and the neighbours.
My wife set the house rules with regards to people walking in, with input from me. The garden gate is always open. Visitors wait prior to entering the house.
It's great. I love my surroundings.