I am a renter as well but we have pretty strict rental agreement regarding these kinds of things. The owner is not even allowed to enter the property without my prior permission or a certain amount of notice.

When you are paying for someone else's house, please do not be afraid to protect yourself with a proper, binding rental-agreement/contract.

Edit: I live in Canada incase that makes a difference.