You are not alone. I work from home but do my very best to ensure that work and home are separated, including the physical location of where I work within my home.
I am by all definitions a "Homebody". There is a distaste for going out to stores or in public and only do so when I absolutely have to. When I do venture from the house without a true need it is usually to escape to the wild for some fishing or hunting with my youngest son. I am content with my small piece of the world and my small circle of neighbors.
This is not because I dislike people, but I just enjoy my home, after all, as you pointed out, it is what I am working for.