Man looking South in All Directions/Variant

Problem
A man builds a square house with windows in each of the four walls.

Each window faces due south.

Where did he build his house?

Solution
He built his house at the North pole.