West Bengal is in the East of India,

West Bengal is in the West of East Bengal,

But East Bengal is in the East of India.

So Scaria is right in saying that :
 "The North of the building is to the East of the site."