I had to check the geography and climate... yes, it's hot, but no, it's not a desert area. You're right, it's not far from Arabia... but it's not in Arabia.
And yes, it's a castle... but let me check whether it was used for any other purposes (I don't think so)

Ok, I found it as "Palace" in wiki...