Why didn't the aborigines build anything?

i mean seriously spiritual mumbo jumbo usually doesn't stand in the way of a logically better system. being quite a harsh terrain, surely it would have been easier to find some arable land and settle and start farming, rather than wandering through the desert as nomads for 40,000 years