All Jerusalem? The Persians had (as recently as 40+/- years) invaded and temporarily held Jerusalem. This visit of the magi may have been seen in the city as a plot to regain the city. It is an interesting way to create a public buzz around the messianic arrival.
Some suggest that the Magi may have been influenced historically by the wise writings/influence of Daniel, at least indirectly. There is a lot of mystery over who these men are and how they knew what they did.
There is the physical temple and there is a temple of individual men's hearts. Where a man's heart is there will be his treasure. There are men who treasure making money from the religious needs of many. There are men who treasure peace that do not confront them. There are men who treasure their position in the church that allow for even profit from such allowance. There are men who treasure the way things just the way they are, the way things have long time been. There are those who treasure their own ideals of the temple and not the ill image it projects to those it mistreats. These are the types of men who would be displeased by Jesus' message carried out in the temple for they do not treasure Him. When we look as individuals upon a collective temple such as this we look upon men's collective hearts. The object is not to avoid coming to the collective temple, it is to call upon all men's hearts by a higher calling; to call upon all men to come observe the most holy heart of our Lord and Savior; to meet with Him by His grace then and there. And if need be, shake a few tables of our own.