The building of the palace was commissioned by the Kurfürst couple Ferdinand Maria and Henriette Adelaide of Savoy to Agostino Barelli in 1664 after the birth of their son Max Emmanuel.
Starting in 1701, the heir to the Bavarian throne, Max Emmanuel conducted a systematic extension of the palace. The palace was for a long time the summer residence of the rulers of Bavaria.