Short answers, pulled from the story.
Margaret of Austria launched an expansion campaign to transform her property into a grand residence in 1507. The architect Rombout II Keldermans managed the project from 1517 until his death on the 2nd of May 1530.
Margaret of Austria raised her nephew Charles within these palace walls until her own death in 1530. Anne Boleyn also grew up at Margaret's court while living among future rulers like Charles who became Holy Roman Emperor at sixteen years old.
The city gate known as the Zandpoort exploded after holding gunpowder stock inside its walls and caused repairable damage to the nearby Hof van Savoye. This blast occurred within the Sand Gate which served as a municipal storage facility before officials repaired the structural harm.
That year in 1561 the property became the residence of Granvelle who served as first Archbishop of Mechelen. He acted as right-hand man to Philip II during his tenure there before the city bought back the building for public use in 1609.
Today the Hof van Savoye functions as the Gerechtshof or Court of Justice housing lower courts including Criminal and Civil divisions. Police Court and Justice of Peace proceedings continue within these historic walls where the Great Council of the Netherlands operated from 1616 until 1795.