It was built on an area located between the outer and inner defensive walls of Dresden (the so-called “outer circle”). Such spaces were customarily called “Zwinger” and were used by the Dresden court for garden purposes (Zwingergarten) near the castle.
Since the palace garden complex was built in such an area, it took its name from it.