Lately, I found a clever way to learn about the former town wall of Wiener Neustadt. At Reyergasse 10, I saw this mural depicting the walls around the city. Some parts of the walls are still visible.
E.g. the Reckturm Tower at the north-western corner of the town. It dates back to the 13th century.