Newport, South Wales used to have three stations - High Street, Dock Street and Mill Street.
The latter two were closed to passengers when the services were diverted to High Street in 1880, but both remained open to goods traffic until the 1960s, so the suffix "High Street" remained in use until then. It's now just known as "Newport", although NRE refer to it as Newport (South Wales) to differentiate it from Newport (Essex), which is some way away.
Ironically, the station's location has never been on the actual High Street, although it is quite near to it. It's current location is on Queensway, a "inner bypass" road constructed in the 1980s, although previously it was on Station Approach, a name that you'll now find on Google Maps but nowhere else as it's an unnamed, very short, pedestrianised street which runs between Queensway and High Street. There's also a Railway Street and a Station Street nearby, but neither of them have ever led to the station.