St Augustine's Church stands on Penarth Headland, and was built in 1866 at a cost of £10,000, financed by Harriet Windsor-Clive, 13th baroness Windsor. It was designed by the famous Victorian architect William Butterfield (1814 – 1900) and is described as one of his best polychromatic churches. At roughly the same time (1865), he also designed another church of the same name, St Augustine's, Queen's Gate, which is a Grade II* listed Anglican church in Brompton, London.