Many French (often Norman French) words/names came across in 1066 and have been assimilated into English, much like Saxon and Norse words/names before them. They are not "foreign".
Two British royal mottos spring to mind: "Ich Dien" and "Dieu et mon Droit".
Montgomery in Powys is Trefaldwyn in Welsh, both names deriving from Roger de Montgomery, whose family name was Baldwyn (of Montgomery in Normandy).
Knutsford is named for the King of England/Denmark/Norway Knut/Cnut/Canute - there's a Knutby in Sweden.
There are many such links with Europe, and some going the other way.
There's a station on the Larkhall branch in Scotland called Chatelherault which had me foxed as it isn't Scottish.
It sounds French but not quite the same as the town of Chatellerault in Aquitaine.
But it turns out there is a link as the title Duc de Chatellerault was given by the French king to the Earl of Arran/Duke of Hamilton who used the name (modified a bit) on his estate.
Chatellerault in France is twinned with Hamilton in Scotland.