Interesting that you should mention that. Every time there is mention of a new referendum, or revoking A50, there is a chorus of leavers warning (or is it making veiled threats) of dark forces rising up, riots etc.. So is this the leavers' own 'project fear' or just a desperate attempt to give the impression that going against their 'democratic entitlement' would be a bad move for all?
As you say, everybody seems to be scared of the leavers which given their angry uncompromising behaviour, isn't surprising, but if there is a messy departure or even an unnecessarily jingoistic flavour of how a deal is handled, the generally tolerant remainers may decide to push back. They are after all the 'privileged elite', so with their riches, they are in a far better position to ride out the inevitable chaos and shortages.