Also worth remembering rugby is a technical and rules-heavy sport where players can occasionally be killed or suffer life changing injuries.
It’s also the anti-football in that (for Union anyway) it’s the preserve sport of posh schools, the Army and other bastions of authority and class. Rules are key, and the authority of the referee is unquestioned. He’s a gentleman (or a lady!) and not a spoilsport so and so.
Football is a game of universal appeal and the referee is in charge but doesn’t occupy the same cultural position as the rugby or cricket referee. Rules in football, for years, have actually operated on consensus, custom and practice regardless of what the Laws say. That’s why you have the cliché of “well, I don’t think you can give a PENALTY for THAT” describing a minor infringement that would be a foul in midfield but not “bad enough” to award a penalty for. See also the non-enforcement of foul throws (“who cares?”), and so on etc etc.