I've often had housemice where I've lived and generally just accept them. But they have provided some funny moments.
When I was much younger, and first realised that one or more mice must have got at the bread, there were a few days between realising this and putting the bread in a tight bin. I carefully balanced a loaf on top of a 1 litre lemonade bottle on the kitchen table, only to find the next morning that the bottle and loaf were still there, but the loaf had been hollowed out from a hole nibbled though the bottom! How they climbed up the table legs then up the smooth surface of a large bottle I'll never know.
On another occasion, I stayed up late to welcome a new lodger who was arriving after 12 midnight. Meanwhile, a mouse appeared in the living room (all open plan, the living room ran into the the kitchen) and one of the cats was watching when the lodger arrived. I spent ages making small talk with the lodger in the kitchen trying to keep him distracted from the cat and mouse hunt behind him. At one point the cat crawled right in front of him, growling, with its belly low, closing in on the mouse while I persisted in trying to distract the lodger. Don't know why, I'm sure the lodger would have been amused.
A Cat is a far more humane method of disposal for the critters
One place I lived had a bird table which was popular with lots of birds and cats which liked being in the garden near the bird table. The odd thing was that the birds never seemed bothered by the cats nearby. Then it became clear what was going on!
The birds kicked the husks of seeds off the table, the husks attracted mice and the mice attracted the cats. Never saw those cats bother a bird, they saw the birds as friends in the supply of mice!