Chorley Borough is much more rural in nature than any of Leyland South Ribble, Preston or Bolton so that population is too widely dispersed to make Chorley an important stop for longer distance services. As for Oxenholme and Penrith there are plenty of trains that pass through those stations non-stop. Don't know why you would even question Carlisle: it's a significant regional centre as well as a junction of six rail routes. Lies, damned lies and statistics!!!
The majority of Chorley's 116,000 population (2017 estimate) live either in the town itself, or in Adlington, Coppull, Euxton or Clayton Brook i.e. within 3-4 miles of the town centre. The outlying villages - Mawdesley, Eccleston, Anglezarke, Brinscall etc, have relatively small populations. We are not so rural as you make out, unfortunately.
I well know that rail travel is not simply proportional to population, that the Lake District attracts many tourists, that Preston and Carlisle are nodal interchanges for much wider areas.
Yet we stop East Coast trains at Retford (22,000), Newark (27,000), Grantham (43,000), and Transpennine stops at say Thirsk (5,000), Northallerton (17,000), Lockerbie (4,000) serving also Dumfries (31,000), so why omit any stop between Preston and Bolton, when the total Leyland-Chorley population is 215,000, considerably larger than the city of Preston itself?
Sometimes we need a reality check to look where possible passengers actually live, and to provide for them. Otherwise we could end up providing marvellous services for tiny hamlets and ignoring sizeable population centres. It would be a bit like the 'rotten boroughs' situation before the 1832 Reform Act.