For me the section to De Panne is prettier than to Knokke. But indeed, to come back, it's a bit more complicated, but not that much : in De Panne, take a train to Ghent (hourly) and change in Lichtervelde for a train to Brugge (also hourly, immédiate connection). It will give you an idea of how...