Because it's a hard problem without one obvious solution.
This video -
How electric trains work and why they make interesting sounds - has some great explanations of electric train motor control from the enthusiast perspective, if you've not seen it before.
I'll do my best to explain my layperson's understanding but it's been a long time since I had physics lessons. Corrections are welcome.
This GIF is a good visual aid for getting your head around what the asynchronous AC motor needs to do - you need a constantly varying magnetic field to control it, which you get from supplying three different phases of AC power to separate coils in the motor. Each phase needs to be synchronised with the others, but offset, to keep this field changing the right way. And in order to change the speed - and as the speed changes, because there's a feedback loop -
you need to constantly change the frequency of all the phases.
So you need to be able to generate AC power at arbitrary and changing frequencies - this is why this form of motor control is called a variable-frequency drive. And the way this is done is to start with DC power and convert it into the correct shape of AC power, which is all 'inverter' means. It's done with transistors (or thyristors, but the differences don't really matter for understanding the train sounds. "GTO" and "IGBT" etc are implementation details and can be misleading in that regard).
You can think of a transistor as being like a remote-controlled switch that can turn on and off in fractions of a second. If you turn the DC power supply on and off fast enough and with some strategically placed delays, you can basically fake an AC waveform - it's ripply but it's good enough to get the motor to work.
This technique is called pulse-width modulation and it's used all over the place, including in some later trains with DC motors where it's just used to vary the voltage. The inverter generates the pulses and they induce audible noise in the motor itself.
The transistors are switched by a microcontroller in order to make the pulses and the pulsing strategy is just part of a computer program that runs on it. Where the pulses should be in order to generate the necessary waveforms is up to the designer of that system. Think about all the diverse software you use on a PC, and how different programs can be even if they are solving much the same problem - programmers are reinventing the wheel all the time.
The Wikipedia page for PWM shows some of the different strategies just for generating waves in the first place. Your program may well have inputs that it has to make complex decisions with, like the current speed or state of the magnetic field in the motor. You're switching very high power motors so you'll generate a lot of electromagnetic noise, in an environment where there is sensitive signalling equipment all over the place. Then there are economic and physical limits to microprocessor power and the viable switching frequencies of the transistors/thyristors. And one of the factors is how smart the programmer was feeling!
All that affects which pulse modes you need and where, and how complicated the strategy can be in the first place. A more complicated strategy might produce less noise, be more efficient, or prolong the life of the motor, but may well be beyond the capabilities of the components you have to work with.
Add on intellectual property and closely guarded trade secrets and it's no wonder that there's all these different ways of solving the same general problem! It's just complicated.
There are families of these systems. This stuff tends to be developed by big engineering conglomerates with a long history of mergers and acquisitions; so Bombardier even before they were bought out by Alstom, for example, produced at least two different kinds. Which leads to strange things like how
the Electrostars on Gautrain have the same (or similar) motor but a different inverter to the British ones, and therefore sound different.
It is broadly the case that trains from the dawn of this technology sounded more 'interesting' because the lower pulsing frequencies tend to be more noticeable, and they have more and/or earlier changes in pulse modes which are what produce the 'gear changing' effect. But there are lots of modern trains that still have very distinctive pulse changes, like the dramatic switch to synchronous pulsing modes you hear on Electrostars and the Hitachi AT family.
Post #4 demonstrates something really cool, which is that, as I mentioned earlier, this process doesn't just generate audible noise in the motors, it generates electromagnetic noise over a much further distance than just the inside of the motor itself. So you can use an inductive coil to turn this back into electrical signals and see the waves that they make up for yourself and hear them much more distinctly. You can go and look at induction recordings on YouTube and compare by sound and visual representation of the waves what each type of train is doing, and become even more attuned to and obsessed with these sounds, if you're the type to

It's very exciting that it's been done for British trains now because for a while it was only rail enthusiasts in Japan who had worked out that you could do this.