Why is certificate (re)-issuance not automated with ACME for this service? This shouldn't be a manual process - there are providers that will do this automatically (Let's Encrypt for DV, GlobalSign for OV certs etc) without any human involvement.
Is there really only one person responsible for this? This issue led to a total production outage which prevented both Avanti & c2c (who have both moved to the RARS2 API for reservations)'s retail sites from making reservations as well as preventing retailers from sending out timetable service cancellation notices. I am relieved that we were still on the RARS broker so that the impact was not more widespread.
Why were there no automated alerts configured to warn you at 14 days, 7 days, 1 day etc away from expiry? Was there no automated alerting / on-call rotation that meant that someone was alerted to this problem when the certificate expired at midnight?
This also previously happened in June 2023 [...] I am relieved that we were still on the RARS broker so that the impact was not more widespread.
Looks like it's been fixedCross country's website seems to be OK.
I thought it'd be shortly after 9am, but I guess RDG's IT ops person must start work at 8am.Looks like it's been fixed
Thanks for that - I'll pop a reminder in my calendar to buy any train tickets for the new year ahead of time!The cert has been replaced with one that expires on Dec 31st.
In other industries, regulators would be unhappy if a such an important customer facing system was unavailable for such a length of time.I think this one was broken for 8h10m which is really quite poor given what the system does.
RARS was broken from 01:00 to 08:05 (because of out of date certificate)
I question how/why nothing was done to prevent such a simple oversight (a certificate expiring) from causing massive problems.The cert has been replaced with one that expires on Dec 31st.
Yeah, so do I.I question how/why nothing was done to prevent such a simple oversight (a certificate expiring) from causing massive problems
Exactly. My most recent employing sector, aviation, had an automated and multi-level pre-emptive monitoring for all certificates.It shouldn't rely on people checking things at all, there should be automated monitoring in place.
I'm guessing that's the case."I question how/why nothing was done to prevent such a simple oversight (a certificate expiring) from causing massive problems."
At a guess, staffing changes at whoever supports the RDG system.
If the person "who knows" has left there may not be anyone who checks these things.
Precisely. Particularly as we're now aware of the massive consequences of the certificate not being renewed on time.It shouldn't rely on people checking things at all, there should be automated monitoring in place.
How are they being overcharged? Advance fares can never be guaranteed. Whether they are removed from sale by error or by strategy is neither here nor there.Is there not some illegality with this that customers are being overcharged due to the rail industry's incompetence?
Especially as this sounds like a normal webserver deployment. If you're working with some sort of appliance where there's no shell access then you're at the mercy of the vendor if they've exposed ACME configuration, or if it's on a private network where you can't respond to the challenge.I set up autorenewing Let's Encrypt certificates when messing around with my own private domain the best part of 10 years ago. There's absolutely no excuse for this degree of negligence.
None. You're expected to arrive an indeterminate amount of time in advance for your train so you have time to purchase your ticket. Avanti might give you discretionary compensation though.I was affected by this today, arriving to catch my train to work I found that I was unable to buy a ticket online or at the Avanti ticket machine at the station. Thankfully a kind fellow commuter let me skip a place in the queue (he wanted a later train) and I managed to buy a ticket at the ticket office in time to catch my train. What would my rights have been if the queue had been longer and I wasn't able to buy a ticket before my train left?
You could definitely buy onboard due to the extraordinary circumstances, with no suitable ticket purchasing facilities at the station.I was affected by this today, arriving to catch my train to work I found that I was unable to buy a ticket online or at the Avanti ticket machine at the station. Thankfully a kind fellow commuter let me skip a place in the queue (he wanted a later train) and I managed to buy a ticket at the ticket office in time to catch my train. What would my rights have been if the queue had been longer and I wasn't able to buy a ticket before my train left?
Suitable ticket purchasing facilities includes a ticket office, which was open.You could definitely buy onboard due to the extraordinary circumstances, with no suitable ticket purchasing facilities at the station.
But able to offer the full range of Advance fares, including those which would otherwise still be available for travel today?Suitable ticket purchasing facilities includes a ticket office, which was open.