• Our new ticketing site is now live! Using either this or the original site (both powered by TrainSplit) helps support the running of the forum with every ticket purchase! Find out more and ask any questions/give us feedback in this thread!

Initial Laidlaw Report into ICWC shambles published

Status
Not open for further replies.
Sponsor Post - registered members do not see these adverts; click here to register, or click here to log in
R

RailUK Forums

wintonian

Established Member
Joined
15 Jan 2010
Messages
4,889
Location
Hampshire
Websites have a habit of becoming unreachable sometimes when the web media publish an important story with links, so I have uploaded it here for convenience.
 

Attachments

  • laidlaw-report.pdf
    195 KB · Views: 76

LNW-GW Joint

Veteran Member
Joined
22 Feb 2011
Messages
21,922
Location
Mold, Clwyd
Looks like anybody wanting a quick fix will be disappointed.
Dysfunctional doesn't begin to describe the level of poor management and processes in DfT.
It's telling that the Senior Manager for refranchising changed 3 times during the course of the ICWC bid.

You will not find the answer to the question "well who should have won?"
Looks like a root and branch rethinking of the refranchising process will be necessary, together with a complete reorganisation of the DfT procurement function.
If this had not been challenged, there would have been a big franchise wreck downstream somewhere.
At least they can start again, with I guess a 2 year delay to new long franchises (if they survive Richard Brown's review).

McLoughlin talked about introducing benefits to WC users quickly, like enhanced delay-repay.
While he was speaking, the southern end of the WCML was stationary because of a suicide at Apsley...

I shouldn't think Philip Rutnam (DfT Permanent Secretary) is looking forward to the TSC grilling on Wedesday.
 

eastdyke

Established Member
Joined
25 Jan 2010
Messages
2,058
Location
East Midlands
...
You will not find the answer to the question "well who should have won?"
...

I think that the answer 'nobody' is about right, and that includes the politicians, the DfT and taxpayers.

The fact that the enquiry is still awaiting sight of certain documents is also telling.

The SLF requirements, had due process been applied, could well have been huge. Certainly beyond the reach of at least some of the bidders.
 

ainsworth74

Forum Staff
Staff Member
Global Moderator
Joined
16 Nov 2009
Messages
31,100
Location
Redcar
Perhaps we should recreate an organisation like OPRAF to oversee franchising? Remove it from the direct purview of the DfT and give it to an organisation that we could, perhaps, staff with experts on contracts, finances and so on.
 

HH

Established Member
Joined
31 Jul 2009
Messages
4,505
Location
Essex
Rumours abound at the moment. Take your pick of the following, at least one of which I know to be true :)

A new 'OPRAF' will be created and will be run by Elaine Holt (who has fallen out bigtime with Dean Finch) - seems a bit early for this to me

The 'Brown Enquiry' will be much later than "end of year" - seems only too likely, but the knock-on effects would be painful

That evidence from DfT Employees has been contradictory and inconsistent, which has hampered both enquiries, as they have been unable to arrive at a definitive account of what happened. I seem to recall this stratagem in TV Court Dramas, but I also found one real life example: http://www.compassdirect.org/english/country/turkey/2008/newsarticle_5422.html. Of course Shaggy also sung a song along these lines, "It wasn't me".
 

snail

Established Member
Joined
16 Jun 2011
Messages
1,911
Location
t'North
That evidence from DfT Employees has been contradictory and inconsistent, which has hampered both enquiries, as they have been unable to arrive at a definitive account of what happened.
Is that PC speak for 'because they made it up as they went along'? :roll:

The finding that all figures ended up being based on actual 2010 values is staggering. No wonder Virgin were confident about the Judicial Review. I see that all the amounts that have been freely bandied around since First were 'awarded' the franchise are redacted in the review document.
 

LNW-GW Joint

Veteran Member
Joined
22 Feb 2011
Messages
21,922
Location
Mold, Clwyd
Perhaps we should recreate an organisation like OPRAF to oversee franchising? Remove it from the direct purview of the DfT and give it to an organisation that we could, perhaps, staff with experts on contracts, finances and so on.

I should think one Richard Bowker is allowing himself a wry smile just now.
 

3141

Established Member
Joined
1 Apr 2012
Messages
2,120
Location
Whitchurch, Hampshire
On the BBC Radio 4 news earlier this evening, it was reported that "Virgin had been stripped of the franchise" but would now continue to run it. Another example of the media's inability to report accurately. When a TOC and a franchise part company "stripped of the franchise" is the only term the media know for the situation.
 

Wath Yard

Member
Joined
31 Dec 2011
Messages
864
There is far more in the report than some procedural errors by civil servants. The short amount of time available to prepare and review the bids is a political issue surely?
 

HH

Established Member
Joined
31 Jul 2009
Messages
4,505
Location
Essex
Is that PC speak for 'because they made it up as they went along'?
More like they made it up after the event. Some may even be honest, but confronted with numerous different accounts of what happened, what can the enquiry do? Short of water-boarding them...

--- old post above --- --- new post below ---
There is far more in the report than some procedural errors by civil servants. The short amount of time available to prepare and review the bids is a political issue surely?
Some bidders prepare pretty much their whole bid in 3 months, including doing numerous models. The DfT had less to do, and longer to do it.

Maybe they were under-resourced (as intimated by the report), but judging by the number of people I've seen working on one bid, including expensive consultants like Atkins & Eversheds, I find that hard to believe. Nor, as the report also suggests, are the DfT personnel junior to the bidder's (at least in salary terms), except maybe bidders would involve senior people more than DfT, where they tend to remain hidden and inscrutable.

No doubt there is politics involved, but DfT cause problems themselves - they delay things at the slightest excuse. What this all shows, unfortunately (and I say unfortunately because it's going to be a real PITA for everyone involved), is that DfT are just not fit to let contracts.

It also calls into question ALL previous contracts & schemes.
 
Last edited:

eastdyke

Established Member
Joined
25 Jan 2010
Messages
2,058
Location
East Midlands
...
Maybe they were under-resourced (as intimated by the report), but judging by the number of people I've seen working on one bid, including expensive consultants like Atkins & Eversheds, I find that hard to believe.
...

Put in the position that the DfT now finds itself the claim of insufficient resource will probably be the plea of 'middle' management, (or whatever 'middle' equates to in the Civil Service). Especially bearing in mind the staff cuts that were imposed without reference to specific outputs.

IMO that makes it simply poor management at a higher level.
 

HH

Established Member
Joined
31 Jul 2009
Messages
4,505
Location
Essex
The problems seem more based (from what I can see) around the re-organisation at DfT, which seems to have left responsibilities confused and some senior people with a very wide mandate, including areas where they have no experience.

--- old post above --- --- new post below ---
Worthwhile revisiting the past:

Its been suggested a few times that the DfT and First both "made the same mistake" in some aspects of this.

I wonder whether First used the Department's model to ensure that they "showed the figures the Department wanted", whilst not necessarily agreeing with the methodology, and having modelled the same thing themselves internally for their own consideration.

That doesn't sound like DfT, but if they did it then it would certainly be an error of process.

Note that First were originally told £205m, according to them, and it was lowered to £190m after they challenged it. It has not been said what form that challenge took, but...

Virgin said they were originally given a figure of £71m. They asked how that number had been arrived at. They were never given an answer, but the amount was lowered to £40m.

It doesn't give me a lot of comfort that the process was a rigorous one.

With what is now known it is clear that none of the bidders knew how the SLF was calculated (Laidlaw is making a big thing, rightly IMO, about the lack of transparency on the SLF), therefore the talk by both Branson & O'Toole, in front of the TSC, was mere bluster.

Note that the so-called 'Ready Reckoner' despite being referred to in some places as a model, is not a model. It was part of the bidding documentation, and merely describes how they would calculate the SLF once they had carried out their risk assessment. The risk assessment is the tricky bit, and this was never described except in the most generic terms. Plus, given the numerous errors in the DfT's SLF calculation it is impossible for the bidders to have arrived at the DfT numbers, especially as those included adjustments which seem to be lost in the mists of DfT.

You could go with the conspiracy theory, but could DfT manage a conspiracy? Not on the evidence before us.

--- old post above --- --- new post below ---
Also, remember that this was said (early on):

As well as forgetting to take inflation into account, officials were responsible for double-counting.

They also took short-cuts that were against the rules.
As I suggested at the time, it was them working in Real rather than Nominal numbers.

However they neither double-counted, nor took short cuts. The actual problems were worse than that. Especially the adjustments that amazingly nobody knows why they were made, but increased Virgin's (erroneous) number, while decreasing First's (erroneous number). This does look like an ABB change, but I think, from what I've read, that it's simply evidence of muddled thinking at DfT, although it may well be that there was also an anti-Branson feeling that had some effect (it seems that they thought that all bidders should put up something, and there seems to have been a desire not to lose the First bid - the latter is what I suggested at one point as being a possibility).

And another quote from me:
As to what will happen:

1. The first enquiry will say that there were several errors by DfT; it was right to re-start the process; senior people and ministers will be exonerated; scapegoats will be confirmed.
Well, I'm looking pretty safe on that one.

Here's a reminder of what Peston said
There’s a blog by Robert Peston on the BBC News website in which he says that all four bidders for the West Coast franchise were given incorrect information and that, as a result, the amounts they were offering to protect taxpayers would have been insufficient if they had won the franchise but weren’t able to keep up with the premiums they had promised to pay.
Bidders weren't given enough information (which I've been saying all along), which isn't the same as wrong information. And it wasn't bidders offering money, it was DfT's asking for money (SLF) that was wrong. So about 3 out of 10 for Peston, but he clearly got a sniff of something.
 
Last edited:

LNW-GW Joint

Veteran Member
Joined
22 Feb 2011
Messages
21,922
Location
Mold, Clwyd
Bidders weren't given enough information (which I've been saying all along), which isn't the same as wrong information. And it wasn't bidders offering money, it was DfT's asking for money (SLF) that was wrong. So about 3 out of 10 for Peston, but he clearly got a sniff of something.

If the WC ITT was inadequate it does not look good for the other bids in progress (ET and GW).
No doubt they will wait for the completed report before acting.
 

HH

Established Member
Joined
31 Jul 2009
Messages
4,505
Location
Essex
If the WC ITT was inadequate it does not look good for the other bids in progress (ET and GW).
No doubt they will wait for the completed report before acting.
I cannot see how these can go through now. If you accept that bidders ought to have more transparency on the DfT Risk Model, then you have to give them that transparency and let them adjust their bids.

Still, if they do that the competitions could be delayed by only 6 months or less. Will they go for that, or will they want to put right any other issues raised by Brown and re-start the process? That means considerable delays all round, and probably WC-like solutions (extensions followed by short franchises). I don't think any bidder would welcome that due to the extra cost.
 

snail

Established Member
Joined
16 Jun 2011
Messages
1,911
Location
t'North
it wasn't bidders offering money, it was DfT's asking for money (SLF) that was wrong.
Why does it say that this affected only First and Virgin? The implication to me is that the other two bidders had low profit margins, but could it be something else?
 

HH

Established Member
Joined
31 Jul 2009
Messages
4,505
Location
Essex
Why does it say that this affected only First and Virgin? The implication to me is that the other two bidders had low profit margins, but could it be something else?

The other bidders were calculated to have covered risk in their margin. Don't forget though that this is using their erroneous model in Real 2010 prices. We have no idea what would have happened if DfT had followed their own process correctly (well except that the First SLF would have been huge).
 

DarloRich

Veteran Member
Joined
12 Oct 2010
Messages
32,923
Location
Fenny Stratford
Perhaps we should recreate an organisation like OPRAF to oversee franchising? Remove it from the direct purview of the DfT and give it to an organisation that we could, perhaps, staff with experts on contracts, finances and so on.

perhaps we should do away with franchises altogether and turn to something called, oh i dont know, British Railways.

(sorry my ludditte side appears to be coming out again - forgive me)
 

Buttsy

Established Member
Joined
20 May 2011
Messages
1,374
Location
Hanborough
perhaps we should do away with franchises altogether and turn to something called, oh i dont know, British Railways.

(sorry my ludditte side appears to be coming out again - forgive me)

What will hopefully happen (as, unfortunately, BR ain't coming back), is that, rather than a franchise being let with all the imponderables, it will go down the route of perscribed fixed term contracts with a profit for the operator, more in the way of Merseyrail & London Overground.
 

HH

Established Member
Joined
31 Jul 2009
Messages
4,505
Location
Essex
What will hopefully happen (as, unfortunately, BR ain't coming back), is that, rather than a franchise being let with all the imponderables, it will go down the route of perscribed fixed term contracts with a profit for the operator, more in the way of Merseyrail & London Overground.
I think that several operators would be fine with that. Funnily enough, one I can think of that wouldn't is Virgin...
 

ainsworth74

Forum Staff
Staff Member
Global Moderator
Joined
16 Nov 2009
Messages
31,100
Location
Redcar
perhaps we should do away with franchises altogether and turn to something called, oh i dont know, British Railways.

Never going to happen (famous last words :lol:). If Labour wouldn't do it in thirteen years then the Conservatives certainly aren't going to do it now. Unless Labour suffer a sudden and rather radical shift to the left I can't seem them doing it either in 2015 (or whenever they get back into power). I think we're going to end up with either a bodge job trying to hold the present system together or concessions à la Merseyrail and London Overground.
 

HH

Established Member
Joined
31 Jul 2009
Messages
4,505
Location
Essex
Another blast from the past that needs updating:

The interesting thing is its now emerging there were two flaws found in the process, the current one that Virgin complained about in an independent report submitted 5 days before the award (seen by channel 4), dismissed by the Dft but then found by the PWC audit, and a seperate unknown 'minor flaw not expected to affect the result' that the Dft found a week before the award and Greening commissioned PWC to investigate (reported by Conservative Home). This PWC investigation while working on another task then uncovered the flaw of interest not being included in the computerised risk model (Guardian/BBC). Its also funny to watch how the different news outlets attack the story from different angles and find different insider sources and different aspects of the story in their investigations.
The PWC report does not mention interest. It found several flaws with the process, one of which is that DfT used Real prices (the "they forgot inflation" one). A second is a more technical issue, probably wouldn't have affected the outcome, but I wouldn't call minor as it would have affected the size of the size of the risk (of all parties) and therefore any possible SLF. A third is that the DfT failed to use their model, instead basing the number on a calculation derived from the "ready reckoner", which is not a model, but a way to get a rough estimate of the model output once you have determined the level of risk. On top of this it appears that DfT made undocumented changes to the levels of SLF required from First & Virgin.

I don't know what the independent report contained, but the above means that the two main areas of the Virgin Legal Claim: that DfT failed to follow their own processes, and that they failed to treat bidders in the same way, have both proven to be true. This is why the SoS took the actions he did.

Pure speculation on my part, but these were so accurate that I can't help but wonder if Virgin also have a DfT source, maybe one that wasn't happy at the process.

Also we know it didnt affect the other two bids because the flawed computerised risk model was only used on the Virgin and First Group bid, a different evaluation was done as a first stage which eliminated the other two. It seems now the reason First's figures agreed with the Governments figures is because they used the original ITT documentation to recreate the model and so theirs didnt include inflation either, Virgin meanwhile in backwards engineering the dft model did include inflation in theirs. So looks like First arent at fault afterall, they just were stupid enough not to notice inflation wasnt accounted for when backwards engineering the model in the same way the Dft didnt notice.
As I said above DfT didn't use their model at all in looking at the SLFs. They used the "ready reckoner", which as I never tire of saying, is not a model. What it was though is equally flawed, as it was based on the flawed outputs from the model. All bids were subject to the SLF check and all bidders were informed of their result. It seems that two of the bidders were told that no SLF was required.

Now we come down to First. All bidders had the "ready reckoner" but again, as I never tire of pointing out, that does not allow you to calculate a value of the SLF. Indeed Laidlaw is very scathing of the DfT due to not making the SLF calculation transparent. Laidlaw also says that bidders should have been able to calculate their figures if they were to make sensible bid choices, which pretty much underlines my point (repeated again at the bottom) that it was impossible for bidders to duplicate the DfT model. Of course nothing would stop bidders attempting to second guess DfT, but First would have to have made three other identical errors, as well as correctly estimating the DfT's risk number, in order to come up with the same value of SLF. Clearly nonsense. As I have said previously, O'Toole was just trying to back DfT when he claimed they reached the same number. Notice there's not been a peep out of First since on the issue. We can be confident that First either never had a model, or if they did, it almost certainly came up with a bigger number.

The position on Virgin is less clear, but they clearly did have a go at duplicating the DfT results. Europa, on behalf of Virgin, came up with a number for First of £600m. There are two ways they could have arrived at this that I can see.

It could have been based on the (erroneous) ready reckoner, the size of their own (erroneous) SLF, and the differences between the two bids, which included the important distinction that Virgin bid a 7% EBIT compared to First's 5% (a difference worth £20-60m a year). That would seem the most sensible approach, and it could have come up with the £600m number, but of course the number would be wrong since it would be founded on several errors. I'd think that correcting those errors would lead to an even larger number.

They could also have arrived at a number completely independently, i.e. by trying to replicate the DfT model. However with no knowledge of how the DfT model was put together there would be no chance of accurately replicating it (as per Laidlaw), and therefore no chance of duplicating the DfT result except by blind chance. You might go this way if you wanted to argue that your risk model was better than DfT's, but that wasn't what Virgin were arguing. They were saying that the DfT's own model should have shown £600m. That's why I think they will have followed a process close to what I outlined above.
 

WatcherZero

Established Member
Joined
25 Feb 2010
Messages
10,272
As ive said elsewhere the Ready Reckoner has now been published (Laidlaw draft report appendix) and it does indeed provide a mathematical formula for bidders to calculate a rough value for the SLF using their margin, non-revenue risks and SLF values for how they order the franchise payments (front loaded, middle loaded, rear loaded, evenly loaded).

But thankyou for the support HH :)
 

eastdyke

Established Member
Joined
25 Jan 2010
Messages
2,058
Location
East Midlands
Last edited:

AndrewP

Member
Joined
5 Sep 2011
Messages
495
I still can't believe this.

For any form of long term contract being procured you have a detailed cost model and get the bidders to plug the numbers in.

The debate should be over more subjective elements and added value elements and not the cost - that should be the easy bit.

It seems that I use more rigor on a £0.5m cleaning contract than the DfT did on the West Coast!!!!!!!
 

eastdyke

Established Member
Joined
25 Jan 2010
Messages
2,058
Location
East Midlands
Seem to be looking for Macavity.

They are unable to say how long Macavity has been in the Department.

Macavity will turn out to be a rather junior cat.
 

LNW-GW Joint

Veteran Member
Joined
22 Feb 2011
Messages
21,922
Location
Mold, Clwyd
Seem to be looking for Macavity.
They are unable to say how long Macavity has been in the Department.
Macavity will turn out to be a rather junior cat.

Saved by the bell!
They are stonewalling behind the various enquiries.
We might not even get to the impact on other franchises.

They haven't done the "can we fit the passengers on the trains" check.
McLoughlin consulted Brussels before talking to Virgin - he also said 9 months for the interim franchise.
Rutnam would be quite impressive if he didn't have a leg to stand on.
A great example of "kicking the can down the road"!

To quote W.S.Gilbert: "I had no idea. I knew nothing about it. I wasn't there". ;)
 
Status
Not open for further replies.

Top