{"id":"507ab869-a261-4982-baac-11777463ed78","slug":"s09e21-seeing-past-the-horizon","subject":"s09e21: Seeing Past The Horizon","title":"Seeing Past The Horizon","publish_date":"2021-04-27T20:57:38.204000+00:00","year":2021,"month":4,"season":9,"episode":21,"episode_label":"s09e21","canonical_url":"https://newsletter.danhon.com/archive/s09e21-seeing-past-the-horizon/","is_premium":0,"word_count":2531,"body_html":"<h1>0.0 Context setting</h1>\n<p>April 27, 2021 and a day earlier than I wanted to send another episode out, but this one matters to me.</p>\n<p>Housekeeping: if you’re interested in (and able to) support my writing and would like to subscribe, you can do so by visiting <a href=\"https://newsletter.danhon.com\">https://newsletter.danhon.com</a> and entering your email address — even if you’re an existing subscriber — and you’ll be taken to a page where you can do a paid subscription.</p>\n<p>TW/CW and note: the language used around suicide has been changed from an earlier version. Thank you to the reader who reminded me. If you are in crisis, in the U.S. you can contact the <a href=\"https://suicidepreventionlifeline.org/\">Suicide Prevention Hotline</a> and in the U.K., the <a href=\"https://www.samaritans.org/how-we-can-help/contact-samaritan/\">Samaritans</a>.</p>\n<p>__</p>\n<h2>1.0 One thing that caught my attention</h2>\n<p>Only one thing today: about the UK Post Office’s Horizon IT scandal.</p>\n<h2>Seeing Past the Horizon</h2>\n<p>I wrote very briefly <a href=\"https://newsletter.danhon.com/archive/9c50a908-282c-4966-8845-739d63465db0\">last episode</a> about Horizon, the UK Post Office’s IT modernization effort and at the request of Jennifer Pahlka, I’m going to go into a little more about it here.</p>\n<p>I’m going to learn and write about five things for this piece:</p>\n<ol>\n<li>How technology projects are procured</li>\n<li>How management uses technology</li>\n<li>What happened next…</li>\n<li>… and what we can learn</li>\n<li>The Biggest Lesson</li>\n</ol>\n<hr />\n<h2>1. How Technology Projects Are Procured</h2>\n<ol>\n<li>\n<p>In 1995, as part of the Conservative Party annual conference, the minister for Social Security announced how a smartcard would reduce benefit fraud (“The personal details of all 15 million benefit claimants would have been carried on a computerised strip which would have been impossible to forge” [<a href=\"https://www.theguardian.com/politics/1999/may/25/uk.politicalnews2\">The Guardian, 25 May 1999</a>]).</p>\n</li>\n<li>\n<p>This became the Benefits Payment Card project, and a contract was awarded to Pathway, a subsidiary of ICL, a technology contractor, in May 1996.</p>\n<p>Important sidebar!</p>\n<ul>\n<li>ICL [<a href=\"https://en.wikipedia.org/wiki/International_Computers_Limited\">Wikipedia</a>] is/was your stereotypical bureaucratic technology company, founded in 1968. That date is important: it both <em>made</em> computers, back when governments and large corporations needed computers that didn’t exist yet. This necessarily meant both hardware <em>and</em> software, the kind of corporate history that involves inventing how to do databases.</li>\n<li>The vendor for this project (Pathway, which turns into Horizon) ends up being referred to as Fujitsu, but the important note is ICL’s history.</li>\n</ul>\n</li>\n<li>\n<p>It’s important to note the priorities of the project, summarized by the National audit office as:</p>\n<ol>\n<li>\n<p>providing a fraud-free method of paying benefits that was a) automated, b) was cheaper, and c) continually reduced costs every year;</p>\n</li>\n<li>\n<p>automating the Post Office’s transactions for “other customers”, automating products and support processes to improve competitiveness, increase efficiency, and “enable greater commercial opportunities”;</p>\n</li>\n<li>\n<p>make reconciling benefits payments “full and speedy”; and</p>\n</li>\n<li>\n<p>provide “improved service” to the Post Office and the Benefits Agency</p>\n</li>\n</ol>\n</li>\n<li>\n<p>I’ll just call it as it is and say that the above is a magical goddamn laundry list, and the equivalent of “computers will make everything, literally everything, better”. There isn’t much that <em>isn’t</em> included in the above project objectives. Any <em>one</em> of these projects is complicated.</p>\n</li>\n<li>\n<p>Oh, and do it all by 1999, 3 years after the contract was awarded.</p>\n</li>\n<li>\n<p>Good news! By October 1996, just 5 months after contract award, “a limited version of the system” — 10 Post Offices, and paying one benefit (Child Benefit). This eventually got extended to 205 post offices, but hey guess what: at the time, there were <em>19,000</em> post offices, and see if you can guess how long the 1996-era contract assumed it would take to roll out a live trial <em>of the full system</em> to all 19,000 post offices? Go on. See if you can guess.</p>\n</li>\n<li>\n<p>Ten months. TEN MONTHS!</p>\n</li>\n<li>\n<p>But, in a level of understatement I can only aspire to, the NAO says “designing and developing a fully functional system proved much more complex and took much more longer than expected”.</p>\n</li>\n<li>\n<p>Yadda yadda yadda, the customers (the Benefits Agency and the Post Office) and the vendor decided it would be for the best if they came up with a new schedule (no doubt necessitating putting another finger in the wind and guessing), and, I don’t know, <em>tried harder</em> to do the impossible.</p>\n</li>\n<li>\n<p>Doing the impossible is, well, it’s in the name: impossible. There’s a notice of breach of contract served by the customer, the vendor counter-sues, and then you’ll be <em>shocked</em> to learn that the project was going to have to “increase prices by 30 percent” or “extend the contract by five years and raise prices by five per cent”.</p>\n</li>\n<li>\n<p>Refereeing this mess involved the Treasury (the money), the Department of Trade and Industry (the sponsor of the post Office), and the Prime Minister’s office because of course by now the project was very embarassing.</p>\n</li>\n<li>\n<p>Oh, and by the way: in 1997, shortly after the contract was awarded, there was a change in administration and 18 years of Conservative government ended, bringing in New Labour.</p>\n</li>\n<li>\n<p>In May 1999 (3 years after contract award, 24 months after the entire and about the project was descoped, and better to do that than lose face and cancel the whole thing. Instead: no smartcard but still “automate the Post Office”, make benefits payments by bank transfer, instead of via a card, let people still collect cash, and make special arrangements for those who don’t have a bank account.</p>\n</li>\n<li>\n<p>The whole contract is effectively cancelled anyway with the descoping.</p>\n</li>\n</ol>\n<p>That’s just the first part of the project! Business as usual for a large, PR-driven, wildly unrealistic technology project designed to make everything better and with (from this point of view), lofty and undefined goals.</p>\n<hr />\n<h2>2. How Management Uses Technology</h2>\n<p>Here’s what happened after Horizon, the name of the IT system developed by ICL/Fujitsu, started to be used. This part is summarized from <a href=\"https://www.postofficetrial.com/2019/08/whats-this-all-about.html\">Post Office Trial</a>:</p>\n<ul>\n<li>\n<p>Horizon is like a combination EPOS/EFTPOS/ERP system for the Post Office. It’s used by all of the post office branches (all 19,000 of them, and 60,000-odd staff).</p>\n</li>\n<li>\n<p>So if Horizon says the balance and accounts of the post office branch you run are off, well… they’re off. “If Horizon says you should £80,000 worth of cash and stock and you only have £50,000, the Post Office considered you owed them £30,000.”</p>\n</li>\n<li>\n<p>Unsurprising surprise: Horizon has bugs in it that result in discrepancies like this.</p>\n</li>\n<li>\n<p>Unsurprising surprise 2: management and bureaucracy either fail to recognize, or are institutionally unable to recognize that its IT system could possibly have any faults.</p>\n</li>\n<li>\n<p>Unsurprising surprise 3: management act as if these discrepancies are clearly somebody else’s fault.</p>\n</li>\n<li>\n<p>If you’re an employee faced with this discrepancy, you have a few choices:</p>\n<ol>\n<li>\n<p>refuse to sign off on accounts you know you’re wrong (you end up being sidelined, so not great for your career);</p>\n</li>\n<li>\n<p>pay back the money you know isn’t missing;</p>\n</li>\n<li>\n<p>shut your branch (breaching your contract to run a branch)</p>\n</li>\n</ol>\n<p>Or you have a fourth choice. You could sign off on accounts that you <em>know</em> inside aren’t right. The Post Office “called this false accounting”.</p>\n</li>\n<li>\n<p>That’s when this got worse. The Post Office prosecuted (criminal charges) these subpostmasters who didn’t make good large discrepancies. “This was done on IT evidence alone, <em>without proof of criminal intent</em>” (my emphasis. Convictions meant the Post Office could seize assets and effectively put people into bankruptcy.</p>\n</li>\n<li>\n<p>These prosecutions and convictions started in 2003.</p>\n</li>\n</ul>\n<hr />\n<h2>3. What happened next…</h2>\n<p>On Friday 23 April 2021, the UK Court of Appeal cleared the convictions of 39 post office workers [<a href=\"https://www.postofficetrial.com/2021/04/court-of-appeal-quashed-further-39.html\">Post Office Trial</a>, <a href=\"https://www.theguardian.com/uk-news/2021/apr/23/court-clears-39-post-office-staff-convicted-due-to-corrupt-data\">The Guardian</a>]. That’s 45 convictions, to date, that have been cleared.</p>\n<p>The case,<a href=\"https://www.judiciary.uk/judgments/hamilton-others-v-post-office-limited/\">Hamilton &amp; Others -v- Post Office Limited</a> [2021] EWCA Crim 577 has both the <a href=\"https://www.judiciary.uk/wp-content/uploads/2021/04/Hamilton-Others-v-Post-Office-summary-230421.pdf\">summary</a> (4 pages) and <a href=\"https://www.judiciary.uk/wp-content/uploads/2021/04/Hamilton-Others-v-Post-Office-judgment-230421.pdf\">full judgment</a> (92 pages) available (as PDFs, natch, and hosted on a Wordpress site! Gotta love those wp-content URLs).</p>\n<p>Here’s key examples of management behavior from the <em>summary</em> of the judgment:</p>\n<ul>\n<li>\n<p>The Post Office “knew there were serious issues about the reliability of Horizon”, “Yet it does not appear that the Post Office adequately considered or made relevant disclosure of problems or concerns with Horizon in any of the [prosecution] cases”</p>\n</li>\n<li>\n<p>“On the contrary, [the Post Office] <em>consistently asserted that Horizon was robust or reliable</em>” (my emphasis). It also didn’t make any attempt to investigate when subpostmasters said there was a problem with Horizon.</p>\n</li>\n<li>\n<p>This failure to disclose problems with Horizon and the failure to investigate reported problems — when involved in prosecutions — were “so egregious as to make the prosecution of Horizon cases <em>an affront to the conscience of the court</em>”. Each prosecution that succeeded “reinforced the asserted reliability of Horizon”.</p>\n</li>\n</ul>\n<p>I love court cases like this (see for example <a href=\"https://en.wikipedia.org/wiki/William_Alsup\">Judge Alsup</a>’s cases) because they typically include (in England, at least) dry, withering descriptions of horrific technology systems in the classical judicial style. The <a href=\"https://www.judiciary.uk/wp-content/uploads/2021/04/Hamilton-Others-v-Post-Office-judgment-230421.pdf\">full judgment</a> outlines Horizon in paras 9-18, but in all the good kind of detail. For example, Horizon is still in use now (actually, it’s now the subject of a big replacement project to move to the Cloud, so… <em>insert combination sigh/laugh</em>), and if you do the maths (contract awarded in 1996, remember) that means there must be an Old Horizon System (referred to in the Horizon Judgment as Legacy Horizon”) and later a modernized version (“Horizon Online”) and apologies if this is triggering or traumatic in any way.</p>\n<hr />\n<h2>4. …and what can we learn</h2>\n<p>It’s offensive to see the Post Office leadership’s approach to what happened with Horizon. A system that was intended to reduce <em>benefit fraud</em> instead was used to <em>prosecute innocent individuals</em>. The people accused were not listened to. Management knew of defects but declined to investigate them.</p>\n<p>Why might management do this? The judge in the High Court case (the case before the Court of Appeal) said:</p>\n<blockquote>\n<p>“In my judgment, the stance taken by the Post Office at the time in 2013 (when a subpostmaster said Horizon had “put a phantom cheque on the [accounting] line” and spoke of going to his Minister of Parliament) demonstrates the most dreadful complacency, and total lack of interest in investigating these serious issues, bordering on <em>fearfulness of what might be found if they were properly investigated</em>” (my emphasis).</p>\n</blockquote>\n<p>If only, you might cry, there had been better project management! If only there had been a risks register, for example! But of course there was. The previous case had a “heavily-redacted “Extract from Lessons Learned Log” of November 2015, in which a Post Office official acknowledged there had been “a failure to be open and honest when issues arise eg roll out of Horizon””.</p>\n<p>Here’s some quick notes, and unfortunately, they would probably not come as a surprise:</p>\n<ul>\n<li>\n<p>This was a megaproject. A wholly irresponsible, PR-driven, fix-everything megaproject. The laundry list of objectives, the promises of full-automation, the perennial idea of dealing with substantial benefit fraud (when most studies [yeah, I know, citation needed] find that the level of fraud is pretty small, and fraud mitigation levels instead persecute claimants).</p>\n</li>\n<li>\n<p>There were no <em>users</em>. Whether internal or external, it doesn’t look like the user experience was taken account of. What was supposed to be improved? What specific needs? Postmasters and subpostmasters <em>didn’t have a choice</em> about using Horizon.</p>\n</li>\n<li>\n<p>A stupendous number of stakeholders: at the executive level, a parent department/agency (The Department of Trade and Industry) and the money (HM Treasury), the Post Office itself, the vendor <em>and then</em> all 60,000 post office staff who would need training.</p>\n</li>\n<li>\n<p>A frankly irresponsible timeline (10 months to a full-scale pilot to all 19,000 post offices, transitioning from paper-based benefits books).</p>\n</li>\n<li>\n<p>Fetishization of new technology: 1996, and the new system needs to use smart cards, and within 4 years, stakeholders can accept descoping to electronic bank payments, which are totally a thing in the UK unlike the uncivilized U.S.</p>\n</li>\n<li>\n<p>Outsourcing of risk to the private sector. I can’t even begin with this one.</p>\n</li>\n<li>\n<p>A big Digital Transformation project that goes wrong. Again.</p>\n</li>\n<li>\n<p>A new procurement method, the <a href=\"https://en.wikipedia.org/wiki/Private_finance_initiative\">Private Finance Initiative</a> a magical innovative procurement policy where “private firms are contracted to complete and manage public projects”, and, well, financialization of government projects.</p>\n</li>\n<li>\n<p>Charismatic megaprojects that survive administration changes (and even party political changes) in my view because of their unrealistic promises and the inability of leadership to see those unrealistic promises as a bunch of unrealizable bullshit, but are happy to leave someone else holding the bag.</p>\n</li>\n</ul>\n<p>And, finally:</p>\n<p>The combination of promises and fear. There’s a note in the Court of Appeal judgment that the Post Office is one of the UK’s most trusted brands, and I’d have to agree: it’s true. The Post Office was incredibly trusted. That trust started to erode with its privatization, but Brits of a certain age have an image of the Post Office as a local institution. Management, I imagine, needed to protect that trust. Imagine saying that the <em>entire accounting system</em> of the Post Office was buggy.</p>\n<p>So they chose the fear-based alternative instead of coming clean. They doubled down. They insisted that <em>of course</em> the system was trustworthy. They had to act <em>as if</em> the system was trustworthy. And that resulted in people going to jail, becoming estranged from their families, and died by <a href=\"https://www.standard.co.uk/news/uk/post-office-scandal-worker-suicide-wrongly-accused-stealing-b931504.html\">suicide</a> [The Evening Standard, April 12 2021].</p>\n<hr />\n<h2>5. The Biggest Lesson</h2>\n<p>The sister of the former post office worker who died by suicide said: “<a href=\"https://www.standard.co.uk/news/uk/post-office-scandal-worker-suicide-wrongly-accused-stealing-b931504.html\">a bloody faulty computer system killed my brother</a>”. [The Evening Standard, April 12 2021]</p>\n<p>My heart goes out to Jayne Caveen. And I hate to do this: a computer system did not kill her brother. Horrible people in management killed her brother, and it’s easiest to blame it on a computer system.</p>\n<p><em>People</em>, people in management, people in positions of trust <em>people running one of the most trusted institutions in England</em> made those decisions to double down and to persecute and prosecute people knowing that the evidence wasn’t reliable and <em>concealing</em> that evidence wasn’t reliable. Intentionally <em>not investigating</em> reports for fear of what might be found, because it <em>might</em> affect public perception of trust, or because it might be discoverable and admissable in court. Cowardice, fear and a lack of integrity is what happened. Pride and boastfulness in a system that could never do what it could. Using technology was and is an excuse. Not taking responsibility is what happened.</p>\n<p>Technology is <em>for people and made by people</em>  and this is what happens when the people running it don’t realize that.</p>\n<p>It doesn’t have to be like this. For that, writing for another day.</p>\n<hr />\n<h2>References / further reading</h2>\n<ul>\n<li><a href=\"https://www.theguardian.com/politics/1999/may/25/uk.politicalnews2\">Ministers drop £1.5bn benefit swipe cards</a>, The Guardian, 25 May 1999.</li>\n<li>Computer Weekly, a UK trade magazine covered the status of Project Pathway — later, Horizon — in <a href=\"https://www.computerweekly.com/feature/More-than-the-cost-of-a-first-class-stamp\">More than the cost of a first-class stamp</a> on 9 November, 2009.</li>\n<li><a href=\"https://www.nao.org.uk/report/the-cancellation-of-the-benefits-payment-card-project/\">The Cancellation of the Benefits Payment Card project</a>, U.K. National Audit Office, 18 August 2000.</li>\n<li><a href=\"https://www.postofficetrial.com/2019/01/articles.html\">Post Office Trial</a> has one of the best overviews and most detail about what happened with Horizon, and a <a href=\"https://www.postofficetrial.com/2019/01/articles.html\">Start Here</a> article</li>\n<li><a href=\"https://www.judiciary.uk/judgments/hamilton-others-v-post-office-limited/\">Hamilton &amp; Others -v- Post Office Limited</a> [2021] EWCA Crim 577, the Court of Appeal judgment <a href=\"https://www.judiciary.uk/wp-content/uploads/2021/04/Hamilton-Others-v-Post-Office-summary-230421.pdf\">summary</a> (4 pages) and <a href=\"https://www.judiciary.uk/wp-content/uploads/2021/04/Hamilton-Others-v-Post-Office-judgment-230421.pdf\">full judgment</a> (92 pages).</li>\n</ul>\n<hr />\n<p>That’s it for today, with this Very Special Episode.</p>\n<p>How are you doing?</p>\n<p>Best,</p>\n<p>Dan</p>\n","body_text":"0.0 Context setting\n\nApril 27, 2021 and a day earlier than I wanted to send another episode out, but this one matters to me.\n\nHousekeeping: if you’re interested in (and able to) support my writing and would like to subscribe, you can do so by visiting\nhttps://newsletter.danhon.com\nand entering your email address — even if you’re an existing subscriber — and you’ll be taken to a page where you can do a paid subscription.\n\nTW/CW and note: the language used around suicide has been changed from an earlier version. Thank you to the reader who reminded me. If you are in crisis, in the U.S. you can contact the\nSuicide Prevention Hotline\nand in the U.K., the\nSamaritans\n.\n\n__\n\n1.0 One thing that caught my attention\n\nOnly one thing today: about the UK Post Office’s Horizon IT scandal.\n\nSeeing Past the Horizon\n\nI wrote very briefly\nlast episode\nabout Horizon, the UK Post Office’s IT modernization effort and at the request of Jennifer Pahlka, I’m going to go into a little more about it here.\n\nI’m going to learn and write about five things for this piece:\n\nHow technology projects are procured\n\nHow management uses technology\n\nWhat happened next…\n\n… and what we can learn\n\nThe Biggest Lesson\n\n1. How Technology Projects Are Procured\n\nIn 1995, as part of the Conservative Party annual conference, the minister for Social Security announced how a smartcard would reduce benefit fraud (“The personal details of all 15 million benefit claimants would have been carried on a computerised strip which would have been impossible to forge” [\nThe Guardian, 25 May 1999\n]).\n\nThis became the Benefits Payment Card project, and a contract was awarded to Pathway, a subsidiary of ICL, a technology contractor, in May 1996.\n\nImportant sidebar!\n\nICL [\nWikipedia\n] is/was your stereotypical bureaucratic technology company, founded in 1968. That date is important: it both\nmade\ncomputers, back when governments and large corporations needed computers that didn’t exist yet. This necessarily meant both hardware\nand\nsoftware, the kind of corporate history that involves inventing how to do databases.\n\nThe vendor for this project (Pathway, which turns into Horizon) ends up being referred to as Fujitsu, but the important note is ICL’s history.\n\nIt’s important to note the priorities of the project, summarized by the National audit office as:\n\nproviding a fraud-free method of paying benefits that was a) automated, b) was cheaper, and c) continually reduced costs every year;\n\nautomating the Post Office’s transactions for “other customers”, automating products and support processes to improve competitiveness, increase efficiency, and “enable greater commercial opportunities”;\n\nmake reconciling benefits payments “full and speedy”; and\n\nprovide “improved service” to the Post Office and the Benefits Agency\n\nI’ll just call it as it is and say that the above is a magical goddamn laundry list, and the equivalent of “computers will make everything, literally everything, better”. There isn’t much that\nisn’t\nincluded in the above project objectives. Any\none\nof these projects is complicated.\n\nOh, and do it all by 1999, 3 years after the contract was awarded.\n\nGood news! By October 1996, just 5 months after contract award, “a limited version of the system” — 10 Post Offices, and paying one benefit (Child Benefit). This eventually got extended to 205 post offices, but hey guess what: at the time, there were\n19,000\npost offices, and see if you can guess how long the 1996-era contract assumed it would take to roll out a live trial\nof the full system\nto all 19,000 post offices? Go on. See if you can guess.\n\nTen months. TEN MONTHS!\n\nBut, in a level of understatement I can only aspire to, the NAO says “designing and developing a fully functional system proved much more complex and took much more longer than expected”.\n\nYadda yadda yadda, the customers (the Benefits Agency and the Post Office) and the vendor decided it would be for the best if they came up with a new schedule (no doubt necessitating putting another finger in the wind and guessing), and, I don’t know,\ntried harder\nto do the impossible.\n\nDoing the impossible is, well, it’s in the name: impossible. There’s a notice of breach of contract served by the customer, the vendor counter-sues, and then you’ll be\nshocked\nto learn that the project was going to have to “increase prices by 30 percent” or “extend the contract by five years and raise prices by five per cent”.\n\nRefereeing this mess involved the Treasury (the money), the Department of Trade and Industry (the sponsor of the post Office), and the Prime Minister’s office because of course by now the project was very embarassing.\n\nOh, and by the way: in 1997, shortly after the contract was awarded, there was a change in administration and 18 years of Conservative government ended, bringing in New Labour.\n\nIn May 1999 (3 years after contract award, 24 months after the entire and about the project was descoped, and better to do that than lose face and cancel the whole thing. Instead: no smartcard but still “automate the Post Office”, make benefits payments by bank transfer, instead of via a card, let people still collect cash, and make special arrangements for those who don’t have a bank account.\n\nThe whole contract is effectively cancelled anyway with the descoping.\n\nThat’s just the first part of the project! Business as usual for a large, PR-driven, wildly unrealistic technology project designed to make everything better and with (from this point of view), lofty and undefined goals.\n\n2. How Management Uses Technology\n\nHere’s what happened after Horizon, the name of the IT system developed by ICL/Fujitsu, started to be used. This part is summarized from\nPost Office Trial\n:\n\nHorizon is like a combination EPOS/EFTPOS/ERP system for the Post Office. It’s used by all of the post office branches (all 19,000 of them, and 60,000-odd staff).\n\nSo if Horizon says the balance and accounts of the post office branch you run are off, well… they’re off. “If Horizon says you should £80,000 worth of cash and stock and you only have £50,000, the Post Office considered you owed them £30,000.”\n\nUnsurprising surprise: Horizon has bugs in it that result in discrepancies like this.\n\nUnsurprising surprise 2: management and bureaucracy either fail to recognize, or are institutionally unable to recognize that its IT system could possibly have any faults.\n\nUnsurprising surprise 3: management act as if these discrepancies are clearly somebody else’s fault.\n\nIf you’re an employee faced with this discrepancy, you have a few choices:\n\nrefuse to sign off on accounts you know you’re wrong (you end up being sidelined, so not great for your career);\n\npay back the money you know isn’t missing;\n\nshut your branch (breaching your contract to run a branch)\n\nOr you have a fourth choice. You could sign off on accounts that you\nknow\ninside aren’t right. The Post Office “called this false accounting”.\n\nThat’s when this got worse. The Post Office prosecuted (criminal charges) these subpostmasters who didn’t make good large discrepancies. “This was done on IT evidence alone,\nwithout proof of criminal intent\n” (my emphasis. Convictions meant the Post Office could seize assets and effectively put people into bankruptcy.\n\nThese prosecutions and convictions started in 2003.\n\n3. What happened next…\n\nOn Friday 23 April 2021, the UK Court of Appeal cleared the convictions of 39 post office workers [\nPost Office Trial\n,\nThe Guardian\n]. That’s 45 convictions, to date, that have been cleared.\n\nThe case,\nHamilton & Others -v- Post Office Limited\n[2021] EWCA Crim 577 has both the\nsummary\n(4 pages) and\nfull judgment\n(92 pages) available (as PDFs, natch, and hosted on a Wordpress site! Gotta love those wp-content URLs).\n\nHere’s key examples of management behavior from the\nsummary\nof the judgment:\n\nThe Post Office “knew there were serious issues about the reliability of Horizon”, “Yet it does not appear that the Post Office adequately considered or made relevant disclosure of problems or concerns with Horizon in any of the [prosecution] cases”\n\n“On the contrary, [the Post Office]\nconsistently asserted that Horizon was robust or reliable\n” (my emphasis). It also didn’t make any attempt to investigate when subpostmasters said there was a problem with Horizon.\n\nThis failure to disclose problems with Horizon and the failure to investigate reported problems — when involved in prosecutions — were “so egregious as to make the prosecution of Horizon cases\nan affront to the conscience of the court\n”. Each prosecution that succeeded “reinforced the asserted reliability of Horizon”.\n\nI love court cases like this (see for example\nJudge Alsup\n’s cases) because they typically include (in England, at least) dry, withering descriptions of horrific technology systems in the classical judicial style. The\nfull judgment\noutlines Horizon in paras 9-18, but in all the good kind of detail. For example, Horizon is still in use now (actually, it’s now the subject of a big replacement project to move to the Cloud, so…\ninsert combination sigh/laugh\n), and if you do the maths (contract awarded in 1996, remember) that means there must be an Old Horizon System (referred to in the Horizon Judgment as Legacy Horizon”) and later a modernized version (“Horizon Online”) and apologies if this is triggering or traumatic in any way.\n\n4. …and what can we learn\n\nIt’s offensive to see the Post Office leadership’s approach to what happened with Horizon. A system that was intended to reduce\nbenefit fraud\ninstead was used to\nprosecute innocent individuals\n. The people accused were not listened to. Management knew of defects but declined to investigate them.\n\nWhy might management do this? The judge in the High Court case (the case before the Court of Appeal) said:\n\n“In my judgment, the stance taken by the Post Office at the time in 2013 (when a subpostmaster said Horizon had “put a phantom cheque on the [accounting] line” and spoke of going to his Minister of Parliament) demonstrates the most dreadful complacency, and total lack of interest in investigating these serious issues, bordering on\nfearfulness of what might be found if they were properly investigated\n” (my emphasis).\n\nIf only, you might cry, there had been better project management! If only there had been a risks register, for example! But of course there was. The previous case had a “heavily-redacted “Extract from Lessons Learned Log” of November 2015, in which a Post Office official acknowledged there had been “a failure to be open and honest when issues arise eg roll out of Horizon””.\n\nHere’s some quick notes, and unfortunately, they would probably not come as a surprise:\n\nThis was a megaproject. A wholly irresponsible, PR-driven, fix-everything megaproject. The laundry list of objectives, the promises of full-automation, the perennial idea of dealing with substantial benefit fraud (when most studies [yeah, I know, citation needed] find that the level of fraud is pretty small, and fraud mitigation levels instead persecute claimants).\n\nThere were no\nusers\n. Whether internal or external, it doesn’t look like the user experience was taken account of. What was supposed to be improved? What specific needs? Postmasters and subpostmasters\ndidn’t have a choice\nabout using Horizon.\n\nA stupendous number of stakeholders: at the executive level, a parent department/agency (The Department of Trade and Industry) and the money (HM Treasury), the Post Office itself, the vendor\nand then\nall 60,000 post office staff who would need training.\n\nA frankly irresponsible timeline (10 months to a full-scale pilot to all 19,000 post offices, transitioning from paper-based benefits books).\n\nFetishization of new technology: 1996, and the new system needs to use smart cards, and within 4 years, stakeholders can accept descoping to electronic bank payments, which are totally a thing in the UK unlike the uncivilized U.S.\n\nOutsourcing of risk to the private sector. I can’t even begin with this one.\n\nA big Digital Transformation project that goes wrong. Again.\n\nA new procurement method, the\nPrivate Finance Initiative\na magical innovative procurement policy where “private firms are contracted to complete and manage public projects”, and, well, financialization of government projects.\n\nCharismatic megaprojects that survive administration changes (and even party political changes) in my view because of their unrealistic promises and the inability of leadership to see those unrealistic promises as a bunch of unrealizable bullshit, but are happy to leave someone else holding the bag.\n\nAnd, finally:\n\nThe combination of promises and fear. There’s a note in the Court of Appeal judgment that the Post Office is one of the UK’s most trusted brands, and I’d have to agree: it’s true. The Post Office was incredibly trusted. That trust started to erode with its privatization, but Brits of a certain age have an image of the Post Office as a local institution. Management, I imagine, needed to protect that trust. Imagine saying that the\nentire accounting system\nof the Post Office was buggy.\n\nSo they chose the fear-based alternative instead of coming clean. They doubled down. They insisted that\nof course\nthe system was trustworthy. They had to act\nas if\nthe system was trustworthy. And that resulted in people going to jail, becoming estranged from their families, and died by\nsuicide\n[The Evening Standard, April 12 2021].\n\n5. The Biggest Lesson\n\nThe sister of the former post office worker who died by suicide said: “\na bloody faulty computer system killed my brother\n”. [The Evening Standard, April 12 2021]\n\nMy heart goes out to Jayne Caveen. And I hate to do this: a computer system did not kill her brother. Horrible people in management killed her brother, and it’s easiest to blame it on a computer system.\n\nPeople\n, people in management, people in positions of trust\npeople running one of the most trusted institutions in England\nmade those decisions to double down and to persecute and prosecute people knowing that the evidence wasn’t reliable and\nconcealing\nthat evidence wasn’t reliable. Intentionally\nnot investigating\nreports for fear of what might be found, because it\nmight\naffect public perception of trust, or because it might be discoverable and admissable in court. Cowardice, fear and a lack of integrity is what happened. Pride and boastfulness in a system that could never do what it could. Using technology was and is an excuse. Not taking responsibility is what happened.\n\nTechnology is\nfor people and made by people\nand this is what happens when the people running it don’t realize that.\n\nIt doesn’t have to be like this. For that, writing for another day.\n\nReferences / further reading\n\nMinisters drop £1.5bn benefit swipe cards\n, The Guardian, 25 May 1999.\n\nComputer Weekly, a UK trade magazine covered the status of Project Pathway — later, Horizon — in\nMore than the cost of a first-class stamp\non 9 November, 2009.\n\nThe Cancellation of the Benefits Payment Card project\n, U.K. National Audit Office, 18 August 2000.\n\nPost Office Trial\nhas one of the best overviews and most detail about what happened with Horizon, and a\nStart Here\narticle\n\nHamilton & Others -v- Post Office Limited\n[2021] EWCA Crim 577, the Court of Appeal judgment\nsummary\n(4 pages) and\nfull judgment\n(92 pages).\n\nThat’s it for today, with this Very Special Episode.\n\nHow are you doing?\n\nBest,\n\nDan","raw_format":"markdown","source":"app","summary":"This issue examines the UK Post Office's catastrophic Horizon IT scandal, tracing how an ambitious 1990s technology modernization project designed to reduce benefit fraud and automate postal services spiraled into a system that falsely accused thousands of postal workers of theft and embezzlement. The piece walks through how the project was conceived with impossibly ambitious, vaguely defined goals, bungled procurement that promised delivery timelines that were never realistic, and cost overruns that led to descoping—only to then explore how the system was weaponized by management as an unquestionable authority that workers were held responsible for, with Horizon's data treated as infallible truth even when it contradicted reality. Throughout, there's an implicit argument about how technology gets deployed not as a tool to solve problems but as a way for institutions to avoid accountability and shift blame onto individuals, and how the original sin of poor procurement and unrealistic expectations set the stage for years of injustice.","reading_minutes":13,"links":[{"url":"https://newsletter.danhon.com","normalized_url":"https://newsletter.danhon.com/","domain":"danhon.com","anchor_text":"https://newsletter.danhon.com","is_archive":0,"archive_url":null,"archive_service":null,"category":"self"},{"url":"https://suicidepreventionlifeline.org/","normalized_url":"https://suicidepreventionlifeline.org/","domain":"suicidepreventionlifeline.org","anchor_text":"Suicide Prevention Hotline","is_archive":0,"archive_url":null,"archive_service":null,"category":"external"},{"url":"https://www.samaritans.org/how-we-can-help/contact-samaritan/","normalized_url":"https://samaritans.org/how-we-can-help/contact-samaritan","domain":"samaritans.org","anchor_text":"Samaritans","is_archive":0,"archive_url":null,"archive_service":null,"category":"external"},{"url":"https://newsletter.danhon.com/archive/9c50a908-282c-4966-8845-739d63465db0","normalized_url":"https://newsletter.danhon.com/archive/9c50a908-282c-4966-8845-739d63465db0","domain":"danhon.com","anchor_text":"last episode","is_archive":0,"archive_url":null,"archive_service":null,"category":"self"},{"url":"https://www.theguardian.com/politics/1999/may/25/uk.politicalnews2","normalized_url":"https://theguardian.com/politics/1999/may/25/uk.politicalnews2","domain":"theguardian.com","anchor_text":"The Guardian, 25 May 1999","is_archive":0,"archive_url":null,"archive_service":null,"category":"external"},{"url":"https://en.wikipedia.org/wiki/International_Computers_Limited","normalized_url":"https://en.wikipedia.org/wiki/International_Computers_Limited","domain":"wikipedia.org","anchor_text":"Wikipedia","is_archive":0,"archive_url":null,"archive_service":null,"category":"external"},{"url":"https://www.postofficetrial.com/2019/08/whats-this-all-about.html","normalized_url":"https://postofficetrial.com/2019/08/whats-this-all-about.html","domain":"postofficetrial.com","anchor_text":"Post Office Trial","is_archive":0,"archive_url":null,"archive_service":null,"category":"external"},{"url":"https://www.postofficetrial.com/2021/04/court-of-appeal-quashed-further-39.html","normalized_url":"https://postofficetrial.com/2021/04/court-of-appeal-quashed-further-39.html","domain":"postofficetrial.com","anchor_text":"Post Office Trial","is_archive":0,"archive_url":null,"archive_service":null,"category":"external"},{"url":"https://www.theguardian.com/uk-news/2021/apr/23/court-clears-39-post-office-staff-convicted-due-to-corrupt-data","normalized_url":"https://theguardian.com/uk-news/2021/apr/23/court-clears-39-post-office-staff-convicted-due-to-corrupt-data","domain":"theguardian.com","anchor_text":"The Guardian","is_archive":0,"archive_url":null,"archive_service":null,"category":"external"},{"url":"https://www.judiciary.uk/judgments/hamilton-others-v-post-office-limited/","normalized_url":"https://judiciary.uk/judgments/hamilton-others-v-post-office-limited","domain":"judiciary.uk","anchor_text":"Hamilton & Others -v- Post Office Limited","is_archive":0,"archive_url":null,"archive_service":null,"category":"external"},{"url":"https://www.judiciary.uk/wp-content/uploads/2021/04/Hamilton-Others-v-Post-Office-summary-230421.pdf","normalized_url":"https://judiciary.uk/wp-content/uploads/2021/04/Hamilton-Others-v-Post-Office-summary-230421.pdf","domain":"judiciary.uk","anchor_text":"summary","is_archive":0,"archive_url":null,"archive_service":null,"category":"external"},{"url":"https://www.judiciary.uk/wp-content/uploads/2021/04/Hamilton-Others-v-Post-Office-judgment-230421.pdf","normalized_url":"https://judiciary.uk/wp-content/uploads/2021/04/Hamilton-Others-v-Post-Office-judgment-230421.pdf","domain":"judiciary.uk","anchor_text":"full judgment","is_archive":0,"archive_url":null,"archive_service":null,"category":"external"},{"url":"https://en.wikipedia.org/wiki/William_Alsup","normalized_url":"https://en.wikipedia.org/wiki/William_Alsup","domain":"wikipedia.org","anchor_text":"Judge Alsup","is_archive":0,"archive_url":null,"archive_service":null,"category":"external"},{"url":"https://www.judiciary.uk/wp-content/uploads/2021/04/Hamilton-Others-v-Post-Office-judgment-230421.pdf","normalized_url":"https://judiciary.uk/wp-content/uploads/2021/04/Hamilton-Others-v-Post-Office-judgment-230421.pdf","domain":"judiciary.uk","anchor_text":"full judgment","is_archive":0,"archive_url":null,"archive_service":null,"category":"external"},{"url":"https://en.wikipedia.org/wiki/Private_finance_initiative","normalized_url":"https://en.wikipedia.org/wiki/Private_finance_initiative","domain":"wikipedia.org","anchor_text":"Private Finance Initiative","is_archive":0,"archive_url":null,"archive_service":null,"category":"external"},{"url":"https://www.standard.co.uk/news/uk/post-office-scandal-worker-suicide-wrongly-accused-stealing-b931504.html","normalized_url":"https://standard.co.uk/news/uk/post-office-scandal-worker-suicide-wrongly-accused-stealing-b931504.html","domain":"standard.co.uk","anchor_text":"suicide","is_archive":0,"archive_url":null,"archive_service":null,"category":"external"},{"url":"https://www.standard.co.uk/news/uk/post-office-scandal-worker-suicide-wrongly-accused-stealing-b931504.html","normalized_url":"https://standard.co.uk/news/uk/post-office-scandal-worker-suicide-wrongly-accused-stealing-b931504.html","domain":"standard.co.uk","anchor_text":"a bloody faulty computer system killed my brother","is_archive":0,"archive_url":null,"archive_service":null,"category":"external"},{"url":"https://www.theguardian.com/politics/1999/may/25/uk.politicalnews2","normalized_url":"https://theguardian.com/politics/1999/may/25/uk.politicalnews2","domain":"theguardian.com","anchor_text":"Ministers drop £1.5bn benefit swipe cards","is_archive":0,"archive_url":null,"archive_service":null,"category":"external"},{"url":"https://www.computerweekly.com/feature/More-than-the-cost-of-a-first-class-stamp","normalized_url":"https://computerweekly.com/feature/More-than-the-cost-of-a-first-class-stamp","domain":"computerweekly.com","anchor_text":"More than the cost of a first-class stamp","is_archive":0,"archive_url":null,"archive_service":null,"category":"external"},{"url":"https://www.nao.org.uk/report/the-cancellation-of-the-benefits-payment-card-project/","normalized_url":"https://nao.org.uk/report/the-cancellation-of-the-benefits-payment-card-project","domain":"nao.org.uk","anchor_text":"The Cancellation of the Benefits Payment Card project","is_archive":0,"archive_url":null,"archive_service":null,"category":"external"},{"url":"https://www.postofficetrial.com/2019/01/articles.html","normalized_url":"https://postofficetrial.com/2019/01/articles.html","domain":"postofficetrial.com","anchor_text":"Post Office Trial","is_archive":0,"archive_url":null,"archive_service":null,"category":"external"},{"url":"https://www.postofficetrial.com/2019/01/articles.html","normalized_url":"https://postofficetrial.com/2019/01/articles.html","domain":"postofficetrial.com","anchor_text":"Start Here","is_archive":0,"archive_url":null,"archive_service":null,"category":"external"},{"url":"https://www.judiciary.uk/judgments/hamilton-others-v-post-office-limited/","normalized_url":"https://judiciary.uk/judgments/hamilton-others-v-post-office-limited","domain":"judiciary.uk","anchor_text":"Hamilton & Others -v- Post Office Limited","is_archive":0,"archive_url":null,"archive_service":null,"category":"external"},{"url":"https://www.judiciary.uk/wp-content/uploads/2021/04/Hamilton-Others-v-Post-Office-summary-230421.pdf","normalized_url":"https://judiciary.uk/wp-content/uploads/2021/04/Hamilton-Others-v-Post-Office-summary-230421.pdf","domain":"judiciary.uk","anchor_text":"summary","is_archive":0,"archive_url":null,"archive_service":null,"category":"external"},{"url":"https://www.judiciary.uk/wp-content/uploads/2021/04/Hamilton-Others-v-Post-Office-judgment-230421.pdf","normalized_url":"https://judiciary.uk/wp-content/uploads/2021/04/Hamilton-Others-v-Post-Office-judgment-230421.pdf","domain":"judiciary.uk","anchor_text":"full judgment","is_archive":0,"archive_url":null,"archive_service":null,"category":"external"}],"sections":[{"id":1867,"ord":0,"number":"0.0","heading":"Context setting","level":1,"word_count":119},{"id":1868,"ord":1,"number":"1.0","heading":"One thing that caught my attention","level":2,"word_count":18},{"id":1869,"ord":2,"number":null,"heading":"Seeing Past the Horizon","level":2,"word_count":70},{"id":1870,"ord":3,"number":"1","heading":"How Technology Projects Are Procured","level":2,"word_count":709},{"id":1871,"ord":4,"number":"2","heading":"How Management Uses Technology","level":2,"word_count":286},{"id":1872,"ord":5,"number":"3","heading":"What happened next…","level":2,"word_count":337},{"id":1873,"ord":6,"number":"4","heading":"…and what can we learn","level":2,"word_count":650},{"id":1874,"ord":7,"number":"5","heading":"The Biggest Lesson","level":2,"word_count":213},{"id":1875,"ord":8,"number":null,"heading":"References / further reading","level":2,"word_count":122}]}