{"id":214897,"date":"2022-01-28T05:35:55","date_gmt":"2022-01-28T03:35:55","guid":{"rendered":"http:\/\/www.groundup.org.za\/article\/parliaments-botched-digitisation-may-mean-millions-of-precious-documents-were-lost-in-the-fire\/"},"modified":"2022-01-28T05:35:55","modified_gmt":"2022-01-28T03:35:55","slug":"parliaments-botched-digitisation-may-mean-millions-of-precious-documents-were-lost-in-the-fire","status":"publish","type":"post","link":"https:\/\/www.myza.co.za\/press\/parliaments-botched-digitisation-may-mean-millions-of-precious-documents-were-lost-in-the-fire\/","title":{"rendered":"Parliament\u2019s botched digitisation may mean millions of precious documents were lost in the fire"},"content":{"rendered":"<div id=\"article_body\">\n<p><a class=\"bigger-image\" href=\"https:\/\/www.groundup.org.za\/media\/uploads\/images\/Third%20Party\/parliament-digital-20220127\/botched-scan-example-1.jpg\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" alt class=\"warn_big\" src=\"http:\/\/www.myza.co.za\/press\/wp-content\/uploads\/2022\/01\/parliaments-botched-digitisation-may-mean-millions-of-precious-documents-were-lost-in-the-fire.jpg\"><\/a><\/p>\n<p class=\"caption\">In this scan of the Hansard, created by i-Kno, every second page of this 16-page document is illegible.<\/p>\n<ul>\n<li>Valuable records in Parliament\u2019s library are likely to have been damaged or destroyed in the fire earlier this month.<\/li>\n<li>A project about five years ago was supposed to create a digital store of Parliament\u2019s archive.<\/li>\n<li>But quality-control samples suggest that nearly half the pages were not scanned properly, and there are troubling questions about how the project was managed, especially by Parliament itself.<\/li>\n<\/ul>\n<p id=\"docs-internal-guid-35ec7224-7fff-1c02-e2fa-9ec678a5329a\">A botched digitisation project has probably condemned irreplaceable documents to extinction following the fire in Parliament.<img loading=\"lazy\" decoding=\"async\" alt class=\"leave\" height=\"1\" id=\"gu_counter\" src=\"http:\/\/www.myza.co.za\/press\/wp-content\/uploads\/2022\/01\/parliaments-botched-digitisation-may-mean-millions-of-precious-documents-were-lost-in-the-fire.gif\" width=\"1\"><\/p>\n<p>Over the course of two years, an outside company was paid millions of rands to scan Parliament\u2019s collection of about 7,000 volumes of material or seven million individual pages.<\/p>\n<p>Much of this collection was unique to Parliament \u2014 no other store of archival material in the country has a copy. Of particular importance are the annexures to the Hansard \u2014 the official record of Parliament\u2019s deliberations going back to 1910. The records include unpublished government reports, annual reports, research, and manuscripts.<\/p>\n<p>Parliament staff cannot yet access the buildings where these records are kept. While the library and stores at the National Council of Provinces are <a href=\"https:\/\/www.iol.co.za\/news\/politics\/parliament-fire-historic-collections-and-heritage-objects-saved-from-the-fire-cf29c6bf-6e5e-41e7-bbfd-8fe9b6e8e115\">understood to be safe<\/a>, a 4 January report to the Parliament Library warns that the entire collection in the stores at the National Assembly were affected by the fire, and may be lost. These stores contain South Africa\u2019s entire pre-1994 parliamentary records.<\/p>\n<p>The basement in the National Assembly that houses the archives is believed to have suffered grave water damage during the fire. At one point the water was chest-high, according to a report. This would be disastrous for the documents housed there, most of which are decades old.<\/p>\n<p>The 4 January report offers some mitigation: these records have been digitised. But this is not accurate.<\/p>\n<p>Almost half of the scans are semi-legible or even completely unreadable. This failure was identified by Parliament\u2019s library staff after the records were scanned in 2017. The service provider returned to Parliament to rescan the botched records &#8211; but abruptly stopped this work long before it was completed.<\/p>\n<p>Despite that millions of pages needed to be scanned again in order to be legible, the project was listed as being finished in official records.<\/p>\n<p>In Parliament\u2019s <a href=\"https:\/\/static.pmg.org.za\/Parliament_Annual_Report_17-18_v1F.pdf\">Annual Report<\/a> for 2017\/18, listed among the key achievements that year was the digitisation of \u201capproximately seven million pages of rare and fragile library material which included books, Hansard, artwork, microfiche, photographs and maps\u201d.<\/p>\n<p>The annual report was presented to the Joint Standing Committee on Financial Management of Parliament (Joint Committee) on 31 October 2018 by Acting Secretary to Parliament, Baby Tyawa.<\/p>\n<p>The <a href=\"https:\/\/static.pmg.org.za\/5th_Parliament_Legacy_Report_-_07_May_2019.pdf\">legacy report<\/a> of the fifth term of Parliament repeats this claim, saying that the Enhanced Library Service Project had digitised this huge archive and that the project had been completed in 2017.<\/p>\n<p>But the monthly reports filed in 2017 by the Rare &amp; Historical Information Services (RHIS), the division of the Parliamentary Information Centre that deals specifically with the huge archives at Parliament, show a different picture.<\/p>\n<p>In January 2017, the librarian in charge of RHIS at the time, Ingrid Henrici, reported that 6,092 volumes had been scanned by that stage, or 88% of the total archive. This was being performed by a service provider called <a href=\"http:\/\/www.i-kno.net\/\">i-Kno<\/a>, at just under R5 million according to Parliament\u2019s spokesperson.<\/p>\n<p>But the quality control that was done on the project suggested that the project was far from complete. Of the 1,746 scanned volumes that had been checked by the RHIS library staff, 44% had to be rejected. The Annexures to the Hansard and manuscripts were a particular problem. Three staff members had been assigned to the project.<\/p>\n<p>At this stage, according to the delivery schedule in the report, the digitisation project was already two months overdue.<\/p>\n<p>In the next report for February 2017, the situation is worse. \u201cDelivery of re-scanned items did not take place as projected,\u201d writes Henrici. Quality checks revealed more deficient scans, with the error rate rising to just under 50%. Of the 2,014 scanned volumes that had been checked, 1,001 had to be rejected and redone.<\/p>\n<p>In March 2017, it was reported that a seventh harddrive used to store the digitised records had crashed, \u201ca very concerning issue\u201d, wrote Henrici. More worrying was that the quality control of the scans was \u201csuspended until delivery of re-scanned volumes takes place\u201d. The report states that the service providers had made no further deliveries of scanned materials, nor had they rescanned any new items.<\/p>\n<p>The April report does not mention the digitisation project, and in June the only mention is a note that quality checks on the scans were \u201ccontinuing slowly\u201d.<\/p>\n<p>In July, a farce: \u201cAn attempt was made by i-Kno to access Parliament to complete the outstanding rescans and pack up the equipment and remove it from Parliament. This was unsuccessful due to their vetting having expired and their problem in getting revetted due to outstanding tax documents.\u201d<\/p>\n<p>In its last available report, from September 2017, RHIS gives up. \u201cQuality checking of previously digitised resources from the project has currently come to an end. QC will be put on hold as there are no further developments with regards to getting the project completed.\u201d<\/p>\n<p>These reports were sent to Albert Ntunja, the Chief Librarian of the South African Parliamentary Library at the time. From here, Ntunja should have reported on the progress of this project to the Divisional Manager of Knowledge and Information Services. In 2016, Neil Nel retired from this role, and his position was taken over by Dr Leon Gabriel.<\/p>\n<p>In turn, Nel and Gabriel should have reported to the Deputy Secretary to Parliament: Core Business, who should have reported to the Secretary to Parliament.<\/p>\n<p>The Secretary to Parliament at the time until his suspension for suspicion of maladministration and abuse of power in June 2017 was Gengezi Mgidlana. Baby Tyawa was appointed as Acting Secretary to Parliament after Mgidlana\u2019s suspension, and remains in the role.<\/p>\n<p>Someone in this chain of responsibility reported that this vast multi-million rand digitisation project had been satisfactorily completed, and this claim was confirmed in various official reports, and transmitted to the Joint Committee.<\/p>\n<p>How was this failure swept under the rug? Why was it not identified as fruitless and wasteful expenditure in Parliament\u2019s annual reports?<\/p>\n<p>On 25 October 2017, Tyawa, Acting Secretary to Parliament, presented Parliament\u2019s 2016\/17 annual report to the Joint Committee, and announced that in that reporting period \u201cirregular expenditure had decreased by 84%, from R15 million in 2016 to R2.4 million in 2017\u201d while fruitless and wasteful expenditure had \u201cincreased by 29%, from R830,000 in 2016 to R1 million in 2017\u201d.<\/p>\n<p>The digitisation project was not considered among these expenditure items. Further, the project was not <a href=\"https:\/\/static.pmg.org.za\/171025AR.pdf\">listed<\/a> among the failed performance targets that year. In fact, no mention was given to this project at all in this performance report.<\/p>\n<p>When Mgidlana presented Parliament\u2019s 2015\/16 annual report to the Joint Committee on 21 October 2016, he announced that of the fruitless and wasteful expenditure during the financial year, R257,000 was from \u201cbacklogs of digitisation of library books due to unavailability of Parliament staff\u201d. Mgidlana\u2019s presentation explained that the service provider (i-Kno) could not easily access Parliament or receive barcodes from Parliament staff during the period that staff were on strike. The annual report itself declares that the project under which the digitisation fell was mostly on track.<\/p>\n<p>In the <a href=\"https:\/\/static.pmg.org.za\/171024review.pdf\">financial performance review<\/a> of Parliament for 2016\/17, the incomplete digitisation is not accounted for. Instead the R257,000 in wasted expenditure from the 2016 strike is rolled over.<\/p>\n<p>The digitisation of the archives was designated as a sub-project in a larger effort (the so-called \u201cEnhance parliamentary information centre services\u201d project). Once the records were successfully digitised, they were to be entered into a database that could be accessed by a proprietary system called uVimba (Parliament\u2019s central document management system). According to a mid-year report presented to the Joint Committee, uVimba was operational by mid-2018 &#8211; even if the digitised documents that could be accessed through uVimba were desperately deficient.<\/p>\n<p>GroundUp has found no mention of the digitisation effort or the problems recounted in the RHIS reports in any documentation sent to the Joint Committee by Parliament officials between 2016 and 2018.<\/p>\n<p>In response to our questions, Gerrit van Dyk of i-Kno and Smarter Image, said that i-Kno rescanned most of the items that were noted to be of poor quality and the items were provided on hard drives to Parliament for further review. He said that the scanned images were large due to the quality that Parliament required. Parliament did not have sufficient space on their servers for the images at the time, and so all the images were located on hard drives supplied by i-Kno.<\/p>\n<p>\u201cThe main reasons for the \u2018defective\u2019 scans can also be found in the project documentation at Parliament. More than 80% of scans were successful and i-Kno did rescan those defective documents, as far as possible.\u201d<\/p>\n<p>In response to our questions, Parliament confirmed that the project ended in September 2017, as established in the RHIS report. That means that no further scanning or re-scanning was done by i-Kno after that date. Van Dyk of i-Kno likewise confirmed that to his knowledge, Parliament did not complete the checking of the rescans. (<a href=\"https:\/\/www.groundup.org.za\/media\/uploads\/documents\/gerrit_van_dyki-kno_correspondence_with_groundup.pdf\">Read Van Dyk\u2019s full response<\/a>.)<\/p>\n<p>But the volumes that we have seen were not rescanned. They are filled with defective pages.<\/p>\n<p><a class=\"bigger-image\" href=\"https:\/\/www.groundup.org.za\/media\/uploads\/images\/Third%20Party\/parliament-digital-20220127\/who_knows.png\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" alt src=\"http:\/\/www.myza.co.za\/press\/wp-content\/uploads\/2022\/01\/parliaments-botched-digitisation-may-mean-millions-of-precious-documents-were-lost-in-the-fire.png\"><\/a><\/p>\n<p class=\"caption\">Your guess as to what this is, is as good as ours. From Parliament\u2019s digital collection.<\/p>\n<p><a class=\"bigger-image\" href=\"https:\/\/www.groundup.org.za\/media\/uploads\/images\/Third%20Party\/parliament-digital-20220127\/for_ghosts_only.png\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" alt src=\"http:\/\/www.myza.co.za\/press\/wp-content\/uploads\/2022\/01\/parliaments-botched-digitisation-may-mean-millions-of-precious-documents-were-lost-in-the-fire-1.png\"><\/a><\/p>\n<p class=\"caption\">Or this one?<\/p>\n<p><a class=\"bigger-image\" href=\"https:\/\/www.groundup.org.za\/media\/uploads\/images\/Third%20Party\/parliament-digital-20220127\/women_in_legislature.png\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" alt src=\"http:\/\/www.myza.co.za\/press\/wp-content\/uploads\/2022\/01\/parliaments-botched-digitisation-may-mean-millions-of-precious-documents-were-lost-in-the-fire-2.png\"><\/a><\/p>\n<p class=\"caption\">This is a scan of a discussion in the early 20th century on Women in Legislature.<\/p>\n<p><a class=\"bigger-image\" href=\"https:\/\/www.groundup.org.za\/media\/uploads\/images\/Third%20Party\/parliament-digital-20220127\/completely_illegible.png\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" alt src=\"http:\/\/www.myza.co.za\/press\/wp-content\/uploads\/2022\/01\/parliaments-botched-digitisation-may-mean-millions-of-precious-documents-were-lost-in-the-fire-3.png\"><\/a><\/p>\n<p class=\"caption\">This one is completely illegible. It\u2019s important to note that these badly scanned and misaligned images are not unusual; they are common.<\/p>\n<p>According to Parliament: \u201cRescanned materials returned to Parliament were not rechecked and a final error rate was not determined. Library statistics confirmed that 95.35% of digitised materials were delivered to Parliament.\u201d<\/p>\n<p>But it is not clear how the 95% completion rate was achieved when read with the RHIS reports. The last report that provides information on total job completion says that 89% of all scans had been completed, excluding rescans. Quality control in the subsequent months slowed to a trickle and then stopped completely. Any digitisation from then on was done on demand by library staff.<\/p>\n<p>Parliament concedes that the job was not done. \u201cThe Close-out report [to I-Kno\u2019s contract] acknowledged that approximately 4.65% of the work was not delivered to Parliament.\u201d As a result, according to Parliament, the 20% retainer, R1.1 million, was withheld. (<a href=\"https:\/\/www.groundup.org.za\/media\/uploads\/documents\/media_inquiry-_ground_up.updated.pdf\">Read Parliament\u2019s full response<\/a>.)<\/p>\n<p>So while the contract was closed out, the work was not completed &#8211; and yet it was marked as complete in both the Annual Report and the Legacy Report.<\/p>\n<h2 class=\"subheading\">What is possibly lost?<\/h2>\n<p>Parliamentary staff cannot yet access the library collection stored beneath the National Assembly. It is believed that the following archival materials are likely permanently damaged.<\/p>\n<ul>\n<li>The Annexures: all of the House of Assembly Reports covering the period from 1910-1980<\/li>\n<li>Commission Reports, including from Departmental Committees<\/li>\n<li>Hansard Debates<\/li>\n<li>Senate Debates<\/li>\n<li>Select Committee Reports from 1910-1992<\/li>\n<li>Legal Deposit Books<\/li>\n<li>Selected works of South African History and Geography &#8211; general collection items housed in the journals store were moved to the National Assembly store due to renovations to the National Council of Provinces and library<\/li>\n<li>Parliamentary Correspondence \u2013 Imperial Blue Books<\/li>\n<li>Statistical registers<\/li>\n<li>Bills 1910-1990<\/li>\n<li>Announcements, Tablings and Committee Reports<\/li>\n<li>House of Lords, Australia, New Zealand and Canada Hansard Debates<\/li>\n<li>Minutes of proceedings<\/li>\n<li>Question Papers<\/li>\n<\/ul>\n<p>Almost all of UCT\u2019s Hansard collection from 1920 was lost in last year\u2019s fire. The National Library has copies and they will provide digital scans on demand but they will be missing annexures and many other documents only located in Parliament.<\/p>\n<\/div>\n<div id=\"article_copyright\">\n<p>\u00a9 2022 GroundUp. This article is licensed under a <a href=\"http:\/\/creativecommons.org\/licenses\/by-nd\/4.0\/\" rel=\"license\">Creative Commons Attribution-NoDerivatives 4.0 International License<\/a>.<\/p>\n<p>You may republish this article, so long as you credit the authors and GroundUp, and do not change the text. Please include a link back to the original article.<\/p>\n<p>We put an invisible pixel in the article so that we can count traffic to republishers. All analytics tools are solely on our servers. We do not give our logs to any third party. Logs are deleted after two weeks. We do not use any IP address identifying information except to count regional traffic. We are solely interested in counting hits, <b>not tracking<\/b> users. If you republish, please do not delete the invisible pixel.<\/p>\n<\/div>\n<p><img decoding=\"async\" src=\"http:\/\/www.myza.co.za\/press\/wp-content\/uploads\/2022\/01\/parliaments-botched-digitisation-may-mean-millions-of-precious-documents-were-lost-in-the-fire.jpg\"><a href=\"https:\/\/www.groundup.org.za\/\">Source: GroundUp<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>In this scan of the Hansard, created by i-Kno, every second page of this 16-page document is illegible. Valuable records in Parliament\u2019s library are likely to have been damaged or destroyed in the fire earlier this month. A project about five years ago was supposed to create a digital store of Parliament\u2019s archive. But quality-control [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":214898,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","ngg_post_thumbnail":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[9928],"tags":[28001],"class_list":{"0":"post-214897","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-groundup","8":"tag-groundup","9":"entry"},"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/www.myza.co.za\/press\/wp-content\/uploads\/2022\/01\/parliaments-botched-digitisation-may-mean-millions-of-precious-documents-were-lost-in-the-fire.jpg","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.myza.co.za\/press\/wp-json\/wp\/v2\/posts\/214897","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.myza.co.za\/press\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.myza.co.za\/press\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.myza.co.za\/press\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.myza.co.za\/press\/wp-json\/wp\/v2\/comments?post=214897"}],"version-history":[{"count":0,"href":"https:\/\/www.myza.co.za\/press\/wp-json\/wp\/v2\/posts\/214897\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.myza.co.za\/press\/wp-json\/wp\/v2\/media\/214898"}],"wp:attachment":[{"href":"https:\/\/www.myza.co.za\/press\/wp-json\/wp\/v2\/media?parent=214897"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.myza.co.za\/press\/wp-json\/wp\/v2\/categories?post=214897"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.myza.co.za\/press\/wp-json\/wp\/v2\/tags?post=214897"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}