Recovery and migration of data

Description

Summary of the work To enable teams to effectively restore their business processes we need to retrieve and migrate their data to their newly procured system. This project is to deliver: Data discovery and extraction of data, ready for migration. We expect a complete dataset with documentation for migration. Specialist role Data engineer Expected Contract Length 8 weeks Latest start date Monday 16 August 2021 Maximum Day Rate £750 per day Who Speclialist Work With Hackney Relationship Manager Engagement from another Local Authority What Specialists Work On We need to successfully migrate the recovered data to a new system without access to the legacy application, knowledge of it’s database schema, or support from the vendor. The vendor of the new system will transform and load the data, so we need assistance to identify, extract and model the appropriate data from the recovered database of the legacy application. Users need to be able to validate the data in a database via a front end interface. The specialist will deliver: *Data discovery and extraction of data, ready for migration in new system *A complete dataset with documentation for migration Skills & Experience • Experience of working with Oracle databases • Experience of database modelling and architecture • Experience of working with SQL servers and CSV files • Data discovery experience to understand underlying data structure and relationships • Iterative approach to development, reconciliation and testing • Experience of working with AWS Cloud Infrastructure Nice to Haves Experience of working with Planning, Building Control and Land Charges data Work Location Work can take place remotely. If onsite work is required, this will take place at London Borough of Hackney offices Working Arrangments Remote working No. of Specialists to Evaluate 3 Cultural Fit Criteria • Work as a team with our organisation and other suppliers • Be transparent and collaborative when making decisions • Take responsibility for their work Assessment Method • Reference • Interview • Presentation Evaluation Weighting Technical competence 60% Cultural fit 7% Price 33% Questions from Suppliers 1. Is there an incumbent/preferred supplier? There is no incumbent/preferred supplier. 2. Could you please provide breakdown of further stages with dates? When exactly the final decision would be made? Provisional DatesInterview w.c. 2/8/2021Aiming for a final decision by 6/8/2021 3. Would a supplier be qualified out if the resource having transferrable skills doesn’t have experience of “working with Planning, Building Control and Land Charges data” at all? A supplier would not be qualified out if the resource does not have the above transferrable skills. It is a nice to have. 4. Is the consultant expected to work on a full-time basis (9 to 5) or is it up to suppliers to decide what arrangements will be required to complete the project on time? We can negotiate the hours. Though the more regular the hours, the better. 5. What is the volume of records to be migrated? The volume is currently unknown but should become clearer as part of the Data discovery. 6. How many different types of load files are to be prepared for uploading? There are CSV files, which are record data and document metadata.There are PDF files 7. 1. What types of resources are required and how many?2. We assume that resources can work remotely from outside of UK (offshore) also. Please confirm. 1. Type of resources - Technical (DBA, Data Analyst or Data Scientist) Number of resources - x12. No, we will not be allocating work outside of UK (offshore). Due to GDPR restrictions and the possibility of having to send physical storage media to the successful applicant. 8. Is the data to be sanitised and/or deduplicated? At present, there is no data cleaning requirement. We’ve been able to recover the Oracle DBF files, have tested that they load successfully, and querying the tables returns data. The DBF files have been moved and are available from an AWS S3 bucket.There is an open offer of help from colleagues at other Local Authorities using the legacy application.We’re unable to restore the legacy application without the support of the vendor, which makes this non-viable. 9. Is the data to be mapped from legacy to new (i.e. M -> Male, F – Female)? Yes, it will be mapped from legacy to new. 10. Would you consider using RPA to achieve the required results? The structure of the old data compared to the new will limit this.