DAFM is looking for a LDW solution that;
• Houses our current data requirements in a LDW architecture including but not limited to the following components; Data Warehouse, Data Marts, Data Lake, Master Data Management, Data virtualisation/Federation/access Layer, Cloud computing (if appropriate), Named user sandboxes
• Is scalable and can provide additional resources to address both the computational and data storage needs of big data analysis for the DAU.
• Support conceptual, logical and physical data modelling and include graphical interface data modelling tools.
• Plan, design, implement and test the ETL process into the new data platform and to provide the ETL scripts to DAFM.
• Provide compute resources for high speed data analysis. A solution that can monitor and orchestrate workload either on-premise or cloud based data structures based on the proposed architecture.
• Provides a data catalogue, metadata, taxonomy and a data dictionary for the LDW. Provide a searchable data/metadata catalogue and a data lineage tool.
• Supports historical and real-time BI and analytics and integrates with our current BI and analytics tool set.
• Has a system backup and disaster recovery regimen that integrates with the departments backup and recovery policies.
• Has a robust governance and security controls that allow monitoring and regulation of access to the LDW. The solution should have the facility to leverage user authentication technologies such as Active Directory.
• Can monitor data stability and create and issue alarms and alerts through the creation of incidence tickets.
• Includes an auditing and reporting feature that records access to logs, data structures and system performance.