To ensure a successful and smooth learning experience on the Applied Data Engineering programme, learners need access to specific tools.
Important note: Please ensure learners can also access the core requirements listed in this article in addition to the programme-specific requirements outlined below. It is the employer's responsibility to ensure this access is in place by the relevant deadline.
Learning Access
Tool | Details | Implementation notes | Deadline |
Platform used to teach SQL and Python as part of the programme.
No data will be uploaded to Sphere as we use dummy data in the lesson. They will then need to be able to apply teachings from here to their own internal SQL/Python environment with full adherence to internal company data policies. | Allowlisting required | Module 1 | |
Platform used to interact with hands-on data engineering labs as part of the programme.
No data will be uploaded to Skillable as we use dummy data for any lab environment. They will then need to be able to apply teachings from here to their own internal engineering environment with full adherence to internal company data policies. | Allowlisting required | Module 1 |
Practical Application
These requirements are needed for learners to apply their learnings from the programme, and demonstrate as part of their End Point Assessment.
Requirement | Details & Examples |
Database & Pipelines | Apprentices will also need access to at least one large database and pre-existing data pipelines. |
Learners will need Python installed in order to apply the learnings taught from the programme. | |
Integrated Development Environment (IDE) | Environment for write and run code.
Examples: VS Code, PyCharm, Google Collab |
Database Management and Administration Tool | |
Containerised Development Platform | Example: Docker Desktop |
Task Management Platform | Example: Apache Airflow |
Event Streaming Platform | Example: Apache Kafka |
Version Control Development Platform | |
Change Data Capture Platform | Example: Debezium |
Data Linage Tool | Example: Apache Atlas |
Streaming Process Platform | Example: Apache Flink |
Cloud-based computing Platform | |
Monitoring Tool | Example: Prometheus |
Visualisation Tool | Example: Grafana |