Assessment Method 1

Instruction and application

In Progress

Understanding AM1's Grading Criteria

Let's look specifically at Assessment Method 1. In particular, we will review the requirements you need for the project write-up and the presentation.

What is needed in AM1?Assessment Method 1, or the project evaluation report, presentation and questions, takes place after Gateway and is an opportunity for you to complete a significant and defined piece of work that has a real business application and benefit.

Your work on the project must not start until after your Gateway meeting. The project itself is not part of the EPA, but underpins the evaluation report and presentation.

The project is based on a real life example of your everyday work in your industry. Producing a project evaluation report and presentation reflects normal professional practice. For the project, report, and presentation, you are required to be concise and precise in your use of language in written and verbal communication.

The project evaluation report offers a realistic opportunity to combine project management, examples of data products and formal writing enabling you to reflect on your approach. It is a holistic assessment method, allowing you to demonstrate KSBs in an integrated way.

You will complete your project after your Gateway meeting. However, at Gateway you will submit a project brief for the project evaluation report, presentation and questions, which must be signed off by the EPAO. The project brief should be no more than 500 words and is not assessed. The project itself and the work included in the report and presentation must be written up after you have gone through Gateway.

The project you choose should be based on any of the following:

• A specific problem.
• A recurring issue.
• An idea or opportunity.

Picking a projectIn the final phase of the program, you will refine and finalise your project idea, ensuring it aligns with your role and delivers meaningful business value to your organisation. This will prepare you to begin your project immediately after the Gateway meeting.

Your project must address the needs of your employer’s business, align with your occupation and apprenticeship, and provide an opportunity to demonstrate the relevant Knowledge, Skills, and Behaviors (KSBs) outlined in the Assessment Criteria section.

The project should focus on one of the following:

• A specific problem.
• A recurring issue.
• An innovative idea or opportunity. The project report must reflect actual work completed for your employer, as simulated projects are not permitted. You will be expected to work under your regular workplace supervision and integrate the project into your normal duties and responsibilities, allowing you to contribute meaningfully while completing your apprenticeship requirements.

Below is a list of project ideas that could be used to guide your decision.

Project Ideas:

• scaling of an existing system or process
• making improvements to a current system
• enhancing organisational capability
• improvements to enhance environmental sustainability

**What is the project brief?**The project brief is a document that you will submit at your Gateway meeting. In this document you will include the title of your project, a brief overview, and a mapping document that acknowledges you have reviewed and considered each of the grading criteria in your project.

What is the structure of my project brief?

The project brief includes the following:

• Project Title
• Scope (500 words maximum)Write a summary of the work-based project you have completed. You must outline how the project has addressed the following themes and their associated KSBs:Data product design
• Data product deployment and evaluation
• Collaborative working
• Scope Mapping Document Project brief template:

Data Engineer V1.0 Project Title & Scope.pdf / Data EngineerProject Title and ScopeAM1 Project evaluation report, presentation and questionsApprentice’s name:Apprentice’s email:Employer:Training provider:This document is not assessed but must be approved before you start work on your projectevaluation report and presentation. Full guidance is available in the Data Engineer Resource Pack.Project TitlePlease write below the title of your project.ScopeWrite a summary of the work-based project you have completed. You must outline how the projecthas addressed the following themes and their associated KSBs:● Data product design● Data product deployment and evaluation● Collaborative working (Maximum 500 words)Review and complete project mapping document and sign the declaration below. This is toensure the project evaluation report allows you to meet the grading assessment criteriamapped to this assessment method.The mapping document contains the grading assessment criteria for this assessment method.Review the 1st for EPA Resource Pack on epaPRO or the EPA Plan to help you complete it.Apprentice signature:Date:An electronic signature is acceptable.Once complete, submit this document to your training provider. They will upload it to the EPAportal, and you’ll receive feedback within 7 days of uploading.Data Engineer 1.0 End Point Assessment - Project Title & Scope V1.0© 1st for EPA 2024. Contains public sector information licensed under the Open Government Licence v3.0 1AM1 Project Evaluation Title & Scope Mapping DocumentThe purpose of this mapping document is to ensure that the relevant grading assessment criteria hasbeen taken into consideration when identifying and completing the project. This is important to ensurethe grading assessment criteria have been reviewed and considered, when completing the projectand can be covered when completing the project evaluation report and presentation.KSBs Data product design - Pass Criteria SufficientScopeK6K7K9K12K13K14S1S2S3S4S5S27B1Demonstrates how they have collated, evaluated and refined userrequirements to design and build a scalable data product that serves multipleneeds and complies with regulatory requirements. (K9, S1, S3)Yes/NoExplains how they collated, evaluated and refined business requirements, todesign, build and maintain a system whilst ensuring that organisationalstrategies for sustainable, net-zero technologies are considered. (K12 & S2)Yes/NoExplains how they selected sustainable solutions in relation to data productsand environmental social governance to ensure the use of less carbon acrossthe various stages of product and service delivery. (K7, S27)Yes/NoDemonstrates how they used security, scalability and governance whenautomating data pipelines using programming languages and data integrationplatforms with graphical user interfaces. (K13, S4)Yes/NoDemonstrates how they have taken accountability produced and maintainedtechnical documentation for a data product in order to meet organisationaluser requirements, whilst adapting to changing work priorities to ensure thatdeadlines are met. (S5, B1)Yes/NoExplains how debugging, version control and testing have an impact onsoftware development and the principles for data products. (K6) Yes/NoOutlines the uses of different on-demand cloud computing platforms. (K14) Yes/NoData product design - Distinction CriteriaJustifies how the data product created met the requirements and servedmultiple needs. (S1, S3) Yes/NoKSBs Data product deployment and evaluation - Pass CriteriaK2K4K8K15K17K19K20K24K25K26S6S9S16S24S26Explains the deployment approaches processes for new data pipelines andautomated processes. (K8) Yes/NoExplains techniques such as star schemas, data lakes and data marts and theimpact they have on data warehousing principles. (K15) Yes/NoDemonstrate how to systematically clean, validate and describe data at allstages of extract, transform and load, showing how combining disparate datasources and taking different approaches to data integration delivers value toan organisation. (K17, S6)Yes/NoDescribes the types and uses of data engineering tools in their ownorganisation and how they apply them. (K20) Yes/NoEvaluates the strengths and weaknesses of prototype data products tointegrate within an organisation’s overarching data structure, taking intoconsideration the lifecycle of implementing data solutions in a business. (K24,K25, S24)Yes/NoDescribes the approved organisational architectures and the relevant datadevelopment frameworks. (K26) Yes/NoIdentifies data quality metrics and their frameworks and tracks them to ensurequality, accuracy and reliability of the data product. (K4, S26) Yes/NoDemonstrates the use of tools and programming to query and manipulate dataand implement automated validation checks, showing the methodologies usedfor moving data from one system to another for storage and handling. (K2, S9)Yes/NoData Engineer 1.0 End Point Assessment - Project Title & Scope V1.0© 1st for EPA 2024. Contains public sector information licensed under the Open Government Licence v3.0 2Explains how they have worked with structured, semi-structured andunstructured data, developing algorithms to extract from sources. (K19, S16) Yes/NoData product deployment and evaluation - Distinction CriteriaEvaluates the success of the algorithm developed. (S16) Yes/NoKSBs Collaborative working – Pass CriteriaK30S22S23B2Outlines the methods and techniques used to communicate messages aboutthe data product that meet the needs of the audience. (K30, S23) Yes/NoExplains how they worked collaboratively with different technical andnon-technical stakeholders, using adaptive business methodology to supportan inclusive culture and develop and maintain strong working relationships inorder to achieve common goals. (S22, B2)Yes/NoCollaborative working – Distinction CriteriaEvaluate the impact of the methods and techniques used to communicatemessages about the data product to the audience. (K30, S23) Yes/NoData Engineer 1.0 End Point Assessment - Project Title & Scope V1.0© 1st for EPA 2024. Contains public sector information licensed under the Open Government Licence v3.0 3Scope Mapping DocumentKSBData product design - Pass Criteria****Sufficient ScopeK6

K7

K9

K12

K13 K14

S1

S2

S3

S4

S5

S27

B1

Demonstrates how they have collated, evaluated and refined user requirements to design and build a scalable data product that serves multiple needs and complies with regulatory requirements. (K9, S1, S3)Yes/NoExplains how they collated, evaluated and refined business requirements, to design, build and maintain a system whilst ensuring that organisational strategies for sustainable, net-zero technologies are considered. (12 & S2)Yes/NoExplains how they selected sustainable solutions in relation to data products and environmental social governance to ensure the use of less carbon across the various stages of product and service delivery. (K7, S27)Yes/NoDemonstrates how they used security, scalability and governance when automating data pipelines using programming languages and data integration platforms with graphical user interfaces. (K13, S4)Yes/NoDemonstrates how they have taken accountability produced and maintained technical documentation for a data product in order to meet organisational user requirements, whilst adapting to changing work priorities to ensure that deadlines are met. (S5, B1)Yes/NoExplains how debugging, version control and testing have an impact on software development and the principles for data products. (K6)Yes/NoOutlines the uses of different on-demand cloud computing platforms. (K14)Yes/NoData product design - Distinction CriteriaJustifies how the data product created met the requirements and served multiple needs. (S1, S3)Yes/NoKSBs****Data product deployment and evaluation - Pass CriteriaK2

K4

K8

K15

K17

K19

K20

K24

K25

K26

S6

S9

S16

S24

S26

Explains the deployment approaches processes for new data pipelines and automated processes. (K8) Yes/NoExplains techniques such as star schemas, data lakes and data marts and the impact they have on data warehousing principles. (K15)Yes/NoDemonstrate how to systematically clean, validate and describe data at all stages of extract, transform and load, showing how combining disparate data sources and taking different approaches to data integration delivers value to an organisation. (K17, S6)Yes/NoDescribes the types and uses of data engineering tools in their own organisation and how they apply them. (K20)Yes/NoEvaluates the strengths and weaknesses of prototype data products to integrate within an organisation’s overarching data structure, taking into consideration the lifecycle of implementing data solutions in a business. (K24, K25, S24)Yes/NoDescribes the approved organisational architectures and the relevant data development frameworks. (K26)Yes/NoIdentifies data quality metrics and their frameworks and tracks them to ensure quality, accuracy and reliability of the data product. (K4, S26)Yes/NoDemonstrates the use of tools and programming to query and manipulate data and implement automated validation checks, showing the methodologies used for moving data from one system to another for storage and handling. (K2, S9)Yes/NoExplains how they have worked with structured, semi-structured and unstructured data, developing algorithms to extract from sources. (K19, S16)Yes/NoData product deployment and evaluation - Distinction CriteriaEvaluates the success of the algorithm developed. (S16) Yes/NoKSBs****Collaborative working – Pass CriteriaK30 S23 B2Outlines the methods and techniques used to communicate messages about the data product that meet the needs of the audience. (K30, S23)Yes/NoExplains how they worked collaboratively with different technical and non-technical stakeholders, using adaptive business methodology to support an inclusive culture and develop and maintain strong working relationships in order to achieve common goals. (S22, B2)Yes/NoCollaborative working – Distinction CriteriaEvaluate the impact of the methods and techniques used to communicate messages about the data product to the audience. (K30, S23)Yes/NoWhat is the project evaluation report?###

You will conduct a project and evaluate the outcome (during the EPA period) in the form of an electronic based project report and a presentation.

The project evaluation report offers a realistic opportunity to combine project management, examples of data products and formal writing enabling you to reflect on the approaches you take.

project

By writing the evaluation report for the project and responding to questions that delve into the rationale behind key decisions, identified risks, challenges encountered, resolutions implemented, and areas requiring further action, you will effectively demonstrate your professional expertise and competency.

What is the best way to structure my project evaluation report?

Project reports must include at least the following:

• an executive summary (or abstract)
• an introduction
• the scope of the project (including key performance indicators, aims and objectives)
• a project plan
• research outcomes
• data analysis outcomes
• project outcomes
• discussion of findings
• recommendations and conclusions
• references
• The project must map, in an appendix, how it evidences the relevant KSBs for this assessment method.

Additionally, the report must include:

• Why a specific model was deployed for a certain data set
• How the apprentice overcame challenges and made improvements as a result
• How data bias was handled. Project evaluation report template:

**Word count:**The report should be a maximum of 5,000 words (+/- 10%). Appendices, references and diagrams are not included in this total and external hyperlinks to content will not be reviewed.

The evaluation report and presentation will be reviewed by an assessor; however, you will not receive any grade or feedback until all elements of EPA have been completed and graded.

Tips for a Successful Project Evaluation Report

• The project evaluation report exemplifies your expertise and should be presented in a professional format.
• Ensure that you write your report in the first person (using “I…”). This allows you to put emphasis on what you singularly did to apply your knowledge, skills, and behaviours.
• Make sure to maintain a professional tone.
• Avoid “we” statements, wherever possible unless you worked with others and need to specify their role.
• Use the assessment criteria when writing your project evaluation report. Make sure you evidence how you have met these.Cross-reference your project with the assessment criteria, making sure the assessment criteria are clearly evident in the project evaluation report submission.
• You may choose to write the assessment criteria KSB reference number at the appropriate place to make it evident to the assessor.
• Explain any technical terms that may not have meaning outside your organisation.

**What is the presentation with questioning?**In the presentation with questions, you must deliver a presentation to an independent assessor on your completed project. The independent assessor must ask questions following the presentation.

The questions will center on the content of your project evaluation report and presentation. This structured discussion with an independent assessor is designed to showcase your expertise and highlight your competence, focusing on the Knowledge, Skills, and Behaviors (KSBs) associated with this assessment method.

How is the presentation structured?

Your presentation must include**:**

• An overview of the project.
• The project scope (including key performance indicators).
• Summary of actions undertaken by the apprentice.
• Project outcomes and how these were achieved.
• How the apprentice overcame any challenges. You will prepare and submit your presentation, speaker notes and supporting materials to

The EPAO at the same time as the evaluation report by the end of week 8 of the EPA

Period.

If needed during your presentation, be sure to have the following:

• Audio-visual presentation equipment
• Flip chart with writing and drawing materials
• Computer

Tips for a Successful Presentation

• Refrain from simply re-engineering (cut and paste) your project evaluation report into the presentation word-for-word; the assessor will have already read your report and this would be a waste of valuable time.
• Look to elaborate on criteria that you were unable to describe in greater detail in the evaluation report due to the limits of the word count.
• Practice your presentation and plan to use the full time allowed.
• Consider providing some dynamic evidence e.g. a demonstration of the data product to bring it to life.

What will happen during the questioning portion?

Before your EPA, the assessor will review your project evaluation report and presentation, focusing on identifying any additional evidence or clarification needed to evaluate your performance against the assessment criteria.

The presentation and questioning session will last 50 minutes, typically consisting of a20-minute presentation followed by30 minutes of questioning. The assessor may extend the session by up to 10% to allow you to complete your response to a question. During this time, the assessor will ask a minimum ofsix open-ended questions, along with relevant follow-up questions. These questions will be based on your project evaluation report and presentation, targeting project evidence and the grading requirements for this assessment method.

If a question is unclear, you may request the assessor to rephrase or clarify it.

You are allowed access to an electronic copy of your project evaluation report, presentation

and speaker notes throughout the presentation and questioning.

Tips for the Questioning

• The assessor will keep the questioning focused and if they sense you are moving away from relevant topics, they will steer the conversation back to the assessment criteria. Similarly, if you have sufficiently covered the criteria, the assessor will move on.
• Having reviewed the project evaluation report and listened to your presentation, the assessor will seek further evidence or clarity based on the topics in the assessment grading criteria.
• Listen to what you are asked and try to respond fully, bearing in mind the KSBs in the assessment criteria.
• In your answers, you may refer to any aspects of your project, evaluation report or presentation to demonstrate the assessment criteria. You may also refer to your own (electronic) notes when answering the assessor’s questions. You should use this opportunity to demonstrate how you have applied the assessment criteria in your project.

Action Item: Share your questions

**Instructions:**Before we move on, are there any last questions you have about Assessment Method 1?