Assessment Method 1

Instruction and application

In Progress

Understanding AM1's Grading Criteria

Let's look specifically at Assessment Method 1. In particular, we will review the requirements you need for the project write-up and the presentation.

What is needed in AM1?Assessment Method 1, or the project evaluation report, presentation and questions, takes place after Gateway and is an opportunity for you to complete a significant and defined piece of work that has a real business application and benefit.

Your work on the project must not start until after your Gateway meeting. The project itself is not part of the EPA, but underpins the evaluation report and presentation.

The project is based on a real life example of your everyday work in your industry. Producing a project evaluation report and presentation reflects normal professional practice. For the project, report, and presentation, you are required to be concise and precise in your use of language in written and verbal communication.

The project evaluation report offers a realistic opportunity to combine project management, examples of data products and formal writing enabling you to reflect on your approach. It is a holistic assessment method, allowing you to demonstrate KSBs in an integrated way.

You will complete your project after your Gateway meeting. However, at Gateway you will submit a project brief for the project evaluation report, presentation and questions, which must be signed off by the EPAO. The project brief should be no more than 500 words and is not assessed. The project itself and the work included in the report and presentation must be written up after you have gone through Gateway.

The project you choose should be based on any of the following:

• A specific problem.
• A recurring issue.
• An idea or opportunity.

Picking a projectIn the final phase of the program, you will refine and finalise your project idea, ensuring it aligns with your role and delivers meaningful business value to your organisation. This will prepare you to begin your project immediately after the Gateway meeting.

Your project must address the needs of your employer’s business, align with your occupation and apprenticeship, and provide an opportunity to demonstrate the relevant Knowledge, Skills, and Behaviors (KSBs) outlined in the Assessment Criteria section.

The project should focus on one of the following:

• A specific problem.
• A recurring issue.
• An innovative idea or opportunity. The project report must reflect actual work completed for your employer, as simulated projects are not permitted. You will be expected to work under your regular workplace supervision and integrate the project into your normal duties and responsibilities, allowing you to contribute meaningfully while completing your apprenticeship requirements.

Below is a list of project ideas that could be used to guide your decision.

Project Ideas:

• scaling of an existing system or process
• making improvements to a current system
• enhancing organisational capability
• improvements to enhance environmental sustainability

**What is the project brief?**The project brief is a document that you will submit at your Gateway meeting. In this document you will include the title of your project, a brief overview, and a mapping document that acknowledges you have reviewed and considered each of the grading criteria in your project.

What is the structure of my project brief?

The project brief includes the following:

• Project Title
• Scope (500 words maximum)Write a summary of the work-based project you have completed. You must outline how the project has addressed the following themes and their associated KSBs for the Machine Learning Engineer standard:Machine learning solution design and development
• Model deployment, monitoring and lifecycle management
• Stakeholder communication and collaborative working
• Scope Mapping Document Project brief template:

Machine Learning Engineer Project Title & Scope — AM1 Project evaluation report, presentation and questions. Apprentice’s name, apprentice’s email, employer, and training provider fields are captured on the template. This document is not assessed but must be approved before you start work on your project evaluation report and presentation. Full guidance is available in the Machine Learning Engineer Resource Pack.

Detailed AIMLF KSB mapping to be finalised — reference the Machine Learning Engineer standard.

Project Title — please write below the title of your project. Scope — write a summary of the work-based project you have completed. You must outline how the project has addressed the following themes and their associated KSBs: Machine learning solution design and development; Model deployment, monitoring and lifecycle management; Stakeholder communication and collaborative working (maximum 500 words). Review and complete the project mapping document and sign the declaration. Apprentice signature and date required (an electronic signature is acceptable). Once complete, submit this document to your training provider. They will upload it to the EPA portal, and you’ll receive feedback within 7 days of uploading.

Machine Learning Engineer End Point Assessment — Project Title & Scope.

Scope Mapping Document

Detailed AIMLF KSB mapping to be finalised — reference the Machine Learning Engineer standard.

The AM1 project must evidence pass and distinction criteria across the Machine Learning Engineer themes:

• Machine learning solution design and development
• Model deployment, monitoring and lifecycle management
• Stakeholder communication and collaborative working

What is the project evaluation report?

You will conduct a project and evaluate the outcome (during the EPA period) in the form of an electronic based project report and a presentation.

The project evaluation report offers a realistic opportunity to combine project management, examples of data products and formal writing enabling you to reflect on the approaches you take.

project

By writing the evaluation report for the project and responding to questions that delve into the rationale behind key decisions, identified risks, challenges encountered, resolutions implemented, and areas requiring further action, you will effectively demonstrate your professional expertise and competency.

What is the best way to structure my project evaluation report?

Project reports must include at least the following:

• an executive summary (or abstract)
• an introduction
• the scope of the project (including key performance indicators, aims and objectives)
• a project plan
• research outcomes
• data analysis outcomes
• project outcomes
• discussion of findings
• recommendations and conclusions
• references

✨

The project must map, in an appendix, how it evidences the relevant KSBs for this assessment method.

• Why a specific model was deployed for a certain data set
• How the apprentice overcame challenges and made improvements as a result
• How data bias was handled. Project evaluation report template:

**Word count:**The report should be a maximum of 5,000 words (+/- 10%). Appendices, references and diagrams are not included in this total and external hyperlinks to content will not be reviewed.

The evaluation report and presentation will be reviewed by an assessor; however, you will not receive any grade or feedback until all elements of EPA have been completed and graded.

Tips for a Successful Project Evaluation Report

• The project evaluation report exemplifies your expertise and should be presented in a professional format.
• Ensure that you write your report in the first person (using “I…”). This allows you to put emphasis on what you singularly did to apply your knowledge, skills, and behaviours.
• Make sure to maintain a professional tone.
• Avoid “we” statements, wherever possible unless you worked with others and need to specify their role.
• Use the assessment criteria when writing your project evaluation report. Make sure you evidence how you have met these.Cross-reference your project with the assessment criteria, making sure the assessment criteria are clearly evident in the project evaluation report submission.
• You may choose to write the assessment criteria KSB reference number at the appropriate place to make it evident to the assessor.
• Explain any technical terms that may not have meaning outside your organisation.

**What is the presentation with questioning?**In the presentation with questions, you must deliver a presentation to an independent assessor on your completed project. The independent assessor must ask questions following the presentation.

The questions will center on the content of your project evaluation report and presentation. This structured discussion with an independent assessor is designed to showcase your expertise and highlight your competence, focusing on the Knowledge, Skills, and Behaviors (KSBs) associated with this assessment method.

How is the presentation structured?

Your presentation must include**:**

• An overview of the project.
• The project scope (including key performance indicators).
• Summary of actions undertaken by the apprentice.
• Project outcomes and how these were achieved.
• How the apprentice overcame any challenges. You will prepare and submit your presentation, speaker notes and supporting materials to

The EPAO at the same time as the evaluation report by the end of week 8 of the EPA

Period.

If needed during your presentation, be sure to have the following:

• Audio-visual presentation equipment
• Flip chart with writing and drawing materials
• Computer

Tips for a Successful Presentation

• Refrain from simply re-engineering (cut and paste) your project evaluation report into the presentation word-for-word; the assessor will have already read your report and this would be a waste of valuable time.
• Look to elaborate on criteria that you were unable to describe in greater detail in the evaluation report due to the limits of the word count.
• Practice your presentation and plan to use the full time allowed.
• Consider providing some dynamic evidence e.g. a demonstration of the data product to bring it to life.

What will happen during the questioning portion?

Before your EPA, the assessor will review your project evaluation report and presentation, focusing on identifying any additional evidence or clarification needed to evaluate your performance against the assessment criteria.

The presentation and questioning session will last 50 minutes, typically consisting of a20-minute presentation followed by30 minutes of questioning. The assessor may extend the session by up to 10% to allow you to complete your response to a question. During this time, the assessor will ask a minimum ofsix open-ended questions, along with relevant follow-up questions. These questions will be based on your project evaluation report and presentation, targeting project evidence and the grading requirements for this assessment method.

If a question is unclear, you may request the assessor to rephrase or clarify it.

You are allowed access to an electronic copy of your project evaluation report, presentation

and speaker notes throughout the presentation and questioning.

Tips for the Questioning

• The assessor will keep the questioning focused and if they sense you are moving away from relevant topics, they will steer the conversation back to the assessment criteria. Similarly, if you have sufficiently covered the criteria, the assessor will move on.
• Having reviewed the project evaluation report and listened to your presentation, the assessor will seek further evidence or clarity based on the topics in the assessment grading criteria.
• Listen to what you are asked and try to respond fully, bearing in mind the KSBs in the assessment criteria.
• In your answers, you may refer to any aspects of your project, evaluation report or presentation to demonstrate the assessment criteria. You may also refer to your own (electronic) notes when answering the assessor’s questions. You should use this opportunity to demonstrate how you have applied the assessment criteria in your project.

Action Item: Share your questions

**Instructions:**Before we move on, are there any last questions you have about Assessment Method 1?

In progress