Skills application demo
Skills application demo
Facing fairness in facial recognition demo
In this skills application demo, we'll apply an end-to-end fairness auditing pipeline on a facial-emotion CNN—reinforcing skills in demographic proxy derivation, slice-level evaluation, visualisation, and bias mitigation for robust and equitable models.
Challenge instructions and resources
Select the link below to download and access the Jupyter Notebook so you can follow along with this activity. It includes the challenge instructions and the skills application demo files needed.
Activity instructions
Watch the demo
Watch the coach demonstrate how to apply techniques to evaluate and refine the performance of the model.
Key takeaways
- Fairness Auditing = Measurable Impact: You saw how targeted fixes—post-hoc temperature scaling and tone-aware re-weighting—can close FNR gaps across skin-tone groups, no heavy retraining required.
- Clear Equity Insights, Better Governance: You learned to connect slice-level fairness metrics from the facial-emotion dataset to real-world governance decisions, powering ethical deployment and stakeholder buy-in.
- Workflow Confidence from Day One: You’ll own the end-to-end fairness pipeline—proxy derivation, disaggregated evaluation, mitigation, and trade-off analysis—and apply it immediately to govern your ML models.
Skills application
Facing fairness in facial recognition practical
In this skills application, you'll apply the techniques show in the demo to compute tone weights, build per-sample weights, fine-tune the last 3 epochs with sample weight and then recompute weighted-F1 and max-FNR gap
≤ 0.05 and F1 ≥ baseline
Learning this skill brings value to the workplace because mastering slice-level fairness evaluation equips you to spot and fix hidden biases, delivers more reliable predictions across all demographics, and drives data-informed, ethical decision-making in your ML projects.
Challenge instructions and resources
Select the link below to download and access the Jupyter Notebook for this activity. It includes the challenge instructions and the files needed to complete the challenge.
Activity instructions
Work on the challenges
Follow the instructions in the Jupyter Notebook to work on the challenges. Use the provided resources to:
- Compute tone weights.
- Build per-sample weights.
- Fine-tune the last 3 epochs with
sample_weight. - Recompute weighted-F1 and max-FNR gap—aim for gap ≤ 0.05 and F1 ≥ baseline.
Collaborate in the breakout room
Discuss and share insights with fellow apprentices as you work on the activity challenges. While the activity is designed for individual completion, feel free to ask questions, collaborate, and compare approaches with your group.
Share your findings
Submit your completed Jupyter Notebook and summarise your findings.
Regroup
Return to the main session after 25 minutes to discuss key takeaways and insights from the exercise.