KROG
🇳🇴

CWA 18398 · assessment rubric

E.5 Process Improvement

← All competences

Level e-3

From role 1.2 Data Curation Lead · EQF EQF7

Enhance AI process performance by designing and implementing data-driven improvements that integrate multiple AI concepts, address operational risks, uphold ethical standards, and support effective team collaboration.

  1. 5.1 Design modifications to AI workflows to improve performance and efficiency using practical AI development projects.

    Assessed by Graded workflow diagrams and updated AI/data pipelines; rubric-based evaluation of performance improvements, assessed for clarity of workflow design, effectiveness of implemented improvements, and alignment with data curation, quality, and governance requirements.

  2. 5.2 Apply multiple AI process concepts and metrics to identify, analyse, and solve process problems in real-world AI applications.

    Assessed by Analysis report submission with metrics calculations, including data quality indicators and performance measures; assessed via peer review or instructor feedback for accuracy of calculations, appropriateness of metrics, and validity of conclusions.

  3. 5.3 Assess operational risks and ethical considerations in AI development and deployment by evaluating AI systems in operational environments.

    Assessed by Risk and ethical assessment report evaluated against a checklist and supported by case study review; assessed for identification of process-related risks, ethical considerations, and alignment with data governance and compliance standards.

  4. 5.4 Collaborate effectively within a team to implement process improvements in AI project settings.

    Assessed by Team project documentation assessed via contribution logs and peer evaluation; evaluated for clarity of roles, effectiveness of collaboration, and contribution to consistent and improved data curation processes.

  5. 5.5 Evaluate the outcomes of AI process changes against performance, ethical, and compliance criteria using defined metrics and benchmarks.

    Assessed by Comparative performance report graded against defined metrics and benchmarks; oral defence or presentation optional; assessed for analytical depth, validity of comparisons, and justification of proposed process improvements.

  6. 5.6 Document AI process modifications and lessons learned for knowledge sharing within the team.

    Assessed by Lessons-learned or reflective report reviewed for completeness, clarity, and insightfulness; assessed for critical reflection on process performance, identification of improvement opportunities, and linkage to future optimisation of data curation workflows.

From role 2.8 MLOps Engineer · EQF EQF6

Enhance AI process performance by designing and implementing data-driven improvements that integrate multiple AI concepts, address operational risks, uphold ethical standards, and support effective team collaboration.

  1. 8.1 Design modifications to AI workflows to improve performance and efficiency using practical AI development projects.

    Assessed by Graded workflow diagrams and updated AI pipelines, with rubric-based evaluation of performance improvements, assessed for design of AI workflow modifications that improve performance and efficiency in practical AI development projects.

  2. 8.2 Apply multiple AI process concepts and metrics to identify, analyse, and solve process problems in real-world AI applications.

    Assessed by Analysis report submission with metrics calculations, peer review, or instructor feedback, assessed for application of multiple AI process concepts and metrics to identify, analyse, and solve process problems in real-world AI applications.

  3. 8.3 Assess operational risks and ethical considerations in AI development and deployment by evaluating AI systems in operational environments.

    Assessed by Risk and ethical assessment report evaluated against a checklist with case study review, assessed for operational risk and ethical consideration assessment in AI development and deployment environments.

  4. 8.4 Collaborate effectively within a team to implement process improvements in AI project settings.

    Assessed by Team project documentation assessed via contribution logs and peer evaluation, assessed for effective team collaboration and implementation of process improvements in AI project settings.

  5. 8.5 Evaluate the outcomes of AI process changes against performance, ethical, and compliance criteria using defined metrics and benchmarks.

    Assessed by Comparative performance report graded against metrics and benchmarks, with optional oral defence or presentation, assessed for evaluation of AI process-change outcomes against performance, ethical, and compliance criteria.

  6. 8.6 Document AI process modifications and lessons learned for knowledge sharing within the team.

    Assessed by Lessons-learned or reflective report reviewed for completeness, clarity, insightfulness, and usefulness for team knowledge sharing on AI process modifications. DEVELOPMENT & OPERATIONS [2]

From role 3.8 Human-AI Interaction Lead · EQF EQF7

Enhance AI process performance by designing and implementing data-driven improvements that integrate multiple AI concepts, address operational risks, uphold ethical standards, and support effective team collaboration.

  1. 8.1 Design modifications to AI workflows to improve performance and efficiency using practical AI development projects.

    Assessed by Graded workflow diagrams and updated AI pipelines; rubric-based evaluation of AI workflow modifications and measurable performance or efficiency improvements in practical AI development projects.

  2. 8.2 Apply multiple AI process concepts and metrics to identify, analyse, and solve process problems in real-world AI applications.

    Assessed by Analysis report submission with metrics calculations; peer review or instructor feedback assessing application of multiple AI process concepts and metrics to identify, analyse, and solve process problems.

  3. 8.3 Assess operational risks and ethical considerations in AI development and deployment by evaluating AI systems in operational environments.

    Assessed by Risk and ethical assessment report evaluated against a checklist, with case study review assessing operational risks and ethical considerations in AI development and deployment.

  4. 8.4 Collaborate effectively within a team to implement process improvements in AI project settings.

    Assessed by Team project documentation assessed via contribution logs and peer evaluation for effective collaboration and implementation of AI process improvements in project settings.

  5. 8.5 Evaluate the outcomes of AI process changes against performance, ethical, and compliance criteria using defined metrics and benchmarks.

    Assessed by Comparative performance report graded against defined metrics and benchmarks, with optional oral defence or presentation, assessing performance, ethical, and compliance outcomes of AI process changes.

  6. 8.6 Document AI process modifications and lessons learned for knowledge sharing within the team.

    Assessed by Lessons-learned or reflective report reviewed for completeness, clarity, insightfulness, and documentation of AI process modifications for team knowledge sharing. C.4 Management MANAGEMENT [4]

From role 4.3 AI Tech Lead · EQF EQF7

Enhance AI process performance by designing and implementing data-driven improvements that integrate multiple AI concepts, address operational risks, uphold ethical standards, and support effective team collaboration.

  1. 8.1 Design modifications to AI workflows to improve performance and efficiency using practical AI development projects.

    Assessed by Graded workflow diagrams and updated AI pipelines; rubric-based evaluation of AI workflow modifications and measurable performance or efficiency improvements in practical AI development projects.

  2. 8.2 Apply multiple AI process concepts and metrics to identify, analyse, and solve process problems in real-world AI applications.

    Assessed by Analysis report submission with metrics calculations; peer review or instructor feedback assessing application of multiple AI process concepts and metrics to identify, analyse, and solve process problems.

  3. 8.3 Assess operational risks and ethical considerations in AI development and deployment by evaluating AI systems in operational environments.

    Assessed by Risk and ethical assessment report evaluated against a checklist, with case study review assessing operational risks and ethical considerations in AI development and deployment.

  4. 8.4 Collaborate effectively within a team to implement process improvements in AI project settings.

    Assessed by Team project documentation assessed via contribution logs and peer evaluation for effective collaboration and implementation of AI process improvements in project settings.

  5. 8.5 Evaluate the outcomes of AI process changes against performance, ethical, and compliance criteria using defined metrics and benchmarks.

    Assessed by Comparative performance report graded against defined metrics and benchmarks, with optional oral defence or presentation, assessing performance, ethical, and compliance outcomes of AI process changes.

  6. 8.6 Document AI process modifications and lessons learned for knowledge sharing within the team.

    Assessed by Lessons-learned or reflective report reviewed for completeness, clarity, insightfulness, and documentation of AI process modifications for team knowledge sharing. MANAGEMENT [4]

From role 4.6 AI Operations Manager · EQF EQF6

Enhance AI process performance by designing and implementing data-driven improvements that integrate multiple AI concepts, address operational risks, uphold ethical standards, and support effective team collaboration.

  1. 7.1 Design modifications to AI workflows to improve performance and efficiency using practical AI development projects.

    Assessed by Graded workflow diagrams and updated AI pipelines; rubric-based evaluation of AI workflow modifications and measurable performance or efficiency improvements in practical AI development projects.

  2. 7.2 Apply multiple AI process concepts and metrics to identify, analyse, and solve process problems in real-world AI applications.

    Assessed by Analysis report submission with metrics calculations; peer review or instructor feedback assessing application of multiple AI process concepts and metrics to identify, analyse, and solve process problems.

  3. 7.3 Assess operational risks and ethical considerations in AI development and deployment by evaluating AI systems in operational environments.

    Assessed by Risk and ethical assessment report evaluated against a checklist, with case study review assessing operational risks and ethical considerations in AI development and deployment.

  4. 7.4 Collaborate effectively within a team to implement process improvements in AI project settings.

    Assessed by Team project documentation assessed via contribution logs and peer evaluation for effective collaboration and implementation of AI process improvements in project settings.

  5. 7.5 Evaluate the outcomes of AI process changes against performance, ethical, and compliance criteria using defined metrics and benchmarks.

    Assessed by Comparative performance report graded against defined metrics and benchmarks, with optional oral defence or presentation, assessing performance, ethical, and compliance outcomes of AI process changes.

  6. 7.6 Document AI process modifications and lessons learned for knowledge sharing within the team.

    Assessed by Lessons-learned or reflective report reviewed for completeness, clarity, insightfulness, and documentation of AI process modifications for team knowledge sharing.

From role 5.2 AI Compliance Officer · EQF EQF7

Enhance AI process performance by designing and implementing data-driven improvements that integrate multiple AI concepts, address operational risks, uphold ethical standards, and support effective team collaboration.

  1. 6.1 Design modifications to AI workflows to improve performance and efficiency using practical AI development projects.

    Assessed by Graded workflow diagrams and updated AI pipelines; rubric-based evaluation of AI workflow modifications and measurable performance or efficiency improvements in practical AI development projects.

  2. 6.2 Apply multiple AI process concepts and metrics to identify, analyse, and solve process problems in real-world AI applications.

    Assessed by Analysis report submission with metrics calculations; peer review or instructor feedback assessing application of multiple AI process concepts and metrics to identify, analyse, and solve process problems.

  3. 6.3 Assess operational risks and ethical considerations in AI development and deployment by evaluating AI systems in operational environments.

    Assessed by Risk and ethical assessment report evaluated against a checklist, with case study review assessing operational risks and ethical considerations in AI development and deployment.

  4. 6.4 Collaborate effectively within a team to implement process improvements in AI project settings.

    Assessed by Team project documentation assessed via contribution logs and peer evaluation for effective collaboration and implementation of AI process improvements in project settings.

  5. 6.5 Evaluate the outcomes of AI process changes against performance, ethical, and compliance criteria using defined metrics and benchmarks.

    Assessed by Comparative performance report graded against defined metrics and benchmarks, with optional oral defence or presentation, assessing performance, ethical, and compliance outcomes of AI process changes.

  6. 6.6 Document AI process modifications and lessons learned for knowledge sharing within the team.

    Assessed by Lessons-learned or reflective report reviewed for completeness, clarity, insightfulness, and documentation of AI process modifications for team knowledge sharing.

From role 5.3 AI Risk Manager · EQF EQF7

Enhance AI process performance by designing and implementing data-driven improvements that integrate multiple AI concepts, address operational risks, uphold ethical standards, and support effective team collaboration.

  1. 6.1 Design modifications to AI workflows to improve performance and efficiency using practical AI development projects.

    Assessed by Graded workflow diagrams and updated AI pipelines; rubric-based evaluation of AI workflow modifications and measurable performance or efficiency improvements in practical AI development projects.

  2. 6.2 Apply multiple AI process concepts and metrics to identify, analyse, and solve process problems in real-world AI applications.

    Assessed by Analysis report submission with metrics calculations; peer review or instructor feedback assessing application of multiple AI process concepts and metrics to identify, analyse, and solve process problems.

  3. 6.3 Assess operational risks and ethical considerations in AI development and deployment by evaluating AI systems in operational environments.

    Assessed by Risk and ethical assessment report evaluated against a checklist, with case study review assessing operational risks and ethical considerations in AI development and deployment.

  4. 6.4 Collaborate effectively within a team to implement process improvements in AI project settings.

    Assessed by Team project documentation assessed via contribution logs and peer evaluation for effective collaboration and implementation of AI process improvements in project settings.

  5. 6.5 Evaluate the outcomes of AI process changes against performance, ethical, and compliance criteria using defined metrics and benchmarks.

    Assessed by Comparative performance report graded against defined metrics and benchmarks, with optional oral defence or presentation, assessing performance, ethical, and compliance outcomes of AI process changes.

  6. 6.6 Document AI process modifications and lessons learned for knowledge sharing within the team.

    Assessed by Lessons-learned or reflective report reviewed for completeness, clarity, insightfulness, and documentation of AI process modifications for team knowledge sharing.

Level e-4

From role 1.6 AI Business Analyst · EQF EQF7

Optimise AI development and operational processes by coordinating complex workflows, applying integrated performance metrics, and embedding governance practices that ensure ethical, secure, and high-performing solutions.

  1. 8.1 Integrate complex AI performance metrics and governance practices to evaluate existing workflows in multi-team AI projects.

    Assessed by Evaluation report assessed for completeness, accuracy, and integration of complex AI performance metrics and governance practices in the evaluation of existing multi-team AI workflows.

  2. 8.2 Coordinate multiple AI development and operational processes across teams or systems by implementing cross-functional workflows.

    Assessed by Consolidated workflow documentation or project plan graded on clarity, coordination, and integration of multiple AI development and operational processes across teams or systems.

  3. 8.3 Refine and optimise AI workflows using data-driven insights and best practices from deployed AI systems.

    Assessed by Optimized workflow diagrams or implementation logs evaluated for measurable efficiency improvements supported by data-driven insights and best practices from deployed AI systems.

  4. 8.4 Ensure ethical, compliance, and security considerations are incorporated into process improvements in enterprise AI deployments.

    Assessed by Compliance checklist or audit report reviewed for thoroughness, adherence to standards, and incorporation of ethical, compliance, and security considerations into enterprise AI process improvements.

  5. 8.5 Monitor and assess the impact of workflow changes on organisational performance and AI solution effectiveness using measurable KPIs.

    Assessed by KPI analysis report or dashboards graded on validity of analysis, conclusions, and evidence of the impact of workflow changes on organizational performance and AI solution effectiveness.

  6. 8.6 Facilitate communication and knowledge transfer between teams to support process improvement through workshops and documentation.

    Assessed by Knowledge repository, workshop materials, or presentations assessed for clarity, usefulness, dissemination quality, and support for communication and knowledge transfer between teams.

  7. 8.7 Identify opportunities for AI process innovation by analysing emerging trends and technologies.

    Assessed by Innovation proposal evaluated on originality, feasibility, and alignment with emerging AI trends and technologies as opportunities for process innovation. C.2 Development and Operations DEVELOPMENT & OPERATIONS [2]

From role 3.4 AI Advisor · EQF EQF7

Optimise AI development and operational processes by coordinating complex workflows, applying integrated performance metrics, and embedding governance practices that ensure ethical, secure, and high-performing solutions.

  1. 7.1 Integrate complex AI performance metrics and governance practices to evaluate existing workflows in multi-team AI projects.

    Assessed by Evaluation report assessed for completeness, accuracy, and integration of AI performance metrics and governance practices in workflow evaluation.

  2. 7.2 Coordinate multiple AI development and operational processes across teams or systems by implementing cross-functional workflows.

    Assessed by Consolidated workflow documentation or project plan graded on clarity, coordination, integration, and cross-functional process coverage across teams or systems.

  3. 7.3 Refine and optimise AI workflows using data-driven insights and best practices from deployed AI systems.

    Assessed by Optimized workflow diagrams or implementation logs evaluated for use of data-driven insights and measurable efficiency improvements in AI workflows.

  4. 7.4 Ensure ethical, compliance, and security considerations are incorporated into process improvements in enterprise AI deployments.

    Assessed by Compliance checklist or audit report reviewed for thoroughness and adherence to ethical, compliance, and security standards in enterprise AI process improvements.

  5. 7.5 Monitor and assess the impact of workflow changes on organisational performance and AI solution effectiveness using measurable KPIs.

    Assessed by KPI analysis report or dashboards graded on validity of analysis, conclusions, and measurable impact of workflow changes on organizational performance and AI solution effectiveness.

  6. 7.6 Facilitate communication and knowledge transfer between teams to support process improvement through workshops and documentation.

    Assessed by Knowledge repository, workshop materials, or presentations assessed for clarity, usefulness, dissemination quality, and support for communication and knowledge transfer between teams.

  7. 7.7 Identify opportunities for AI process innovation by analysing emerging trends and technologies.

    Assessed by Innovation proposal evaluated on originality, feasibility, alignment with AI trends, and identification of opportunities for AI process innovation.

From role 3.6 Responsible AI Officer · EQF EQF7

Optimise AI development and operational processes by coordinating complex workflows, applying integrated performance metrics, and embedding governance practices that ensure ethical, secure, and high-performing solutions.

  1. 6.1 Integrate complex AI performance metrics and governance practices to evaluate existing workflows in multi-team AI projects.

    Assessed by Evaluation report assessed for completeness, accuracy, and integration of AI performance metrics and governance practices in workflow evaluation for multi-team AI projects.

  2. 6.2 Coordinate multiple AI development and operational processes across teams or systems by implementing cross-functional workflows.

    Assessed by Consolidated workflow documentation or project plan graded on clarity, coordination, integration, and cross-functional process coverage across teams or systems.

  3. 6.3 Refine and optimise AI workflows using data-driven insights and best practices from deployed AI systems.

    Assessed by Optimized workflow diagrams or implementation logs evaluated for use of data-driven insights, best practices from deployed AI systems, and measurable efficiency improvements.

  4. 6.4 Ensure ethical, compliance, and security considerations are incorporated into process improvements in enterprise AI deployments.

    Assessed by Compliance checklist or audit report reviewed for thoroughness and adherence to ethical, compliance, and security standards in enterprise AI process improvements.

  5. 6.5 Monitor and assess the impact of workflow changes on organisational performance and AI solution effectiveness using measurable KPIs.

    Assessed by KPI analysis report or dashboards graded on validity of analysis, conclusions, and measurable impact of workflow changes on organisational performance and AI solution effectiveness.

  6. 6.6 Facilitate communication and knowledge transfer between teams to support process improvement through workshops and documentation.

    Assessed by Knowledge repository, workshop materials, or presentations assessed for clarity, usefulness, dissemination quality, and support for communication and knowledge transfer between teams.

  7. 6.7 Identify opportunities for AI process innovation by analysing emerging trends and technologies.

    Assessed by Innovation proposal evaluated on originality, feasibility, alignment with AI trends, and identification of opportunities for AI process innovation. SUPPORT & GUIDANCE [3]