KROG
🇳🇴

CWA 18398 · assessment rubric

D.2 ICT Quality Strategy Development

← All competences

Level e-4

From role 1.2 Data Curation Lead · EQF EQF7

Define, evaluate, coordinate, and optimise AI quality strategies by integrating ethical, resilience, and performance considerations across AI systems, using relevant frameworks and monitoring to address complex problems and enhance organisational outcomes.

  1. 2.1 Define AI quality strategies by applying principles of ethics, performance, and resilience, using frameworks such as ISO/IEC 42001, EU AI Ethics Guidelines, and Explainable AI best practices.

    Assessed by Assessment of an AI training module design document and AI use-case mapping, evaluated for relevance to ICT quality strategy, clarity of learning design, alignment with data quality objectives, and suitability of selected AI use cases.

  2. 2.2 Evaluate AI system interactions, interdependencies, and quality objectives against organisational goals, using AI performance metrics, KPIs, and benchmarking tools.

    Assessed by Evaluation of AI training materials and a recorded or observed AI training session, assessed for accuracy, pedagogical quality, practical applicability, and ability to communicate ICT quality principles in AI-enabled data curation contexts.

  3. 2.3 Coordinate cross-functional activities to implement AI quality strategies and ensure alignment with organisational objectives.

    Assessed by Review of an AI learning feedback summary and revised AI training content, assessed for quality of feedback analysis, responsiveness to learner needs, evidence of improvement, and alignment with ICT quality and data governance requirements.

  4. 2.4 Optimise AI quality strategies by integrating strategic monitoring, feedback loops, and continuous improvement practices.

    Assessed by Assessment of AI ethics and governance training materials and applied AI case examples, evaluated for completeness, regulatory and ethical accuracy, relevance to data quality strategy, and ability to support responsible AI/data curation practice.

  5. 2.5 Solve strategic AI quality challenges across multiple systems by applying evidence-based decision-making.

    Assessed by Evaluation of documented AI learner support evidence and facilitation notes, assessed for clarity of guidance, appropriateness of support interventions, responsiveness to learner difficulties, and consistency with intended learning outcomes.

  6. 2.6 Report and communicate strategic AI quality outcomes, lessons learned, and recommendations for organisational decision-making.

    Assessed by Review of an AI instructional design rationale and alignment with learning objectives, assessed for coherence between learning outcomes, activities, assessment approach, ICT quality strategy, and the required professional competence level.

From role 2.6 AI Quality & Evaluation Specialist · EQF EQF7

Define, evaluate, coordinate, and optimise AI quality strategies by integrating ethical, resilience, and performance considerations across AI systems, using relevant frameworks and monitoring to address complex problems and enhance organisational outcomes.

  1. 4.1 Define AI quality strategies by applying principles of ethics, performance, and resilience, using frameworks such as ISO/IEC 42001, EU AI Ethics Guidelines, and Explainable AI best practices.

    Assessed by AI strategy document submission, Strategy alignment matrix review, and Risk brief presentation, assessed for definition of AI quality strategies that apply ethics, performance, and resilience principles using frameworks such as ISO/IEC 42001, EU AI Ethics Guidelines, and Explainable AI best practices.

  2. 4.2 Evaluate AI system interactions, interdependencies, and quality objectives against organisational goals, using AI performance metrics, KPIs, and benchmarking tools.

    Assessed by AI evaluation report analysis, KPI framework submission, and Benchmarking report review, assessed for evaluation of AI system interactions, interdependencies, and quality objectives against organizational goals using AI performance metrics, KPIs, and benchmarking tools.

  3. 4.3 Coordinate cross-functional activities to implement AI quality strategies and ensure alignment with organisational objectives.

    Assessed by Coordination plan review, Stakeholder map submission, and Executive summary presentation, assessed for coordination of cross-functional activities and alignment of AI quality strategy implementation with organizational objectives.

  4. 4.4 Optimise AI quality strategies by integrating strategic monitoring, feedback loops, and continuous improvement practices.

    Assessed by AI optimization plan submission, Monitoring framework evaluation, and Recommendation report review, assessed for integration of strategic monitoring, feedback loops, and continuous improvement practices in AI quality strategy optimisation.

  5. 4.5 Solve strategic AI quality challenges across multiple systems by applying evidence-based decision-making.

    Assessed by Problem-solving case study submission, Decision log analysis, and Scenario planning report presentation, assessed for evidence-based decision-making in solving strategic AI quality challenges across multiple systems.

  6. 4.6 Report and communicate strategic AI quality outcomes, lessons learned, and recommendations for organisational decision-making.

    Assessed by AI Quality Outcomes Report, Lessons Learned Brief, and Executive Recommendation Presentation – assessed for evidence-based reporting of strategic AI quality outcomes, clarity of lessons learned, actionability of recommendations, and suitability for organizational decision-making

From role 3.6 Responsible AI Officer · EQF EQF7

Define, evaluate, coordinate, and optimise AI quality strategies by integrating ethical, resilience, and performance considerations across AI systems, using relevant frameworks and monitoring to address complex problems and enhance organisational outcomes.

  1. 4.1 Define AI quality strategies by applying principles of ethics, performance, and resilience, using frameworks such as ISO/IEC 42001, EU AI Ethics Guidelines, and Explainable AI best practices.

    Assessed by AI strategy document submission, Strategy alignment matrix review, and Risk brief presentation assessed for defining AI quality strategies using ethics, performance, resilience, and relevant AI quality frameworks.

  2. 4.2 Evaluate AI system interactions, interdependencies, and quality objectives against organisational goals, using AI performance metrics, KPIs, and benchmarking tools.

    Assessed by AI evaluation report analysis, KPI framework submission, and Benchmarking report review assessed for evaluation of AI system interactions, interdependencies, and quality objectives against organizational goals.

  3. 4.3 Coordinate cross-functional activities to implement AI quality strategies and ensure alignment with organisational objectives.

    Assessed by Coordination plan review, Stakeholder map submission, and Executive summary presentation assessed for coordination of cross-functional activities and alignment of AI quality strategy implementation with organizational objectives.

  4. 4.4 Optimise AI quality strategies by integrating strategic monitoring, feedback loops, and continuous improvement practices.

    Assessed by AI optimization plan submission, Monitoring framework evaluation, and Recommendation report review assessed for integration of strategic monitoring, feedback loops, and continuous improvement practices.

  5. 4.5 Solve strategic AI quality challenges across multiple systems by applying evidence-based decision-making.

    Assessed by Problem-solving case study submission, Decision log analysis, and Scenario planning report presentation assessed for evidence-based decisions addressing strategic AI quality challenges across multiple systems.

  6. 4.6 Report and communicate strategic AI quality outcomes, lessons learned, and recommendations for organisational decision-making.

    Assessed by AI quality report submission, Executive slides presentation, and Visual dashboard demonstration assessed for communication of AI quality outcomes, lessons learned, and recommendations for organizational decision-making.

From role 5.1 AI Governance Officer · EQF EQF8

Define, evaluate, coordinate, and optimise AI quality strategies by integrating ethical, resilience, and performance considerations across AI systems, using relevant frameworks and monitoring to address complex problems and enhance organisational outcomes.

  1. 4.1 Define AI quality strategies by applying principles of ethics, performance, and resilience, using frameworks such as ISO/IEC 42001, EU AI Ethics Guidelines, and Explainable AI best practices.

    Assessed by AI Quality Strategy Document, Strategy Alignment Matrix, and Risk Brief Presentation assessed for defining AI quality strategies that apply ethics, performance, and resilience principles using relevant frameworks such as ISO/IEC 42001, EU AI Ethics Guidelines, and Explainable AI best practices.

  2. 4.2 Evaluate AI system interactions, interdependencies, and quality objectives against organisational goals, using AI performance metrics, KPIs, and benchmarking tools.

    Assessed by AI evaluation report analysis, KPI framework submission, and Benchmarking report review assessed for evaluation of AI system interactions, interdependencies, and quality objectives against organizational goals using AI performance metrics, KPIs, and benchmarking tools.

  3. 4.3 Coordinate cross-functional activities to implement AI quality strategies and ensure alignment with organisational objectives.

    Assessed by Coordination plan review, Stakeholder map submission, and Executive summary presentation assessed for coordination of cross-functional activities to implement AI quality strategies and ensure alignment with organizational objectives.

  4. 4.4 Optimise AI quality strategies by integrating strategic monitoring, feedback loops, and continuous improvement practices.

    Assessed by AI optimization plan submission, Monitoring framework evaluation, and Recommendation report review assessed for optimization of AI quality strategies through strategic monitoring, feedback loops, and continuous improvement practices.

  5. 4.5 Solve strategic AI quality challenges across multiple systems by applying evidence-based decision-making.

    Assessed by Problem-solving case study submission, Decision log analysis, and Scenario planning report presentation assessed for evidence-based decision-making in solving strategic AI quality challenges across multiple systems.

  6. 4.6 Report and communicate strategic AI quality outcomes, lessons learned, and recommendations for organisational decision-making.

    Assessed by AI quality report submission, Executive slides presentation, and Visual dashboard demonstration assessed for clear communication of strategic AI quality outcomes, lessons learned, and recommendations for organizational decision-making.