The role involves overseeing accuracy monitoring, data analysis, and reporting to ensure reliable performance of Gen AI use cases.The PMO will also support the development of test data, establish scalable monitoring processes, and provide stakeholders with actionable insights for decision-making.

Mandatory Skill(s)

• Must have strong analytical skills for monitoring AI accuracy and performance;
• Must have proficiency in data quality management and reporting;
• Must have ability to design and implement scalable monitoring processes;
• Good communication skills to present insights to stakeholders;

Desirable Skill(s)

• Experience with Gen AI projects and accuracy evaluation;
• Familiarity with data preparation and test datasets, especially document samples;
• Knowledge of performance metrics, trend analysis, and issue identification;
• Exposure to project management frameworks and stakeholder reporting;

Responsibilities

• Ensure the quality and accuracy of Gen AI use cases through comprehensive monitoring and analysis;
• Establish and improve scalable accuracy monitoring processes applicable to various Gen AI use cases;
• Provide stakeholders with clear and insightful reports on Gen AI performance;
• Manage and analyze accuracy data, ensuring data quality and relevance for performance evaluation;
• Implement and refine monitoring processes to track key metrics for Gen AI use cases, enabling proactive identification of performance trends and potential issues;
• Generate regular reports on the accuracy and performance of Gen AI use cases, highlighting trends and insights for stakeholders and various forums;
• Contribute to the preparation of Gen AI test data, focusing on document samples;

If you are interested in this role, click on the “Apply to this job” button below or you could also write in with your CV to Princi Trivedi at Princi.T@sciente.com quoting the job title.