JOB DESCRIPTIONS
Key Responsibilities:
- Design nuanced evaluation questions that challenge AI models, focusing on complex, real-world business scenarios requiring advanced reasoning.
- Identify and validate ideal answers for evaluation prompts, ensuring they are grounded in authoritative sources or synthesized from multiple credible references, such as case studies and academic journals.
- Analyze AI model responses through multiple iterations, pinpointing areas of failure and refining prompts for deeper insights.
- Develop detailed scoring rubrics that outline specific criteria for evaluating AI performance, enabling objective assessment of future model outputs.
- Collaborate with top researchers at leading AI Labs, AI engineers, and business strategists to align evaluation methodologies with project goals.
Required Skills and Qualifications:
- Master's or PhD in Business Administration or a related discipline.
- Advanced knowledge in areas such as Business Strategy, Corporate Finance, and Organizational Behavior.
- Strong analytical skills with the ability to craft complex, multi-layered business scenarios.
- Proficiency in sourcing and validating information from credible references to support evaluations.
- Experience in remote, asynchronous collaboration with cross-functional teams.
Preferred Qualifications:
- Familiarity with AI model evaluation and training processes.
- Experience designing and implementing evaluation metrics or rubrics.
- Knowledge of emerging trends in AI and its applications in business.
Salary
Competitive
Monthly based
Location
, East Gonja Municipal District, Savannah Region, Ghana, Savannah Region, Ghana
Job Overview
Location
, East Gonja Municipal District, Savannah Region, Ghana, Savannah Region, Ghana
