About Us
Deccan AI is a model training and eval startup headquartered in the Bay Area. We are founded by IIT Bombay, IIM Ahmedabad and ex-Google alumni, and work with some of the top AI frontier labs in the world, e.g. Google Deepmind, Snowflake, and many more. We are backed by Prosus Ventures, and our India delivery office is in Hyderabad. Most of our roles are on-site i.e. Bay Area / Hyderabad.
What it is like to work @ Deccan
To be honest, our workplace is not for the faint-hearted. We work hard, We work fast (many of our clients require same day turnarounds for their complex data needs). We like those who take ownership, roll up their sleeves and do. We like those who thrive in ambiguity and who can operate without titles / hierarchies.But what you will find: tremendous learning, tremendous growth, and a very motivated set of colleagues who are also fun to be around.
About Role
As an Technical Content Manager, you will lead the strategy, design, and execution of assessment programs that measure and improve learner outcomes. This role combines assessment expertise, project management, SME collaboration, and analytics to ensure high-quality, scalable, and effective assessments across learning programs.
Key Responsibilities
Assessment Strategy & Planning
- Define and drive end-to-end assessment strategy aligned with learning objectives and business goals.
- Plan and manage assessment roadmaps across multiple programs, ensuring timely and high-quality delivery.
Assessment Design & Development
- Oversee the creation of assessments, quizzes, tests, and evaluation frameworks that accurately measure learner proficiency.
- Ensure assessments are valid, reliable, and aligned with defined skill outcomes.
Skill Matrix & Outcome Mapping
- Lead the development and continuous refinement of learner skill matrices.
- Map assessments to skills and learning outcomes, and validate effectiveness through data-driven testing.
SME Sourcing & Management (Must-Have)
- Proactively headhunt Subject Matter Experts (SMEs) via LinkedIn and other platforms.
- Onboard, manage, and collaborate with SMEs to ensure assessment quality, relevance, and consistency.
Assessment Operations & Project Management
- Manage assessment workflows, timelines, dependencies, and stakeholder coordination.
- Ensure smooth execution across design, review, testing, and deployment phases.
Analytics & Continuous Improvement
- Track assessment performance metrics and learner outcomes.
- Use insights to iterate on assessment design and improve learning impact.
Competitive & Market Analysis
- Research and analyze competitor assessment approaches and industry best practices.
- Recommend improvements to stay ahead of EdTech assessment trends.
Community & Stakeholder Engagement
- Collaborate with internal teams, SMEs, and learning communities to drive engagement and alignment.
Must-Have Requirements
- 2–5 years of experience in assessment design, project management, content operations, or EdTech roles.
- Hands-on experience in headhunting SMEs on LinkedIn and managing expert contributors.
- Strong project management skills with the ability to manage multiple assessment initiatives simultaneously.
- Experience creating and managing assessments aligned to learning outcomes.
- Excellent communication, stakeholder management, and coordination skills.
- Strong analytical mindset with attention to detail.
Good-to-Have Qualifications
- Proficiency in assessment tool design and psychometric analysis.
- Proven experience working with Item Response Theory (IRT PRO).
- Experience leading assessment initiatives focused on measuring and improving student learning outcomes.
- Familiarity with LMS platforms, assessment tools, or EdTech products.
- Exposure to data-driven evaluation and validation of assessments.