AI Backend Engineer – AI Systems & Agentic Platforms

About Deccan AI

Deccan AI is a high-growth, venture-backed AI model training and evaluation company headquartered in the Bay Area. Founded by alumni of IIT Bombay, IIM Ahmedabad, and ex-Google leaders, we partner with some of the world’s most advanced AI labs and enterprises to build, train, and scale cutting-edge AI systems.
Backed by $25M in Series A funding, Deccan AI operates at the forefront of Generative AI, working on large-scale model evaluation, agentic workflows, and real-world AI deployment. Our mission is to accelerate the development of reliable, scalable, and production-ready AI systems.

Role Overview

We are looking for a Backend Engineer with strong exposure to Generative AI and Agentic systems to join our fast-moving team. This is not a traditional backend role — you will work on building AI-native platforms, designing distributed systems, and owning end-to-end deployment in a zero-hierarchy environment.
You will have full ownership of systems you build, from architecture design to production deployment.

Key Responsibilities

1. Scalable System Design

  • Design and build highly scalable backend systems and APIs.
  • Architect distributed systems capable of handling high-throughput workloads.
  • Write clean, maintainable, and efficient code in Java, Golang, or Python.

2. AI & Agentic System Development

  • Build and integrate Generative AI applications using tools like LangChain and LangGraph.
  • Develop and deploy AI Agents and Agentic workflows.
  • Work on ML-powered features such as semantic search, recommendation systems, and fraud detection.

3. End-to-End Ownership

  • Own the full development lifecycle — from design to deployment and monitoring.
  • Manage deployments using AWS/GCP, Kubernetes, and CI/CD pipelines.
  • Ensure system reliability, observability, and performance optimization.

4. Database & Data Systems

  • Work across multiple data systems including:
    • Relational databases (Postgres, MySQL)
    • NoSQL databases (MongoDB)
    • Graph Databases
    • Vector Databases for AI applications
  • Design efficient data models and optimize query performance.

5. Platform & Infrastructure

  • Build core platform services such as payments, onboarding, and user systems.
  • Integrate backend systems with AI pipelines and model-serving infrastructure.
  • Work with emerging protocols such as MCP (Model Context Protocol).

What We’re Looking For

  • Strong backend engineering experience (3–8 years preferred).
  • Hands-on experience with Generative AI / LLM-based systems.
  • Familiarity with:
    • LangChain / LangGraph
    • AI Agents / Agentic AI frameworks
  • Solid understanding of:
    • Distributed systems
    • API design
    • System scalability
  • Experience with cloud platforms (AWS/GCP) and containerization (Kubernetes).
  • Strong database fundamentals across SQL, NoSQL, and modern data stores.
  • Ability to work in fast-paced, ambiguous environments with rapid iteration cycles.

What Makes This Role Different

  • Zero hierarchy: Full ownership and autonomy over your work.
  • AI-first engineering: Work at the cutting edge of Generative AI and agentic systems.
  • High impact: Build systems that directly power real-world AI applications.
  • Fast execution: Same-day iterations and rapid product cycles.
  • Strong founding team: Learn from experienced operators and researchers.

Why Join Deccan AI?

At Deccan AI, you won’t just build backend systems — you’ll build the infrastructure powering the next generation of AI applications. If you enjoy solving complex engineering problems, working with cutting-edge AI technologies, and owning systems end-to-end, this role is built for you.