Job description

We are seeking a Staff Software Engineer / Staff GenAI Engineer to provide technical leadership in the design, development, and deployment of AI-driven platforms and products. This role combines hands-on engineering expertise with architectural ownership and client-facing consulting responsibilities.

Key Responsibilities

• Lead the architecture, design, and development of scalable backend systems integrating machine learning and Generative AI models into production-grade applications.

• Drive end-to-end delivery of GenAI solutions, including LLM-based systems, RAG architectures, and agentic workflows, from experimentation to production.

• Design and implement agentic AI systems enabling multi-step reasoning, tool calling, memory management, and orchestration.

• Apply a strong understanding of machine learning techniques (regression, classification, clustering, decision trees, neural networks, probabilistic models) to solution design and implementation.

• Collaborate closely with data scientists to train, fine-tune, evaluate, and deploy ML/AI models, ensuring reliability and performance at scale.

• Work with structured and unstructured data sources, designing efficient data pipelines and storage strategies.

• Lead development of backend microservices and APIs supporting AI-driven applications.

• Ensure production readiness of AI systems, including performance optimization, monitoring, cost control, and security.

• Define cloud-native deployment strategies for AI solutions on AWS, Azure, and GCP.

• Establish containerized deployment standards using Docker and Kubernetes across development and production environments.

• Oversee data architecture, performance, and integrity across SQL and NoSQL databases (PostgreSQL, MongoDB).

• Implement monitoring and logging frameworks to ensure reliability, observability, and operational excellence of AI systems.

• Lead the development of AI-powered SaaS products within the Heka.ai platforms.

Tactical & cross-team leadership

• Be a DRI for major architectural initiatives and blueprints; own design docs and migration plans.

• Maintain ownership of triage and incident prioritization; advocate severity/priority to stakeholders.

• Serve as a maintainer/owner for multiple critical repositories, tech stacks, or services.

• Mentor engineers formally; grow others via code reviews, pairing, and career coaching.

• Break down large efforts into epics and MVCs; coordinate cross-team delivery.

• Facilitate or lead working groups for cross-cutting initiatives (performance, APIs, security, standards).

• Represent your group to leadership: engineering allocation, reliability status, and iteration health.

• Participate in hiring: design interviews, assess candidates, and recommend bias-reduction improvements.

• Participate in Diversity, Inclusion & Belonging initiatives and mentorship programs