About IAMB.AI
IAMB.AI turns research questions into peer-reviewed papers. It started as the exact process behind a PRISMA systematic review published in IEEE Access, rebuilt so that AI agents do the grind and every step stays on the record: searching the databases, screening with independent AI reviewers, extraction with quoted evidence, and the manuscript itself. We are building toward fully autonomous, agentic AI research, and we study how research itself is done along the way.
The role
Building AI agents that take real actions is the easy part. Building agents that get better over time, that learn from feedback, correct mistakes and optimize toward outcomes researchers care about, is one of the hardest open problems in production AI. As a Staff AI/ML Engineer on Applied Research, you will own the technical direction for feedback-driven learning in IAMB.AI's agentic research systems: reward modeling from human reviewers' decisions, preference optimization, reinforcement learning, and the evaluation needed to know whether any of it works. This is a senior individual contributor role with broad scope: you set direction, run experiments at scale and close the loop between human signals and model behavior, shipping research into production.
Own the feedback learning roadmap
- Define and carry out the applied research agenda for feedback-driven agentic AI, from reward modeling and preference optimization to online learning and human feedback loops.
- Turn human reviewers' corrections, evaluation data and product signals into concrete training and optimization strategies.
- Stay close to the frontier on RLHF, RLAIF, DPO, PPO, GRPO and related methods, and know when simpler approaches win.
Build production learning systems
- Design and build learning loops that improve agent reasoning, planning, tool use and action over time.
- Build evaluation that measures what matters: reasoning quality, instruction following, agreement with human reviewers, task success and safety, offline and online.
- Run large-scale experiments that connect model changes to measurable improvements for researchers.
Provide technical leadership
- Set technical direction across modeling, experimentation, evaluation design and production readiness, without needing management authority.
- Work closely with product, engineering, design and research to move work from prototype to shipped capability.
- Explain complex AI systems clearly to technical and non-technical people.
What you will bring
- Research contributions through peer-reviewed publications, patents, open-source work, or demonstrated applied research impact in reinforcement learning, reward modeling, evaluation or recommendation systems.
- 8+ years building production AI or ML systems: LLMs, generative AI, agentic systems, recommendation, search, personalization or applied research at scale.
- Hands-on experience improving AI systems through reinforcement learning, reward modeling, fine-tuning, human feedback or preference optimization, with results you can point to.
- A strong understanding of agentic AI: reasoning, planning, tool use, action, instruction following and self-correction.
- Strong software engineering in Python and at least one production systems language.
- The judgment to balance model quality, impact, latency, reliability, cost and maintainability, and to explain those trade-offs clearly.
Preferred qualifications
- Experience with agent evaluation, offline and online experiments, and human feedback loops in production.
- Direct experience with RLHF, RLAIF, DPO, PPO, GRPO or related optimization techniques.
- Prior Staff, Senior Staff, Tech Lead or equivalent senior individual contributor experience.
- A master's or PhD in computer science, machine learning, AI or a related field, or equivalent depth shown through industry work.
- Experience with production ML infrastructure: model serving, observability, data pipelines, feature stores or experimentation platforms.