Applied ML / AI Engineer

 

Location: Singapore
Employment Type: Full-time
Work Arrangement: Hybrid / on-site, depending on project needs
Compensation: Competitive base compensation, aligned with experience and role scope
Work Eligibility: Applicants must have the right to work in Singapore

To Apply: Email your CV at careers@nestria.ai

​

About Nestria AI

Nestria AI is a Singapore-based high-assurance agentic AI startup building reliable, secure, and enterprise-ready AI systems for regulated and IP-sensitive industries. Our platform helps enterprises deploy agentic AI safely through runtime assurance, observability, verification workflows, secure orchestration, and customer-ready deployment environments.

We are building a creative, collaborative, and curiosity-led culture where people are encouraged to challenge the status quo, communicate openly, move with ownership, and support each other with empathy and respect.

​

About the Role

We are looking for an Applied ML / AI Engineer to design and implement AI evaluation, orchestration, and verification workflows for our platform. This role sits at the intersection of applied AI, software engineering, experimentation, evaluation, and customer use-case adaptation.

As an early team member, you will work closely with the founders and have the opportunity to shape the product, engineering culture, and customer-facing platform as the company grows.

​

Key Responsibilities

• Design and implement AI evaluation workflows, including model evaluation logic, test cases, scoring, benchmarking, and performance analysis.

• Build verification flows to assess AI outputs for correctness, reliability, traceability, and policy adherence.

• Develop orchestration workflows for AI agents, including task routing, tool use, multi-step reasoning flows, and validation loops.

• Support use-case adaptation across customer pilots, including workflow design, prompt architecture, data preparation, and evaluation setup.

• Build testing pipelines for AI-driven features, including regression testing, edge-case testing, and model comparison.

• Analyse model performance, failure modes, latency, accuracy, consistency, and reliability across different workflows.

• Work with platform engineers to integrate AI workflows into runtime services, dashboards, APIs, and deployment environments.

• Support experimentation with different models, prompting strategies, retrieval workflows, and verification methods.

• Prepare technical documentation, evaluation reports, and internal engineering notes.

• Work closely with founders and engineering team to translate customer use cases into working AI system designs.

 

Requirements

• Bachelor’s degree in Computer Science, Engineering, Data Science, AI, Machine Learning, or a related technical field.

• Master’s degree is preferred.

• Strong programming skills in Python.

• Practical experience building AI, ML, LLM, NLP, RAG, or agentic AI applications.

• Understanding of model evaluation, testing, benchmarking, error analysis, and performance measurement.

• Experience with APIs, data pipelines, workflow orchestration, and software engineering practices.

• Familiarity with LLM frameworks, vector databases, retrieval systems, model providers, or evaluation libraries.

• Ability to experiment quickly, analyse results clearly, and turn prototypes into reliable workflows.

• Strong problem-solving ability and comfort working with ambiguous technical problems.

 

Nice to Have

• Experience with AI safety, AI governance, model risk management, red-teaming, or assurance workflows.

• Experience with agentic AI systems, tool-using agents, multi-agent workflows, or autonomous task execution.

• Familiarity with enterprise AI deployment, RAG pipelines, data security, or regulated environments.

• Experience with technical domains such as cybersecurity, software analysis, compliance automation, hardware security, or operations automation.

 

What We Look For

• Strong curiosity to learn and build in a fast-changing AI environment.

• Startup mindset, high ownership, and willingness to wear multiple hats.

• Clear thinking, practical execution, and comfort working through ambiguity.

• Strong culture add: openness, collaboration, empathy, and constructive challenge.

• Interest in building reliable AI systems that enterprises can trust and deploy.

​

Why Join Us

• Work directly with the founding team of a deep-tech AI startup.

• Work on high-impact problems in reliable AI, agentic AI, AI governance, security, and enterprise automation.

• Gain exposure to customer pilots across regulated and IP-sensitive industries.

• Join at an early stage where your work will directly shape the product and company direction.

• Be part of a creative, collaborative, and curiosity-led culture that values openness, empathy, ownership, and constructive challenge.

​​

​

To Apply: Please send your CV, LinkedIn profile, GitHub or portfolio if available, and a short note on why you are interested in the role at careers@nestria.ai