Principal ML Engineer

Location: Remote, only for candidates in LATAM Job Overview Ryz Labs is looking for a Principal Machine Learning Engineer to join the core engineering team of one of our key international clients. In this role, you will play a pivotal part in shaping our client’s next-generation AI platforms, sitting at the intersection of production systems, applied AI, and engineering excellence. You will bridge distributed systems architecture with hands-on MLOps and LLM engineering. We are seeking an exceptional technical leader who can design scalable multi-tenant architectures, build robust AI agent governance frameworks, and serve as a trusted technical authority collaborating directly with product managers and key client stakeholders. Key Responsibilities • Production ML & Optimization: Deploy and manage AI models at scale, monitoring performance, hallucination rates, drift, latency, and infrastructure costs. • Architecture & Delivery: Design distributed, event-driven microservices using Python, Go, or TypeScript while building IaC and CI/CD pipelines to ship your own services. • AI Security & Governance: Implement agent permission structures, human-in-the-loop workflows, data isolation boundaries, and prompt injection defenses. • Product Collaboration: Partner with Product Managers from inception to translate business requirements into scalable architectures and present trade-offs to executives. What You Bring • 12–15+ years in software engineering, with a clear evolution from Backend/Distributed Systems Architecture into applied Production ML Engineering. • Production ML Expertise: Deep experience with MLOps, model evaluation rubrics, advanced RAG, vector search (embeddings, HNSW, hybrid search), and fine-tuning. (We are looking for engineers building real systems, not just consuming LLM APIs). • Software Architecture: Strong mastery of distributed systems, microservices, and asynchronous event-driven patterns in Python, Go, or TypeScript. • Practical DevOps & Cloud: Hands-on command of Docker, cloud infrastructure (AWS/GCP/Azure), and automated CI/CD pipelines. • AI Governance & Security: Practical knowledge of LLM safety, threat modeling, data boundary enforcement, and agent security. • Fluent English & Communication: Ability to articulate complex technical trade-offs (e.g., RAG vs. Fine-tuning, latency vs. accuracy) clearly to client executives and non-technical stakeholders. Nice-to-Have • Prior experience with multi-agent orchestration frameworks (e.g., LlamaIndex, Semantic Kernel, AutoGen, CrewAI, MCP). • Experience in fast-paced consulting, advisory, or high-growth tech platforms.