PL
Associate Distinguished Engineer - AI Transformation Leader
PeopleNTech LLC
🇺🇸 United States
Hybrid
Staff / Principal
9 months ago
- AI
- AI/ML
- MLOps
- Microservices
- RAG
- Databricks
- Snowflake
- Kubernetes
- Ray
- Vertex AI
- Azure ML
- System Design
- Machine Learning
- AWS
- Azure
- GCP
- BigQuery
9 months ago
- Title: Associate Distinguished Engineer - AI Transformation Leader
- Location: NYC, NY or Atlanta, GA (Hybrid – 1 day a week in office)
- Salary for NYC location: $180-$220k gross (inclusive of base range of $140-$165k + upto 10% org bonus + upto 20% performance bonus)
- Salary for Atlanta Location: $170-$190k gross (inclusive of base of $130-$145k + upto 10% org bonus + upto 20% performance bonus)
- Interview: 3-4 rounds internal (no client interviews), final round might be in person
Job Title: Associate Distinguished Engineer - AI Transformation Leader
Duration: Full-time
Location: NYC
Job Description
Associate Distinguished Engineer – AI, Data Science & Agentic Solutions
As anAssociate Distinguished Engineer – AI, Data Science & Agentic Solutions, you will act as a senior technical authority responsible for architecting, validating, and scaling next-generation AI systems across enterprises. This role is deeply hands-on with modern AI/ML ecosystems, agentic architectures, large-scale data platforms, and cloud-native engineering patterns.
You will partner with senior technology leaders to define end-to-end AI architectures, recommend engineering strategies, and shape the technical roadmap for deploying advanced AI systems such as LLMs, multimodal models, agentic pipelines, retrieval systems, and enterprise ML/LLMOps platforms.
Your focus is toguide solution direction, validate architectural decisions, and remove technical ambiguity, ensuring organizations adopt AI responsibly, securely, and at scale —while staying independent of daily execution cycles.
Key Responsibilities
1. AI Architecture & Technical Leadership
- Architect enterprise-grade AI systems using LLMs, multimodal models, vector databases, knowledge graphs, and agentic orchestration frameworks.
- Design end-to-end pipelines including data ingestion → feature engineering → model training → evaluation → deployment → feedback loops.
- Define and enforce engineering standards for MLOps, LLMOps, data quality, model observability, guardrails, prompt security, and hallucination mitigation.
- Consult on scalable microservices, model serving layers, retrieval-augmented generation (RAG) pipelines, and autonomous agent workflows.
- Conduct architectural reviews, performance tuning, and technical due-diligence for high-risk or complex AI solutions.
- Guide on how to build quick prototypes, PoCs, and production systems using modern AI stacks (transformer models, diffusion models, graph models, reinforcement learning, and agentic systems).
- Advise on selection of foundation models and fine tuning approaches.
- Advise on real-time data streams, event-driven systems, API layers, and cloud-native compute.
- Establish evaluation frameworks: bias, drift, explainability, reliability, performance.
- Lead complex troubleshooting, debugging, and optimization of AI pipelines and distributed training workloads.
- Architect secure, high-throughput data platforms for AI/BI use cases based on lakehouse, medallion, streaming, and vectorized storage patterns.
- Define data governance, metadata, lineage, cataloging, and policy enforcement mechanisms.
- Deploy scalable compute using Databricks, Snowflake, Kubernetes, Ray, SageMaker, Vertex AI, and Azure ML.
- Guide CIO/CTO/CDO teams on AI system design, architecture modernization, model lifecycle governance, and platform engineering standards.
- Translate ambiguous requirements into well-scoped technical blueprints, reference architectures, and engineering backlogs.
- Evaluate enterprise readiness across data, models, infrastructure, and processes — producing AI maturity assessments and architectural recommendations.
- Mentor engineering teams in building reliable, secure, and scalable AI systems with measurable outcomes.
- Lead deep-dive technical workshops on agentic systems, generative AI patterns, model safety architectures, continuous learning loops, and intelligent automation.
- Collaborate with hyperscalers and partners (AWS, Azure, GCP, Databricks, Snowflake, NVIDIA) on technical accelerators, performance benchmarks, and reference implementations.
- Stay ahead of emerging architectures (multi-agent, RAG 2.0, synthetic data generation, self-improving systems) and translate them into actionable engineering strategies.
Qualifications
- 12+ years in AI/ML, data engineering, or large-scale distributed systems.
- Deep hands-on expertise in:
- Foundation models (LLMs, multimodal, vision, speech, embeddings)
- Model finetuning, training, inference optimization, evaluation
- MLOps/LLMOps workflows and ML engineering best practices
- Vector databases, knowledge graphs, retrieval systems
- Strong experience with cloud-native architectures (AWS, Azure, GCP) and data platforms (Databricks, Snowflake, BigQuery, Lakehouse).
- Demonstrated ability to design complex AI systems that operate reliably at scale.
- Experience influencing senior technology leaders through architectural clarity and technical depth.
- Strong documentation, architecture storytelling, and ability to simplify complex technical concepts for varied audiences.
- Track record of publications, open-source contributions, patents, technical talks, or recognized technical leadership is a strong plus.
Associate Distinguished Engineer - AI Transformation Leader · PeopleNTech LLC