Machine Learning Engineer

We are seeking a highly skilled Machine Learning Engineer to design and build alow-latency query understanding and intelligent routing system that operates without reliance on large language models. The role focuses on extractingintent, entities, application context, routing decisions, and supporting evidence from user queries in real time.

This is afull lifecycle role spanning data modeling, ML development, optimization, local deployment, and MLOps. The ideal candidate will have strong experience inapplied NLP, lightweight model architectures, and production-grade ML systems, with a focus onsub-second inference, CPU-based execution, and scalable domain evolution.

Responsibilities

• Design and implement aquery understanding pipeline to extract intent, routing decisions, entities, application mapping, and historical evidence from user queries and conversations.
• Define and build thetraining data model and annotation schema for structured outputs (intent, routing, entities, applications, evidence).
• Leaddata collection, synthesis, analysis, and cleaning to develop high-quality datasets for model training and evaluation.
• Develop and evaluatebaseline and advanced non-LLM models for:
  • Intent classification
  • Query routing
  • Entity extraction
  • Application detection
  • Evidence retrieval
• Build and maintaintrain, test, and evaluation pipelines with strong focus on:
  • Accuracy and F1 score
  • Confidence scoring and calibration
  • Latency and throughput
• Optimize models to meet strict constraints:
  • Sub-second inference latency
  • CPU-only execution
  • Compact model size (<500MB)
• Deploy modelslocally within the application codebase, ensuring seamless integration without reliance on hosted AI services.
• Design and implement aLevel 4 MLOps framework, including:
  • Monitoring and alerting
  • Drift detection
  • Retraining pipelines
  • Data feedback loops
• Develop strategies to handledomain evolution, including:
  • New agents / skills
  • New entity types
  • Updates to domain definitions
• Leveragehistorical queries and routing decisions to improve prediction accuracy and evidence generation.
• Collaborate with product, engineering, and domain teams to translate business workflows into scalable ML solutions.
• Deliver aworking demo / prototype baseline, and iteratively mature it into a production-ready system.

Required Skills

• Strong expertise inMachine Learning and Applied NLP, especially in:
  • Text classification
  • Intent detection
  • Query routing
  • Entity extraction
  • Semantic similarity and retrieval
• Proven experience withnon-LLM approaches, including:
  • Encoder-based models
  • Embedding-based pipelines
  • Classical ML (e.g., XGBoost, Logistic Regression)
  • Lightweight deep learning models
• Experience designingtraining datasets, labeling frameworks, and structured output schemas for multi-task NLP systems.
• Strong understanding ofdata preprocessing and quality improvement, including:
  • Normalization
  • Deduplication
  • Class imbalance handling
  • Synthetic data generation
• Experience buildingrobust evaluation frameworks, including:
  • Precision, Recall, F1
  • Confidence scoring
  • Ranking quality
  • Latency measurement
• Hands-on experience withentity extraction for structured enterprise domains, such as:
  • Device identifiers (PID, Serial Number, MAC, Hostname)
  • Smart / Virtual accounts
  • Orders, contracts, subscriptions
  • Product families and licenses
• Experience handlingmulti-label and hierarchical classification problems.
• Strong ability to buildlow-latency, CPU-optimized inference systems with strict memory and performance constraints.
• Experience deploying ML modelslocally or on-prem within application codebases (not limited to cloud-hosted inference).
• Solid understanding ofMLOps practices, including:
  • Monitoring and observability
  • Drift detection
  • Retraining pipelines
  • Model lifecycle management
• Strong programming skills inPython, with hands-on experience in ML/NLP frameworks and pipeline orchestration.
• Ability to adapt systems tocontinuous domain changes, including new skills, applications, and entities.
• Prior experience inenterprise support systems, operational routing, licensing platforms, or device/account management domains is highly preferred.