DL
software engineer
Diverse Lynx India
Location not stated
2 months ago
- Python
- AWS
- Microservices
- MongoDB
- Machine Learning
- REST API
- NoSQL
- CI/CD
- GitLab
- Jenkins
- Docker
- Kubernetes
- Databricks
- Vertex AI
- MLflow
- FastAPI
- Flask
- Step Functions
- DynamoDB
- API Gateway
- GCP
- CloudWatch
- Grafana
- Prometheus
- Splunk
2 months ago
(Submit only strong candidates - Only 2 slots will be given)
Role Overview
We are looking for a highly skilled Software Engineer to design, develop, and integrate custom services that enable end-to-end machine learning (ML) model development and operationalisation. This role will focus on Python based custom program development, building integration layers, and engineering high performance data and API workflows to support advanced ML driven solutions within Financial Crime Technology.
You will work closely with ML Engineers, Data Engineers, Platform Engineers, and Product teams to create scalable, resilient, and secure integration components running on modern cloud-native architectures.
Required Skills & Experience-
Technical Skills
• Strong coding experience in Python.
• Hands-on experience building REST APIs and microservices.
• Expertise with Kafka (producers, consumers, streaming, schemas).
• Strong understanding of ML model lifecycle, orchestration, and integration patterns.
• Experience working with relational and NoSQL databases.
• Familiarity with cloud environments (AWS preferred).
• Good understanding of CI/CD practices (GitLab, Jenkins, etc.).
• Knowledge of container-based development (Docker, Kubernetes).
Bonus / Nice-to-Have
• Experience with ML platforms (SageMaker, Databricks, Vertex AI, MLflow).
• Experience building feature stores, scoring services, or inference APIs.
• Understanding of event-driven and domain-driven architecture.
• Experience in financial crime, risk, or regulated environments.
Key Responsibilities-
1. Custom Program Development
• Build Python- based custom utilities, integration services, and workflow components to support ML model training, validation, scoring, and deployment.
• Develop modular, reusable components for data transformation, validation, and enrichment.
• Create automation scripts and tools for CI/CD, data processing, and workflow orchestration.
2. ML Model Integration
• Integrate ML models into production pipelines through REST APIs, microservices, or batch interfaces.
• Build and optimize scoring pipelines and real-time inference endpoints.
• Collaborate with ML Engineers to translate notebooks and prototypes into scalable production-grade code.
3. API & Microservice Engineering
• Design and develop RESTful APIs and internal service interfaces using Python (FastAPI/Flask).
• Implement authentication, authorization, rate limiting, and observability for services.
• Work with API gateways and service mesh solutions to ensure reliability and security.
4. Event Streaming & Messaging
• Build data ingestion, event streaming, and near real time processing using Kafka.
• Develop producers, consumers, and streaming integrations supporting ML model workflows.
• Optimize event schemas, partition strategies, and consumer group performance.
5. Integration & Platform Engineering
• Integrate with multiple upstream/downstream systems (databases, message systems, orchestration platforms, ML platforms).
• Work across AWS-native services (e.g., Lambda, S3, Glue, Step Functions, DynamoDB, API Gateway) as required or alternatively with GCP-native services.
• Implement observability (logs/metrics/traces) using tools like CloudWatch, Grafana, Prometheus, Splunk, etc.
6. Engineering Excellence
• Contribute to best practices in code quality, testing, security, and performance.
• Implement unit, integration, and contract tests as part of CI/CD pipelines.
• Participate in design reviews, code reviews, and architectural discussions.
Location - Chennai, Bangalore, Pune, Hyd, New Delhi, Kolkata
Experience Required: 6+ years
software engineer · Diverse Lynx India