|
SN |
Required Information |
Details |
|
1 |
Role |
AWS Data Engineer |
|
2 |
Required Technical Skill Set |
Python, Data engineering, Pyspark, AWS Cloud, Cosmos DB |
|
3 |
Desired Experience Range |
7-13 Years |
|
4 |
Location of Requirement |
Pune, Bangalore, Delhi |
| Desired Competencies (Technical/Behavioral Competency) |
|
| Technical Skills |
- Proficiency inPython for data transformation and automation.
- Experience withTerraform andAWS Cloud infrastructure.
- Familiarity withJava for SCADA software development.
- Understanding ofData Lake architecture anddata modeling.
- Knowledge ofMQTT,Greengrass, andOPC-UA protocols.
- Experience withWindows Server management andPowerShell scripting.
- Ability to create and manageGrafana dashboards using SQL queries.
- Basic knowledge ofAWS CloudWatch andAWS Glue.
|
|
| Responsibilities |
- Design and implement data transformation workflows using Python and AWS services.
- Develop and maintain infrastructure using Terraform and AWS Cloud.
- Standardize and manage raw and curated data in a multi-source Data Lake.
- Build and maintain SCADA data collection software deployed on AWS Greengrass.
- Automate deployment of Greengrass across multiple sites and ensure operational stability.
- Monitor and manage Windows servers hosting Greengrass using PowerShell.
- Create and maintain Grafana dashboards for data visualization and system monitoring.
- Coordinate with IT teams to manage incidents and plan maintenance activities.
- Use AWS CloudWatch to monitor system health and report errors.
- Integrate CRM data (Salesforce) into Power BI using AWS Glue and Python Lambdas.
- Collaborate with Data Platform teams to manage access, API provisioning, and folder creation.
|
|
| Mindset |
- Strong problem-solving and debugging skills.
- Proactive and detail-oriented approach to system monitoring and incident management.
- Effective communication with IT and data platform teams.
|
|
| Soft Skills |
- Strong analytical and problem-solving abilities
- Clear communication in English
- Ability to work independently and collaboratively in a cross-functional team.
- Strong focus on code quality, documentation, and collaboration
|
|
| Highly Recommended |
- Technical Skills:
- Advanced understanding ofSCADA systems and industrial data flows.
- Experience withautomated deployment andmulti-site configuration management.
- Familiarity withnetwork administration andcybersecurity principles.
- Basic knowledgeSalesforce integration.
- Optional
- Technical Skills:
- Experience withPower BI dashboard creation.
- Knowledge ofAPI management anddata access provisioning on enterprise platforms.
|
|
