Associate III - Data Engineering - Pyspark Developer
- 🇮🇳 India
- On-site
- 2 days ago
- PySpark
- ETL
- ELT
- Palantir
- Foundry
- Python
- Scrum
Senior Offshore PySpark Data Engineer
Contractor will play a key role in migrating and/or building ETL/ELT processes in Palantir Foundry infrastructure under the Medicom project establishing Foundry as the primary Data Lake platform for The core Markets scope.
Key responsibilities include:
* Data Flow and Data Lake Structure Creation: Developing and optimizing data flows from Source systems to data lake structures within Foundry using PySpark
* Creating documentation on Python code created by Contractor in client platform.
* Estimation of tasks assigned via ticketing system to the Contractor and timely resolution of those assigned.
* Participation in Scrum meetings of the team in order to plan the work and allow Contractor’s work review by Product Owner
Associate III - Data Engineering - Pyspark Developer · UST