Data Engineer_tcs

Diverse Lynx India

Location not stated

2 months ago

Python
PySpark
Databricks
Delta Lake
MongoDB
Unity Catalog
SQL
Pandas
AWS
Step Functions
PostgreSQL
NoSQL

2 months ago

Not scoredNo CV on file. Upload one and this job gets a score out of 100.Upload CV

Job Description:	RGS ID : 10722673 Location : Pune Exp: 6 to 8 Role Descriptions: RGS raised for upskilling associate in data engineer- Python\| pyspark\| databrick Job Description mandatory Sr.No Required Information Details 1 Role Data Engineer 2 Required Technical Skill Set Python, Databricks, DeltaLake,MongoDB, Sympy, UnityCatalog,SQL,Pandas,GithubAction 4 Desired Experience Range 6+ Years 5 Location of Requirement Bangalore / Pune Desired Competencies (Technical/Behavioral Competency) Must-Have** (Ideally should not be more than 3-5) - Design, build, and maintain data transformation pipelines using AWS services (Lambda Functions, Step Functions .. ) in Python. - Manage effeciently large dataset. - Manage SQL database - Postgresql. - NoSQL- MongoDB - Implement and maintain complex data calculation formula. - Open to collaborate with Software Engineers. - Participate in code reviews, design discussions, and software planning. - Contribute to automation, testing, and deployment processes.- Good-to-Have - AWS Certification SN Responsibility of / Expectations from the Role 1 Design, build, and maintain data transformation pipelines using Python and Databricks. Implement and maintain complex calculation engine. 2 Open to collaborate with Frontend Engineers. 3 Participate in code reviews, design business discussions and software planning. 4 Contribute to automation, testing, and deployment processes. 5 Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine. 6 Open to collaborate with Frontend Engineers. 7 Participate in code reviews, design business discussions and software planning. 8 Contribute to automation, testing, and deployment processes.

Job Description:

RGS ID : 10722673
Location : Pune
Exp: 6 to 8

Role Descriptions: RGS raised for upskilling associate in data engineer- Python| pyspark| databrick

Job Description
**mandatory
Sr.No Required Information Details
1 Role** Data Engineer

2 Required Technical Skill Set** Python, Databricks, DeltaLake,MongoDB, Sympy, UnityCatalog,SQL,Pandas,GithubAction
4 Desired Experience Range** 6+ Years
5 Location of Requirement Bangalore / Pune

Desired Competencies (Technical/Behavioral Competency)
Must-Have**
(Ideally should not be more than 3-5) - Design, build, and maintain data transformation pipelines using AWS services (Lambda Functions, Step Functions .. ) in Python.
- Manage effeciently large dataset.
- Manage SQL database - Postgresql.
- NoSQL- MongoDB
- Implement and maintain complex data calculation formula.
- Open to collaborate with Software Engineers.
- Participate in code reviews, design discussions, and software planning.
- Contribute to automation, testing, and deployment processes.-
Good-to-Have - AWS Certification

SN Responsibility of / Expectations from the Role
1 Design, build, and maintain data transformation pipelines using Python and Databricks. Implement and maintain complex calculation engine.
2 Open to collaborate with Frontend Engineers.
3 Participate in code reviews, design business discussions and software planning.
4 Contribute to automation, testing, and deployment processes.
5 Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine.
6 Open to collaborate with Frontend Engineers.
7 Participate in code reviews, design business discussions and software planning.
8 Contribute to automation, testing, and deployment processes.

Data Engineer_tcs · Diverse Lynx India

Auto apply with Likeremote