DL
Python ,Pyspark
Diverse Lynx India
Location not stated
2 weeks ago
- Python
- Pandas
- NumPy
- PySpark
- SQL
- Devops
- Databricks
- Azure Cloud
- Azure
- ETL
- Azure Databricks
2 weeks ago
· 5 to 8 + Years of experience using Python.
· Develop and implement Data pipelines and algorithms using Python programming language, jointly with knowledge about Pandas, NumPy, Pyspark, SQL and similar libraries.
· Should have working knowledge in devops and should be well versed in databricks to solve real-world problems.
· Should have working knowledge in Azure cloud data lake storage and azure services.
· Utilize SQL for data Extraction, Transformation, and Loading (ETL) processes.
Key Responsibilities*
Work closely with engineers, researchers, and data scientists to gather requirements, perform data analysis, and develop end-to-end pipelines.
Independently develop, code or modify, test, and debug application programs of varying degree of complexity
Conduct experiments and perform data analysis to ensure the robustness, scalability, and accuracy of provided solutions
Optimize and fine-tune for performance and efficiency.
Soft Skills
- Excellent communication
- Team collaboration
- Documentation and knowledge sharing
Education Requirements
Bachelor's/Master's in Computer Science or equivalent
Certifications
Microsoft Azure Certified Developer / Azure Databricks Data Engineer
Skills: Digital : Python~Digital : PySpark
Experience Required: 4-6
Python ,Pyspark · Diverse Lynx India