Databricks Engineer

Databricks Engineer: 9+ years of total experience with 5+ years relevant experience in the mandatory skills.

Mandatory Skills: Databricks, Hadoop, Python, PySpark, Scala, SQL, Azure/AWS cloud services

Required Skills & Experience:

• Very strong hands-on experience in Databricks with Azure/AWS cloud service in Data engineering/Data processing development projects implementing on Data warehouse.
• Hands-on experience in Azure/AWS Cloud-based development and integration
• Proficiency in programming languages Scala and Spark Data frame for data processing and application development
• Strong knowledge and experience in Facts, Dimensions, data Partitions, and handling large volume of data.
• Experience in handling large data in Databricks and performance optimization as well
• Practical experience with Data Engineering, Data Ingestion/Orchestration and the accompanying DevOps with CI-CD tools
• Strong knowledge of Spark, Databricks SQL - Data engineering pipeline implementing in Data warehouse
• Experience in offshore/onshore model and Ability and agile methodology.
• Gathering requirements, understand the business need and regular discussion with tech on design, development activities.
• Should have good experience working with client architect/design team to understand the architecture, requirements and work on the development.
• Experience working in a Financial Industry.
• Certification on Databricks and Azure will be added advantage