VI
Data Engineer - Data Platforms-Azure
VARITE INDIA PRIVATE LIMITED
๐ฎ๐ณ India
On-site
11 months ago
- Stripe
- SQL
- AI
- ETL
- ELT
- Databricks
- PySpark
- Snowflake
- Python
11 months ago
About The Client:
An American multinational technology corporation headquartered in Armonk, New York, it is present in over 175 countries. It specializes in computer hardware, middleware, and software and provides hosting and consulting services in areas ranging from mainframe computers to nanotechnology. As one of the world's oldest and largest technology companies, the Client has been responsible for several technological innovations, including the automated teller machine (ATM), dynamic random-access memory (DRAM), the floppy disk, the hard disk drive, the magnetic stripe card, the relational database, the SQL programming language, and the UPC barcode. The company has made inroads in advanced computer chips, quantum computing, artificial intelligence, and data infrastructure.
Essential Job Functions:
- Design, develop, and optimize end-to-end ETL/ELT pipelines using Databricks and PySpark.
- Build and maintain workflow orchestration and scheduling solutions for data pipelines. Develop and deploy batch and streaming jobs on Databricks Spark clusters.
- Optimize SQL queries and data transformations for performance and scalability.
- Integrate and manage data flows between Databricks and Snowflake
- 4 Years of experience. We are seeking a highly skilled Databricks Data Engineer to design, build, and maintain robust data pipelines and workflows on Databricks.
- The ideal candidate will have hands-on expertise in Python, PySpark, SQL optimization, and Snowflake, with the ability to orchestrate end-to-end workflows, manage scheduling, and run scalable jobs on Spark clusters.
Unlock Rewards: Refer Candidates and Earn.
If you're not available or interested in this opportunity, please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral program, where you'll receive a one-time referral bonus based on the following scale if the referred candidate completes a three-month assignment with VARITE.
Experience Level Bonus Referral:
| 0-2 years | INR 5,000 |
| 2-6 years | INR 7,500 |
| 6+ years | INR 10,000 |
About VARITE: VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA, UK, CANADA and INDIA. VARITE is currently a primary and direct vendor to the leading corporations in the verticals of Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions, Clinical Diagnostics, Utilities, Gaming and Entertainment, and Financial Services.
Equal Opportunity Employer:
VARITE is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, veteran status, or disability status.
Data Engineer - Data Platforms-Azure ยท VARITE INDIA PRIVATE LIMITED