VI
Senior Data Engineer
VARITE INDIA PRIVATE LIMITED
- 🇮🇳 India
- On-site
- Senior
- 1 day ago
- Hadoop
- Java
- Hive
- Azure
- HBase
- Apache Spark
- PySpark
- Scala
- SQL
- Python
- Linux
- NoSQL
- Cassandra
- PostgreSQL
- Azure Databricks
- Azure Cloud
- Data Modeling
- Cosmos DB
- C++
- Ruby
- PHP
- Machine Learning
1 day ago
About The Client:
One of the oldest banking institutions in the UAE and Middle East. The Client provides a range of conventional and Islamic banking services, including personal banking solutions such as deposits, loans, and credit cards. The bank also offers corporate and investment banking services, including corporate finance, investment advisory on mergers and acquisitions, initial public offerings (IPOs), and underwriting
Essential Job Functions:
- Design, develop, and optimize Big Data solutions using Hadoop and Spark technologies
- Develop and tune complex Java, Hive, MapReduce, and Spark jobs
- Build scalable data pipelines and Azure-based data engineering solutions
- Design and maintain dimensional data models for analytics and reporting
- Manage and mentor a team of Data Engineers and vendor partners
- Own and deliver Big Data project deliverables from a delivery perspective
- Ensure source data quality, integrity, and validation
- Lead deployment, auditing, and accuracy validation of data models and attributes
- Support business intelligence initiatives and dashboard development
- Collaborate across teams and support achievement of group goals
- Build and maintain strong stakeholder and team relationships
Mandatory skills
- Hadoop Ecosystem: HDFS, MapReduce, Hive, Pig, HBase, Flume, Sqoop, Impala
- Apache Spark (PySpark/Scala) for large-scale data processing and optimization
- Strong SQL and Performance Tuning expertise
- Programming/Scripting: Python, Java, Scala, Linux scripting
- Relational & NoSQL Databases: Cassandra, HBase, PostgreSQL
- Azure Data Engineering Services: Azure Data Lake Storage (ADLS), Azure Databricks, Azure cloud services
- Stream Processing: Spark Streaming
- Data Modeling (Dimensional/Data Warehouse Modeling)
- Ability to troubleshoot complex data, software, and networking issues
- Azure Cosmos DB experience
- Experience with Storm and other stream-processing frameworks
- Knowledge of C++, Ruby, PHP, and R
- Data Science & Machine Learning exposure
- Open-source Big Data contributions
- Financial Services / Banking domain knowledge
- Additional Azure cloud platform exposure
- 5-10 Years
- 5-10 Years of hands-on experience in Big Data Engineering, Hadoop Ecosystem, Spark, SQL, and Data Engineering solutions on Azure.
- Technology
Unlock Rewards: Refer Candidates and Earn.
If you're not available or interested in this opportunity, please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral program, where you'll receive a one-time referral bonus based on the following scale if the referred candidate completes a three-month assignment with VARITE.
Experience Level Bonus Referral:
| 0-2 years | INR 5,000 |
| 2-6 years | INR 7,500 |
| 6+ years | INR 10,000 |
About VARITE: VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA, UK, CANADA and INDIA. VARITE is currently a primary and direct vendor to the leading corporations in the verticals of Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions, Clinical Diagnostics, Utilities, Gaming and Entertainment, and Financial Services.
Equal Opportunity Employer:
VARITE is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, veteran status, or disability status.
Senior Data Engineer · VARITE INDIA PRIVATE LIMITED