Data Solution Architect

About The Job:

• We are looking for an experienced Big Data Engineer with strong expertise in distributed data systems, Hadoop ecosystem, data engineering, and team leadership.
• The ideal candidate should have hands-on experience in designing, developing, optimizing, and managing large-scale data platforms while leading engineering teams and driving data solutions.

Essential Job Functions:

• Work extensively in the Big Data ecosystem including Hadoop Stack (MapReduce, HDFS, Pig, Hive, HBase, Flume, Sqoop) and NoSQL databases such as Cassandra and HBase.
• Develop, optimize, and maintain complex Java, MapReduce, and Hive jobs.
• Lead Backend and Distributed Data Systems teams while remaining actively involved in hands-on development activities.
• Manage Business Intelligence teams and vendor partners, prioritizing projects based on customer and business requirements.
• Develop and maintain enterprise-grade dashboards using industry best practices.
• Lead and mentor a team of Data Engineers, including full-time employees and third-party resources.
• Analyze and validate the integrity and quality of source data.
• Lead deployment activities and audit data models and attributes for accuracy and consistency.
• Design and implement real-time and stream-processing solutions using technologies such as Spark Streaming and Storm.
• Develop solutions using object-oriented and functional programming languages including Python and Scala.
• Design and build dimensional data models to improve data accessibility, efficiency, and quality.
• Write advanced SQL queries and perform SQL performance tuning and optimization.
• Collaborate with data science and analytics teams to support machine learning and advanced analytics initiatives.
• Manage relational and NoSQL databases including PostgreSQL and Cassandra.
• Own and deliver key Big Data engineering deliverables from a project and delivery perspective.
• Troubleshoot and resolve complex networking, software, and data-related issues.
• Develop and maintain strong relationships with internal stakeholders and cross-functional teams.
• Support team goals by assisting colleagues and promoting collaborative work practices.

Qualifications:
Required Skills & Experience

• 7-10+ years of experience as a Big Data Engineer.
• Strong experience with Hadoop ecosystems, preferably Cloudera Hadoop distribution.
• In-depth knowledge of Hadoop, Spark, and distributed computing frameworks.
• Hands-on experience with Big Data querying tools such as Hive, Pig, and Impala.
• Strong programming and scripting experience in Java, Python, Scala, C++, Linux Shell scripting, Ruby, PHP, and R.
• Experience with stream-processing frameworks such as Spark Streaming and Storm.
• Experience working with relational databases and NoSQL platforms including PostgreSQL, Cassandra, and HBase.
• Strong expertise in advanced SQL development and query performance tuning.
• Experience designing and implementing dimensional data models and data warehouse solutions.
• Proven experience leading and mentoring Big Data engineering teams.
• Strong understanding of distributed systems architecture and large-scale data processing.
• Excellent analytical, troubleshooting, and problem-solving skills.
• Strong planning, organizational, and project execution capabilities.
• Excellent interpersonal and stakeholder management skills.

Good to Have

• Experience with Data Science and Machine Learning tools and technologies.
• Experience with Azure Cloud Services and cloud-native data platforms.
• Exposure to Financial Services domain.
• Experience contributing to open-source Big Data technologies.

Key Competencies

• Strong leadership and team management capabilities.
• Ability to work in fast-paced and highly collaborative environments.
• Excellent communication and stakeholder management skills.
• Ability to effectively plan, organize, and prioritize work.
• Strong focus on delivery excellence and operational efficiency.
• Commitment to mentoring team members and driving continuous improvements.

How to Apply: Interested candidates are encouraged to respond/submit their updated resumes, and for additional job opportunities, please visitJobs In India – VARITE.

Unlock Rewards: Refer Candidates and Earn.

If you're not available or interested in this opportunity, please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral Program, where you'll receive a one-time referral bonus based on the following scale if the preferred candidate completes a three-month assignment with VARITE.

Experience Level Bonus Referral:

• 0-2 years - INR 5,000
• 2-6 years - INR 7,500
• 6+ years - INR 10,000

About VARITE: VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 companies in the USA, UK, Canada, and India. VARITE is currently a primary and direct vendor to leading corporations in Networking, Cloud Infrastructure, Hardware & Software, Digital Marketing & Media Solutions, Clinical Diagnostics, Utilities, Gaming & Entertainment, and Financial Services.

Equal Opportunity Employer:

VARITE is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate based on race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, veteran status, or disability status.