Senior Data Engineer

Job Description

WHAT YOU’LL CHAMPION:

As a Senior Data Engineer, your day-to-day duties will encompass the following areas: 

• Operational Excellence: Provide essential operational support, including system troubleshooting and implementing technical fixes. 

• Data Quality Assurance: Ensure absolute data integrity and data quality across environments. 

• Process Optimization: Continuously improve internal processes through automation, pipeline optimization, and infrastructure re-design. 

• Cross-Functional Collaboration: Support and collaborate closely with cross-functional and multidisciplinary teams in a fast-paced environment. 

• Data Impact: Leverage data visualization tools and techniques to maximize the business impact and intrinsic value of data. 

• Internal Stakeholder Management: Manage technical communication, alignment, and relationships with internal business units, product managers, and engineering teams to ensure data deliverables align with organizational goals. 

• Governance & Compliance: Contribute to improving data governance policies and maintaining data compliance standards. 

• Continuous Learning: Keep continuously current with the latest technical and industry developments. 

WHO YOU ARE:

• BS/MS/PhD in IT, Mathematics, Science or Engineering discipline Up to 4+ yrs relevant experience beyond first degree
• Experience with one of the following languages: Python, Spark
• Experience with DAG, airflow, terraform
• Familiar with data ETL from a wide variety of data sources.
• Experience with SQL and NoSQL databases.
• Experience with pipeline and workflow management tools.
• Experience with various messaging and stream processing.
• Experience with object-oriented/object function scripting languages.
• Familiar with containerisation and orchestration tools.
• Familiar with one of the following cloud-based services: GCP and its tools and services.
• Ability to work under pressure and change, and balance among speed, reliability, and interpretability.
• Good working knowledge of productivity tools such as G Suite, Git, Jira, Confluence.
• Experience with code versioning, code review and documentation.
• Proficient understanding of distributed computing principles.
• Able to select and integrate big data tools and frameworks.
• Familiar or prone to adopt design thinking methods.
• Openness to experimenting with new techniques and new ways of working.
  ​

WHAT YOU’LL ENJOY:

• Physical Wellbeing:Key medical and insurance benefits, maternity expenses, flexible work arrangement, and health and fitness amenities.
• Emotional Wellbeing:Paid time off, wellness programmes, and childcare amenities. 
• Financial Wellbeing:Resources relating to financial, personal skills and career growth programmes.
• Allstars Specials: Free flights, unlimited discounted flights, and exclusive discounts with partners. 
• A unique Allstar culture like no other 

OUR HIRING PROCESS:

• Application received
• Candidate screening
• Interview(s) and assessment(s)
• Background check and/or other assessments
• Offer and negotiation