Lead Data Engineer

We’re looking for a Lead Data Engineer to join our team and help us turn data into insights that drive business decisions. The ideal candidate will have a strong technical background with experience leading a team of data engineers in the design, development, and maintenance of our data architecture. He/she will be responsible for ensuring that our data is accurate, accessible, and secure, and will work closely with the data science team to develop data-driven solutions to business problems. The Lead Data Engineer will also be responsible for mentoring and developing junior data engineers, and for staying up-to-date on the latest industry trends.

Duties & Responsibilities

• Design, implement, and maintain the data architecture for all company data, including but not limited to customer data, product data, financial data, and operational data

• Work with business stakeholders, data scientists, and software engineers to understand data needs and develop solutions to meet those needs

• Design and implement ETL processes to load data from a variety of sources into the data warehouse

• Design and implement data models that are optimized for performance and scalability

• Mentor junior members of the team and provide guidance on best practices

• Participate in code reviews and provide feedback on design and implementation

• Assist in the development of data governance policies and procedures

• Help troubleshoot production issues when they arise

• Perform other duties as assigned

• Write SQL queries and stored procedures to support data analysis and reporting

• Monitor data quality and take corrective action when necessary

• Stay up-to-date on new technologies and approaches in the data engineering field and recommend ways to improve the company’s data infrastructure

Required Skills and Qualifications

• Bachelor’s degree in computer science, engineering, or related field

• 7+ years professional experience as a data engineer or similar role

• Expertise in big data processing tools, including Hadoop, Spark, and MapReduce

• Experience with relational databases, including MySQL, Oracle, and SQL Server

• Proficiency in Java, Python, or Scala

• Strong analytical and problem-solving skills

• Ability to work independently and with a team

Preferred Skills and Qualifications

• Master’s degree in computer science, engineering, or related field

• 10+ years professional experience as a data engineer or similar role

• Experience with NoSQL databases, including MongoDB and Cassandra

• Experience with cloud computing platforms, including Amazon Web Services and Microsoft Azure

• Proficiency in R or MATLAB