Lead Data Engineer | Remote
- Databricks
- ETL
- ELT
- Python
- SQL
- Hadoop
- PySpark
- Snowflake
- Hive
- Apache Airflow
- Apache NiFi
- Talend
- Git
- CI/CD
- Java
Important IT company At the Latin American level, growth requires:
Lead Data Engineer
Experience: Senior / Lead-level Data Engineering
Focus: Big Data, Cloud Data Platforms, Databricks, ETL/ELT
We are seeking an experiencedLead Data Engineer to design and implement scalable data analytics solutions across on-premises and cloud data platforms. The ideal candidate will have strong hands-on experience building production-grade data pipelines and Big Data solutions, with expertise inPython, Spark, SQL, Hadoop, and Databricks.
This role combines hands-on engineering with technical leadership, including architecture discussions, code reviews, mentoring, and driving best practices across data engineering initiatives.
Key Responsibilities
Design and build scalable, cloud-nativedata platforms and pipelines.
Develop robustETL/ELT pipelines integrating data from multiple systems and sources.
Build production-grade data solutions usingPython, Spark, SQL, and Databricks.
Design modular, maintainable, and scalable data processing components.
Participate inarchitecture and technical design decisions.
Lead code reviews and ensure engineering best practices, testing, and maintainability.
Mentor and guide data engineers, promoting technical growth and knowledge sharing.
Supportdata quality, governance, lineage, cataloging, and access management.
Troubleshoot complex data and pipeline issues in production environments.
Participate in planning, estimation, feature sizing, and technical discussions with cross-functional teams.
Mandatory Technical Skills
Strong hands-on experience buildingproduction-grade data engineering solutions.
Advanced proficiency inPython, PySpark/Spark, and SQL.
Strong experience withDatabricks; experience with Snowflake is a plus.
Hands-on experience with theHadoop ecosystem, including technologies such asHive and Impala.
Experience developing and managing data pipelines usingApache Airflow, Apache NiFi, or Talend.
Experience withETL/ELT, data integration, and distributed data processing.
Strong understanding ofGit, CI/CD, automated testing, and release pipelines.
Experience troubleshooting and optimizing complex data pipelines and workloads.
Leadership & Architecture
Proven experience acting as atechnical lead or senior technical contributor within data engineering teams.
Experience mentoring engineers and conducting technical/code reviews.
Ability to decompose complex data problems into scalable and maintainable solutions.
Experience participating inarchitecture and platform design decisions.
Strong communication skills with both technical and non-technical stakeholders.
Preferred Skills
Experience withSnowflake or additional cloud data platforms.
Experience withJava-based applications.
Experience with data governance, data cataloging, lineage, and observability.
Experience designing or modernizing on-premises data platforms into cloud-based architectures.
ADVANCED CONVERSATIONAL ENGLISH AND SPANISH ESSENTIAL(Will be evaluated).
If you are a foreingner residing in Mexico, you must have a valid INE, CURP, NSS and RFC.
Job type: Remote
Location: Mexico.
Salary: $110,000 gross.
Benefits: Excellent superior benefits.
Lead Data Engineer | Remote · GSB Solutions