Big Data Lead

Big Data Lead

Remote
Advanced english

Only México

Must-Have Skills DatabricksAzure Data FactorySQLPythonData engineering and ETL or ELT developmentData pipeline development and performance optimization

Nice-to-Have SkillsExposure to Generative AI solutions and use cases.Experience working on AI or machine-learning-related data projects.Knowledge of Power BI, including dataset preparation and report integration.Experience with PySpark, Delta Lake, or Azure Data Lake Storage.Familiarity with Microsoft Azure cloud services.Understanding of CI/CD processes for data-engineering solutions.Exposure to data preparation for large language models, embeddings, vector databases, or retrieval-augmented generation solutions.