Solution Data Engineer Sr.
- Databricks
- Unity Catalog
- Delta Lake
- Python
- SQL
- PySpark
- Git
- Snowflake
- Data Architecture
- Adobe
- Adobe Analytics
- Redshift
- Airflow
- GCP
- BigQuery
- AWS
- Athena
- AWS Glue
Must Have Skills:
English advanced
Databricks Ecosystem
o Full management of the Databricks environment
o Environment configuration and workspace administration
Governance & Storage
o Implement data governance using Unity Catalog
o Manage structured storage with Delta Lake tables
Development
o Write and optimize data processing logic using Python, SQL, and PySpark
Version Control
o Manage code lifecycle and collaborative development using Git
o Data Warehousing & Integration (Important)
Important Skills:
Snowflake
o Manage data architecture, performance, and integrations within Snowflake
Adobe Data Ingestion
o Handle Adobe Data Feeds and Adobe Analytics
o Ensure correct ingestion and transformation of external marketing data
Nice to Have:
Redshift
o Oversee data warehousing operations in Amazon Redshift
Orchestration
o Use Airflow to schedule, monitor, and manage complex data pipeline workflows
Desirable:
Google Cloud Platform
o Maintain data availability and basic operations in BigQuery
AWS Data Services
o Manage serverless querying with Athena
o Handle metadata management with AWS Glue
Pipeline Ownership
o Own end to end maintenance of data pipelines
o Ensure reliability from data ingestion through final delivery across multiple cloud platforms
REMOTE
ADVANCED ENGLISH
Solution Data Engineer Sr. · Valce Talent Solutions