A
Senior Databricks Engineer
Apolis
- 🇺🇸 United States
- On-site
- Senior
- 7 hours ago
- $50 – $55 / hour
- Databricks
- Teradata
- ETL
- SQL
- PySpark
7 hours ago
Position Title:Senior Databricks Engineer
Location:Las Vegas, US (Remote)
Duration:Long Term Contract
Job description:
The Senior Databricks Engineer will lead the technical discovery and assessment for Teradata modernization initiatives. This role involves analyzing existing data assets, ETL processes, and migration complexity to support Databricks implementation. The engineer will collaborate with architects and stakeholders to define migration approaches and design Databricks solutions. Strong experience with SQL, Teradata, DataStage, Databricks, and PySpark is required, along with a background in large-scale data warehouse modernization.
Required Skills:
- Strong hands-on experience with SQL, Teradata, DataStage, Databricks, PySpark
- Experience with large-scale data warehouse modernization
Preferred Qualifications:
- Control M knowledge
Role and responsibilities:
- Lead technical discovery and assessment for Teradata modernization initiatives
- Analyze existing data assets, ETL processes, and migration complexity to support Databricks implementation
- Analyze Teradata databases, tables, views, stored procedures, macros, and BTEQ scripts
- Reverse engineer IBM DataStage jobs, workflows, and ETL dependencies
- Perform data profiling, data quality assessment, and migration readiness analysis
- Conduct technical impact analysis, lineage mapping, and dependency assessment
- Create source-to-target mappings and migration specifications
- Identify transformation logic, integration patterns, and technical risks
- Collaborate with architects and stakeholders to define Databricks migration approaches
- Design & Build Databricks notebook & integrate with gold framework
- Quick learner to understand the existing frameworks
Senior Databricks Engineer · Apolis