ES
Sr. Data Engineer
Epsilon Solutions LTD
๐ Worldwide
Remote
Senior
7 months ago
- Databricks
- SAS
- Python
- PySpark
- SQL
- Delta Lake
- DB2
- JDBC
- ETL
- COBOL
- CI/CD
- Git
- Azure DevOps
- Machine Learning
- Apache Spark
7 months ago
Remote, Canada
Contract
Note: Security clearance is mandatory
We need resources with Databricks or SAS
Programming Languages
- Python Certification (e.g., PCAP)
- R Programming Certification (e.g., DataCamp, Coursera)
- Proven experience converting SAS EG code to PySpark, SQL, and/or R
- Familiaritywith SAS macros, data steps, and PROC SQL
- Experience with Databricks notebooks, Delta Lake, and Spark SQL
- Ability to optimize PySpark code for performance and scalability
- Experience accessing DB2 data via ODBC/JDBC or ETL tools
- Familiarity with mainframe systems (JCL, COBOL, IMS)
- Ability to replicate or migrate data from DB2 to cloud data lake
- Use of SAS-to-PySpark conversion tools (e.g., SAS2PY, SPROCKET, Scintilla, AI tools)
- Automated testing and validation frameworks for data parity
- Schema mapping and lineage tracking capabilities
- Experience successfully onboarding with client systems.
- Clear documentation of conversion logic and testing results
- Version control and CI/CD integration (e.g., Git, Azure DevOps)
- Compliance with internal data governance and security policies
- Databricks Certified Data Engineer Associate or Professional
- Databricks Certified Machine Learning Associate or Professional
Apache Spark Developer Certification
Sr. Data Engineer ยท Epsilon Solutions LTD