A
Versant - Databricks Engineer
Apolis
- 🇺🇸 United States
- On-site
- Manager or above
- 16 hours ago
- $65 – $70 / hour
- Databricks
- Apache Spark
- Risk Management
- AWS
- ETL
- ELT
- PySpark
- Python
- SQL
- Delta Lake
- Azure
- GCP
- CI/CD
- Git
- Devops
16 hours ago
Work site: Only - New York City, NYC - Onsite
Job Description
**** Onsite Only - New York City, NYC****
Client is seeking a Senior Data Engineer with expertise in Databricks, Apache Spark, and Cloud Data Platforms to lead data engineering initiatives while managing client delivery, support operations, and project execution.
JD:-
Design, build, and optimize scalable data pipelines and lakehouse solutions.
Lead project delivery, resource planning, risk management, and stakeholder communication.
Manage support operations, ensuring SLA compliance and high customer satisfaction.
Collaborate with business, analytics, and engineering teams to deliver data-driven solutions.
Develop dashboards, reports, and automation initiatives to improve operational efficiency.
Solution with consideration to cloud platform costs (AWS/Databricks) and drive cost optimization efforts.
Manage client relationships, monthly reviews, escalations, and commercial discussions.
Identify process improvements, support new application onboarding, and drive continuous innovation.
Skills and experience
5+ years of hands-on experience designing and developing ETL/ELT pipelines using Databricks, Apache Spark, and PySpark.
Strong proficiency in Python, SQL, and PySpark.
5+ years of Project/Delivery Management experience.
Experience with Delta Lake, Data Lakehouse architecture, streaming data, and data warehousing.
Hands-on experience with AWS (preferred), Azure, or GCP.
Knowledge of CI/CD, Git, DevOps practices, and performance tuning.
Versant - Databricks Engineer · Apolis