A
Databricks Engineer
Apolis
- 🇺🇸 United States
- On-site
- Mid level
- 1 month ago
- $70 – $75 / hour
- Databricks
- ETL
- ELT
- Apache Spark
- Python
- SQL
- PySpark
- Delta Lake
- Data Modeling
- CI/CD
- Git
- Devops
- AWS
- Azure
- GCP
1 month ago
Role: Databricks Engineer
Location: Englewood Cliffs, New Jersey / New York, NYJob Description
We are seeking an experiencedDatabricks Engineer with strong expertise in designing, developing, and optimizing modern data engineering solutions.
Required Skills & Responsibilities
- 5+ years of experience designing and implementingETL/ELT pipelines usingDatabricks andApache Spark.
- Strong proficiency inPython, SQL, and PySpark.
- Hands-on experience withDelta Lake,data lakehouse architecture, andstreaming data.
- Develop and maintain scalable data lakehouse architectures for structured and unstructured data.
- Design and optimize data workflows forperformance, scalability, reliability, and cost efficiency.
- Strong understanding ofdata modeling anddata warehousing concepts.
- Experience withperformance tuning and optimization of Spark and Databricks workloads.
- Familiarity withCI/CD pipelines,Git/version control, andDevOps practices.
- Monitor, troubleshoot, and maintain data pipelines to ensure high reliability and data accuracy.
- Integrate Databricks solutions with cloud platforms such asAWS, Azure, or GCP and other enterprise systems.
- Hands-on experience working withAWS, Azure, or GCP.
- Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data solutions.
Required Qualifications
- 5+ years of relevant experience inData Engineering.
- Strong hands-on expertise inDatabricks and Apache Spark.
- Excellent knowledge ofPython, PySpark, and SQL.
- Experience with modernLakehouse and Data Warehouse architectures.
- Strong problem-solving and troubleshooting skills.
- Excellent communication and collaboration abilities.
Databricks Engineer · Apolis