Specialist - Data Engineering

Job Title:Sr.DATABRICKS Architect

Work Location

Jersey City, NJ

Job Description:

Data Bricks JD

• Databricks migration expert Hadoop to Databricks Migration Expert responsible for leading largescale modernization of legacy Hadoop ecosystems to AWS and Databricks cloud platforms
• Must have proven experience migrating HBase Hive HDFS Spark and onprem ETL workloads to scalable cloud native architectures
• Drives end-to-end migration strategy including assessment of current state platforms dependency mapping workload prioritization performance benchmarking and target state architecture design
• Strong expertise in HBase to cloud migration including data model redesign performance optimization schema conversion and replacement strategies using Databricks Delta Lake cloud object storage or NoSQL alternatives where needed
• Handson experience in Spark migration from onprem clusters to Databricks including job refactoring cluster optimization orchestration redesign and cost performance tuning
• Works closely with infrastructure security application and business teams to ensure minimal disruption and strong governance during transition
• Responsible for migration patterns automation frameworks reconciliation controls data validation and production cutover planning
• Ensures platform reliability scalability and regulatory compliance while reducing operational cost and technical debt
• Experience with AWS services such as S3 IAM EC2 Glue EMR Kafka integration and enterprise data governance is strongly preferred