PC
Data Engineer
Pyramid Consulting, Inc
- 🇺🇸 United States
- Hybrid
- 1 day ago
- PySpark
- Scala
- AWS
- ETL
- ELT
- AWS Cloud
- Health insurance
- Pension
1 day ago
Job ID:26-30557
Pay Range: $55 - $60/hour. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location).
Key Responsibilities:
- Develop and maintain scalable data pipelines usingPySpark andScala.
- Design and implement data processing solutions onAWS.
- Build efficient ETL/ELT pipelines for large-scale structured and unstructured data.
- OptimizePySpark/Scala jobs for performance, scalability, and reliability.
- Work withAWS data services and cloud-based data architectures.
- Perform data transformation, cleansing, validation, and integration.
- Troubleshoot data pipeline issues and improve overall system performance.
- Collaborate with data architects, analysts, developers, and business stakeholders.
- Follow best practices for data quality, security, monitoring, and governance.
- 5+ years of strong hands-on experience withPySpark.
- 5+ years of strong programming experience inScala.
- 5+ years of strong experience withAWS cloud services and data engineering.
- Experience building and supporting production-grade data pipelines.
- Good understanding of distributed data processing and cloud data architecture.
Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
By applying to our jobs you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc. and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here.
Data Engineer · Pyramid Consulting, Inc