IL
Senior Data Engineer
ICONMA, LLC
- 🇺🇸 United States
- On-site
- Senior
- 6 hours ago
- Python
- PySpark
- AWS
- AWS Glue
- EMR
- RDS
- PostgreSQL
- MySQL
- Kinesis
- Devops
- CI/CD
- IaC
6 hours ago
Â
Responsibilities:
- Designing and implementing high-performance data pipelines that handle large volumes of data
- Ensuring data integrity through advanced quality checks and lineage tracking
Requirements:
- Core Languages: Expert-level proficiency in Python and PySpark.
- AWS Ecosystem: Deep hands-on experience with AWS Glue and Amazon EMR.
- Big Data Architecture: Proven track record of building scalable pipelines for large-scale data (Terabyte-scale preferred).
- Data Integrity: Demonstrated experience implementing frameworks for Data Lineage and Data Quality.
- Database Knowledge: Strong experience working with S3-based lakes and relational databases (RDS/PostgreSQL/MySQL).
- Industry: Experience within the Financial Services industry is a huge plus.
- Real-time Processing: Experience with Kinesis or Kafka integration for low-latency data delivery.
- DevOps: Familiarity with CI/CD for data pipelines and Infrastructure as Code.
Why Should You Apply?
- Health Benefits
- Referral Program
- Excellent growth and advancement opportunities
Senior Data Engineer · ICONMA, LLC