[Job-26705] Senior Data Engineer, Campinas, Brazil (Hybrid)
CI&T
🇧🇷 Brazil
Hybrid
Senior
4 months ago
- AI
- AWS
- REST API
- Python
- SQL
- Step Functions
- DynamoDB
- ECS
- Fargate
- IAM
- CloudWatch
- PySpark
- EMR
- Adobe
- Data Modeling
- ETL
- ELT
- Git
- GitHub
- CI/CD
4 months ago
Responsibilities:
- Build and maintain end-to-end data pipelines in AWS, often ingesting data from multiple REST APIs.
- Design reliable, observable, and scalable pipelines, with a strong focus on data quality and monitoring.
Explain and discuss the logic of your solutions with stakeholders, not just the tools used.
- Advanced English, comfortable explaining technical solutions in conversation.
- Proven experience as a Data Engineer
- Strong hands-on experience inPython (data processing, API integration, automation) andadvanced SQL (CTEs, window functions, optimization).
- Solid experiencedesigning, building, and maintaining data pipelines on AWS, including:
- Ingestion from REST APIs (authentication, pagination, rate limiting, error handling).
- Transformation and loading into data lakes / data warehouses.
- Orchestration (e.g. Step Functions, Glue Workflows, or similar).
- Strong hands-on experience withAWS Serverless and data ecosystem:
- Lambda, Glue (Glue Jobs / Glue Studio), DynamoDB, ECS/Fargate (if applicable).
- S3, IAM, CloudWatch (logs, metrics, alarms), Step Functions.
- Experience withPySpark or similar distributed processing frameworks(e.g. Spark on EMR/Glue).
- Experience inmarketing data use cases (campaigns, events, customer 360, CDP).
- Experience withAdobe Experience Platform (AEP), especially CDP.
- Experience with event-based architectures (e.g. tracking events, customer journeys).
- Good understanding ofData Engineering fundamentals:
- Data modeling (dimensional and relational), data structures.
- ETL vs ELT, batch vs streaming workflows.
- Data quality, data governance, and data observability practices (monitoring, alerting, lineage).
- Familiarity withGit/GitHubandCI/CD workflows for data pipelines.
- Strong problem-solving mindset: Ability to clearly explain thelogic behind the solution, trade-offs and troubleshooting steps.
- Strong communication skills and ability to collaborate with cross-functional teams.
#LI-AG4#mid-senior Our benefits: -Health and dental insurance-Meal and food allowance-Childcare assistance-Extended paternity leave-Partnership with gyms and health and wellness professionals via Wellhub (Gympass) TotalPass;-Profit Sharing and Results Participation (PLR);-Life insurance-Continuous learning platform (CI&T University);-Discount club-Free online platform dedicated to physical, mental, and overall well-being-Pregnancy and responsible parenting course-Partnerships with online learning platforms-Language learning platformAnd many more! More details about our benefits here: https://ciandt.com/br/pt-br/carreiras At CI&T, inclusion starts at the first contact. If you are a person with a disability, it is important to present your assessment during the selection process. See which data needs to be included in the report by clicking here.This way, we can ensure the support and accommodations that you deserve. If you do not yet have the assessment, don't worry: we can support you in obtaining it. We have a dedicated Health and Well-being team, inclusion specialists, and affinity groups who will be with you at every stage. Count on us to make this journey side by side.
[Job-26705] Senior Data Engineer, Campinas, Brazil (Hybrid) · CI&T