VS
AWS Data Engineer – Qualtrics Integration
Veracity Software Inc
- 🇺🇸 United States
- Remote
- 9 months ago
- AWS
- Qualtrics
- Python
- SQL
- AWS Cloud
- ETL
- AWS Glue
- PySpark
- AWS Lambda
- Node.js
- AWS S3
- Step Functions
- Airflow
- Athena
- CloudWatch
- JSON
- XML
- CRM
- ERP
- Bash
- Devops
- IAM
- IaC
- Terraform
- CloudFormation
- CI/CD
- Power BI
- Tableau
9 months ago
Role Type: Contract
Location: Torrance, CA / Remote
Domain: Enterprise Survey Platform / Qualtrics
Primary Stack: AWS | Python | SQL | Qualtrics API
TheAWS Data Engineer – Qualtrics Integration is responsible for designing, building, and maintaining scalable, automated data pipelines that support Qualtrics survey ingestion, transformation, and downstream reporting.
This role focuses onserverless AWS data engineering, integratingQualtrics APIs with AWS services to process structured survey data, dealer hierarchies, and reporting files. The engineer will ensuredata accuracy, automation, monitoring, and performance across end-to-end workflows.
Key Responsibilities
AWS Cloud & Data Engineering
- Design and maintainETL pipelines using AWS Glue (PySpark)
- DevelopAWS Lambda functions (Python / Node.js) for serverless data processing
- ManageAWS S3 for Qualtrics input/output storage and optimized data access
- Orchestrate workflows usingAWS Step Functions andMWAA (Airflow)
- Query structured datasets usingAWS Athena
- Monitor pipelines usingCloudWatch logs and metrics
- Transform and aggregate Qualtrics datasets (CSV, JSON, XML)
- Merge multiple source files (e.g., dealer master + employee files) into unified hierarchies
- Automate ingestion, transformation, validation, and report generation
- Implement reusable, scalable ETL frameworks
- Integrate withQualtrics APIs to extract raw survey data and response files
- Implementevent-driven processing (S3 triggers→ Lambda)
- Connect AWS pipelines withCRM, ERP, BI tools, or downstream platforms
- Performdata validation and quality checks prior to Qualtrics ingestion
- Generate formatted output files aligned to business-defined templates
- Support ad-hoc analysis using SQL and Athena
- Develop robustPython scripts for Glue, Lambda, and automation tasks
- Write optimizedSQL queries for structured data access
- UseBash/Shell scripting for file movement and preparation
- ConfigureIAM roles and permissions securely
- ImplementInfrastructure as Code (Terraform / CloudFormation)
- SupportCI/CD pipelines for data workflows
- Strong experience inAWS Data Engineering & Serverless Architecture
- Hands-on expertise withAWS Glue, Lambda, S3, Athena, Step Functions
- Experience withMWAA (Airflow) for orchestration
- StrongPython and SQL skills
- Experience integratingQualtrics API or structured survey data
- Ability to troubleshoot pipeline failures and performance issues
- Experience withTerraform or CloudFormation
- CI/CD for data pipelines
- Experience supportingBI tools (Power BI, Tableau, etc.)
- Knowledge of data governance and security best practices
- AWS-focused Data Engineer with strong automation mindset
- Comfortable working withsurvey / VoC / structured data
- Strong debugging, monitoring, and optimization skills
- Able to work independently in enterprise environments
Full Name:
Degree Major with University & Completion Year:
Total Years of Data Engineering Experience:
Total Years of AWS Data Engineering Experience:
Total Years of Experience with Serverless Architecture:
Experience with AWS Glue (PySpark ETL)? (Yes/No – please elaborate):
Experience with AWS Lambda (Python/Node.js)? (Yes/No – please elaborate):
Experience with AWS S3 data storage & optimization?
Experience with AWS Athena? (Yes/No):
Experience implementing data validation & quality checks?
Experience working with Qualtrics API? (Yes/No – please specify):
Experience with event-driven processing (S3→ Lambda)?
Experience integrating AWS with CRM / ERP / BI tools?
Python Experience (years & libraries used):
SQL Experience (years & databases/tools):
Experience with IAM & role-based access?
Brief description of a recent AWS data pipeline you built (tools + outcome):
Motivation / Reason for Interest in Qualtrics Data Engineering Role:
Contact Number:
Email ID:
LinkedIn Profile URL:
Full Address (Street, City, State, Zip):
Notice Period (in weeks):
Current Work Authorization Status:
Expected Hourly Rate:
W2 / C2C (If C2C, corporation name):
Are you comfortable working primarilyRemote with Limited Onsite Flexibility?
AWS Data Engineer – Qualtrics Integration · Veracity Software Inc