DL
SAS Viya with Pyspark
Diverse Lynx India
🇮🇳 India
On-site
3 days ago
- PySpark
- SAS
- ETL
- AWS
- Unit Testing
- Integration Testing
- CI/CD
- SQL
- Python
- AWS Cloud
- EMR
- AWS Glue
- AWS Lambda
- AWS IAM
- Redshift
- Hadoop
- Apache Airflow
- Databricks
- Devops
- Git
- Agile
3 days ago
- Minimum 3+ years of hands-on PySpark development.
- Minimum 3+ years of SAS/SAS Viya development experience.
Key Responsibilities
· Analyze, understand, and document existing SAS Viya programs, workflows, macros, and data processes.- Convert SAS Viya code, data transformation logic, and ETL workflows into PySpark while ensuring functional equivalence.
- Optimize migrated PySpark jobs for scalability, performance, and maintainability.
- Develop and maintain data pipelines using PySpark on AWS platforms.
- Perform code validation, reconciliation, unit testing, and integration testing of migrated solutions.
- Collaborate with business stakeholders, data architects, and source system teams to understand data requirements.
- Troubleshoot and resolve issues related to data processing, performance, and migration.
- Implement coding standards, version control, and CI/CD best practices.
- Participate in design reviews and recommend modernization opportunities during migration.
Mandatory Technical Skills
SAS Expertise
· Strong experience withSAS Viya- SAS Base Programming
- SAS Macros
- SAS SQL
- SAS Data Integration and ETL processes
- Experience analyzing and reverse engineering existing SAS applications
PySpark Expertise
· Strong hands-on development experience inPySpark- Spark DataFrames and Spark SQL
- Performance tuning and optimization of Spark jobs
- Large-scale data processing and ETL development
- Python programming
AWS Cloud
Must have hands-on experience with:· AWS EMR
- AWS Glue
- Amazon S3
- AWS Lambda
- AWS IAM
- AWS Redshift (preferred)
- Cloud-native data engineering and deployment practices
Additional Desired Skills
· SQL and Data Warehousing concepts- Hadoop Ecosystem
- Apache Airflow or similar orchestration tools
- Databricks (preferred)
- CI/CD and DevOps practices
- Git version control
- Agile delivery methodology
Experience Required
· Overall6-10 years of IT experience.- Minimum 3+ years of hands-on PySpark development.
- Minimum 3+ years of SAS/SAS Viya development experience.
- Proven experience in code migration, modernization, or cloud transformation projects.
- Experience working on large-scale data platforms and enterprise data migration initiatives.
SAS Viya with Pyspark · Diverse Lynx India