Data Processing Quality Engineer

Ensure quality of the data processing engine, in terms of result accuracy, performance fidelity, and  robust execution at scale.  

Requirements  

•BS EE/CS or equivalent 

•5+ years of experience in data processing quality or performance testing for database,  data warehouse, or query engine applications.  Experience testing for platforms such as  Apache Spark, Gluten, Velox, DataFusion preferred.  

•Solid knowledge of SQL, Python, and similar data processing languages  

•Automation-first mindset, experienced with programming/scripting languages and  automation tools.  

•Strong in problem-solving and coming up with the test strategy for the complex system. 
•Strong in debugging, root cause, and narrowing down the failures.  

•Experience in Functional, Performance, Integration, System Level testing 
•Experience with the use of public cloud platforms such as AWS, GCP, and MS Azure 

•Good Knowledge of tools like Jira, Confluence, Git, Jenkins. 
•Good understanding of SDLC and agile methodologies. 
•Good understanding of CI/CD implementations.