Python and Apache Spark Big Data Engineer - Assistant Vice President

Experience Range - 8 to 12 years

Strong experience with one or more programming languages (Python/Spark).
•  Demonstrated analytical and problem-solving skills. Application performance tuning, troubleshooting experience and the implementation of these skills in Big Data domain. 
•  Comfortable working with large data volumes and be able to demonstrate a firm understanding of logical data structures and analysis techniques. 
•  Experience in Big data technologies like HDFS, Map Reduce, YARN, Apache Spark, Hive. 
•  Familiarity with data formats like Avro, Parquet, CSV, JSON. 
•  Strong systems analysis, design and architecture fundamentals, Unit Testing and other SDLC activities. 
•  Understanding fundamental design principles behind a scalable application. 
•  Experience in working with UNIX/LINUX and shell scripting. 
•  Good knowledge of database principles, practices with SQL. 
•  Application performance tuning, troubleshooting experience and the implementation of these skills in Big Data domain. Good to Have: 
•  Agile/Scrum methodology experience is required. 
•  Experience in SCMs like GIT and tools like JIRA. 
•  Experience in No SQL databases. 
•  Familiarity with build tools such as Maven and continuous integration like Jenkins/Team City. 
•  Familiarity with cloud and container technologies. 
•  Experience real time data processing - Kafka. 
Responsibilities: 
•  Translate application storyboards and use cases into functional applications. 
•  Design, build, and maintain efficient, reusable, and reliable Python/Scala code. 
•  Ensure the best possible performance, quality, and responsiveness of the applications. 
•  Identify bottlenecks and bugs, and devise solutions to these problems. 
•  Develop high performance & low latency components to run Spark clusters. 
•  Interpreting functional requirements into design approaches those can be served through Big Data platform. 
•  Collaborate and partner with Global Teams based across different locations. 
•  Be able to propose best practices and standards. 
•  Perform the testing of software prototypes and transfer to the operational team. 
•  Processing of data using Hive, Impala & HBASE. 
•  Performing analysis of large data sets and derive insights.

------------------------------------------------------

Job Family Group:

------------------------------------------------------

Job Family:

------------------------------------------------------

Time Type:

------------------------------------------------------

Most Relevant Skills

------------------------------------------------------

Other Relevant Skills

------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity reviewAccessibility at Citi.

View Citi’sEEO Policy Statement and theKnow Your Rights poster.