Spark Performance Tuner

- 8-10 years hands-on data engineering experience in a data heavy environment using big data

- Have extensively used Spark for more than 5 years in the end-to-end development of data pipelines

- Have at least 3+ years of experience in performance tuning Spark applications, Spark SQLs, Spark code

- Hands-on experience in various big data Hadoop tools such as Pig, Splunk, HDFS etc.

- Hands-on experience with Unix scripting, batch, and Cron Jobs.

- Hands-on experience with Python and ideally with (Py)Spark.

- Good communication skills. Able to handle project team and stakeholders.

- Excellent analytic, troubleshooting and impact analysis skills.

- Need good presentation skills, able to convey requirement and issues clearly to business community.

- Palantir or Foundry experience is plus.

- Holding a Bachelors in Computer Science or similar technical field of study