Big Data Developer (Cairo / Beirut / Kochi / Karachi)

25 سبتمبر، 2022

0 29 دقيقة واحدة

الوصف الوظيفي

Duties & Responsibilities:

Specify, design, implement, test, and maintain platform-independent, complex software system components and applications
Duties involve working on existing source code to incorporate new features; ensure that the piece of code written is bug-free
Work under direct supervision with assigned team, on project components, and develop and modify existing source code
Duties also involve working on, or integrating with other system product components and applications
Work to fix bugs and conduct unit testing, make necessary changes to source code and document them
Ensure that Path Solutions’ development standards & QMS are followed
Design and implement algorithms for assigned tasks
Execute development assignments to include design of conceptual approach, coding and debugging
Determine the time estimates and work plan necessary to achieve the goals for building, testing and maintaining quality software to general specification
Communicate information directly and clearly. Check for clarity and understanding during a conversation using active feedback, reflection, and other communication techniques
Facilitate and moderate issue identification and resolution. Identify, communicate and resolve conflicts with the individuals involved.

Required Skills & Qualifications:

B.Sc. in Computer Science or equivalent
Familiar with the Hadoop ecosystem, specifically Sqoop, Flume, Oozie
Knowledgeable in Hadoop administration
Experienced in working with Spark
Experienced in Python statistical modelling techniques and Python libraries
Programming using Python or Scala
Experienced programmer in Java and rest APIs
Familiar with UNIX shell commands
Familiar with Microsoft Azure and/or Hortonworks Data Platfom
Machine Learning Algorithms is a plus
Statistical expertise (statistical tests, T-test, F-test, Profiling techniques, etc.)
Proficiency in English is a must.