Data Engineer

18 أبريل، 2023

0 1 دقيقة واحدة

Data Engineer

الوصف الوظيفي

UAE National_Data Engineer | Enterprise IT | Dubai

Overview of the role

We are currently looking for competent & performance driven UAE National Data Engineer to contribute build Enterprise Data Lake for Al Futtaim by ingesting, modelling various Data sources using Data platform.

What you will do

Responsible for implementing robust data pipelines using Microsoft and Databricks technical Stack
Responsible for building Azure Devops to deploy the ADF pipelines.
Ability to talk to Business clients, understand the requirements and convert them to technical specification documents.
Provide technical design, pyspark coding to accomplish the project deliverables as planned/scoped
Provide technical design, pyspark coding to accomplish the project deliverables as planned/scoped
Explore the latest Azure technologies and passion to learn new products from Databricks

المهارات

Required skills to be successful

Bachelor’s Degree preferably Information Technology
5 years’ experience in Data Engineering
Advanced working knowledge and experience with relational and non-relational databases
Experience building and optimizing Big Data data pipelines, architectures and data sets
Strong analytic skills related to working with unstructured datasets
Azure Devops experience to deploy the ADF pipelines.
UAE National with family book

About the team

The role will report to the Data Platform Lead and you will be working in a busy environment wherein you will be dealing directly with the business requirements to develop ADF and Databricks pipelines meeting with out any glitch in production Data pipelines.

What equips you for the role

The ideal candidate for this role should possess a strong experience in Azure Datafactory (ADF), Databricks, Eventhub, Python, PySpark ,Azure Synapse and SQL