Senior Data Engineer

10 فبراير، 2023

0 0 دقيقة واحدة

الوصف الوظيفي

Emphasis for this role is Data Lake architecture and implementation, data ingestion into Data Lake and knowledge of relevant services in MS Azure. In this role you will provide technical leadership and thought leadership as a senior member in areas such as data access & ingestion, data processing, data integration, data modelling, database design & implementation, data visualization, and advanced analytics.

المهارات

Expert level understanding of Data Lake, AZURE and responsible for ingestion, writing Python scripts, using databricks, data modelling, ETL
Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service is required.
Designing and building of data pipelines using API ingestion and Streaming ingestion methods.
Strong command of relational databases and SQL. Extract, Transform, and Load (ETL) data into a relational database.
Proficiency with Python or R, especially for data manipulation and analysis, and ability to build, maintain and deploy sequences of automated processes with these tools
Experience working in an agile development environments (Kanban, Scrum, etc.)