Sr. Data Warehouse Engineer/ Architect

3 يناير، 2023

0 2 2 دقائق

الوصف الوظيفي

Sr. Data Warehouse Engineer/ Architect (Informatica ETL/Teradata Technology)

A. Accountabilities:

Responsible for the Operations and maintenance of DWH systems (Teradata, Informatica (Extraction, Transformation and Loading) .
Responsible for reports development, deployment and making the analysis and design of the queries used in these reports .
Responsible for monitor, maintain and troubleshoot auto refresh process of DWH systems and software.
Analyze and Development of the Ad hoc queries required by Customer business users.
Monitor all processes are running, all data Feed are coming properly and parsing is done. And Ensure to clear the backlogs for normal processing .
Ensure dumps needed by BI systems are sent on time as per the requirements of the BI policy approved by Customer.
Responsible for administering Hadoop clusters (Cloudera) including activities like deploy Hadoop clusters, add and remove nodes, keep track of jobs, monitor critical parts of the cluster, configure name-node high availability.
Perform Cluster tuning, cluster monitoring and troubleshooting. Backup, Snapshot and Recovery from node failure.
Responsible for Installing and configuring Hadoop Security using Kerberos and Sentry.
Good understanding of Spark, Hive, Kafka and HBase architecture.
Installing, configuring, maintaining and monitoring of HDFS, Yarn, Spark, Hive, Oozie, Kafka, Impala, Zookeeper and other Hadoop eco systems.
Responsible for Monitoring, Performance tuning of Hadoop clusters .
Create Snapshot policies and Recovery from node failures.
Perform Commissioning and Decommissioning of nodes and running balancer utility.

الوصف الوظيفي

المهارات

B. Qualification:

Expert at Teradata and Informatica ETL/ Data Warehouse Techniques.
At least one Cloudera Production project, not only understanding or theoretical knowledge.
Good knowledge in Data Base & SQL.
Good knowledge in Linux Platform.
Knowledge in shell scripting.
Knowledge in IP Network, TCP/IP protocol and related troubleshooting tools etc.
Experience in installation, configuration, and upgrade/migration of Cloudera platforms: CDH, CDP (private cloud and/or public cloud).
Experience in configuring highly secure Cloudera platforms: Kerberos, LDAP/AD integration, in-motion encryption (SSL).

C. Experience:

Minimum of Five (5/-) years in Teradata Data Warehousing (DWH), Informatica ETL & Cloudera.

D. Education:

Bachelor of Computer Science Engineering or graduation in any stream with excellent knowledge in IT and Software Applications.

E. General Skills:

Good Troubleshooting skills.
Good communication and interpersonal skills.
Independent problem solver, self-driven and possess great tact.
Pleasant personality, excellent communications and presentation skills.
Enjoys new challenges and interest in technologies and services.
Good command of spoken and written English.
Ability to work under pressure and flexible, willing extend working hours to exceptionally complete projects.
Ability to work in a team, professionally and personally with different reporting schemes.

F. General Remarks: