Data Engineer (Informatica BDM)
Job Description
Our Client
We are looking to build a team of 10x Data Engineers (Informatica BDM) on a 6-12 months extendable project basis.
Your Responsibilities
- Implement Informatica BDM mappings for extracting data from multiple data sources to Data Lake.
- Creating customized BDM mappings/workflows for incremental using Informatica Developer and deploy them as part of an application on Data Integration service for the native execution or push down using the Hive/Blaze/Spark execution engines.
- Design & development of BDM mappings in Hive/Spark/Blaze mode for large volumes of INSERT/UPDATE.
- Medium to complex quality rule design, development and implementation patterns with cleansing, parsing, standardization, validation, etc.
- Responsible for peer-review of mappings and workflows when required.
- Develop Hive tables and queries.
- Perform detailed analysis of business problems and technical environments and use this in designing the solution.
- Be able to work creatively and analytically in a problem-solving environment.
- Interact with clients and convert business problem into system requirements.
Your Qualifications
- Minimum 4 years of experience on the same role
- Technology: Informatica Suite, Hadoop, SQL & NoSQL
- Degree, Post graduate in Computer Science or related field (or equivalent industry experience)
- Experience of working of enterprise big data distribution such as cloudera, hortonworks or MapR.
- Hands on experience of working with HDFS, HiveQL, BDM Informatica, Spark, HBase, Impala and other big data technologies.
- Experience of design & development of BDM mappings in Hive mode for large volumes of INSERT/UPDATE.
- Experience in complex ETL Mappings to load data using transformations such as Source Qualifier, Sorter, Aggregator, Expression, Joiner, Dynamic Lookup, and Connected and unconnected lookups, Filters, Sequence, Router and Update Strategy.
- Configure the sessions & workflows for recovery and with high availability.
- Experience in delivering data pipelines using Cloudera distributions.
- Excellent knowledge of performance tuning in SQL and Informatica.
- Knowledge of tools such as Sqoop, Flume, and Kafka.
- Experience in Banking, Financial and Fintech experience in an enterprise environment preferred
Halian Group
With over 20 years of experience, we have come to understand that innovation is the only way to provide agile, practical solutions that transform businesses and careers.
Our resourcing and smart services help you to realize tomorrow's potential. Discover the amazing things possible when you bring the right people and the right technologies together.
Job Details
Employment Types:
Part time
Industry:
IT / Computers – Software
Function:
IT
Roles:
Software Engineer / Programmer
Skills:
Data Engineer (Informatica BDM)
