Senior Data Engineer
Job Description
Our Client
We are currently hiring for a leader in the AI/ML space.
Your Responsibilities
- Develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity.
- Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization.
- Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it
- Works closely with a team of frontend and backend engineers, product managers, and analysts.
- Writes unit/integration tests, contributes to engineering wiki, and documents work.
- Designs data integrations and data quality framework
- Works closely with all business units and engineering teams to develop strategy for long term data platform architecture. 6.3.2
- Designs and evaluates open source and vendor tools for data lineage
Your Qualifications
- BS or MS degree in Computer Science or a related technical field
- Strong analytic skills related to working with unstructured datasets 6.3.4.
- 5+ years of Python, SQL and NoSQL
- 5+ years of experience with schema design and dimensional data modeling.
- Hands on experience with Image Processing is a must
- Hands on experience with Python and knowledge of Data Science popular libraries like (PyTorch, Tensorflow and OpenCV – either OR)
- Hands on experience with popular databases, PostgreSQL(must) and MongoDB(optional). Knowledge of geospatial (must)and timeseries DBs (must).
- Experience with Docker is a must. Knowledge of devops tools and Kubernetes(preferred)
Halian Group
With over 20 years of experience, we have come to understand that innovation is the only way to provide agile, practical solutions that transform businesses and careers.
Our resourcing and smart services help you to realize tomorrow's potential. Discover the amazing things possible when you bring the right people and technologies together.
Job Details
Employment Types:
Part time
Industry:
IT / Computers – Software
Function:
IT
Roles:
Software Engineer / Programmer
Skills:
Senior Data Engineer
