Job Description

Job Description: 

Summary
The data engineer’s role is to support the bank in the area of data engineering for the enterprise data platform in the bank.

Duties and Responsibilities
•To design and manage data pipelines in the full data lifecycle;
•To operate and monitor the tools involved in managing the data pipelines;
•As liaison to data users in capturing the data requirements and translating them into data pipelines;
•To be involved in projects which requires development on data pipelines or/and the data lake;
•To prepare and manage all documentations in relation to data pipeline or/and data lake projects such as user requirement document, functional and technical documents, testing documents and operational documents;
•To manage and maintain the operation of the data lake;
•To ensure the relevant data and security policies are applied at all time in the data pipelines and data lake;
•To review and recommend changes in terms of Data Governance according to data policies, data standards, and guidelines;
•To update relevant changes in terms of data architecture to EA team; and
•To assist on providing training for in house data projects.

Qualification

Minimum 5 years of experience in building data pipelines and managing data repository (such as data warehouse/data lake);

A degree in Computing Science, Computer Engineering, Data Analytics or relevant qualifications in the area of data engineering and management;
Practical knowledge of at least two of the following programming languages:

• Phyton
• Bash
• SQL
• PLSQL

Experience in any opensource data orchestration tools
Experience with designing data integration for some of the various data sources listed below:

• MS SQL
• Oracle
• IBM DB2
• MySQL
• PostGreSQL
• File based
• Web services (XML, REST API, SOAP API)
• AWS RDS
• AWS S3
• Cloud Warehouses/Data Lakes (AWS Redshift, SnowFlake, Hadoop)

Development experience for both structured and unstructured data sources;
Experience with data warehousing project end-to-end from data integration to data visualisation;

• Familiar with data modelling (optional)
• pFamiliar with data science and machine learning (optional)

Familiar with data visualisation (optional)

Years of Experience
 Minimum 5 years of relevant experiences
Specific Skills/Knowledge and Certification Required
 Able to evaluate alternatives objectively and make effective, realistic and timely decision and recommendation
 Be an assertive and innovative team player, highly independent, committed, self-motivated, resourceful and result-oriented.
 Ability to network across a variety of functions at various levels.
 Ability to multi-task, highly numerical with great attention to detail and work with various levels of people.
 Experience of working in fast-moving business environment.
 Good communication and interpersonal skills.
 Strong computer skills (e.g. MS. Word, Excel, PowerPoint).
 Able to work under pressure to meet datelines.

Job Requirements