company-logo-image

Manager, Data Engineering

ashley-avatar-image

AI-generated summary

beta

This job is for a Manager in Data Engineering who leads data projects and teams. You might like this job because you'll innovate data systems and make a real impact on client services, driving efficiency while shaping a dynamic team culture.

Undisclosed

Malaysia, Kuala Lumpur

Job Description

This role serves as a key leadership position within the department, overseeing all activities related to data ingestion, management of datasets, transformation, extraction, and operations to support both internal and external client needs. The role is also responsible for shaping the department’s vision and culture, while providing technical expertise and driving a strong focus on operational excellence. Data extraction services · Perform QA activities related to client data services · Execute data analysis to provide insight for internal/external needs · Automate recurrent data related activities · Investigate data to answer customer complaints related to CTOS services (for example score complain, credit report complaint etc…) Data pipeline development and operationalization · Design data pipelines to ingest data from multiple sources and implement quality processes · Design processes to create data insight, data features and operationalize analytics models · Develop and implement those data pipelines · Operationalize data pipelines for automated and semi-automated execution · Implement reporting of data universe, data quality across the organization · Study business requirements and gather business rules to standardize attributes in warehouse. · Perform code reviews to ensure datalake implementation standards are followed. · Establish and maintain documentation in terms of business rules and req, data dictionary, pipeline definition, data flow, etc. Data platform innovation · Own the Data Platform, suggest, specify, and implement enhancements to the platform · Suggest and implement technology components relevant to the data platform · Manage datalake infra & services in terms of capacity scalability, usage, performance, cost utilization, change requests, parameter configuration, etc. · Support key initiatives including migration of CTOS data services to the cloud · Maintain awareness of industry trends and regulatory compliance, implement proactive controls to mitigate risks. WHAT DOES IT TAKE TO BE SUCCESSFUL Qualifications · A Bachelor's Degree, Post Graduate Diploma, or Professional Degree in Computer Science, Information Technology, or equivalent Work Experience · Minimum 10 years’ experience in product/software development · Minimum 5 years’ experience working with data platforms · Experience working within the financial industry is a plus Skills & Competencies · Strong knowledge of data platforms, data pipelines, and data-related development including Hadoop, Spark, Jupyter, and cloud-native services · Proficient in cloud services and data-related cloud-native services (AWS preferred) · Proficient in SQL, Python/Pandas/PySpark for implementing data pipelines · Skilled in automation and monitoring tools such as Shell scripts and scheduling tools like AirFlow · Experience with ETL tools such as Talend and/or cloud-native ETL services · Capable of implementing reporting using data platforms or reporting software · Able to implement data reporting solutions using platforms such as Grafana, Power BI · Excellent written and verbal communication skills in English · Able to multi-task and prioritize activities effectively · Understanding of financial industry data sources (e.g., CCRIS, SSM, Angkasa, Idaman) is a plus Leadership & Interpersonal Attributes · Excellent organizational, operational, and leadership skills · Strong analytical and problem-solving capabilities · Strategic and business-oriented mindset · Outstanding communication and interpersonal abilities · Ability to communicate complex concepts clearly and understandably


Job Requirements


Company Benefits

Medical Benefit

You get medical coverage for you and your children.

Annual Leave Benefits

20 Days of annual leave per year.

Parking Benefits.

Get subsidised parking from our company!


Additional Info

Experience Level

0 - 10 Years of Experience

Job Specialisation


Company Profile

CTOS Digital Berhad-logo-image

CTOS Digital Berhad

Leading Credit Reporting Agency (CRA) We are aggressively expanding our business, and looking for dynamic, driven and motivated individuals to join our team. Our Direct-To-Consumer segment (D2C), is one of our fastest growing product areas in the market, with an abundance of expansion plans and innovative ideas on hand. Source: ctosdigital.com