Job Description

Senior Data Engineer

Important Information 

Location: Kuala Lumpur 

Experience: 5- 8 years

Job Mode: Contract

Work Mode: On-site      

DESCRIPTION OF MAIN TASKS / RESPONSIBILITIES:
Data extraction services

• Execute ad-hoc, monthly and quarterly data extraction services as required by internal/external clients and in accordance with services SLA
• Perform QA activities related to client data services
• Execute data analysis to provide insight for internal/external needs
• Automate recurrent data related activities
• Ensure zero non-compliances on process audit on data security and compliance

Data pipeline development and operationalization
• Design data pipelines to ingest data from multiple sources and implement quality processes
• Design processes to create data insight, data features and operationalize analytics models
• Develop and implement those data pipelines
• Maintain and develop the cloud services relating to data pipelines
• Operationalize data pipelines for automated and semi-automated execution
• Implement reporting of data universe, data quality across the organization
• Implement Dashboard and reports based on stakeholder requirements
• Ensure zero non-compliances on process audit on data security and compliance

Data platform innovation

• Support key initiatives including migration of data services to the cloud

Technical Skills Required
• product / software development            
• Hands on working experience on Data Strong knowledge of data platforms, data pipelines, data related development including platforms such as Hadoop, Spark, Jupyter, cloud native services    
• Hands on experience on cloud services and knowledge of data related cloud native services (AWS).
• AWS Glue ( Data Integration) 
• AWS EMR ( Managed Cluster Platform) 
• tools and programming languages required to implement data pipelines: SQL, Python / Pandas
• tools required to implement automation and monitoring: Shell scripts, scheduling tools such as AirFlow
• ETL tools such as Talend and/or cloud native services
• Experience implementing reporting using a data platform or reporting software(QuickSight, Power BI,etc.)

About Encora 

Encora is the preferred digital engineering and modernization partner of some of the world’s leading enterprises and digital native companies. With over 9,000 experts in 47+ offices and innovation labs worldwide, Encora’s technology practices include Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering.   

At Encora, we hire professionals based solely on their skills and qualifications, and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality. 

Job Requirements