Please check your Work Experience and Job Preferences for accuracy.
Thank you!
AI-generated summary
beta
This job is for a Senior Data Engineer who designs data pipelines, implements data models, and optimizes data processing on AWS. You might like this job because it involves collaborating with stakeholders and continuously improving data infrastructure.
Job Description
Position Responsibilities
- Design and Develop Data Pipelines: Create and maintain efficient, reliable, and scalable data pipelines that extract, transform, and load (ETL) data from diverse sources into AWS data storage systems.
- Data Modeling and Architecture: Design and implement data models for data warehousing and data lakes on AWS, ensuring data integrity, performance, and scalability.
- AWS Cloud Infrastructure: Utilize various AWS services such as Amazon S3, Amazon Redshift, AWS Glue, Amazon EMR, Amazon RDS, and others to build data solutions.
- Data Transformation and Processing: Develop data transformation processes, including data cleansing, enrichment, and aggregation, to ensure data accuracy and consistency.
- Performance Optimization: Identify and implement performance optimization techniques to enhance data processing speed and reduce latency in data pipelines.
- Data Security and Compliance: Ensure that data handling practices comply with relevant data security and privacy regulations. Implement security measures to protect sensitive data.
- Monitoring and Troubleshooting: Monitor data pipelines, data jobs, and data storage systems for issues and troubleshoot any data-related problems to ensure smooth data flow.
- Documentation: Create and maintain technical documentation for data engineering processes, data models, and data pipelines.
- Collaboration and Communication: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver data solutions that meet business needs.
- Continuous Improvement: Stay updated with the latest AWS services and data engineering best practices to propose and implement improvements to the existing data infrastructure.
Job Requirements
Qualification and Experiences
- Bachelor's degree in Computer Science, Engineering, or a related field. A Master's degree is a plus.
- Proven experience as a Data Engineer/Architect for at least 3 years, specifically working with AWS data services and related technologies.
- Proven experience in AI/ML technologies
- Strong knowledge of AWS services such as Amazon S3, Amazon Redshift, AWS Glue, Amazon EMR, Amazon RDS, and others.
- Proficiency in programming languages such as Python, SQL, and familiarity with data manipulation frameworks/libraries.
- Hands-on experience with data modeling, data warehousing concepts, and building data pipelines using ETL tools.
- Familiarity with data governance, data security, and data privacy best practices.
- Excellent problem-solving skills and the ability to work independently as well as part of a team.
- Strong communication skills to effectively collaborate with cross-functional teams and convey technical concepts to non-technical stakeholders.
a Necessity, not a Luxury
Skills
Company Benefits
Employee Discount
Enjoy employee discounts on beverage, merchandise, etc at all outlets across Malaysia.
Employee Perk Programmes
Establishment of corporate benefits to offer exclusive discounts or benefits to each employee.
Health and Wellness
Out-patient care and in-patient care are covered for all employee including ongoing wellness programs & activites.
Career Development
Job training and continuing education help to fuel employee career growth.
Extension Leave Benefits
Provide more generous with their leave days. We have more than 6 other types of leave!
Additional Info
Experience Level
1 - 3 Years of Experience
Career Level
Senior Executive
Job Specialisation
Data Science & Analytics
Company Profile
ZUS Coffee
Get notified on similar new jobs!