company-logo-image

Big Data Operation Engineer

ashley-avatar-image

AI-generated summary

beta

This job is all about managing and optimizing big data systems to keep them running smoothly. You might like this job because you'll engage in data governance, troubleshoot issues, and create automated solutions—all while using Mandarin!

RM 5K - RM 10K

G Tower, around KLCC, Kuala Lumpur

Job Description

Job Description (Mainly using Mandarin/Chinese communicating with stakeholders)

  1. Responsible for big data governance, including data ingestion, data asset management, and data quality monitoring. Manage maintenance of both the underlying platform and upper-layer data applications. Handle daily maintenance, fault diagnosis, and issue resolution of big data systems and data products to ensure stable and reliable system operations.
  2. Perform performance analysis and optimization of big data systems, including automated operations script development, scheduled cleanup of junk data and tasks. Capable of handling daily maintenance, troubleshooting, and fault resolution for various big data systems and data products to ensure consistent and stable service operation.

Job Requirements

Job Requirements:

  1. Having 1 year of relevant experience. Familiar with core big data components, including but not limited to Hadoop, Spark, Hive, HBase, Zookeeper, Flink, Kafka, Redis, Pulsar, ClickHouse, ElasticSearch, and related technologies.
  2. Proficient in basic Linux operations and knowledgeable about fundamental Linux concepts.
  3. Familiar with SQL syntax; experienced with HiveSQL, SparkSQL, Oracle, MySQL, PostgreSQL, or other database query languages.
  4. Able to formulate deployment and operations plans based on actual needs; possesses system monitoring and metrics development capabilities and can identify platform issues through data analysis

Skills

Big Data
Data Science
Data Management

Additional Info

Company Activity

Last active - few minutes ago

Career Level

Junior Executive

Job Specialisation


Company Profile

PERSOLKELLY Malaysia-logo-image

PERSOLKELLY Malaysia

PERSOLKELLY is one of the largest recruitment companies in Asia Pacific providing comprehensive end-to-end workforce solutions to clients.  Headquartered in Singapore, the company was established in 2016 and is a joint venture between Kelly Services, Inc. and affiliates of PERSOL HOLDINGS Co. Ltd.  Today, PERSOLKELLY operates more than 45 offices across 13 markets including Australia, China, Hong Kong,...