You are visiting this website from:
Find Talent Find a Job

Data Platform Administrator

Back to all Jobs
Job Description

Long and stable in-house haken role in Tokyo! English only! Data Platform Engineer!

Roles/Responsibilities

  • Administration and Maintenance for Data pipeline System that transfer and wrangle terabyte of data from various service using ELK, Apache Kafka, Apache NiFi.
  • Collaboration with SRE Tm in Japan and India.
  • Implement Automated Operation System.

Required skills

  • Excellent Hands-on experience with Linux. (At least more than 3-years)
  • Must have experience in administrating and maintaining one of Kafka, KafkaConnect, ELK, NIFI Cluster in production.(At least more than 1-years)
  • Hands-on experience with one of Apache Kafka, KafkaConnect, ELK, NIFI, etc.(At least more than 1-years)
  • Hands-on Experience with one of deployment system like Chef, Ansible, etc
  • Hands-on Experience with one of metrics collection system like Prometheus, Graphite, etc
  • Experience on one of programing languages in Java (or Scala) , Python, or ShellScript (At least more than 1-years)
  • Must have experience in administrating and maintaining client-server backend system in production.(At least more than 1-years)
  • Must be self-organized and gritty on continuous improvements of the platform
  • Must be self-starter and good collaborator with good communication skills.

Preferred skills

  • Hands-on experience with Hadoop (HDFS, Hive/HiveLLAP, MapReduce, Spark on Yarn)
  • Hands-on experience with Streaming framework, like SparkStreaming, Flink.
  • Hands-on experience or great knowledge with Docker, Kubernetes.
  • Hands-on experience or great knowledge with GCP, AWS, Azure
  • Fluent or Business level of Japanese.

About our client
Multinational Corporation

Morgan McKinley Asia Pac is acting as an Employment Business in relation to this vacancy.

broadbean-tracking

Consultant Details

Consultant Details

Toshiko Igarashi
Toshiko Igarashi
  • Consultant | IT Recruitment - Contract