Join one of Japan's largest internet service companies as a Data Engineer and be part of a cutting-edge eCommerce platform. You will design and optimize large-scale data pipelines and work with real-time and batch processing technologies like Spark and Kafka to drive innovation and support millions of users. This is an excellent opportunity to shape large-scale ecosystems and contribute to Japan's digital transformation.
Key Responsibilities
- Design, build, and maintain large-scale data pipelines and datasets
- Develop and operate Spark and Kafka applications for real-time and batch processing
- Optimize data workflows for performance, reliability, and scalability
- Collaborate with cross-functional teams to deliver data-driven insights
- Ensure compliance with data governance, quality, and security standards
Required Skills and Qualifications
Experience:
- 5+ years' professional experience as a Data Engineer
- Strong expertise in Spark and Kafka application development/operations
- Proven track record in building and optimizing data pipelines and datasets
- Solid understanding of data architecture and performance tuning
- Proficiency in SQL and relational database systems
Soft Skills:
- Strong problem-solving and communication skills in multicultural environments
Language Requirements
- Japanese: Conversational
- English: Business level
Preferred Skills & Qualifications
- Experience with cloud platforms (AWS, GCP, or Azure)
- Knowledge of Hadoop ecosystem (Hive, HDFS, Spark Streaming)
- Familiarity with containerization (Docker, Kubernetes)
- Programming skills in Python, Scala, or Java
Why You'll Love Working Here
- Opportunity to work on large-scale data platforms impacting millions of users
- Exposure to cutting-edge technologies including Spark, Kafka, and cloud solutions
- Collaborative, multicultural teams that value innovation and professional growth
About the Company
As one of Japan's largest internet service companies, this organization operates across eCommerce, fintech, telecommunications, and digital services, impacting millions of users. Their data engineering teams work with advanced technologies such as Spark, Kafka, and modern cloud solutions, fostering a culture of innovation, collaboration, and continuous learning.
Don't Miss Out - Apply Now!
