[English Friendly] Data Engineer | Big Data Platform ~8M

We are seeking a Lead Data Engineer to design, build, and optimize large-scale data pipelines supporting a major e-commerce platform. You will play a critical role in enabling data-driven decision-making by delivering high-quality, scalable data solutions.

Client Details

The client operates a large-scale e-commerce ecosystem with tens of thousands of merchants and hundreds of millions of products. Their data platform supports business-critical analytics and handles extremely high traffic during major events.

Description

• Design, build, and optimize large-scale data pipelines using Spark, Kafka, and GCP
• Manage and maintain data pipelines for high-volume e-commerce platforms
• Automate data ingestion and processing workflows
• Lead cloud migration initiatives from on-premise to Google Cloud Platform
• Troubleshoot and resolve complex data storage and retrieval challenges
• Monitor, debug, and maintain production systems using logging and alerting tools

Job Offer

• Long-term contract (initial 2 months, renewable every 3 months)
• Opportunity to work on one of Japan's largest data platforms
• Exposure to cutting-edge big data technologies (GCP, Spark, Kafka)
• Leadership role with high ownership and impact
• Working hours: 9:00 - 17:30 (Weekdays only)
• Stable environment with large-scale, real-world data challenges

To apply online please click the 'Apply' button below. For a confidential discussion about this role please contact Hikari Takamura on +813 6832 8903.

• 5+ years of experience as a Data Engineer
• Hands-on experience with Spark and Kafka development & operations
• Strong programming skills in Python, Java, or Scala
• Experience with Google Cloud Platform (GCP) and BigQuery
• Advanced SQL skills and strong RDBMS experience
• Proven experience building and optimizing data pipelines and datasets
• Experience with Docker and Kubernetes