[English ONLY] Data Engineer (Hadoop)

A global and one of the world’s largest Insurance Service provide is seeking an experienced Data Engineer (Hadoop) to join its Data Management Team. You must have good experience of working with Python or Java, and large-scale data analytics with understanding of distributed computing systems.

Responsibilities:
- Collaborate with users and project team on requirements and expectations
- Analyze business requirements, create proper data solutions that meets functional and non-functional requirements
- Design and implement highly scalable and robust data pipelines in Python/Java for processing of extreme large amount of data
- Create and maintain reusable frameworks for data ingestion, validation, normalization, and transformation
- Create scripts for test automation, CI/CD, data migrations, data validations
- Provide technical support for incident recovery

Why should you apply:
- Long-term and stable project in a global insurance leader
- Hybrid work setup with a collaborative, international team
- Excellent exposure to enterprise-scale Azure cloud and data platforms
- Career growth opportunities within a diverse and inclusive environment


Company Details:
A US based world’s leading insurance providers, offering a broad range of life, health, and retirement solutions to individuals, families, and businesses. The company is heavily invested in digital transformation, utilizing advanced technologies like cloud computing, data analytics, AI, and cybersecurity to enhance customer experience and streamline operations. As part of its values, it has a strong focus on creating a diverse environment, and in particular on the appointment of women in high-level position.

Working Hours: 9:00 - 18:00 (Mon-Fri)
Working Style: 4 days’ work in office, and 1 day work from home (more WFH days is possible)
Holidays: Saturday, Sunday, National Holidays, Year-end and New Year Holidays, Paid Holidays
Services/Benefits: Transportation expenses up to 20,000 yen per month, plus Paid leave, plus social insurance (health insurance, welfare pension, and work-related accident insurance), Periodic health examination, and Employment insurance

Required Skills:
- Minimum 4~5 years of working experience as a developer or data engineer
- Strong programming skills and software development experience in Java or Python
- Deep understanding of distributed systems (Hadoop) and its optimization
- Experience in public cloud technologies, preferably Azure
- Good knowledge of Oracle database, MS-SQL Server, Linux, networking
- Proficient in SQL, shell scripting, git, unit testing, CI/CD tools
- Understanding of design principles, coding standards and best practices
- Strong learning ability and problem-solving skills
- Excellent communication, presentation, and interpersonal skills