Data Engineer - Global Insurance firm

Randstad is partnered with global Life Insurance client in their search for a Data Engineer. Through this role you will join the firm's global Data Management department, where you will work alongside brilliant data professionals. If you have strong background in Data Engineering with Scala and Spark, or a background in Java, Python, or other back-end languages and want to become a data engineer, this role is for you.

Responsibilities

• You will be utilizing various resources in Azure such as Data　Factory, Databricks, Synapse, and PowerBI to create the best solutions for the business.
• Build ETL pipelines in data factory, transform data in databricks, and use CICD pipelines to release code to production
• Transform and prepare various upstream data with Scala & Spark and prepare them for various downstream channels.
• Communicate effectively with end users and other engineers in the squad to implement the best solutions

• Experience with Scala, Spark, or Java, Python (and other back-end languages) but willing to learn Scala.
• Strong experience with relational databases database (mainly SQL).
• More than 3 years of application development experience.

Good-to-have

• Experience of building data pipelines to extract, transfer and load data.
• Knowledge about Microsoft Azure or other public cloud architecture.
• Experience in using ETL tool like Azure Data Factory.
• Working knowledge of API based architectures.