Senior Data Engineer (Palantir)

Are you passionate about leveraging cutting-edge technology to solve complex data challenges? Do you have a strong software engineering background and expertise in Palantir Foundry? EPAM is seeking an open-minded, innovative professional with excellent English skills to join our team in Portugal as a Senior Data Engineer. In this role, you'll collaborate with talented colleagues on impactful projects, working with some of the world's most advanced data platforms to drive real business value.

Responsibilities:

• Ingest data from multiple sources and domains into the Palantir Foundry platform.
• Develop and maintain a large-scale Big Data pipeline (PySpark) consisting of more than 350 datasets including orchestration and monitoring.
• Perform entity resolution (fuzzy matching) of sites (healthcare centers) and investigators from diverse sources.
• Apply data science techniques for segmentation and targeting of sites and investigators enabling users to select the best potential candidates across various features.
• Create front-end applications to facilitate data consumption by end-users utilizing Workshop and coding in TypeScript.

Requirements:

• 4+ years of front-end software engineering experience.
• Hands-on experience with Palantir Foundry including code workspace, pipeline builder and ontology for back-end pipeline development using Python, PySpark and Spark.
• Experience with GenAI technologies.
• Proficiency in JavaScript, Workshop and Slate.

Nice to have:

• Ontology.