Senior Data Software Engineer (Databricks)

This advert was translated automatically from Portuguese. Read the original.

We are seeking a Senior Data Software Engineer skilled in Databricks to join our team in Portugal. You will be integral to our efforts, bringing a deep understanding of data engineering, expertise in Databricks and an open-minded approach to our collaborative and friendly work environment. This role is ideal for a professional eager to develop scalable data solutions and drive innovation in our Data practice. Responsibilities - Design, develop and maintain scalable data pipelines and architectures - Optimize data models and enhance ETL processes utilizing Databricks and related technologies - Implement rigorous data quality checks and monitoring to guarantee high integrity - Keep abreast of the latest trends and technologies in data engineering and advocate for the adoption of beneficial new tools - Troubleshoot and resolve data-related issues promptly - Participate in code reviews ensuring adherence to high standards of code quality Requirements - Hands-on experience with Databricks, including Delta Lake workflows, Delta Live Tables, along with deployment and versioning strategies - Solid understanding of data architecture and data modeling skills - Expertise in Spark, using either Scala or PySpark - Proficiency in cloud-native technologies and software engineering best practices such as containers, unit tests, linting and code style checks - Engineering background in AWS, Azure or GCP - Experience with big data and performance optimization of data-intensive applications - Proactive approach and prior client-facing experience - Ability to navigate ambiguity and work independently - Desire to engage in a transparent, fast-moving startup environment - Fluent English communication skills at a B2+ level or higher