Big Data Engineer

This advert was translated automatically from Portuguese. Read the original.

Hello! Do you believe you found this opportunity by chance? We at Nimber don't believe in chance. Did it catch your attention? Great. Keep reading... We are Nimber, and we're not just filling vacancies; we're building a team ready to transform things. If you're prepared to rewrite the rules and make a real impact, this is your moment. Join us and let's put the future where it belongs: in the hands of passionate people. But what does Nimber mean? In mathematics and game theory, they are numbers with special properties of addition and multiplication. And what we really want is to add value to our clients' projects. Position: Big Data Engineer Location: Lisbon (Hybrid) Responsibilities - Develop and maintain data processing and transformation solutions in Big Data environments; - Work with Spark On-Premise, Hadoop and Hive in the implementation and evolution of solutions; - Develop solutions and components using Python and SQL; - Integrate systems and data flows through APIs and Kafka; - Participate in the implementation and maintenance of CI/CD pipelines; - Work in Linux environments and contribute to DevOps practices; - Manage source code through Git; - Use XL Release and XL Deploy in build, release and deployment processes; - Manage and monitor scheduling processes through CTRL-M; - Identify opportunities for optimisation and performance improvement of solutions; - Collaborate with international and distributed teams, contributing to the continuous evolution of solutions. Requirements - Solid experience in software development; - Experience with Spark On-Premise, Python, Hadoop, Hive and SQL; - Experience in Linux environments; - Knowledge of APIs and Kafka; - Experience with CI/CD and familiarity with DevOps concepts; - Experience with Git; - Knowledge of XL Release and XL Deploy; - Experience with CTRL-M; - Experience in optimisation and performance improvement will be valued; - Minimum English B2 (mandatory). Ready to join us and succeed? If you're tired of feeling like just another number, send us your application and become a Nimber.