Senior Cloud Data Engineer – Azure, Databricks

Job Description

As a Senior Cloud Data Engineer, you will: Take ownership of comprehensive solutions, collaborating closely with the team. Develop and refine data processing solutions in the cloud. Create and update thorough documentation. Analyze and optimize system performance, both for existing and future designs. Interpret client needs to deliver optimal business solutions. Evaluate potential risks and implement mitigation strategies. Tailor solutions to align with specific business requirements.

Qualifications

1. A minimum of 5 years of IT experience, with at least 3.5 years specifically working with data in the Azure cloud, demonstrated through commercial projects implemented in production. 2. Proven commercial experience in processing large datasets using Databricks. 3. Advanced proficiency in SQL, utilizing it across various MS technology solutions. 4. Familiarity with methodologies and fluency in Git and CI/CD practices. 5. Expertise in creating and optimizing data processing solutions (ETL, ELT, etc.), backed by technical designs and alternative solution options. 6. Competence in cloud monitoring, diagnostics, and problem-solving, with a strong understanding of infrastructure planning and cost estimation. 7. Familiarity with Delta Lake and Data Lakehouse concepts. 8. Knowledge of SMP and MPP architectures, along with examples of solutions based on these architectures. 9. Understanding of migrating on-premise solutions to the cloud and familiarity with basic migration types. 10. Knowledge of security mechanisms for secure data storage and processing in the cloud. 11. In-depth knowledge of Azure cloud data storage and processing services. 12. Experience in direct collaboration with clients. 13. Advanced proficiency in English (C1 level) and fluency in Polish.