Are you ready to take on a role where your work directly shapes how large-scale platforms operate, process massive datasets, and deliver actionable insights? We are seeking an experienced Senior Data Engineer to join a high-performing team working with some of the most advanced distributed systems in the industry.
In this role, you’ll be building and optimising data pipelines that process tens of terabytes daily and manage multiple petabytes of data. Your expertise will be crucial in ensuring these systems are efficient, reliable, and low-latency, while maintaining compliance with privacy regulations. You’ll work on transforming complex data into meaningful insights that drive decisions, improve compliance, and enhance customer experience.
What You’ll Do:
- Own significant components of large-scale data systems, from design to implementation.
- Collaborate closely with product managers and partner engineering teams to design, build, and maintain features.
- Develop and refine data models, ensuring efficiency and scalability.
- Build robust data extraction, transformation, and merging processes.
- Design and maintain tools for data management, transformation, and accessibility.
- Monitor and troubleshoot data pipelines, creating visualisations and reports to track system health.
- Ensure data compliance and governance, including tagging, classification, and traceability.
- 5+ years of Azure Data Engineering experience.
- 5+ years designing highly scalable data solutions for analytics, business intelligence, data science, or data engineering.
- Strong experience with big data tools (Spark/PySpark, Synapse, ADF, SQL, Kusto, Power BI, etc.).
- Expertise in data warehouse concepts and data lakes.
- Skilled in building reports/dashboards using Power BI and writing complex SQL.
- Experience working with cloud platforms such as Azure or AWS
