Big Data Engineer
6 month contract
Day rate - up to £450 a day
Our clients BI team is expanding! We are looking for an experienced Business Intelligence Engineer to join our crew. Do you have strong Big Data/Hadoop skills? Are you experienced with data services within Azure? Are you ready to tackle a variety of challenges around data structuring and transformation? Please get in touch to find out more.
- Design, implementation and test for a range of data pipelines, applying structure to unstructured data and carrying out various transformations.
- Configuration and set up of specific data services within Azure, to ensure suitability and alignment with the rest of the stack.
- Documentation of architecture and data flows, ensuring a clear, maintainable stack going forward.
- Responsibility for compliance with organizational policies and privacy requirements.
Deep knowledge of SQL and Hive.
- Relevant experience with Azure, specifically ADF, HDInsights, and Databricks.
- Demonstrated experience with data infrastructure design