Azure Data Engineer

London, Hybrid - 1-2 days onsite per week

6 months

£450 - £520 Inside IR35

My client is looking for a skilled Azure Data Engineer to join an exciting new project of theirs. You will be responsible for assisting in the build and configuration of the Data Lake.

To be considered for this role you must have experience in Data Migration, Data Profiling, and enhancing Data Quality as well as expertise in utilising Azure services such as Azure Data Lake Storage, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure SQL Database and Azure Stream Analytics.

Strong programming skills in Python or Scala with a focus on Spark, PySpark experience preferred.

Key Skills:

• Experience working with both relational and NoSQL databases.
• Demonstrated expertise in designing and implementing data pipelines, adhering to industry standards and best practices.
• Experience with continuous integration practices.
• Solid understanding of data modeling principles, including medallion and Kimball architectures, and proficiency in data serialization formats such as Parquet, ORC, and Avro.
• Advanced proficiency in Azure Data Factory for efficient data workflow orchestration.
• Expertise in SQL and T-SQL for effective data querying and manipulation within Azure SQL Database.
• Ability to design and implement data warehousing solutions using Azure Synapse Analytics.
• Proficiency utilising Azure Databricks for data processing and analytics.
• Deep understanding of Apache Spark for large-scale data processing.
• Expertise in setting up and optimising Azure Blob Storage and Azure Data Lake Storage for efficient data management.
• Proficiency in Agile (Scrum) methodologies.