Location: Birmingham or Sheffield (Hybrid, 2 days onsite p/w)
Contract End Date: November 2025
Rate: Up to £500 per day Inside IR35
About the Role
We are seeking an experienced Data Engineer with strong skills in ETL processes, streaming data, and machine learning integration. You will work with large-scale structured and unstructured datasets, transforming raw data into actionable insights that power analytical and predictive systems. This role involves hands-on engineering, advanced data processing, and leveraging modern telemetry and ML techniques to drive real-world impact.
Key Responsibilities
- Preprocess structured and unstructured data for analytics and modelling.
- Enhance data collection pipelines to capture all relevant data for analytic systems.
- Cleanse, process, and validate data integrity for downstream use.
- Analyse large datasets to identify trends, patterns, and actionable insights.
- Develop predictive models and machine learning algorithms.
- Present analytical results in clear, impactful formats.
- Propose innovative solutions and strategies to address business challenges.
- Perform data mining to extract valuable information from diverse sources.
- Use machine learning tools for feature selection, classifier creation, and optimisation.
Required Skills & Experience
- Strong programming skills in Python; experience with Scala or Java is an advantage.
- Expertise with OpenTelemetry stack, including components such as virtual machines, middleware (IIS, Apache), hypervisors, and databases.
- Understanding of the OTLP format and structuring telemetry data for analytics.
- Ability to correlate OLTP streaming data from multiple components and generate actionable outcomes using applied ML techniques.
