Advanced Data Engineer DEN
Role Overview
•
Role: Lead Data Engineer — Snowflake / DBT / AWS
•
Seniority Level: Lead (8+ years of experience)
•
Core Mission: Drive the development of Commercial Data Products within the enterprise Common Data Platform (CDP), supporting advanced analytical data products, feature datasets, and machine learning pipelines.
Key Responsibilities
•
Data Modeling & Transformations: Implement advanced DBT transformations and Snowflake models to query, shape, and structure data for analytical consumption.
•
Pipeline Development: Build robust ingestion pipelines and ETL workflows using AWS data services (Lambda, S3, Glue, Step Functions).
•
Code & SQL Optimization: Write and optimize complex SQL and Python code (PySpark where needed) for high-performance data processing.
•
API Integration: Integrate API and external data sources, ensuring robust error handling, retries, and secure connectivity.
•
ML & Feature Support: Build and maintain feature datasets and views in Snowflake that feed analytics workflows (such as Dataiku), and collaborate with Data Science teams around Feature Store management.
•
Quality & Operations: Create comprehensive testing, monitoring, runbooks, and CI/CD pipelines for production-grade data assets.
•
Cross-Functional Collaboration: Partner closely with Data Science, product, delivery, and BI teams to support reporting and analytical needs.
Must-Have Requirements & Skills
•
Experience: Minimum 8+ years of professional experience in Data Engineering.
•
Core Technologies: Hands-on expertise with DBT and Snowflake.
•
Programming: Strong programming skills in Python and SQL (PySpark preferred).
•
Cloud & Ingestion: Practical AWS data services experience (Lambda, S3, Glue, Step Functions) and experience with API-based data ingestion.
•
Pipelines & MLOps Support: Proven experience building production data pipelines, data modeling, testing, monitoring, and CI/CD.
•
Environment: Comfortable working in governed enterprise environments.
Nice-to-Have / Preferred Skills
•
Knowledge of the commercial domain within the pharmaceutical or life sciences industry (healthcare, claims, HCP, patient support, or Veeva data experience).
