Lead Data Engineer - Computational Discovery
Lead Data Engineer - Computational Discovery - Contract - Wilmington DE
Ready to engineer the future of data in pharma? Join us as a Lead Data Engineer and turn complex challenges into groundbreaking solutions.
Proclinical is seeking a Lead Data Engineer to play a pivotal role in designing, implementing, and maintaining scalable data pipelines and structures.
Primary Responsibilities:
This position focuses on integrating complex scientific datasets into modern cloud architectures, supporting translational research initiatives. You will collaborate with cross-functional teams to ensure robust, scalable, and FAIR-compliant solutions.
Skills & Requirements:
- Proficiency in Python, including libraries such as Pandas, PySpark, Dask, and SQLAlchemy.
- Advanced knowledge of SQL and workflow orchestration tools like Airflow, Dagster, or Prefect.
- Experience with modern cloud architectures (e.g., Azure Fabric, Databricks, Snowflake).
- Strong understanding of data modeling, ETL processes, and schema design for complex datasets.
- Expertise in API development for data access.
- Familiarity with FAIR principles and metadata standards for scientific data.
- Excellent communication and collaboration skills to bridge IT and scientific teams.
- Preferred: Knowledge of clinical data standards (e.g., SDTM, ADaM, CDISC) and biomarker data formats (e.g., NGS, flow cytometry, proteomics).
The Lead Data Engineer's responsibilities will be:
- Act as a hands-on technical lead, defining architecture and coding scalable ETL pipelines and data structures.
- Oversee the ingestion of complex datasets (e.g., genomics, proteomics, imaging, lab data) into cloud-based data lakes.
- Lead data engineering projects, designing integration solutions for diverse scientific data sources.
- Develop automated procedures to normalize unformatted external vendor data into a structured Common Data Model (CDM).
- Collaborate with research and IT teams to align infrastructure with scientific needs.
- Architect and implement scalable ETL processes, APIs, and visualization tools for data access.
- Engage stakeholders to gather requirements and incorporate feedback into designs.
- Lead user acceptance testing (UAT) to ensure high-quality deliverables.
- Promote FAIR principles and interoperability across translational and clinical programs.
If you are having difficulty in applying or if you have any questions, please contact Anderson Maldonado at [email protected]
If you are interested in applying to this exciting opportunity, then please click 'Apply' or to speak to one of our specialists please request a call back at the top of this page.
Proclinical is a leading life sciences recruiter focused on finding exceptional people and matching them with the finest positions across the globe. Proclinical is acting as an Employment Agency in relation to this vacancy.
By submitting this application, you confirm that you've read and understood our privacy policy, which informs you how we process and safeguard your data -
Recommended Jobs
Commercial Roofing Estimator
Tecta America Carolinas, a commercial roofing contractor, provides a full range of quality roofing services, including, commercial and industrial roofing, re-roofs, leak repairs, preventative mainte…
Childcare Assistant Teacher (Ages 3 and below)
Summary Master's Garden Preschool in Hillsborough seeks to hire a full-time childcare assistant teacher to support their lead teachers and Master's Garden director in fostering a nurturing envir…
Primary Care Physician (MD/DO) - UNC Family Medicine at Eden
Description Are you looking for an opportunity to make a difference in a rural community, practicing medicine the way you were trained? UNC Family Medicine at Eden seeks a BC/BE physician to join …
Inside Sales Representative
Inside Sales Representative General Insulation Company is a national wholesale distributor of commercial and industrial insulation products, HVAC supplies, 3M Firestop products, and associated const…
Guest Relations Representative
Guest Relations Representative Location Elizabeth City, NC : Department and Name: Guest Services- Sentara Albemarle Medical Center Physical Location: Elizabeth City, NC Employment Status: Regular…
Machinist (Shaft Machining) - 2nd Shift - Grade D ($21.42 - $26.01)
Machinist I (D) Arden, NC BorgWarner is a global product leader in delivering innovative and sustainable mobility solutions for the vehicle market. We are a company of innovators and indep…
Mechanical Maintenance Engineer - Rotating Equipment
Senior Estimator – Wet Utilities Location: Greater Los Angeles, Orange County, Inland Empire Salary: Commensurate with Experience Employment Type: Full-Time General Summary The Sen…
Travel PCU RN - $2,746 per week
HealthTrust Workforce Solutions HCA is seeking a travel nurse RN PCU - Progressive Care Unit for a travel nursing job in Asheville, North Carolina. Job Description & Requirements ~ Specialty: P…
Security Technician
Job Responsibilities: Responsible in installing Fire and Security life safety systems as shown on plans. Included but not limited to pulling wire, mounting devices, programming, and commissioni…
Primary Care Opportunity - Pinehurst North Carolina!
This Multi-Specialty Group offers a broad range of primary care and specialty care services to the Central North Carolina area with over 16 locations. Dedicated to continually expanding programs a…