Lead Data Engineer - Computational Discovery

Proclinical Staffing
Wilmington, NC

Lead Data Engineer - Computational Discovery - Contract - Wilmington DE

Ready to engineer the future of data in pharma? Join us as a Lead Data Engineer and turn complex challenges into groundbreaking solutions.

Proclinical is seeking a Lead Data Engineer to play a pivotal role in designing, implementing, and maintaining scalable data pipelines and structures.

Primary Responsibilities:

This position focuses on integrating complex scientific datasets into modern cloud architectures, supporting translational research initiatives. You will collaborate with cross-functional teams to ensure robust, scalable, and FAIR-compliant solutions.

Skills & Requirements:

  • Proficiency in Python, including libraries such as Pandas, PySpark, Dask, and SQLAlchemy.
  • Advanced knowledge of SQL and workflow orchestration tools like Airflow, Dagster, or Prefect.
  • Experience with modern cloud architectures (e.g., Azure Fabric, Databricks, Snowflake).
  • Strong understanding of data modeling, ETL processes, and schema design for complex datasets.
  • Expertise in API development for data access.
  • Familiarity with FAIR principles and metadata standards for scientific data.
  • Excellent communication and collaboration skills to bridge IT and scientific teams.
  • Preferred: Knowledge of clinical data standards (e.g., SDTM, ADaM, CDISC) and biomarker data formats (e.g., NGS, flow cytometry, proteomics).

The Lead Data Engineer's responsibilities will be:

  • Act as a hands-on technical lead, defining architecture and coding scalable ETL pipelines and data structures.
  • Oversee the ingestion of complex datasets (e.g., genomics, proteomics, imaging, lab data) into cloud-based data lakes.
  • Lead data engineering projects, designing integration solutions for diverse scientific data sources.
  • Develop automated procedures to normalize unformatted external vendor data into a structured Common Data Model (CDM).
  • Collaborate with research and IT teams to align infrastructure with scientific needs.
  • Architect and implement scalable ETL processes, APIs, and visualization tools for data access.
  • Engage stakeholders to gather requirements and incorporate feedback into designs.
  • Lead user acceptance testing (UAT) to ensure high-quality deliverables.
  • Promote FAIR principles and interoperability across translational and clinical programs.

If you are having difficulty in applying or if you have any questions, please contact Anderson Maldonado at [email protected]

If you are interested in applying to this exciting opportunity, then please click 'Apply' or to speak to one of our specialists please request a call back at the top of this page.

Proclinical is a leading life sciences recruiter focused on finding exceptional people and matching them with the finest positions across the globe. Proclinical is acting as an Employment Agency in relation to this vacancy.

By submitting this application, you confirm that you've read and understood our privacy policy, which informs you how we process and safeguard your data -

Posted 2026-01-13

Recommended Jobs

Commercial Roofing Estimator

Tecta & Schwickerts
Indian Trail, NC

Tecta America Carolinas, a commercial roofing contractor, provides a full range of quality roofing services, including, commercial and industrial roofing, re-roofs, leak repairs, preventative mainte…

View Details
Posted 2025-12-17

Childcare Assistant Teacher (Ages 3 and below)

Master's Garden Preschool/ Ebenezer Baptist Church
Hillsborough, NC

Summary Master's Garden Preschool in Hillsborough seeks to hire a full-time childcare assistant teacher to support their lead teachers and Master's Garden director in fostering a nurturing envir…

View Details
Posted 2026-01-15

Primary Care Physician (MD/DO) - UNC Family Medicine at Eden

UNC REX Healthcare
Eden, NC

Description Are you looking for an opportunity to make a difference in a rural community, practicing medicine the way you were trained? UNC Family Medicine at Eden seeks a BC/BE physician to join …

View Details
Posted 2026-01-14

Inside Sales Representative

General Insulation Company
Charlotte, NC

Inside Sales Representative General Insulation Company is a national wholesale distributor of commercial and industrial insulation products, HVAC supplies, 3M Firestop products, and associated const…

View Details
Posted 2025-12-09

Guest Relations Representative

Sentara Healthcare
Elizabeth City, NC

Guest Relations Representative Location Elizabeth City, NC : Department and Name: Guest Services- Sentara Albemarle Medical Center Physical Location: Elizabeth City, NC Employment Status: Regular…

View Details
Posted 2026-01-09

Machinist (Shaft Machining) - 2nd Shift - Grade D ($21.42 - $26.01)

BorgWarner Inc.
Arden, NC

Machinist I (D) Arden, NC    BorgWarner is a global product leader in delivering innovative and sustainable mobility solutions for the vehicle market. We are a company of innovators and indep…

View Details
Posted 2026-01-15

Mechanical Maintenance Engineer - Rotating Equipment

Greenville, NC

Senior Estimator – Wet Utilities Location: Greater Los Angeles, Orange County, Inland Empire Salary: Commensurate with Experience Employment Type: Full-Time General Summary The Sen…

View Details
Posted 2025-12-29

Travel PCU RN - $2,746 per week

HealthTrust Workforce Solutions HCA
Asheville, NC

HealthTrust Workforce Solutions HCA is seeking a travel nurse RN PCU - Progressive Care Unit for a travel nursing job in Asheville, North Carolina. Job Description & Requirements ~ Specialty: P…

View Details
Posted 2026-01-14

Security Technician

SGS Consulting
North Carolina

Job Responsibilities: Responsible in installing Fire and Security life safety systems as shown on plans. Included but not limited to pulling wire, mounting devices, programming, and commissioni…

View Details
Posted 2025-12-02

Primary Care Opportunity - Pinehurst North Carolina!

National Health Partners
Pinehurst, NC

This Multi-Specialty Group offers a broad range of primary care and specialty care services to the Central North Carolina area with over 16 locations. Dedicated to continually expanding programs a…

View Details
Posted 2025-11-21