Data Engineer
Job Role: Data Engineer
Location: Charlotte, NC (Onsite/Hybrid)
Job Description:
We are looking for a Data Engineer to join our team and help build out our Data Mesh platform, focusing on Ingestion as a Service. The ideal candidate will work on Spark-based frameworks, leverage AWS native services, and apply functional programming principles to deliver scalable, cloud-native data solutions. This role will collaborate closely with both business and technology teams to deliver robust, consumer-focused data platforms.
Key Responsibilities:
Design and implement AWS cloud-native solutions for Data Mesh, specifically the Ingestion as a Service module.
Build and enhance Spark-based frameworks to support scalable and reusable data ingestion pipelines.
Apply functional programming concepts to develop modular, maintainable microservices for the data mesh domain.
Develop, build, and test data engineering pipelines using Python and PySpark.
Collaborate with business and technology stakeholders to deliver modern, consumer-focused data platforms.
Contribute to the development of technology standards, tools, and processes in support of the overall data strategy.
Assist with conceptual data modeling and ensure alignment with data domain principles.
Communicate and apply data management concepts such as Master Data Management, Critical Data Elements, Granularity, and Normalization.
Operate and manage CI/CD pipelines using Jenkins, CloudFormation, etc.
Work with AWS Data Services including Glue, Lambda, Step Functions, DynamoDB, RDS (Postgres), Event Triggers, and Lake Formation.
Recommended Jobs
Immunology Specialist
You have what it takes: a competitive drive coupled with exceptional sales ability. In this role, you will be responsible for implementing the sales plan by delivering proficient sales presentatio…
Delivery Driver - Pharmacy Services
What Pharmacy Services & Delivery contributes to Cardinal Health Pharmacy Services & Delivery is responsible for the prompt and accurate delivery and distribution of radiopharmaceuticals or oncol…
Pharmaceutical Rep - Oncology
Who are we looking for in our Pharmaceutical Sales Rep professionals? We are looking for healthcare and business-minded professionals, with successful sales track records who strive for organizatio…
Camp Counselor
Who We Are: Eagle’s Nest Camp is non-profit, overnight camp located on 200 acres of wooded land in the lush mountains of Western North Carolina, just southwest of Asheville and down the road from Pi…
Seeking a part-time babysitter in Chapel Hill for 2 kids
Pay: $18 - $25 per hour Start Date: In 1-2 Days Location: Chapel Hill, NC Job Description Seeking a part-time babysitter in Chapel Hill for 2 kids. Must have experience and references. …
Direct Field Inspector
Earn $40,000–$70,000+ your first year , no experience needed. We train, you earn. Opportunity for promotions, big bonuses, and no overnight travel . Why Southern National Roofing Southern…
Operator Blending/Loading
Clean Harbors is seeking a dedicated Operator Blending/Loading to join our team, focusing on promoting environmental sustainability and energy efficiency. This role is crucial in ensuring the safe and…
High Volume Upscale Sous Chef Opportunity
A national upscale restaurant group is searching for a strong Sous Chef in the Raleigh, NC area. The Sous Chef should have prior high-volume upscale dining experience and the ability to foster a clima…
IT Business Analyst - Salesforce
Huber Engineered Woods (HEW), a division of J.M. Huber Corporation, combines its advanced adhesives and wood product technologies with state-of-the-art manufacturing capabilities to produce premium s…
Fabricator, Rigger
We are seeking a skilled Fabricator, Rigger to join our dynamic team at {EMPLOYER-DESC}. In this role, you will be responsible for assembling structural forms, such as machinery frames, tanks, and fur…