Data Systems Engineer (AWS, Snowflake, RedShift, Python, Scala, Hadoop, Spark, Kafka, Hive, API, Handling, API Development, Data Migration, Batch Data Pipelines) in Charlotte, NC

DBA Web Technologies
Charlotte, NC

Data Systems Engineer (AWS, Snowflake, RedShift, Python, Scala, Hadoop, Spark, Kafka, Hive, API, Handling, API Development, Data Migration, Batch Data Pipelines) in Charlotte, NC

API Development, AWS, AWS Lambda, Data Migration, Hadoop, Java, Oracle, Snowflake, SQL Server

Location: North Carolina

Job Function: Data Engineer

Date Of Job Posting: 08-19-2021

Data Systems Engineer (AWS, Snowflake, RedShift, Python, Scala, Hadoop, Spark, Kafka, Hive, API,Handling, API Development, Data Migration, Batch Data Pipelines) in Charlotte, NC

Position: Data Systems Engineer (AWS, Snowflake, RedShift, Python, Scala, Hadoop, Spark, Kafka, Hive, API,Handling, API Development, Data Migration, Batch Data Pipelines)

Location: Charlotte, NC

Duration: Full-Time ONSITEposition (no contracts, no corp to corp, no remote)

Salary: Excellent Compensation with benefits + 401K

SKILLS: AWS, Glue, Lambda, EMR, Snowflake, RedShift, Python, Scala, Java, Hadoop, Spark, Kafka, Hive, API Handling, API Development,Custom Data pipeline development,Data Migration, Oracle, SQL server, Batch Data Pipelines, Agile

THE OPPORTUNITY:

For one of our reputed client in Financial Space, we have an immediate need for a Data Systems Engineer to be based in Charlotte, North Carolina.

Our Ideal Data Systems Engineer will have skills emphasis on data management, data processing, and developing framework for scalable data infrastructure solutions to integrate with heterogeneous data sources. The candidate will work closely with Program Managers, Engineers, Data scientists, Reporting team and other key parts of the business to understand their data requirements and build appropriate systems and platform that meet or exceed those specific business functions. You must be willing to get into the details but also be able to step back and help us plan the strategic direction of our data management and reporting practices.

THE ROLE:

·Utilize multiple development languages/tools such as Java, Python, Scala and object-oriented approaches in building prototypes and evaluate results for effectiveness and feasibility.

·Design, develop, test, and implement data-driven solutions to meet business requirements, ability to quickly identify an opportunity and recommend possible technical solutions by working with third party vendors.

·Provide business analysis and develop ETL code to meet all technical specifications and business requirements according to the established architectural designs.

·Extracting business data from multiple structured and unstructured data sources, utilizing data pipeline to ingest data in Enterprise Data Lake - hybrid environment.

·Deploy application code and analytical models using CI/CD tools and techniques and provides support for deployed data applications and analytical models using Jenkins, GitHub.

·Willing to take ownership of pipeline and can communicate concisely and persuasively to varied audience including data provider, engineering, and analysts.

·Ability to research and assess open-source technologies and components to recommend and integrate into the design and implementation.

REQUIREMENTS:

·Bachelor's degree in computer science, information systems or relevant field of study.

·Master's degree preferred

·Experienced in Cloud Technologies: AWS, Glue, Lambda, EMR and Snowflake/RedShift database

·Must have related technical experience and specialist level knowledge of Python, Scala or Java

·Also should have experience with Hadoop ecosystem and Big Data technologies: Spark, AWS, Kafka, Hive, API Handling, CDH

·Experience in API Development and Handling Experience in Custom Data pipeline development (Cloud and in-house local) and migrate data from large-scale data environments - Oracle, SQL server with experience in end-to-end design and build process of Near-Real Time and Batch Data Pipelines.

·Demonstrated ability to work with team members and clients to assess needs, aid and resolve problems.

·Excellent problem-solving skills, verbal/written communication, and the ability to explain technical concepts to business partners.

·Partner with Development teams to ensure Coding standards are in alignment with DevOps practices with respect to Tools, Standards, and Security.

·Self-motivated and capable of delivering results with minimal ongoing direction. Ability to work in a fast-paced environment and manage multiple priorities in parallel.

·Automation mind-set - drive to continuously look for ways to automate existing processes.

·Experience working on Agile Scrum teams.

--------------------------------------------------

Apply for this job
Posted 2026-01-29

Recommended Jobs

Travel Nurse RN - Med/Surg / Telemetry - $1,894 per week in Shelby North, NC

TravelNurseSource
North, NC

Registered Nurse (RN) | Med/Surg / Telemetry Location: Shelby North, NC Agency: TalentBurst, Inc. Pay: $1,894 per week Shift Information: Nights - 3 days x 12 hours Start Date:…

View Details
Posted 2026-05-27

Physical Therapist Assistant / PTA / PRN

Broad River Rehabilitation
Kinston, NC

Job Description Job Description Physical Therapist Assistant/ PTA / PRN - Kinston NC / NORTH CAROLINA Assisted Living Facility 1-year experience required We currently have a PRN PTA …

View Details
Posted 2026-04-05

Medical Assistant

Bethany Medical
High Point, NC

CMA/RMA (FULL-TIME) “The Largest Independent Established Multi-Specialty Group in Central North Carolina is Seeking a CMA/RMA to join our Team Full-Time.” VOTED “BUSINESS OF THE YEAR” 2018 VOTED…

View Details
Posted 2026-06-03

Veterinary Dentist and Oral Surgeon

South Asheville Veterinary Emergency & Specialty (SAVES)
Asheville, NC

Are you ready to call North Carolina home? South Asheville Veterinary Emergency & Specialty (SAVES)Asheville, is GROWING and looking for a Dentist and Oral Surgeon to join our incredible team of spe…

View Details
Posted 2026-06-18

Bartender

Seasons 52
Raleigh, NC

For this position, pay will be variable by location - plus tips. Work in a team-oriented, high-volume, fast-paced, guest-centric environment to provide guests with a fresh dining experience…

View Details
Posted 2026-05-14

Gerente de Turno de Restaurante

Noodles & Company
Raleigh, NC

Resumen: E n Noodles & Company , nuestra misión es nutrir e inspirar a cada miembro del equipo, cada cliente y cada comunidad a la que servimos. Estamos contratando Gerentes de Turno para lide…

View Details
Posted 2025-12-19

Association Property Manager

Tessier Group
Arden, NC

Plan, direct, or coordinate the management or governance activities of commercial, industrial, or residential real estate properties. Responsible for maintaining the integrity of the physical asse…

View Details
Posted 2026-05-10

Interior Designer, Corporate Office Spaces

Amwins
Charlotte, NC

Job Description Job Description Amwins is the largest specialty distributor of property, casualty and professional lines of insurance products - we're ready for even the most complex placements.…

View Details
Posted 2026-06-05

Superintendent

IMOCO INC.
Fletcher, NC

Job Description Job Description Benefits: ~ Paid Holidays ~ Life insurance ~401(k) ~401(k) matching ~ Dental insurance ~ Health insurance ~ Paid time off ~ Parental leave ~ Visio…

View Details
Posted 2026-04-11