Senior Data Engineer
Position Type
Location Seattle, WA
Job Requirements -
7+ years of Data/Software Engineering experience
5+ years of hands-on development experience in Python and PySpark for large-scale data processing
4+ years experience with Containers (Docker and orchestration, ie: Kubernetes or EKS or Redhat)
4+ years of experience with test automation
5+ years experience working with SQL & NoSql databases
Experience with version control systems, such as Git
Work experience in a complex enterprise application delivery, using agile development methodology
Bachelor's in computer science or equivalent work experience
Job Description
Our client is seeking a top-tier Senior Data Engineer to join their engineering team.
The team supports various mid-layer services across the organization and to external partners and is seeking a strong Data Engineer with cloud experience to work with Customer data.
The ideal candidate will have strong experiences in Python, PySpark, Databricks, Cloud, Containerization, Data Streaming, and Agile/Scrum.
Required Skills -
Data Engineering with Python & PySpark, Databricks, Containers, Cloud, Automated testing, Agile
Job Duties -
Be an active participant in all scrum ceremonies and lead in the delivery of the strategic roadmap.
Responsible for the full application development lifecycle and support.
Provide subject matter expertise and direction, guidance, and support on complex engagements.
Collaborate with the Architecture team, Product team, Development team and other Information Technology (IT) team. Initiates process improvements for new and existing systems.
Design, build, and maintain scalable and efficient data pipelines using Python and PySpark.
Develop and optimize ETL/ELT processes to ingest, transform, and load large datasets from various sources.
Implement data quality checks and monitoring to ensure the accuracy and integrity of our data.
Desired Skills & Experience -
The following would all be a plus:
Java
Spring Boot
Kafka
Cassandra
Elastic Search
Recommended Jobs
Sr. Mobile Reefer Technician
Fleet Services - A COX AUTOMOTIVE Company, Keeps Fleets Moving! Position: Mobile Diesel Mechanic II Headquartered in Indianapolis, Fleet Services by Cox Automotive (FS) has grown to become one o…
Regional Sales Manager - Remote
Job Responsibilities Include Developing customer relationships in multiple states Acts as sales team member (at times leading this team and other times in a support role) Understanding and gather…
Deployment and Desktop Support- 6 month onsite Contract - Charlotte NC - MUST BE currently in Charlotte-746188
W-2 Rate up to $22/hour- On Site Multiple openings Multiple Deployment and Desktop Support contractors required for Charlotte. Expected Skills: Able to work without assistance; can provide li…
Occupational Therapy Assistant / COTA / OTA / PRN
Job Description Job Description Occupational Therapist Assistant / COTA / OTA / PRN - TAYLORSVILLE, NC PRN - Flexible Schedule! We currently are looking for a PRN Occupational Therapist Ass…
Product Manager
Stakeholder Engagement & Requirement Gathering Collaborate with business units to document requests, understand business value, and prioritize effectively Engage with department leaders, exe…
Emergency Medicine Advanced Practice Clinician in Roxboro, NC
Are you an advanced practice clinician (APC) with a desire you provide the highest quality of care to your patients? If so, we need you! TeamHealth is seeking a full-time physician assistant (PA) or …
Utility Foreman with Crew
Utility Foreman with Crew D.H. Griffin Infrastructure, LLC., is a heavy civil construction company, offering services in site grading and development, specialty concrete, as well as underground util…
Orthopedic Physician Assistant
Overview We are seeking a dedicated and skilled PA to join our total joint orthopedic team. The ideal candidate will have a strong background in diagnosing and treating musculoskeletal conditions,…
Server
You’ll be the face of our restaurant and responsible for our customers’ experiences. You need to be quick on your feet (literally and metaphorically) and have a polite and friendly attitude. If you en…
Information Security Threat Management Specialist
At Bank of America, we are guided by a common purpose to help make financial lives better through the power of every connection. We do this by driving Responsible Growth and delivering for our …