Scala Spark Data Developer
Kforce client is in need of a Scala Spark Data Developer to work on-site 4 days a week in Burlington, MA. This is a contract to hire opportunity. Summary: The Scala Spark Data Developer will be supporting multiple data use cases, including lift-and-shift initiatives and new pipeline development, on an AWS-based big data platform. The role is hands-on, delivery-focused, and embedded within an environment that has production support already in place, allowing time to learn standardized processes. Key Responsibilities:
- Design, develop, and maintain data ingestion and ETL pipelines
- Build and optimize Scala-Spark based data processing jobs
- Support multiple data use cases, including modernization and lift-and-shift efforts
- Implement and maintain business logic within data pipelines
- Work within a standardized data engineering framework while contributing to improvements
- Collaborate with existing teams supporting production workloads
- 7-8 years of overall experience ina Data Development focused role
- Scala and Spark/Secondary preference would be Java with Spark if no Scala
- Databricks experience - Databricks Compute, Databricks Storage
- Hands-on experience designing and developing: Ingestion pipelines, ETL pipelines
- Databricks workspace and cluster configuration and Job scheduling and workflow management
- Airflow experience is preferred
- Solid experience with data pipeline architecture and workflow management
Recommended Jobs
Territory Executive - National Accounts (Charlotte)
As the Territory Executive for Sentry in our National Accounts division, you'll work with brokers and agents in a defined territory to create Sentry awareness. You will be responsible for genera…
Service Technician
What To Expect As a Tesla Technician, you become a vital part of our global team, working towards our mission of accelerating the world's transition to sustainable energy. At Tesla, you'll collabo…
Registered Nurse (RN) Staffing Resources ICU, ED
Overview: Registered Nurses for Staffing Resources Float pool 7p-7a – Need experienced nurses in the following areas: ICU, ED full-time set rate $54.50 Department Description: Serving the com…
Foreman
BHI Energy is currently looking for a Working Foreman to work at the Roxboro Power Plant located in Roxboro, NC. Responsible for providing day-to-day direction and Supervision of work activities of…
Buffet Attendant
At Cicis, we open our doors everyday with the purpose of making each guest’s day by delivering remarkable service and high-quality pizza. Many employees start just expecting just a job but end up wit…
Strategic Sourcing Specialist Direct & MRO
Strategic Sourcing Specialist – Indirect / MRO Confidential Opportunity | Strategic Sourcing & Procurement | Indirect/MRO A multi-site manufacturing organization is hiring a Strategic Sou…
Sales Representative
About our Company: Results Roofing Our ownership is compromised by a group of innovative entrepreneurs, who are actively changing the game in the roofing industry. Creating the company based on…
Commercial Flooring Careers
QuestMark Flooring - Mooresville, NC - Full Time *Salaried and hourly positions available - SIGNING BONUS* **QuestMark is looking for local experienced employees** Join our fast-growing servic…
Phlebotomist
Phlebotomist Labcorp is seeking a Phlebotomist to join our team at Morehead City, NC. Work Schedule: Monday-Friday 7:30am-4:00pm Job Responsibilities: Perform blood collections by venipu…