Senior Data Engineer

M9 Solutions is dedicated to providing IT services and solutions to the Federal Government by mobilizing the right people, skills, clearance levels, and technologies to help organizations who desire improved performance and modern, sustainable change. M9 has provided quality IT services and support to more than 30 Federal Agencies and multiple commercial customers nationwide. Our capabilities include digital transformation, software development, cloud migration, applications & infrastructure, cybersecurity, data delivery & analytics, and IT talent solutions.

M9 Solutions is seeking a Senior Data Engineer to work on-site for a client located in Springfield, VA. An active TS/SCI clearance is required.

Responsibilities

• Data Ingestion & Acquisition: Collect and integrate data from a wide variety of structured and unstructured sources, including APIs, RDBMS, file systems, third-party services, and real-time streams.


• Pipeline Development: Design and implement scalable ETL/ELT pipelines to clean, enrich, normalize, and semantically align data (ontology-driven transformations).


• Cloud Deployment: Build and deploy data pipelines and associated infrastructure on AWS or Azure, using managed services like Lambda, Glue, Step Functions, Azure Data Factory, etc.


• Database Architecture: Understand and optimize for different storage engines—relational (PostgreSQL, MySQL), columnar (Redshift, BigQuery), indexing engines (ElasticSearch), key-value stores (DynamoDB, Redis), Object stores (S3 or similar), and caching layers.


• Streaming Data Processing: Work with Apache Kafka (or similar platforms) to handle high-volume, low-latency data streams.


• Workflow Orchestration: Utilize Apache Airflow (or equivalent) to schedule and monitor complex data workflows.


• AI/ML Integration: Collaborate with data scientists to integrate LLMs and ML models into pipelines for inference, tagging, enrichment, or intelligent routing of data.

Required Skills and Qualifications

• Active TS/SCI.


• Bachelor's or master’s degree in computer science, engineering, or a related field.


• 10+ years of experience in data engineering or software development roles.


• Strong proficiency in Python, including experience with libraries like pandas, PySpark, FastAPI, or similar.


• Solid experience with cloud services (AWS or Azure) and Cloud native data engineering tools.


• Proven experience in building and maintaining data pipelines using Kafka, Airflow, and other open-source frameworks.


• Strong grasp of database internals and trade-offs between different storage technologies.


• Familiarity with data governance, lineage, and metadata management concepts.


• Experience or strong interest in integrating LLMs and AI/ML models into production-grade data systems.

Preferred Skills and Qualifications

• Knowledge of data cataloging tools and semantic layer design.


• Experience with containerization (Docker) and orchestration (Kubernetes).


• Familiarity with MLOps tools or platforms (e.g., SageMaker, MLflow).


• Prior experience working in regulated or secure environments.

Full-Time Employee Compensation

• M9 Solutions’ pay range for this position is a general guideline only and not a guarantee of compensation or salary. Additional factors considered in extending an offer include, but are not limited to, responsibilities of the position, education, experience, knowledge, skills, abilities, as well as internal equity, location, alignment with market data, applicable bargaining agreement (if any), or other law.


• M9 Benefits -

Salary Range

$60,000 - $180,000 USD

M9 Solutions, LLC (M9) is a Federal contractor and we comply with all applicable federal laws prohibiting discrimination in employment, including Title VII of the Civil Rights Act of 1964. We also adhere to the affirmative action requirements of the Vietnam Era Veterans' Readjustment Assistance Act (VEVRAA) and Section 503 of the Rehabilitation Act, ensuring equal opportunity for veterans and individuals with disabilities. Please click here to complete M9's Voluntary Self-Identification Form and then email it to [email protected] . If you need accommodation during the application process or encounter difficulties using our website, please contact our Human Resources Department at [email protected] or 703-936-0880 .

With 14+ years of proven delivery and steady growth, M9 Solutions is a unique small business with credible past performance and key capabilities offering project management services, solution architects, business analysts, program managers, technical architects, and technical consultants. M9 was recognized as an Inc. 5000 Fastest-Growing Private Companies in 2021, 2020, 2019, 2018, 2017, 2016, and 2012. M9 Solutions believes that work should be fun, rewarding, and something everyone can be excited about. We offer a competitive compensation package and value diversity in driving the vision of the company.