Agile Defense is seeking a Data Engineer (SME) to design, build, and maintain data collection, processing, and integration pipelines. You will centralize and structure data from various web-based applications, wrangling disparate sources into unified, consumable data APIs for internal and external stakeholders. This role involves close collaboration with software developers, data analysts, and product teams.

What You'll Do

Design, develop, and maintain data ingestion pipelines to collect structured and unstructured data from user applications and bulk data sources.
Implement efficient data transformation and storage strategies to facilitate easy retrieval and analysis.
Collaborate with software development teams to optimize application-generated data for streamlined aggregation.
Ensure data integrity, security, and compliance with industry regulations and company policies.
Optimize query performance and improve data access patterns to support analytical and operational use cases.
Work with business stakeholders to define data requirements and improve data accessibility for decision-making.
Design and build APIs to support data ingestion, retrieval, and integration with external systems.
Develop and maintain event-driven architectures, utilizing event storage for real-time data processing.

What We're Looking For

Bachelor’s degree in Computer Science, Software Engineering, or a related technical field, or equivalent professional experience.
Minimum of eight (8) years of relevant professional experience.
Experience developing data pipelines, integration solutions, and data aggregation services in complex environments.
Must possess an active TS/SCI security clearance.
Due to U.S. Government contract requirements, only U.S. citizens are eligible for this position.
3+ years of experience in front-end development with a focus on React.
Strong proficiency in JavaScript (ES6+), TypeScript, HTML5, and CSS3.
Knowledge of modern CSS frameworks (Tailwind CSS, Styled Components, or SASS/SCSS).
Experience with build tools and package managers (Webpack, Vite, pnpm, Yarn, npm).
Familiarity with RESTful APIs, Eventstores, and WebSockets for data fetching.
Experience with CI/CD pipelines and version control (Git, GitLab, etc.).
Strong problem-solving skills and the ability to work independently or collaboratively.
Proficiency in database technologies, including SQL, NoSQL, and event-based databases (e.g., PostgreSQL, MySQL, MongoDB, EventStoreDB).
Strong programming skills in Golang, Python, and JavaScript/TypeScript.
Experience with cloud-based data solutions (AWS, GCP, or Azure) and data warehousing.
Familiarity with building APIs, data integration tools, and best practices for data aggregation.
Understanding of API-based data aggregation and event-driven architectures.
Ability to work independently and collaboratively within a team.

Nice to Have

Experience with testing frameworks (Jest, React Testing Library, Cypress).
Experience working with streaming and batch data processing frameworks.
Building microservice APIs in Golang/Python (e.g., Gin, Echo, FastAPI, etc.).
Designing, maintaining, and updating database schemas and configurations (SQL/NoSQL/EventStoreDB).
Aggregating user-created and imported classified data into versioned datasets.
Designing data provenance, lineage, retention, and management solutions.

Technical Stack

Frontend: React, JavaScript (ES6+), TypeScript, HTML5, CSS3, Tailwind CSS, Styled Components, SASS/SCSS
Build Tools: Webpack, Vite, pnpm, Yarn, npm
APIs & Protocols: RESTful APIs, Eventstores, WebSockets
Testing: Jest, React Testing Library, Cypress
Version Control: Git, GitLab
Databases: SQL, NoSQL, PostgreSQL, MySQL, MongoDB, EventStoreDB
Languages: Golang, Python
Cloud: AWS, GCP, Azure
Frameworks: Gin, Echo, FastAPI