Data Engineer

BTI is seeking highly motivated Data Engineer to be at the forefront of data infrastructure development. Your data engineering tasks include designing, constructing, installing, and maintaining the systems that allow for the seamless flow, availability, and reliability of data. Candidate will work with stakeholders including Product Managers of various Army PEO systems, lead engineers, and developer teams to assist with data-related technical issues and support their data infrastructure needs. Candidate will work to integrate the and multiple other Army warfighting systems to achieve end-to-end data management and interoperability.

Primary Duties/Responsibilities:

• Develop Data architecture.
• Developing and maintaining data pipelines for efficient data extraction, transformation, and loading (ETL) processes.
• Designing and optimizing data storage solutions, including data warehouses and data lakes.
• Ensuring data quality and integrity through data validation, cleansing, and error handling.
• Collaborating with data analysts, and software engineers to understand data requirements and deliver relevant data sets (e.g., for business intelligence).
• Implementing data security measures and access controls to protect sensitive information.
• Automating and improving data processes and workflows for scalability and efficiency.
• Monitoring data infrastructure for performance and reliability to address issues promptly.
• Keeping abreast of industry trends and emerging technologies in data engineering.
• Documenting data pipelines, processes, and best practices for knowledge sharing.
• Participating in data governance and compliance efforts to meet regulatory requirements.
• Continuously optimizing data architecture to support the Army's evolving data needs.
• Collaborating with cross-functional teams to drive data-driven decision-making within the organization.
• Assemble large, complex data sets that meet functional / non-functional requirements.
• Identify, design, and implement internal process improvements.

• Study and describe the infrastructure required for optimal pulling, pushing, transformation, and loading of data from a wide variety of data sources using SQL, XML and other technologies.
• Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative data design.
• Work with data and analytics experts to strive for greater functionality in our data systems.
• Provide key leaders detailed analysis of issues with recommended solutions; provide technical reports.
• Work in field and lab Agile software development environments that are highly stressful and rapidly changing.

Required Skills:

• U.S. Citizen
• An active Secret clearance or the ability to obtain an interim Secret clearance within 30 days
• Bachelor's Degree (computer sciences, data science, or a related field) required.
• Master's degree in data science or a related discipline is preferred.

Desired Attributes:

• Microsoft and Cisco certification are favorable.
• Proficiency in data modeling and database management.
• Strong programming skills (e.g., Python, Java, or SQL).
• Knowledge of big data technologies like Hadoop and Spark.
• Experience with ETL (Extract, Transform, Load) processes.
• Familiarity with data warehousing and cloud platforms (e.g., AWS, Azure, or Google Cloud).

• Knowledge and experience working military messaging, such as VMF and USMTF, as well as working familiarity with a variety of databases and stores for processing message types.
• Serve as Subject Matter Expert for Program or Product Office as an engineer or integrator with a detailed understanding of Army, Joint and Coalition Interoperability.
• Build processes supporting data transformation, data structures, metadata, dependency and workload management.
• A successful history of manipulating, processing and extracting value from large, disconnected datasets.
• Self-driven with little supervision, coordinate internally and externally as required to meet mission goals.
• Strong project management and organizational skills.
• Experience supporting and working with cross functional teams in a dynamic environment.
• Experience with DoD practices.