BigBear.ai Data Engineer (Partial Remote) in REMOTE, Virginia

Overview BigBear.ai is seeking a Data Engineer to focus specifically on the development and maintenance of scalable data stores that supply big data in forms needed for business analysis. The best athlete candidate for this position will be able to apply advanced consulting skills, extensive technical expertise and has full industry knowledge to develop innovative solutions to complex problems. This candidate is able to work without considerable direction and may mentor or supervise other team members.This position will partially remote out of Crystal, City VA (2-3 days in office). An active Secret Clearance is required. Data is absolutely the lifeblood of Advana and our data engineers are the doctors administering it! Our data engineers support data collection, ingestion, validation, and loading of optimized data in the appropriate data stores. They work on a team made up of analyst(s), developer(s), data scientist(s), and a product lead and everyone on the team collaborates in support of a specific the mission.Working directly with the analyst(s) and the product lead, the data engineer identifies and implements solutions for the data requirements, including building pipelines to collect data from disparate, external sources, implementing rules to validate that expected data is received, cleansed, transformed, massaged and in an optimized output format for the data store. The Data Engineer performs validation and analytics corresponding with client requirements and evolves solutions through automation, optimizing performance with minimal human involvement.As pipelines are executed, the data engineer monitors their status, performance, and troubleshoots issues while working on improvements to ensure the solution is the very best version to address the customer need. What you will do Develop and maintain scalable data stores Identify and implement solutions base on data requirements Builds pipelines to collect data from disparate, external sources Implements rules to validate that expected data is received, cleansed, transformed, massaged and in an optimized output format for the data store Evolves solutions through automation, Optimizes performance Monitors data pipeline status, performance, and troubleshoots issues while working on improvements What you need to have Bachelor’s Degree and 5+ years of experience Clearance: Must be able to obtain and maintain an active Secret clearance 5+ years of experience with a modern programming language such as Python or Java (strong Python skills preferred) 5+ years of experience with SQL 5+ years of experience developing data pipelines using modern Big Data ETL technologies like Apache Kafka, Apache Flink, Apache Airflow or StreamSets.5 years of experience working in a big data and cloud environment Someone with a solid background developing solutions for high volume, low latency applications and can operate in a fast paced, highly collaborative environment. A candidate with distributed computer understanding and experience with Spark Experience with Databricks and Spark What we’d like you to have 2 years of experience working in an agile development environment Ability to quickly learn technical concepts and communicate with multiple functional groups Ability to display a positive, can-do attitude to solve the challenges of tomorrow Possession of excellent verbal and written communication skills Preferred experience with understanding of data pain points and challenges across respective DoD client joint commands A person who appreciates the opportunity to be independent, creative and challenged.An individual with a curious mind, passionate about solving problems quickly and bringing innovative ideas to the table. About BigBear.ai BigBear.ai delivers AI-powered analytics and cyber engineering solutions to support mission-critical operations and decision-making in complex, real-world environments. BigBear.ai’s customers, which include the US Intelligence Community, Department of Defense, the US Federal Government, as well as customers in manufacturing, healthcare, commercial space, and other sectors, rely on BigBear.ai’s solutions to see and shape their world through reliable, predictive insights and goal-oriented advice.Headquartered in Columbia, Maryland, BigBear.ai is a global, public company traded on the NYSE under the symbol BBAI. For more information, please visit: and follow BigBear.ai on Twitter: @BigBearai. Apply tot his job