Data Engineer
Apply NowCompany: Crimson Phoenix
Location: Mc Lean, VA 22101
Description:
What You Will Be Doing :
Required Skills:
Must Have :
Desired Skills:
Nice to Have :
- Developing new tools, code, and services to execute data engineering activities.
- Movement of structure and unstructured data using approved methods.
- Executing data ingestion activities for storing data in a local or enterprise level location.
- Viewing data in its source format.
- Developing code to format data that supports exploration.
- Analyzing source data formats and working with Data Scientists and partners to determine the formats and transforms that best meet mission objectives.
- Developing code and tools to provide one-time and on-going data formatting and transformations into enterprise or boutique data models.
- Implementing existing ETL code and best practices/standards.
- Developing an ETL Code Transition Plan.
- Developing and delivering documentation for each project including ETL mappings, code use guide, code location, and access instructions.
- Facilitating Code Reviews.
- Providing consulting services to support data transport, ingestion, conditioning, access, and management.
Required Skills:
Must Have :
- MUST HAVE a Current and Active Top Secret SCI with Polygraph, as the customer is NOT sponsoring clearances.
- Experience with Extract, Transform, and Load (ETL) tools and processes.
- Python.
- AWS.
- SQL.
- APIs.
- Linux.
- Geospatial tools/data.
Desired Skills:
Nice to Have :
- Docker.
- Jenkins.
- Hadoop/Spark.
- Kibana.
- Kafka.
- NiFi.
- ElasticSearch.