ETL/Data Engineer
Apply NowCompany: Technogen International Company
Location: Alturas, CA 96101
Description:
Position Title: ETL/Data Engineer
Required Skills: AWS, ETL tool experience, data ingest pipelines, Snowflake or Databricks
Location: 100% REMOTE ,CA
Required Skills: AWS, ETL tool experience, data ingest pipelines, Snowflake or Databricks
Location: 100% REMOTE ,CA
- This team is building out a data platform for enterprise business partners (Unified Log Collection). Logging data from security products.
- This platform will ingest the data, process it, and produce use cases, analytics, etc. for clients.
- Looking for an ETL Engineer who has worked with data from an enriching standpoint (enriched table view).
- 4+ years' experience required.
- They are using Vector for ETL - an open-source tool that is being built. This is replacing Logstash.
- Environment: Logstash, Vector, Databricks, Snowflake
- Day to day: ingest data, process data, and build parsers. Store data in S3 and taking flattened data and uploading into snowflake.
- The data they are using is security/network source so they would need to be comfortable working with that data (Palo Alto, UTM, Crowdstrike).