Senior Data Engineer
Apply NowCompany: CivicMinds, Inc.
Location: Carlsbad, CA 92009
Description:
About Us:
Based in Carlsbad, CA, our Client provides a Platform-as-a-Service (PaaS), allowing industry partners to customize, localize and integrate search technologies directly into their business-to-consumer offerings. We are a unique group of brilliant minds intent on discovering, learning and building. We work in a vibrant atmosphere, with an emphasis on personal and professional development. This is an opportunity to tackle complex problems usually reserved for a handful of large companies in the search industry
We are a unique group of brilliant minds intent on discovering, learning and building. We work in a vibrant atmosphere, with an emphasis on personal and professional development. This is an opportunity to tackle complex problems usually reserved for a handful of large companies in the search industry.
About the Opportunity:
We are looking for a Senior Data Engineer to join our team to manage and oversea data logging, pipelines, processing and presentation of data related to the platforms. The right candidate will take a lead role on the design of the next generation platform utilizing technologies outside of the Hadoop ecosystem.
The ideal candidate will be self-motivated, possess excellent communication skills (both oral and written) and be able to work independently. A keen interest in various aspects of language processing is essential in our multi-disciplinary team.
Duties and Responsibilities:
Skills and Qualifications:
Based in Carlsbad, CA, our Client provides a Platform-as-a-Service (PaaS), allowing industry partners to customize, localize and integrate search technologies directly into their business-to-consumer offerings. We are a unique group of brilliant minds intent on discovering, learning and building. We work in a vibrant atmosphere, with an emphasis on personal and professional development. This is an opportunity to tackle complex problems usually reserved for a handful of large companies in the search industry
We are a unique group of brilliant minds intent on discovering, learning and building. We work in a vibrant atmosphere, with an emphasis on personal and professional development. This is an opportunity to tackle complex problems usually reserved for a handful of large companies in the search industry.
About the Opportunity:
We are looking for a Senior Data Engineer to join our team to manage and oversea data logging, pipelines, processing and presentation of data related to the platforms. The right candidate will take a lead role on the design of the next generation platform utilizing technologies outside of the Hadoop ecosystem.
The ideal candidate will be self-motivated, possess excellent communication skills (both oral and written) and be able to work independently. A keen interest in various aspects of language processing is essential in our multi-disciplinary team.
Duties and Responsibilities:
- Design, implement, and support ETL data pipelines in a big data environment
- Maintain and improve existing data logging, pipeline and analytics platform
- Architect and design next generation data platform with appropriate new technologies
- Work with executives, product managers, machine learning scientists, and engineers to understand reporting and visualization needs
- Design, implement, and support a SQL based data warehouse
- Ensure reliability and accuracy of data logging and processing for all products
Skills and Qualifications:
- Graduate degree in Computer Science or a similar field, or equivalent work experience
- 3+ years working in Data Engineering or Data Warehousing
- Experience with T-SQL, specifically Microsoft SQL Server
- Experience with Database design and schema definition
- Experience with Hadoop ecosystem (Hive, Pig, Oozie)
- Experience with Python
- Experience with Data Visualization and Reporting platforms
- The following experience is a plus:
- Tableau
- Kafka
- Spark