Senior Python Engineer
Apply NowCompany: Avani Technology Solutions, Inc.
Location: Lake Forest, CA 92630
Description:
Top 3 Skills
Python
ETL
Experience within structured and un-structured data
Unstructured data into relational databases
AWS
Requirements:
You have a Bachelor's Degree in Computer Science (or related field) and have 5+ years of relevant work experience in business intelligence, data engineering, data warehousing, or a similar field.
You have expert level experience with SQL and Python, with intermediate around Hive, Pig
You remain active in learning emerging practices and technologies in the BI/DW and data science space.
You are comfortable and confident in your knowledge of multiple database programming languages and your knowledge of relational and columnar databases.
You have experience integrating data from multiple data sources and have processed large amounts of unstructured data.
You have experience with Cloud technologies (AWS preferred), Big Data Components (Apache Spark, Hadoop, Presto, etc.), and Continuous Integration tools is desired, but not required.
Data Engineer Job Responsibilities:
Provide significant contributions to the growth of our Data infrastructure
Design, develop, test and deploy business intelligence solutions
Design and document data structures/models and data flows
Interact with various business units and technical teams to gather requirements
Review, optimize and document current ETL processes
Ensure data quality, completeness, and accuracy
Collaborate with team members in code reviews, discovering better practices and patterns and continuous improvements
Python
ETL
Experience within structured and un-structured data
Unstructured data into relational databases
AWS
Requirements:
You have a Bachelor's Degree in Computer Science (or related field) and have 5+ years of relevant work experience in business intelligence, data engineering, data warehousing, or a similar field.
You have expert level experience with SQL and Python, with intermediate around Hive, Pig
You remain active in learning emerging practices and technologies in the BI/DW and data science space.
You are comfortable and confident in your knowledge of multiple database programming languages and your knowledge of relational and columnar databases.
You have experience integrating data from multiple data sources and have processed large amounts of unstructured data.
You have experience with Cloud technologies (AWS preferred), Big Data Components (Apache Spark, Hadoop, Presto, etc.), and Continuous Integration tools is desired, but not required.
Data Engineer Job Responsibilities:
Provide significant contributions to the growth of our Data infrastructure
Design, develop, test and deploy business intelligence solutions
Design and document data structures/models and data flows
Interact with various business units and technical teams to gather requirements
Review, optimize and document current ETL processes
Ensure data quality, completeness, and accuracy
Collaborate with team members in code reviews, discovering better practices and patterns and continuous improvements