Data Engineer
Apply NowCompany: Technogen International Company
Location: Alpharetta, GA 30022
Description:
Must Have 10+ Years of Experience
Must be Local to GA
Skills Needed: GCP/Google Cloud, SQL, (SSIS,SSAS & SSRS), Python and Tableau/PowerBI
Data Engineer
Location: Alpharetta, GA (Hybrid - 2 Days in A Week)
Duration: 12+ Months
Job Description:
Responsibilities:
10+ years of experience in data engineering.
Design, develop, and maintain new data capabilities and infrastructure for utilizing, third-party, and partner data to enhance data products and solutions
Design, develop, and implement scalable data pipelines and ETL/ELT processes using SSIS, Python and API integrations
Identify existing data capability and infrastructure gaps or opportunities within and across initiatives and provide subject matter expertise in support of remediation
Collaborate with technical team and business stakeholders to understand data requirements and translate them into technical solutions
Work with large datasets, ensuring data quality, accuracy, and performance
Implement data transformation, integration, and validation processes to support analytics and reporting needs
Optimize and fine-tune data pipelines for improved speed, reliability, and efficiency
Implement best practices for data storage, retrieval, and archival to ensure data accessibility and security
Troubleshoot and resolve data-related issues, collaborating with the team to identify root causes
Document data processes, data lineage, and technical specifications for future reference
Review and analyze existing data collection systems, and make recommendations on improvement, maintenance, or other factors to improve the system.
Develop, build, and implement new data collection systems where needed.
Provide training and guidance on new systems that are being implemented.
Participate in code reviews, ensuring adherence to coding standards and best practices
Collaborate with other teams to automate deployment and monitoring of data pipelines
Proven experience in data engineering, with a strong track record of designing and implementing data solutions
Proficiency in programming languages such as Python, Java, or Scala, and experience with data processing frameworks (Spark, Hadoop, etc.)
In-depth understanding of data warehousing concepts, cloud platforms (GCP), and data modeling techniques
Strong knowledge of SQL and NoSQL databases, as well as data integration and transformation tools(SSIS)
Passion for and engagement with emerging trends in data, AI/ML, analytics, and digital experiences
Experience in data product development, analytical models, and model governance
Experience in anonymizing data and managing the use of data
Experience in data hygiene procedures, identity resolution capabilities or data management a plus
Familiarity with BI technologies (e.g. Microsoft Power BI, Tableau)
Ability to create strategies and plans that define how information can be utilized to support an organization's overall business strategy, and how that information and data is organized, and governed inside an organization
Familiarity with industry best practices for collection and use of data
Outstanding problem-solving skills and the ability to navigate complex data challenges
Proven abilities to take initiative and be innovative
Analytical mind with a problem-solving aptitude
Effective communication and collaboration skills to work with both technical and non-technical stakeholders
MUST HAVE SKILLS:
Microsoft SQL Server
Microsoft Business Intelligence(SSIS,SSAS & SSRS)
Python
GCP Data Services
Tableau/PowerBI
Must be Local to GA
Skills Needed: GCP/Google Cloud, SQL, (SSIS,SSAS & SSRS), Python and Tableau/PowerBI
Data Engineer
Location: Alpharetta, GA (Hybrid - 2 Days in A Week)
Duration: 12+ Months
Job Description:
Responsibilities:
10+ years of experience in data engineering.
Design, develop, and maintain new data capabilities and infrastructure for utilizing, third-party, and partner data to enhance data products and solutions
Design, develop, and implement scalable data pipelines and ETL/ELT processes using SSIS, Python and API integrations
Identify existing data capability and infrastructure gaps or opportunities within and across initiatives and provide subject matter expertise in support of remediation
Collaborate with technical team and business stakeholders to understand data requirements and translate them into technical solutions
Work with large datasets, ensuring data quality, accuracy, and performance
Implement data transformation, integration, and validation processes to support analytics and reporting needs
Optimize and fine-tune data pipelines for improved speed, reliability, and efficiency
Implement best practices for data storage, retrieval, and archival to ensure data accessibility and security
Troubleshoot and resolve data-related issues, collaborating with the team to identify root causes
Document data processes, data lineage, and technical specifications for future reference
Review and analyze existing data collection systems, and make recommendations on improvement, maintenance, or other factors to improve the system.
Develop, build, and implement new data collection systems where needed.
Provide training and guidance on new systems that are being implemented.
Participate in code reviews, ensuring adherence to coding standards and best practices
Collaborate with other teams to automate deployment and monitoring of data pipelines
Proven experience in data engineering, with a strong track record of designing and implementing data solutions
Proficiency in programming languages such as Python, Java, or Scala, and experience with data processing frameworks (Spark, Hadoop, etc.)
In-depth understanding of data warehousing concepts, cloud platforms (GCP), and data modeling techniques
Strong knowledge of SQL and NoSQL databases, as well as data integration and transformation tools(SSIS)
Passion for and engagement with emerging trends in data, AI/ML, analytics, and digital experiences
Experience in data product development, analytical models, and model governance
Experience in anonymizing data and managing the use of data
Experience in data hygiene procedures, identity resolution capabilities or data management a plus
Familiarity with BI technologies (e.g. Microsoft Power BI, Tableau)
Ability to create strategies and plans that define how information can be utilized to support an organization's overall business strategy, and how that information and data is organized, and governed inside an organization
Familiarity with industry best practices for collection and use of data
Outstanding problem-solving skills and the ability to navigate complex data challenges
Proven abilities to take initiative and be innovative
Analytical mind with a problem-solving aptitude
Effective communication and collaboration skills to work with both technical and non-technical stakeholders
MUST HAVE SKILLS:
Microsoft SQL Server
Microsoft Business Intelligence(SSIS,SSAS & SSRS)
Python
GCP Data Services
Tableau/PowerBI