Data Platform Engineer
Apply NowCompany: Avani Technology Solutions, Inc.
Location: Rochester, NY 14609
Description:
Position: Data Platform Engineer
Location: Rochester, NY
Duration: 12+ Months
Hadoop and Informatica experience are a MUST
Description:
The Data Platform Engineer engages in the design, development and maintenance of the big data platform. This platform hosts structured and non-structured data sets that support various business operations and enable data-driven decisions. The role involves administering various data-hub ecosystem open source software tools along with other vendor supported tools like HortonWorks Hadoop, CISCO DV, IBM COGNOS tools. The DPE will work closely with Data Scientists, infrastructure Administrators and Data Platform Architects to ensure the platform meets business demands.
Essential Resource Responsibilities / Accountabilities: Level I- Installs and /or upgrades, configures, administers and troubleshoots the data hub software environment in order to achieve a reliable, highly available, well performing system- Provides direct technical support to data warehouse user community, and triages support to appropriate personnel when technical support is not sufficient.- Develops standards, policies and procedures for the form, structure and attributes of the data warehouse tools and systems - Develops data/information quality metrics- Develops processes to monitor cluster performance and resource usage- Works with Server Engineers to install new nodes, resolve node failures, and apply patches and upgrades- Maintains processes that feed data from various systems across the enterprise, ensuring data quality and process efficiency- Follows and helps streamline procedures for provisioning access to the BI system and establishing security Minimum Resource Qualifications:- Bachelor's degree in Information Technology, Computer Science, Software Engineering, or closely related field (or four additional years related work experience in lieu of bachelors)- Related work experience (i.e. Co-ops/Internships) preferred- Ability to take initiative and have a strong vision for driving large scale distributed data platforms- Experience with ecosystem components such as Hadoop, Cisco DV, Cognos, etc- Familiarity with Linux system administration, Linux scripting and networking skills- Proficiency in a programming language such as Python or Java is a plus- Experience with relational and NoSQL databases, including modeling and writing complex queries is a plus- MUST have EXCELLENT communication and
analytical skills Level I - Ability to perform routine tool maintenance working with the vendors and others on the team- Ability to identify data warehouse application and data issues- Monitor system uptime and performance- Escalate appropriately to management and/or more senior Tool Administrators- Minimum of 3 years' experience in tool administration- Demonstrated experience with Data Warehousing- Proactively identify and address risks on system before they become systems issues- Research and resolve data warehouse application and data issues
Physical Requirements- Ability to travel across regions Physical Requirements: In support of the Americans with Disabilities Act, this resource requirements document lists only those responsibilities and qualifications deemed essential to the position Equal Opportunity
Employer: As such, requires all suppliers of temporary staffing resources to affirm the rights of every person to participate in all aspects of employment without regard to race, color, sex/gender, age, disability, religion, creed, citizenship status, national origin, veteran status, military status, marital status, familial status, domestic violence victim status, sexual orientation, gender identity, predisposing genetic characteristic, genetic information, or any other status protected under the law
Location: Rochester, NY
Duration: 12+ Months
Hadoop and Informatica experience are a MUST
Description:
The Data Platform Engineer engages in the design, development and maintenance of the big data platform. This platform hosts structured and non-structured data sets that support various business operations and enable data-driven decisions. The role involves administering various data-hub ecosystem open source software tools along with other vendor supported tools like HortonWorks Hadoop, CISCO DV, IBM COGNOS tools. The DPE will work closely with Data Scientists, infrastructure Administrators and Data Platform Architects to ensure the platform meets business demands.
Essential Resource Responsibilities / Accountabilities: Level I- Installs and /or upgrades, configures, administers and troubleshoots the data hub software environment in order to achieve a reliable, highly available, well performing system- Provides direct technical support to data warehouse user community, and triages support to appropriate personnel when technical support is not sufficient.- Develops standards, policies and procedures for the form, structure and attributes of the data warehouse tools and systems - Develops data/information quality metrics- Develops processes to monitor cluster performance and resource usage- Works with Server Engineers to install new nodes, resolve node failures, and apply patches and upgrades- Maintains processes that feed data from various systems across the enterprise, ensuring data quality and process efficiency- Follows and helps streamline procedures for provisioning access to the BI system and establishing security Minimum Resource Qualifications:- Bachelor's degree in Information Technology, Computer Science, Software Engineering, or closely related field (or four additional years related work experience in lieu of bachelors)- Related work experience (i.e. Co-ops/Internships) preferred- Ability to take initiative and have a strong vision for driving large scale distributed data platforms- Experience with ecosystem components such as Hadoop, Cisco DV, Cognos, etc- Familiarity with Linux system administration, Linux scripting and networking skills- Proficiency in a programming language such as Python or Java is a plus- Experience with relational and NoSQL databases, including modeling and writing complex queries is a plus- MUST have EXCELLENT communication and
analytical skills Level I - Ability to perform routine tool maintenance working with the vendors and others on the team- Ability to identify data warehouse application and data issues- Monitor system uptime and performance- Escalate appropriately to management and/or more senior Tool Administrators- Minimum of 3 years' experience in tool administration- Demonstrated experience with Data Warehousing- Proactively identify and address risks on system before they become systems issues- Research and resolve data warehouse application and data issues
Physical Requirements- Ability to travel across regions Physical Requirements: In support of the Americans with Disabilities Act, this resource requirements document lists only those responsibilities and qualifications deemed essential to the position Equal Opportunity
Employer: As such, requires all suppliers of temporary staffing resources to affirm the rights of every person to participate in all aspects of employment without regard to race, color, sex/gender, age, disability, religion, creed, citizenship status, national origin, veteran status, military status, marital status, familial status, domestic violence victim status, sexual orientation, gender identity, predisposing genetic characteristic, genetic information, or any other status protected under the law