Hadoop-Lead
Apply NowCompany: Futran Tech Solutions Pvt. Ltd.
Location: Dublin, CA 94568
Description:
Must have - Experience in developing Hadoop (Sqoop, Hive, Oozie, Ambari, and Hive SQL), Netezza (Stored Procedures, Bash Scripting)
Required and Preferred skillsets:
Experience in developing Hadoop
Required Data Modeling experience
Required experience in Hive, Oozie, Ambari, and Hive SQL
Required data warehousing experience
System Integration knowledge required
Netezza experience preferred
Retail experience preferred
Extract Transform Load (ETL) experience, bash scripting
Knowledge in Master Data Management (MDM) desirable
Experience with a BI reporting framework (such MicroStrategy, MicroSoft, etc.) is a plus.
ESSENTIAL DUTIES AND RESPONSIBILITIES & CORE ACCOUNTABILITIES
Work with stakeholders to understand their information needs and translate these into business functional and technical requirements and solutions.
Design and develop service oriented applications that encompass both ETL processes in the backend and the web service presentation layer that are performant and scalable.
Analyze complex data systems and document data elements, data flow, relationships and dependencies to contribute to conceptual, logical and physical data models.
Perform thorough testing and validation to ensure the accuracy of reports and transformations.
Ensure data quality and data governance; create/maintain data dictionary and related metadata.
Collaborate in the planning, design, development, test, and deployment of new BI solutions.
Provide production support for new and existing BI solutions. Resolve issues with reports and data as identified by users.
Ability to understand and effectively communicate at both a business and technical level.
Good understanding of the challenge and various solutions in handling large data volume, whether in terms of complex SQL queries and stored procedures, or brute-force caching, or paradigms of parallel processing.
Experience in designing and deploying production supported dimensional models, star schemas, and/or data marts.
Able to find creative solutions and move quickly to deliver them.
Strong ability to collaborate with team members throughout the process and consult with other project teams on the design and use of enterprise data.
Good written and oral communication skills and a desire to educate co-workers and business users about our data and how to access it.
Participates in systems design, working within an established framework.
Performs coding and/or configuration to meet documented needs, utilizing standard procedures and techniques.
Interfaces with business analysts and/or customers to clarify requirements.
Contributes to the development of test plans and participates in post-implementation reviews.
Provide daily operational support for production systems including providing on-call support.
Writes documentation that describes installation and operating procedures.
Demonstrates understanding of application development methods, as well as the fundamentals of requirement specification, design, coding, and testing of business applications systems.
Has a strong working understanding of installed systems, with the ability to troubleshoot and resolve many problems on the existing system(s) supported.
Demonstrates proficiency with one or more technology environments, with the ability to learn and apply new and emerging concepts very quickly.
Demonstrates familiarity and strong working knowledge of the relevant programming languages/tools for the application area
Builds and maintains a strong working knowledge of the business area(s) supported and the applications that support it.
Participates in technical design, contributing insights and ideas.
Successfully troubleshoots most applications problems independently, determining the root cause and fixing the problem.
Contributes to the development of project plans, identifies key milestones, and raises critical project issues such as resource needs and contingencies.
May be responsible for completion of a phase or component of a project.
Collaborate on code reviews, internal processes, and software enhancements.
Required and Preferred skillsets:
Experience in developing Hadoop
Required Data Modeling experience
Required experience in Hive, Oozie, Ambari, and Hive SQL
Required data warehousing experience
System Integration knowledge required
Netezza experience preferred
Retail experience preferred
Extract Transform Load (ETL) experience, bash scripting
Knowledge in Master Data Management (MDM) desirable
Experience with a BI reporting framework (such MicroStrategy, MicroSoft, etc.) is a plus.
ESSENTIAL DUTIES AND RESPONSIBILITIES & CORE ACCOUNTABILITIES
Work with stakeholders to understand their information needs and translate these into business functional and technical requirements and solutions.
Design and develop service oriented applications that encompass both ETL processes in the backend and the web service presentation layer that are performant and scalable.
Analyze complex data systems and document data elements, data flow, relationships and dependencies to contribute to conceptual, logical and physical data models.
Perform thorough testing and validation to ensure the accuracy of reports and transformations.
Ensure data quality and data governance; create/maintain data dictionary and related metadata.
Collaborate in the planning, design, development, test, and deployment of new BI solutions.
Provide production support for new and existing BI solutions. Resolve issues with reports and data as identified by users.
Ability to understand and effectively communicate at both a business and technical level.
Good understanding of the challenge and various solutions in handling large data volume, whether in terms of complex SQL queries and stored procedures, or brute-force caching, or paradigms of parallel processing.
Experience in designing and deploying production supported dimensional models, star schemas, and/or data marts.
Able to find creative solutions and move quickly to deliver them.
Strong ability to collaborate with team members throughout the process and consult with other project teams on the design and use of enterprise data.
Good written and oral communication skills and a desire to educate co-workers and business users about our data and how to access it.
Participates in systems design, working within an established framework.
Performs coding and/or configuration to meet documented needs, utilizing standard procedures and techniques.
Interfaces with business analysts and/or customers to clarify requirements.
Contributes to the development of test plans and participates in post-implementation reviews.
Provide daily operational support for production systems including providing on-call support.
Writes documentation that describes installation and operating procedures.
Demonstrates understanding of application development methods, as well as the fundamentals of requirement specification, design, coding, and testing of business applications systems.
Has a strong working understanding of installed systems, with the ability to troubleshoot and resolve many problems on the existing system(s) supported.
Demonstrates proficiency with one or more technology environments, with the ability to learn and apply new and emerging concepts very quickly.
Demonstrates familiarity and strong working knowledge of the relevant programming languages/tools for the application area
Builds and maintains a strong working knowledge of the business area(s) supported and the applications that support it.
Participates in technical design, contributing insights and ideas.
Successfully troubleshoots most applications problems independently, determining the root cause and fixing the problem.
Contributes to the development of project plans, identifies key milestones, and raises critical project issues such as resource needs and contingencies.
May be responsible for completion of a phase or component of a project.
Collaborate on code reviews, internal processes, and software enhancements.