Big Data Application Developer

Big Data Application Developer

6 Months

Downtown, Toronto (Hybrid)

Daily Responsibilities:

• Design and implement solutions that meet the stakeholder's needs
• Participate actively in requirements gathering, data modeling and design sessions
• Develop detailed plans and accurate estimates for completion of build, system testing and implementation phases of project
• Develop, code, document and execute unit tests, systems, integration and acceptance tests and testing tools for functions of high complexity
• Write, test and maintain detailed programs according to specifications given by computer software engineers and systems analysts
• Provide input and coordinates with Database Analyst in creating new and modifying existing database structures using different types of databases
• Conceive, design and test logical structures for solving technical problems
• Participate in walkthrough reviews of all technical specifications, programs and unit test plans
• Perform performance tuning to improve performance over multiple functions
• Provides consulting services on new and existing initiatives

Must-have Skills/Experiences and/or Education, certifications, qualifications, designations:

• 5+ years of application development experience in Spark/Scala with big data
• 5+ years of experience working on Hadoop platform
• Extensive knowledge of processing Petabytes scale data with high degree of parallelism
• Experience in developing highly performant code using Spark/Scala framework.
• Ability to work with data structures & code optimization
• Ability to write SQL/hive queries
• Helios / Jenkins or any other combination DevOps
• Experience in writing Unit test cases & perform thorough unit testing.
• Experience with Unix/ SQL