AIA Senior Developer
Apply NowCompany: Avani Technology Solutions, Inc.
Location: Plano, TX 75025
Description:
1. Job Title : SR ASSOCIATE - LOOKING FOR AZURE DATA FACTORY 2. Job Summary : MICROSOFT CORTANA ANALYTICS 3. Shift : 9 Am to 6 PM EST 4. Roles & Responsibilities : Platform Engineer: As a part of the CTO organization the Global Data/ Analytics Architecture and Platform Engineering team has built and operates a state-of-the-art Advanced Analytics platform to enable world-class technology capabilities to accelerate PepsiCo's global growth across all the businesses. We are responsible to build Data/Delta lakes by sourcing data from businesses around the globe to promote PepsiCo's Advanced Analytics capabilities to the next level. We are always exploring suitable cutting-edge technologies to enhance data management Natural Language Query/generation AI/ML federated querying faster Real-time and Batch data ingestion/extracts semantic data layer data virtualization layer Integrated Data Fabric etc. capabilities on Advanced Analytics platform. We are looking for a Platform Engineer to join our team to strengthen the current Advanced Analytics capabilities provide technical architectural solutions for given business use cases and explore and implement suitable latest tools and technologies on our platform. - This role is responsible for Solution Architecture Design development test and implement Advanced Analytics capabilities at PepsiCo. - This role is to explore evaluate experiment and implement suitable cutting-edge technologies to enhance data management Batch and Streaming Analytics Natural Language Query/generation AI/ML federated querying faster Real-time and Batch data ingestion/extracts semantic data layer data virtualization layer Integrated Data Fabric etc. capabilities on Advanced Analytics platform. - This role will be required to evaluate new tools and technologies to recommend their fit for our Advanced Analytics platform. - This role is expected to explore and evaluate emerging Enterprise Data Science platforms to build and operationalize complex AI/ML models then implement the selected Data Science platform as a self-service platform. - This role is expected to support several groups in GD&A (Advanced Analytics solution development Advanced Visualization Data Technologies). - This role will require leading both technology and application solutions in the advanced analytics space. Qualifications: - BA/BS required preferably in Computer Science Data Analytics Data Architecture Required Skill set: - 5+ years of experience in Hadoop ecosystem (Ex: Hive Spark Kafka Hbase Oozie Sqoop etc) - 3 to 5 years of hands-on experience in architecting designing and implementing data ingestion pipes for batch real-time and streams on Azure cloud platform at scale - 1 to 3 years of experience in using ETL tools like ADF Infoworks Nifi or similar tools especially for a large volume of data - 1 to 3 years of hands-on experience on Databricks - 3 to 5 years of hands-on experience with Azure cloud especially with Spark ADLS and Blob storage etc technologies - 1 to 2 years of experience on distributed querying tools like Presto or similar tools - 1 to 2 years of experience on virtualization tools like Denodo or similar tools - 1 to 3 years of experience in evaluating emerging technologies is required - Having exposure/experience in Snowflake or Synapse is an added advantage - Having experience in extracting/querying/Joining a large number of data sets at scale is essential - Highly analytical motivated decisive thought leader with solid critical thinking ability to quickly connect technical and business 'dots' - Has strong communication and organizational skills and able to deal with ambiguity while juggling multiple priorities and projects at the same time - Able to understand statistical solutions and execute similar activities Good