AWS data engineer
Apply NowCompany: SysMind Tech
Location: Newark, NJ 07104
Description:
Skill: AWS Data Engineer
Responsibilities:
- Experience in AWS Glue, Lambda, Atpersonna, Pyspark, Redshift, EMR, AWS RDB, AWS DynamoDB, AWS Glacier, Python.
- Minimum 5 years of professional experience in data integration and management.
- 3+ years of hands on development experience in AWS Glue, Lambda functions, AWS Atpersonna, Redshift, Pyspark.
- Hands on working experience in AWS GLUE ETL tool and having good knowledge on any of tperson ETL tools(Informatica cloud,Talend etc.).
- Must have working experience with SQL, and databases (e.g.: Postgres, Redshift) implementing Data Models.
- Expertise with Python Language and Apacperson Spark. Have working experience in projects involving these.
- Strong hands on exposure to AWS Analytics services particulary Lambda,Step functions,EMR, Athena, Glue, Data-Pipelines.
- Understanding and technical knowledge on AWS service like EC2, S3. Should have used these technologies in previously executed projects.
- Strong AWS development experience for data ETL/pipeline/integration/automation work. Should have a deep understanding of BI & Analytics Solution development lifecycle.
- Full Flexed in AWS cloud development & Automation for Analytics.
- Should have a deep understanding of AWS Services (Redshift, Glue, Lambda, Athena, S3, EC2), Visual Studio, SQL Server, SSIS, Matillion; Python.
- Strong experience on real-time scalable workflow implementation.
Responsibilities:
- Developer will be part of an Agile Development team focusing on Sprint Agile implementation.
- Developer will be developing data ingestion pipelines from personterogenous sources like databases, Files, APIs, Kafka streaming etc using a variety of services.
- Developer may be assigned to deliver tperson data from AWS data platform for different consumption use cases and services.
- Developer may be engaged in peer reviews to ensure code accuracy and well architected architecture and implementation.
- Developer may be asked to do client demo or anotperson project demo.
- Developer must be proactive in escalating impacting issues and be resourceful to look for alternative.
- Developer may have to work on tight timelines sometimes.