Senior AbInitio Data Engineer
Apply NowCompany: Cynet Systems
Location: Reston, VA 20191
Description:
Job Description:
Essential Functions:
Essential Functions:
- Work with Business Analysts and Product team to gather data requirements.
- Design and Build AbInitio data graphs and data pipelines to extract the data various databases/flat files/message queues.
- Transform the data to create a consumable data layer for various application uses.
- Support Data pipeline with bug fixes, and additional enhancements.
- Document Technical design ,Operational Runbook etc.
- To perform this job successfully, an individual must be able to perform each essential duty satisfactorily.
- The requirements listed below are representative of the knowledge, skill, and/or ability required.
- Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
- Education Level: Bachelor's Degree.
- Education Details: Computer Science, Information Technology or Engineering or related field.
- Total of 10+ Years of IT Experience predominantly in Data Integration/ Data Warehouse area.
- Must have at least 5 years of ETL Design and Development experience using Ab Initio.
- 1-2 years of Data Integration project experience on Hadoop Platform, preferably Cloudera.
- bInitio CDC ( Change Data Capture ) experience in a Data Integration/ETL project setting is great to have.
- Working knowledge of HDFS, Hive, Impala and other related Hadoop technologies
- Working knowledge in various AWS services is nice to have.
- Sound understanding of SQL and ability to write well performing SQL queries.
- Good knowledge of OLTP and OLAP data models and other data warehouse fundamentals.
- Rigor in high code quality, automated testing, and other engineering best practices, ability to write reusable code components.
- bility to unit test the code thoroughly and to troubleshoot issues in production environments.
- Must have some working experience with Unix/Linux shell scripting.
- Must be able to work independently and support other junior developers as needed
- Some Java development experience is nice to have.
- Knowledge of Agile Development practices is required.