Data Warehouse Developer
Apply NowCompany: Technogen International Company
Location: Saint Paul, MN 55106
Description:
Looking for a Data Warehouse Developer to help install and maintain a CDC for US Bank. They will be moving tables to a secondary DB2 Database and the CDC will be used for the move/capture of the Data. Are you available for new roles?
US Bank - Data Warehouse Developer/CDC Lead
Richfield MN with some remote
12 months +
Project Details:
Install and configure IBM InfoSphere CDC (Change Data Capture)
Would also like to have scheduled data analytics reporting if not real-time, then at least daily or 3 times a day.
Also would like to store the data as OLTP (90 days), OLAP (historical data), and add Hadoop to keep 7 years of data.
Day to Day:
There are no DBAs on is team, so this role will manage the IBM InfoSphere CDC application
assist the Cognos team with the OLTP transactional database and with OLAP database side.
Assist with running replication jobs to move the between the databases and then do the reporting.
Tech Stack:
DB2 OLTP (Transactional Database) plus a second DB2 OLAP (Analytical Database) via Replication jobs between the 2 databases.
Cognos Data Modeler creates the OLAP dimensional data modeling and mappings. Not using ETL, but may look into IBM DataStage.
1400 tables in the OLTP, but 300 designated for the reporting OLAP database for the developer to utilize for reporting.
They have a scripted run tool that builds the SQL (Hive?) queries. Delimiters can be changed. Using Bash/Unix shell scripting also.
Must Have:
Advanced SQL
IBM CDC (Change Data Capture) - need to be comfortable working in an environment where it isn't already set up.
Strong Plus:
DB2
Hadoop
AIX/Linux/Unix Scripting
IBM DataStage ETL or similar ETL
Required Skills : Advanced SQL IBM CDC (Change Data Capture) - need to be comfortable working in an environment where it isn't already set up. Wikipedia's CDC External Links LinkedIn Databus griddable.io Change Data Capture (based on Databus) - http://www.griddable.io HVR Change Data Capture - https://www.hvr-software.com/product/change-data-capture/ Attunity Change Data Capture (CDC) IBM Infosphere CDC Tutorial on setting up CDC in Oracle 9i Oracle GoldenGate Replication Oracle Data Integrator Tutorial on setting up SQL Azure Change Data Capture Details of the CDC facility included in Microsoft Sql Server 2008 Feb '08 CTP Gamma Soft DataDistribution BackOffice DBMoto, real-time data replication and change data capture Debezium, open-source change data capture platform with support for MySQL, PostgreSQL and others
Basic Qualification :
Additional Skills :
Background Check :Yes
Notes :
Selling points for candidate :
Project Verification Info :
Candidate must be your W2 Employee :No
Exclusive to Apex :No
Face to face interview required :No
Candidate must be local :No
Candidate must be authorized to work without sponsorship ::No
Interview times set :Yes
Type of project :Development/Engineering
Master Job Title :Dev: Other
Branch Code :Minneapolis
US Bank - Data Warehouse Developer/CDC Lead
Richfield MN with some remote
12 months +
Project Details:
Install and configure IBM InfoSphere CDC (Change Data Capture)
Would also like to have scheduled data analytics reporting if not real-time, then at least daily or 3 times a day.
Also would like to store the data as OLTP (90 days), OLAP (historical data), and add Hadoop to keep 7 years of data.
Day to Day:
There are no DBAs on is team, so this role will manage the IBM InfoSphere CDC application
assist the Cognos team with the OLTP transactional database and with OLAP database side.
Assist with running replication jobs to move the between the databases and then do the reporting.
Tech Stack:
DB2 OLTP (Transactional Database) plus a second DB2 OLAP (Analytical Database) via Replication jobs between the 2 databases.
Cognos Data Modeler creates the OLAP dimensional data modeling and mappings. Not using ETL, but may look into IBM DataStage.
1400 tables in the OLTP, but 300 designated for the reporting OLAP database for the developer to utilize for reporting.
They have a scripted run tool that builds the SQL (Hive?) queries. Delimiters can be changed. Using Bash/Unix shell scripting also.
Must Have:
Advanced SQL
IBM CDC (Change Data Capture) - need to be comfortable working in an environment where it isn't already set up.
Strong Plus:
DB2
Hadoop
AIX/Linux/Unix Scripting
IBM DataStage ETL or similar ETL
Required Skills : Advanced SQL IBM CDC (Change Data Capture) - need to be comfortable working in an environment where it isn't already set up. Wikipedia's CDC External Links LinkedIn Databus griddable.io Change Data Capture (based on Databus) - http://www.griddable.io HVR Change Data Capture - https://www.hvr-software.com/product/change-data-capture/ Attunity Change Data Capture (CDC) IBM Infosphere CDC Tutorial on setting up CDC in Oracle 9i Oracle GoldenGate Replication Oracle Data Integrator Tutorial on setting up SQL Azure Change Data Capture Details of the CDC facility included in Microsoft Sql Server 2008 Feb '08 CTP Gamma Soft DataDistribution BackOffice DBMoto, real-time data replication and change data capture Debezium, open-source change data capture platform with support for MySQL, PostgreSQL and others
Basic Qualification :
Additional Skills :
Background Check :Yes
Notes :
Selling points for candidate :
Project Verification Info :
Candidate must be your W2 Employee :No
Exclusive to Apex :No
Face to face interview required :No
Candidate must be local :No
Candidate must be authorized to work without sponsorship ::No
Interview times set :Yes
Type of project :Development/Engineering
Master Job Title :Dev: Other
Branch Code :Minneapolis