Data Engineer
Apply NowCompany: Sarian, Inc.
Location: New York, NY 10025
Description:
Software /Data engineer
Location- Weehawken, NJ & NYC, NY
Duration: 6-12 Months
Project Overview
The project is an initiation of a common data platform for all asset management data, like securities time series, security factors, portfolio holdings, benchmark holding and performance time series data scattered across different platforms and from different sources like database, flat files, Amazon S3 and through 3rd party web services.
The requirement is to load and store this data in a Cassandra based on the use cases and provide API layers on top of it, which will be data (raw or calculated) providing rest api for the analytical research teams.
Roles and Requirement
Highly productive, self-motivated self-starter
Working within and across Agile teams to design, develop, test, implement, and support core jave and big data technical solutions
Requirement analysis and conceptual modelling of cassandra schema
Design and implementation of data loading application to load Cassandra.
Extensive hands on experience on Core Java, Spring and Spark.
Knowledge of Spring Boot and Spring Integration preferred.
Good to have experience/knowledge of Apache Solr and Apache TinkerPop
Good to have experience/knowledge of Python scripting and Jupyter Notebook
Hands on experience on Cassandra through development, operations or data modelling.
DSE Cassandra table designs based on query pattern.
Other Requirements
Core Java, Spring(Experience in Spring Boot, Spring Data and Spring Integration preferred)
Apache Cassandra
Apache Spark (Core and Query)
Apache Solr (Search), Apache TinkerPop (Graph DB) Preferred
Python scripting and Jupyter Notebook Good to have
Location- Weehawken, NJ & NYC, NY
Duration: 6-12 Months
Project Overview
The project is an initiation of a common data platform for all asset management data, like securities time series, security factors, portfolio holdings, benchmark holding and performance time series data scattered across different platforms and from different sources like database, flat files, Amazon S3 and through 3rd party web services.
The requirement is to load and store this data in a Cassandra based on the use cases and provide API layers on top of it, which will be data (raw or calculated) providing rest api for the analytical research teams.
Roles and Requirement
Highly productive, self-motivated self-starter
Working within and across Agile teams to design, develop, test, implement, and support core jave and big data technical solutions
Requirement analysis and conceptual modelling of cassandra schema
Design and implementation of data loading application to load Cassandra.
Extensive hands on experience on Core Java, Spring and Spark.
Knowledge of Spring Boot and Spring Integration preferred.
Good to have experience/knowledge of Apache Solr and Apache TinkerPop
Good to have experience/knowledge of Python scripting and Jupyter Notebook
Hands on experience on Cassandra through development, operations or data modelling.
DSE Cassandra table designs based on query pattern.
Other Requirements
Core Java, Spring(Experience in Spring Boot, Spring Data and Spring Integration preferred)
Apache Cassandra
Apache Spark (Core and Query)
Apache Solr (Search), Apache TinkerPop (Graph DB) Preferred
Python scripting and Jupyter Notebook Good to have