Sr. Data Engineer with Data Bricks

Apply Now

Company: Omni Inclusive

Location: Houston, TX 77084

Description:

Job description :
  • 7 years or more relevant software development experience with a fairly "Full Stack " profile
  • Experience of delivery within a trading environment.
  • Experience working in fast- paced project delivery using AGILE methods
  • Strong software development skills, knowledge of best practices (SOLID, CI/CD, etc.)
  • Python 3
  • Creating applications and packages
  • Writing reliable unit and end-to-end tests with PyTest
  • Data manipulation with Pandas
  • Web development with Python
  • MS Azure: virtual networks, key vaults and storage, security
  • MS DevOps pipelines
  • Kubernetes containers
  • ReactJS front end development experience
  • MS SQL backend development experience
  • Experience in developing API's in python using FastAPI
  • Hands on in ADF and Azure Databricks
Desirable:
  • Knowledge of physical commodities trading markets and organisations (esp. Client/ gas/oil).
  • Useful to have Data Engineering experience blended along with core software engineering experience
  • Experience of working directly with traders on trader models.
  • Python: Bokeh visualization, Tornado web framework, asyncio programming, Azure Python API
  • Hashicorp Terraforms (azurerm)
  • Kafka Confluent
  • Conda package management
  • Basic knowledge in numerical calculus, such as multi-dimensional function interpolation, numerical differentiation
  • Basic understanding of the WebSockets protocol
  • Knowledge of the OAuth2 and web security
  • Basic knowledge of modern JavaScript, TypeScript, Node.js
Personal Attributes:
  • determined focus on the user and user experience when problem- solving
  • Team player and able to collaborate, proactively communicates and shares understanding and experience within a team
  • Clear communicator and able to work in a multicultural/lingual environment
  • Uses initiative and owns their deliverables end-to-end
  • Brings ideas to the table, is inquisitive and excited by new technology
  • Used to working in a flexible, independent manner on a mixture of small unstructured and large structured items
  • Provides regular, considered feedback and regularly strives to improve their own ways of working

Similar Jobs