Lead Software Engineer, Data Platform
Apply NowCompany: Balyasny Asset Management L.P.
Location: Chicago, IL 60629
Description:
The Lead Software Engineer will be at the forefront of a small data platform team tasked with expanding the core components and APIs that BAM's engineers, analysts and researchers depend on for managing and accessing data.
The team sits as part of Core Data Platform, who manage the firms databases, warehouses, ETL and analytics systems, as well as a number of APIs that sit on top of those foundations.
Operating in a cloud-native, Kubernetes-based ecosystem, the team will focus on supporting existing data access APIs, a firmwide message bus, expanding data streaming architecture, building out new consolidated data access APIs on top of Iceberg and generally working to compose together a broad set of modern open source technologies to build a best-in-class data and analytics platform.
We are seeking a visionary player-coach who is passionate about crafting high-quality software, thrives on working with data in all its forms, and possesses intense drive to advance initiatives and achieve results. We are looking for leaders who are highly collaborative and who are excited to build products in partnership with stakeholder teams. We expect leads to bring ambitious vision for what a modern data platform can be as well as deep industry/open source awareness and engagement. Advocating for and championing the latest technologies is in your DNA.
Responsibilities of the Lead Software Engineer include:
QUALIFICATIONS AND REQUIREMENTS:
The team sits as part of Core Data Platform, who manage the firms databases, warehouses, ETL and analytics systems, as well as a number of APIs that sit on top of those foundations.
Operating in a cloud-native, Kubernetes-based ecosystem, the team will focus on supporting existing data access APIs, a firmwide message bus, expanding data streaming architecture, building out new consolidated data access APIs on top of Iceberg and generally working to compose together a broad set of modern open source technologies to build a best-in-class data and analytics platform.
We are seeking a visionary player-coach who is passionate about crafting high-quality software, thrives on working with data in all its forms, and possesses intense drive to advance initiatives and achieve results. We are looking for leaders who are highly collaborative and who are excited to build products in partnership with stakeholder teams. We expect leads to bring ambitious vision for what a modern data platform can be as well as deep industry/open source awareness and engagement. Advocating for and championing the latest technologies is in your DNA.
Responsibilities of the Lead Software Engineer include:
- Devising and developing solutions that capitalize on cloud-based data and distributed computing technologies, and a deep intuition on the open-source data ecosystem.
- Consulting with users of SDKs, APIs and Open source tools that we offer to improve the developer experience and assist them with best practices
- Partnering with end-users and collaborating with team members to clarify and expand upon requirements, as well as providing occasional first-level support.
- Employing creativity and lateral thinking to engineer high-performance solutions for loading and serving vast quantities of investment data.
- Working within a tightly-knit engineering team, deeply contributing to technical design discussions, code reviews, and overall team engagement.
- Producing software systems that are robust, well designed, rigorously tested, and meticulously documented.
- Mentoring and leading a small, skilled team of software engineers.
- Collaborating with leadership and stakeholders to plan future features and define the product roadmap.
QUALIFICATIONS AND REQUIREMENTS:
- A degree in Computer Science or a closely related field.
- Over 8 years of professional software development experience. Experience in the financial industry is a plus.
- Extensive software development experience in at least 2 object oriented programming languages - one must be Python or Golang
- A fervent desire to build robust data platforms.
- Profound knowledge of software engineering best practices, object-oriented principles, and the intricacies of data-centric development.
- Advanced knowledge of SQL both OLAP and OLTP database systems
- Experience with Data Lakes, with Iceberg familiarity a plus.
- Deep understanding of ETL and orchestration technologies. Familiarity with catalogs and metadata management a plus.
- Advanced knowledge of streaming systems including kafka and flink.
- Deep understanding of managing applications and infrastructure in cloud environments and strong experience with Kubernetes.
- Familiarity with fundamental DevOps practices, including continuous integration/continuous deployment (CI/CD) and infrastructure as code.
- Experience in at least one cloud environment, with a preference for those familiar with AWS.
- A self-starter mindset, with a penchant for experimentation, a habit of asking probing questions, and the ability to thrive in a fast-paced, agile setting.
- A continuous learner, eager to gain a comprehensive understanding of large and complex systems at every level, who enjoys delving into nuanced problems, conceiving innovative solutions, and conducting thorough tests to grasp both the positive and negative outcomes.