Database Engineer

About the job

We are seeking a Senior Database Engineer with 6+ years of experience to join our Data Platform team. You will design, prototype, and optimize complex data workflows and architectures, focusing on SQL optimization, Python development, and data-driven analysis. This role requires advanced technical expertise and the ability to work collaboratively with the product manager and software architect.

Key Responsibilities

• Design, develop, and optimize complex SQL queries and Python macros for data transformations within the DuckDB framework.
• Implement advanced data normalization and denormalization strategies to ensure data integrity and performance.
• Perform data pipeline transformations and integrate statistical and ML methods into SQL and Python workflows.
• Collaborate with cross-functional teams to define data architecture and enhance the lb_duckdb_manager's functionality.
• Ensure high performance and scalability of database operations through performance tuning and effective indexing strategies.
• Manage changes that need to ripple across tables in the dataset, leveraging efficient update processes and monitoring tools.
• Write platform-grade Python code while adhering to best practices and coding standards.
• Mentor junior developers, sharing expertise in database design and SQL transformations.

Job Requirements

• 6+ years of relevant work experience
• Expertise in Database Design, Query Engine Design, Database storage engines
• Excellent ability to map business domains to data models
• Excellent written and spoken communication skills
• Advanced SQL Development: Optimize complex queries (CTEs, window functions, pivots, grouping sets) in DuckDB and PostgreSQL.
• Data Pipeline Design: Build and optimize data workflows using Python and modern tools like Spark, DBT, Kafka, Dagster, and Flink.
• Exploratory Data Analysis (EDA): Apply statistical methods and machine learning principles to derive insights and drive decision-making.
• Integration of GenAI Tools: Work seamlessly with tools in IDE environments (Visual Studio Code, Jupyter Notebook).
• DataOps and DevOps: Design and optimize pipelines, manage Git-based version control, and implement CI/CD workflows.
• Collaboration: Document requirements and analysis, communicate effectively with clients, and contribute to a user-centric development process.
• Our office is located in Collingwood, Ontario. You must be willing to come to the office twice a week.

How To Apply

Please send your cover letter and resum to Nathalie Burstein at info@liquidanalytics.com. Be sure to include the title of the job youre applying to.