Data Engineering and BI Systems Lead

What Can I Expect to do in this Role?

• Manage and deploy OTF’s enterprise data infrastructure for analytics and BI systems

• Develop, test, and maintain OTF’s data warehouse architecture in Microsoft Azure – experience with Databricks is preferred

• Manage a trusted and reliable set of data sources for analytics applications and BI dashboards

• Oversee ETL development, including the design, implementation, and scaling of new data pipelines, transformation of raw data into data models using Databricks or other tools

• Optimize existing infrastructure and pipelines, including troubleshooting and solving production problems

• Oversee CI/CD processes and source control management using Azure DevOpsIdentify ways to improve data quality in collaboration with MEBI team members

• Inform data governance strategy, providing feedback on data issues and vulnerabilities, and acting as an advocate and driver of OTF data policies and principles 

• Ensure data security, privacy, and compliance with relevant regulations and organizational policies (e.g. FIPPA, Privacy Policy, Information Management Policy, Information Classification Standard, Records Retention Schedules, etc.)

• Act as primary liaison between IT, business units, and MEBI teams to ensure alignment of data solutions with organizational goals

• Lead the operationalization of BI strategy including data storage, management, and access, in collaboration with Measurement, Evaluation and Business Intelligence department team members 

• Support the OTF’s annual BI plan with general guidance to the Director, MEBI, and carries out approved BI initiatives and projects

• Lead the development and implementation of BI solutions from a people, process and technology perspective, including an integrated strategy for upskilling team members, operational process optimization, and systems enhancements

• In collaboration with other MEBI team members and the Director, participate in the development and execution of analytics roadmap strategies, business cases, RFP/RFI submissions, cost-benefit analysis and benefits realization deliverables.

• Informs the BI budget with general guidance to the Director MEBI and in collaboration with the Director, IT.

Skills and Attributes

• Strong background in distributed data systems and lakehouse architectures as they relate to BI concepts, methods, tools and technologies

• Experience with Microsofts’ Azure environment (ADLS, Logic Apps, Function Apps, Azure Data Factory ,) - Azure Databricks experience with PySpark & SQL is preferred

• Experience with programming in SQL, Python and/or others (i.e. R, Spark, PowerShell, Bash) to support data modeling, cleaning, integration, and cloud automation.

• Experience designing and managing enterprise-wide cloud data and analytics infrastructure, including lakehouse environments, data modeling, ETL pipelines, and analytic tools

• Experience in designing data systems from initial architecture to implementation and optimization.

• Demonstrated experience designing, implementing, and maintaining CI/CD pipelines and Git repositories Project management skills including the ability to effectively manage and prioritize the implementation of multiple projects in the data systems, with competing timelines and deliverables.

• Knowledge of Data Governance tools and workstreams, including data catalogues, metadata, data quality and/or others.

• Ability to translate business needs into BI solutions for diverse stakeholders

• Ability to stay up to date on new and existing programs and software tools that may be relevant to OTF’s BI needs

• Willingness and ability to travel occasionally, primarily within Ontario.

• Bilingualism is an asset.

• A team player with a sense of humour.

Core Competencies

• Pursuit of Excellence/Accountability: Take ownership and delivers

• Agility: Embrace change and ambiguity

• Collaboration: Working together with others to leverage skills, talents, and knowledge 

• Critical Thinking: Interpret, evaluate, and analyze facts and information

• Inclusion: Embrace all people irrespective of race, gender identity, disability

How Do I Qualify?

• Minimum 1 year direct experience in Enterprise Data Warehouse technologies and distributed systems

• Minimum 1 year hands on experience developing data warehousing, data lakes, batch processing, and extract transform load (ETL) workflow solutions 

• Minimum 1 year direct experience designing and optimizing SQL database architecture

• Expertise in developing software code in one or more languages (SQL, Python, Java, Spark).

• Experience and demonstrated success in project management.

• Familiarity with PowerBI and Sharepoint

• Experience with Databricks (Delta Lake, Unity Catalog, Lakehouse Architecture, Databricks SQL Warehouses, Databricks Asset Bundles, etc.)

• Experience with Azure DevOps or other Git version control systems

• Experience working with third-party APIs to ingest data for analytics purposes. 

• Bachelor’s degree in computer science or related degree or equivalent work experience

• Preferred: Azure Data Engineering certification 

We invite applications from people who reflect the diverse communities we serve, including Indigenous (First Nation, Métis and Inuit) and Black peoples.

Acknowledgements

• We welcome applications from people who are reflective of the diverse communities we serve, including those who might need accommodation.
• OTF is committed to accommodating applicants with disabilities throughout the hiring process, in accordance with the Accessibility for Ontarians with Disabilities Act (AODA). This job posting falls under the Public Service of Ontario Act, 2006
• OTF is committed to building a diverse and inclusive organization for all individuals in our workplaces, which includes supporting people living with disabilities, people from the Black, Indigenous, People of colour and from 2SLGBTQIA+ communities
• OTF is a certified Positive Space employer, which means we create and promote safe spaces for 2SLGBTQIA+ communities.

• The use of AI is not used to screen, assess, or select applicants

• While we thank all applicants for their interest, only those selected for an interview will be contacted.

Application Deadline: December 3, 2025