AI initiative registry

Every initiative listed in the registry can be consulted here, without an account. Each record shows its progress, its milestones and the history of its decisions. Requests still under triage do not appear: they join the registry once reviewed.

Perception and Understanding

AI that interprets the world, whether through text, images, or sound.

What is “Perception and Understanding”?

This category includes AI systems that sense, interpret, or perceive data from the environment, emulating human senses like sight, sound, touch, smell, and language comprehension. These capabilities form the foundation of AI awareness, enabling systems to extract meaning from unstructured inputs like text, images, video, audio, or environmental signals.

Perception and Understanding
Subcategory	Description	Examples
Language understanding — Natural Language Processing (NLP)	Understanding and generating human language	Chatbots, document summarization
Computer vision	Understanding images, video, and spatial data	Object detection, satellite imagery analysis, species ID
Speech recognition	Converting audio to text	Voice-to-text for transcription, voice-based commands for virtual assistants
Multimodal AI	Combining input types (text + images, etc.)	Image captioning, document understanding tools
Olfactory AI (artificial smell recognition)	Detecting and interpreting smells using e-noses	Gas leak detection, spoilage sensing, pollutant ID in fish labs
Haptic AI (artificial touch sensing)	Interpreting touch and tactile feedback	Robotic sampling, pressure detection, texture, temperature
Audio event detection	Recognizing non-speech sounds	Marine mammal calls (whale song), mechanical alerts, engine noise anomaly detection
Sensor fusion AI	Combining multiple sensory inputs	Autonomous underwater vehicle navigation, habitat monitoring

Key indicator: If the AI’s primary task is to interpret raw input (e.g. image, text, sound, sensor data), this is where it belongs.
Common input types: Visual data (images, video)

Audio and speech

Natural language text

Sensor readings (e.g. haptics, chemical, temperature)

Filter 1

Search titles and descriptions

Sector

Program

Stage

Region

Strategic alignment

AI category

AI sub-category

AI capability

Prime Minister's mandate commitment

Scope

Declared to TBS On hold

Reset

71 current initiative(s)

AI initiative registry
ID	AI Initiative	Stage	Description	Sector	Region	AI Bucket	SME
189	Site Assessments	Ideation On hold On hold	Automatically assess presence of eel grass from drone video Solution being developped to assist Fish and Fish Habitat Protection Program in...	Indigenous Affairs, Aquaculture and Governance	Gulf	Perception and Understanding	Dupuis, Marc
191	Irish Moss Research	Ideation On hold On hold	Automatically and non-invasively detect and assess health of Irish Moss Solution being developed for Science to review hundreds of hours of...	Indigenous Affairs, Aquaculture and Governance	Gulf	Perception and Understanding	Dupuis, Marc
192	Harbour Assessments	Ideation On hold On hold	Automatically and continuously assess harbour conditions via drone and satellite imagery Solution being developed for Small Craft harbours t...	Indigenous Affairs, Aquaculture and Governance	Gulf	Perception and Understanding	Dupuis, Marc
162	Recherche et développement d’outils de vision automatisée pour l’étude des refuges marins des coraux et des éponges du golfe du Saint-Laurent. Not translated · original: French	Ideation	Projet de contribution avec le Centre de développement et de recherche en intelligence numérique (CDRIN). L’objectif est de concevoir et dév...	Ecosystems and Oceans Science	National Capital Region	Perception and Understanding	Winegardner, Amanda
174	AI model for Video review	Ideation	An AI model that reviews video monitoring footage for a fishery or given vessel and machine learns potential events of non compliance	Programs Sector	National Capital Region	Perception and Understanding	Bédard, Mathieu
76	Chumputer Vision - salmon scale age predictive AI (See B8)	Ideation	Deep Machine Learning and Convolutional Neural Network application for the predictive application of age assignment of Chum salmon by way of...	Ecosystems and Oceans Science	Pacific	Perception and Understanding	Wischniowski, Stephen
62	Deep sea habitat, organism and object detection and identification.	Ideation	Proposing a capstone project to Computer Science students from Camosun College to develop a pipeline for identifying objects and loading the...	Ecosystems and Oceans Science	Pacific	Perception and Understanding	Best, Merlin
72	Extracting impacts data from regulatory documents	Ideation	Use OCR pdf readers, topic detection and language models to detect specific data elements inside written text documents, for extraction and...	Ecosystems and Oceans Science	Pacific	Perception and Understanding	Bird, Tom
33	Machine-learning-assisted Benthic Marine Life Annotation Tool	Ideation On hold On hold	The goal of the project is to improve the efficiency of the image annotation process to reduce manual efforts of the benthic science team an...	Strategic Policy	National Capital Region	Perception and Understanding	Wang, Yuchen
35	AI-assisted Solution to Detect Ghost Gear from Side Scan Sonar Images	Ideation On hold On hold	The goal of the project is use AI to automate data analysis in detecting Ghost Gear. Client: Ghost Gear Program	Strategic Policy	National Capital Region	Perception and Understanding	Petrovic, Marina
245	Object, Classification, Tagging, Organization, and Pattern Understanding Solution (OCTOPUS)	Development	This initiative leverages AI technologies to build an Object, Classification, Tagging, Organization, and Pattern Understanding Solution (OC...	Chief Digital Officer	National Capital Region	Perception and Understanding	Ibrahim, Omar
240	The Current	Development	Don't let your harvested data get stuck in still water. Navigate new data streams with AI automation, augmentation and information enableme...	Fisheries Management	Not region specific	Perception and Understanding	Bird, Tom
165	AIMMS (Artificial Intelligence for Marine Mammals in Survey imagery)	Development	The AIMMS project develops a platform to automate and accelerate the interpretation of aerial imagery for marine mammal population assessmen...	Fisheries Management	National Capital Region	Perception and Understanding	Mosnier, Arnaud
228	SILScanner	Pilot	Deploy on DFO's PBMM Cloud a proof of concept application that uses optical character recognition (OCR) to digitize and validate Stream Insp...	Chief Digital Officer	National Capital Region	Perception and Understanding	Bird, Tom
190	Lobster Stock Assessment	Pilot	Automatically assess lobster count and habitat from hours of video efficiently Solution being developed for Science to review hundreds of ho...	Indigenous Affairs, Aquaculture and Governance	Gulf	Perception and Understanding	Dupuis, Marc
212	Surveillance électronique en mer Not translated · original: French	Pilot	Il s’agit de capture d’images vidéo sur les navires de pêche pour ensuite les faire analyser par des ressources humaines et un modèle d’inte...	Statistics, Policy and Licensing	Quebec	Perception and Understanding	Rémillard, Vincent
218	L’observation des bélugas de l’estuaire du Saint-Laurent Not translated · original: French	Pilot	Entente de contribution avec le Groupe de recherche et d'éducation sur les mammifères marins (GREMM) pour le développement d'un module de me...	Marine Planning and Conservation	Quebec	Perception and Understanding	Robert, Sonia
187	Atlantic Bluefin Tuna Monitoring	Pilot	Automatically perform video analytics from hundred of harvester tuna video Solution being developed in region to assist C&P in batch process...	Indigenous Affairs, Aquaculture and Governance	Gulf	Perception and Understanding	Dupuis, Marc
188	Coastal Surveillance	Pilot	Automatically process thousands of drone images as part of continuous surveillance Solution being developed in region to assist C&P in batch...	Indigenous Affairs, Aquaculture and Governance	Gulf	Perception and Understanding	Dupuis, Marc
213	Numérisation de documents manuscrits Not translated · original: French	Pilot	En collaboration avec l’équipe nationale de l’Intendant principal des données (PSSI), visant principalement la pêche au saumon. L’objectif e...	Statistics, Policy and Licensing	Quebec	Perception and Understanding	Rémillard, Vincent
217	Suite du projet de recherche de recherche et développement d’outils de vision automatisée pour l’étude des refuges marins des coraux et des éponges du golfe du Saint-Laurent. Not translated · original: French	Pilot	Une entente de contribution pour l’année 2025-2026 (Programme de gestion des océans) visant à l’amélioration de l’outil développé par le Cen...	Marine Planning and Conservation	Quebec	Perception and Understanding	Brossard, Jade
94	DFO Bot, deep learning application to analyse otolith images available in DFO Dots	Pilot	Development of a neural network trained using otolith images, expert-derived age estimates, otolith annotations and annuli to obtain age est...	Ecosystems and Oceans Science	National Capital Region	Perception and Understanding	Winegardner, Amanda
95	Optimization of Machine Learning modelling strategy for coastal zooplankton taxonomic identification from flow microscopy imaging.	Pilot	As part of Aquaculture Monitoring Program we are using Ecotaxa's ML algorithm to identify zooplankton. The project aims at identifying the b...	Ecosystems and Oceans Science	National Capital Region	Perception and Understanding	Winegardner, Amanda
96	Use of machine-learning (ML) algorithms and high-performance computing (HPC) for the optimization of satellite image analysis for mapping coastal habitats	Pilot	This project aims to improve satellite image analysis of marine habitats leveraging NRC HPC and ML assets to apply cutting-edge ML technique...	Ecosystems and Oceans Science	National Capital Region	Perception and Understanding	Winegardner, Amanda
103	Improved understanding of the processes impacting harmful algal blooms	Pilot	Using machine learning algorithms to analyze phytoplankton images from the Imaging Flow Cytobot (IFCB) to recognize and quantify species ass...	Ecosystems and Oceans Science	National Capital Region	Perception and Understanding	Winegardner, Amanda

189
Site Assessments
Automatically assess presence of eel grass from drone video Solution being developped to assist Fish and Fish Habitat Protection Program in reviewing hundreds of hours of drone footage to detect presence of Eel Grass.

Ideation On hold Indigenous Affairs, Aquaculture and Governance Perception and Understanding
191
Irish Moss Research
Automatically and non-invasively detect and assess health of Irish Moss Solution being developed for Science to review hundreds of hours of video for Irish Moss presence and health.

Ideation On hold Indigenous Affairs, Aquaculture and Governance Perception and Understanding
192
Harbour Assessments
Automatically and continuously assess harbour conditions via drone and satellite imagery Solution being developed for Small Craft harbours to assess harbour conditions (presence of ice, usage, vessel and vehicle traffic, change detection) based on drone footage and satellite imagery.

Ideation On hold Indigenous Affairs, Aquaculture and Governance Perception and Understanding
162
Recherche et développement d’outils de vision automatisée pour l’étude des refuges marins des coraux et des éponges du golfe du Saint-Laurent.
Projet de contribution avec le Centre de développement et de recherche en intelligence numérique (CDRIN). L’objectif est de concevoir et développer un outil d’intelligence artificielle permettant de détecter et suivre les organismes benthiques filmés dans refuges marins des coraux et des éponges du Golfe du Saint-Laurent.

Ideation Ecosystems and Oceans Science Perception and Understanding
174
AI model for Video review
An AI model that reviews video monitoring footage for a fishery or given vessel and machine learns potential events of non compliance

Ideation Programs Sector Perception and Understanding
76
Chumputer Vision - salmon scale age predictive AI (See B8)
Deep Machine Learning and Convolutional Neural Network application for the predictive application of age assignment of Chum salmon by way of scale images. Chum salmon has been selected as the gateway species due to its relatively easy scale pattern interpretation, this will foster the pathway forward for Chinook, Coho Sockeye and Herring as future targets for AI age interpretation. Deep Machine Learning and Convolutional Neural Network within a Python predictive algorithm

Ideation Ecosystems and Oceans Science Perception and Understanding
62
Deep sea habitat, organism and object detection and identification.
Proposing a capstone project to Computer Science students from Camosun College to develop a pipeline for identifying objects and loading the results into Biigle for human review. TBD.

Ideation Ecosystems and Oceans Science Perception and Understanding
72
Extracting impacts data from regulatory documents
Use OCR pdf readers, topic detection and language models to detect specific data elements inside written text documents, for extraction and analysis in a cumulative impacts context. Large lanugage models and topic clustering tools

Ideation Ecosystems and Oceans Science Perception and Understanding
33
Machine-learning-assisted Benthic Marine Life Annotation Tool
The goal of the project is to improve the efficiency of the image annotation process to reduce manual efforts of the benthic science team and reduce time-to-insight from underwater surveys. Further development is prevented by DFO's IT infrastructure. There are ongoing discussions with CDOS to resolved this but the project is on hold in the meantime. Client: Quebec Region/Pacific Region - Oceans and Ecosystem Sciences Division

Ideation On hold Strategic Policy Perception and Understanding
35
AI-assisted Solution to Detect Ghost Gear from Side Scan Sonar Images
The goal of the project is use AI to automate data analysis in detecting Ghost Gear. Client: Ghost Gear Program

Ideation On hold Strategic Policy Perception and Understanding
245
Object, Classification, Tagging, Organization, and Pattern Understanding Solution (OCTOPUS)
This initiative leverages AI technologies to build an Object, Classification, Tagging, Organization, and Pattern Understanding Solution (OCTOPUS) to enhance the analysis of video, image, and audio data, improve monitoring capabilities and support decision-making processes at DFO. The MVP will initially focus on video processing capabilities, with planned expansion to image and audio analysis in FY 2026–27. In addition, the initiative will deliver integrated data annotation and model training tools to support continuous improvement and reuse of AI models.

Development Chief Digital Officer Perception and Understanding
240
The Current
Don't let your harvested data get stuck in still water. Navigate new data streams with AI automation, augmentation and information enablement. The Current is a cloud-hosted platform that enables users anywhere in the department to ingest large volumes of structured and unstructured documents, extract data using optical character recognition and large language models, validate and review results through human-in-the-loop workflows, and relate extracted information using shared concepts and standards. The architecture emphasizes asynchronous processing, modular extraction services, strong traceability, and governance-ready design. The platform supports configurable extraction tasks, versioned models and definitions, auditable review processes, and future discovery of related research outputs and datasets across heterogeneous sources. As the initial use-case, the Text Intelligence and Data Extraction (TIDE) Service has been developed for the Salmon Habitat Restoration (SHARE) System. TIDE is a baseline iteration of The Current that fulfills the minimum viable product requirements of SHARE. TIDE focuses on digitizing, extracting, and modeling data from large unstructured text documents. TIDE establishes the baseline architecture and demonstrates a scalable workflow in Production.

Development Fisheries Management Perception and Understanding
165
AIMMS (Artificial Intelligence for Marine Mammals in Survey imagery)
The AIMMS project develops a platform to automate and accelerate the interpretation of aerial imagery for marine mammal population assessments. By streamlining annotation and review, and enabling scientists to develop custom machine-learning models without advanced coding skills, the AIMMS workflow significantly reduce processing time, accelerate delivery of science advice, and lower operational costs.

Development Fisheries Management Perception and Understanding
228
SILScanner
Deploy on DFO's PBMM Cloud a proof of concept application that uses optical character recognition (OCR) to digitize and validate Stream Inspection Logs (SILs). The PoC was originally developed on SSC's cloud infrastructure. It is now being deployed in DFO PB cloud infrastructure. BLADES initiative and IT security teams are involved.

Pilot Chief Digital Officer Perception and Understanding
190
Lobster Stock Assessment
Automatically assess lobster count and habitat from hours of video efficiently Solution being developed for Science to review hundreds of hours of video for lobster count and state of habitat.

Pilot Indigenous Affairs, Aquaculture and Governance Perception and Understanding
212
Surveillance électronique en mer
Il s’agit de capture d’images vidéo sur les navires de pêche pour ensuite les faire analyser par des ressources humaines et un modèle d’intelligence artificielle doté de capacité d’identification d’événements, d’espèces, etc. Projet fait en collaboration avec l’équipe nationale de l’Intendant principal des données.

Pilot Statistics, Policy and Licensing Perception and Understanding
218
L’observation des bélugas de l’estuaire du Saint-Laurent
Entente de contribution avec le Groupe de recherche et d'éducation sur les mammifères marins (GREMM) pour le développement d'un module de mesures morphométriques assistées par l’intelligence artificielle pour les bélugas de l'estuaire du Saint-Laurent L’entente s’est terminée le 31 mars 2024 mais le module est en cours d’utilisation. Considérant la contrainte de temps imposée par les mesures manuelles des images prises par drones de bélugas, l’équipe de recherche du GREMM a développé une méthode exploitant l’IA pour mesurer plus rapidement et plus efficacement les bélugas.

Pilot Marine Planning and Conservation Perception and Understanding
187
Atlantic Bluefin Tuna Monitoring
Automatically perform video analytics from hundred of harvester tuna video Solution being developed in region to assist C&P in batch processing of at-sea video monitoring footage.

Pilot Indigenous Affairs, Aquaculture and Governance Perception and Understanding
188
Coastal Surveillance
Automatically process thousands of drone images as part of continuous surveillance Solution being developed in region to assist C&P in batch processing of drone surveillance images.

Pilot Indigenous Affairs, Aquaculture and Governance Perception and Understanding
213
Numérisation de documents manuscrits
En collaboration avec l’équipe nationale de l’Intendant principal des données (PSSI), visant principalement la pêche au saumon. L’objectif est de numériser des documents avec des données manuscrites et de les faire analyser par un modèle d’intelligence artificielle qui va décoder l’écriture pour la transformer en données numériques et les insérer dans une base de données. Le but est de remplacer la saisie manuelle de ces données.

Pilot Statistics, Policy and Licensing Perception and Understanding
217
Suite du projet de recherche de recherche et développement d’outils de vision automatisée pour l’étude des refuges marins des coraux et des éponges du golfe du Saint-Laurent.
Une entente de contribution pour l’année 2025-2026 (Programme de gestion des océans) visant à l’amélioration de l’outil développé par le Centre de développement et de recherche en intelligence numérique (CDRIN) en 2024-2025. Le projet a comme objectif global de concevoir et développer un outil d’intelligence artificielle permettant de détecter et suivre les organismes benthiques filmés dans les refuges marins des coraux et des éponges du Golfe du Saint-Laurent.

Pilot Marine Planning and Conservation Perception and Understanding
94
DFO Bot, deep learning application to analyse otolith images available in DFO Dots
Development of a neural network trained using otolith images, expert-derived age estimates, otolith annotations and annuli to obtain age estimates from otoliths.

Pilot Ecosystems and Oceans Science Perception and Understanding
95
Optimization of Machine Learning modelling strategy for coastal zooplankton taxonomic identification from flow microscopy imaging.
As part of Aquaculture Monitoring Program we are using Ecotaxa's ML algorithm to identify zooplankton. The project aims at identifying the best strategy in building model training sets for each region monitored. This strategy will be the basis for future AMP zooplankton identification work.

Pilot Ecosystems and Oceans Science Perception and Understanding
96
Use of machine-learning (ML) algorithms and high-performance computing (HPC) for the optimization of satellite image analysis for mapping coastal habitats
This project aims to improve satellite image analysis of marine habitats leveraging NRC HPC and ML assets to apply cutting-edge ML techniques to the challenges of remote sensing data analysis. Relates to ongoing project (below) through MPC service-level agreement.

Pilot Ecosystems and Oceans Science Perception and Understanding
103
Improved understanding of the processes impacting harmful algal blooms
Using machine learning algorithms to analyze phytoplankton images from the Imaging Flow Cytobot (IFCB) to recognize and quantify species associated with harmful algal blooms.

Pilot Ecosystems and Oceans Science Perception and Understanding