Main content

Natural Language Generation For Relative Position Description Using the PHI-Descriptor

Show full item record

Title: Natural Language Generation For Relative Position Description Using the PHI-Descriptor
Author: Francis, Jesse
Department: School of Computer Science
Program: Computer Science
Advisor: Matsakis, Pascal
Abstract: Ordinary phrases like "the garden is surrounded by a fence" describe spatial relationships between objects. When scenes are captured in the form of digital images and machines expected to be able to communicate about space, models of spatial relationships must be designed. These models are often derived from an image descriptor called relative position descriptor. One of the most recent and promising descriptors is the PHI-descriptor. In this thesis, we show that the models derived from the PHI-descriptor are sound and that the PHI-descriptor is semantically rich. We define and demonstrate a PHI-descriptor based fuzzy system that maps any pair of 2D image objects to an extensive, natural and sensible English-language description of the relative position of the objects. To our knowledge, there is no comparable, more expressive system. The system is tested on synthetic and real data, and suggestions on how to improve its descriptive capabilities are presented.
URI: http://hdl.handle.net/10214/14253
Date: 2018-09


Files in this item

Files Size Format View
Francis_Jesse_201809_MSc.pdf 25.01Mb PDF View/Open

This item appears in the following Collection(s)

Show full item record