Natural Language Generation For Relative Position Description Using the PHI-Descriptor

Date

2018-09-05

Authors

Francis, Jesse

Journal Title

Journal ISSN

Volume Title

Publisher

University of Guelph

Abstract

Ordinary phrases like "the garden is surrounded by a fence" describe spatial relationships between objects. When scenes are captured in the form of digital images and machines expected to be able to communicate about space, models of spatial relationships must be designed. These models are often derived from an image descriptor called relative position descriptor. One of the most recent and promising descriptors is the PHI-descriptor. In this thesis, we show that the models derived from the PHI-descriptor are sound and that the PHI-descriptor is semantically rich. We define and demonstrate a PHI-descriptor based fuzzy system that maps any pair of 2D image objects to an extensive, natural and sensible English-language description of the relative position of the objects. To our knowledge, there is no comparable, more expressive system. The system is tested on synthetic and real data, and suggestions on how to improve its descriptive capabilities are presented.

Description

Keywords

relative position descriptor, PHI-descriptor, natural language generation, spatial relation, spatial relationships, relative position

Citation