A Method for Measuring Sentence Similarity and its Application to Conversational Agents

Yuhua Li, Zuhair Bandar, David McLean, James O’Shea

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    19 Citations (Scopus)

    Abstract

    This paper presents a novel algorithm for computing similarity between very short texts of sentence length. It will introduce a method that takes account of not only semantic information but also word order information implied in the sentences. Firstly, semantic similarity between two sentences is derived from information from a structured lexical database and from corpus statistics. Secondly, word order similarity is computed from the position of word appearance in the sentence. Finally, sentence similarity is computed as a combination of semantic similarity and word order similarity. The proposed algorithm is applied to a real world domain of conversational agents. Experimental results demonstrated that the proposed algorithm reduces the scripter’s effort to devise rule base for conversational agent.
    Original languageEnglish
    Title of host publicationUnknown Host Publication
    Number of pages6
    Publication statusPublished - 2004
    EventThe 17th International FLAIRS Conference - Florida, USA
    Duration: 1 Jan 2004 → …

    Conference

    ConferenceThe 17th International FLAIRS Conference
    Period1/01/04 → …

    Fingerprint Dive into the research topics of 'A Method for Measuring Sentence Similarity and its Application to Conversational Agents'. Together they form a unique fingerprint.

  • Cite this

    Li, Y., Bandar, Z., McLean, D., & O’Shea, J. (2004). A Method for Measuring Sentence Similarity and its Application to Conversational Agents. In Unknown Host Publication