Multimodal Quantum Natural Language Processing: A Novel Framework for using Quantum Methods to Analyse Real Data

Oct 29, 2024
e-Print:

Citations per year

0 Citations
Abstract: (arXiv)
Despite significant advances in quantum computing across various domains, research on applying quantum approaches to language compositionality - such as modeling linguistic structures and interactions - remains limited. This gap extends to the integration of quantum language data with real-world data from sources like images, video, and audio. This thesis explores how quantum computational methods can enhance the compositional modeling of language through multimodal data integration. Specifically, it advances Multimodal Quantum Natural Language Processing (MQNLP) by applying the Lambeq toolkit to conduct a comparative analysis of four compositional models and evaluate their influence on image-text classification tasks. Results indicate that syntax-based models, particularly DisCoCat and TreeReader, excel in effectively capturing grammatical structures, while bag-of-words and sequential models struggle due to limited syntactic awareness. These findings underscore the potential of quantum methods to enhance language modeling and drive breakthroughs as quantum technology evolves.
Note:
  • This thesis, awarded a distinction by the Department of Computer Science at University College London, was successfully defended by the author in September 2024 in partial fulfillment of the requirements for an MSc in Emerging Digital Technologies
  • [1]
    Computing machinery and intelligence. Mind, 59(236):433-460,. Online
    • A. Turing
  • [2]
    Inc. Amazon Web Services. What is natural language processing? - nlp explained - aws
  • [3]
    The georgetown-ibm experiment demonstrated in january 1954. In Machine Translation: From Real Users to Research, pages 102-114
    • W.J. Hutchins
  • [4]
    The first public demonstration of machine translation: The georgetownibm system, 7th january, n.d. Online
    • J. Hutchins
  • [5]
    National Academy of Sciences Automatic Language Processing Advisory Committee, Division of Behavioral Sciences and National Research Council. Language and machines: Computers in translation and linguistics. Technical Report 1416, National Academy of Sciences
  • [6]
    Eliza reinterpreted: The world’s first chatbot was not intended as a chatbot at all. arXiv.org,. Online
    • J. Shrager
  • [7]
    Stanford University. Shrdlu,. Online
  • [7]
    Accessed 23 Aug
  • [8]
    A neural probabilistic language model
    • Y. Bengio
      ,
    • R. Ducharme
      ,
    • P. Vincent
      ,
    • C. Jauvin
      ,
    • J. Ca
    et al.
      • J.Machine Learning Res. 3 (2003) 1137-1155
  • [8]
    Accessed 23 Aug
    • Y. Bengio
      ,
    • R. Ducharme
      ,
    • P. Vincent
      ,
    • C. Jauvin
      ,
    • J. Ca
    et al.
  • [9]
    Accessed 23 August
    • T. Mikolov
      ,
    • K. Chen
      ,
    • G. Corrado
      ,
    • J. Dean
  • [10]
    Distributed representations of words and phrases and their compositionality. arXiv preprint
    • T. Mikolov
      ,
    • I. Sutskever
      ,
    • K. Chen
      ,
    • G. Corrado
      ,
    • J. Dean
  • [10]
    Accessed 23 Aug.. 40
    • T. Mikolov
      ,
    • I. Sutskever
      ,
    • K. Chen
      ,
    • G. Corrado
      ,
    • J. Dean
  • [11]
    Accessed 23 Aug
    • D. Bahdanau
      ,
    • K. Cho
      ,
    • Y. Bengio
  • [12]
    Sequence to sequence learning with neural networks. arXiv preprint
    • I. Sutskever
      ,
    • O. Vinyals
      ,
    • Q.V. Le
  • [12]
    Accessed 23 Aug
    • I. Sutskever
      ,
    • O. Vinyals
      ,
    • Q.V. Le
  • [13]
    Get to the point: Summarization with pointergenerator networks. arXiv preprint
    • A. See
      ,
    • P.J. Liu
      ,
    • C.D. Manning
  • [13]
    Accessed 23 Aug
    • A. See
      ,
    • P.J. Liu
      ,
    • C.D. Manning
  • [14]
    A neural attention model for abstractive sentence summarization. arXiv preprint
    • A.M. Rush
      ,
    • S. Chopra
      ,
    • J. Weston
  • [14]
    Accessed 23 Aug
    • A.M. Rush
      ,
    • S. Chopra
      ,
    • J. Weston
  • [15]
    Learning to forget: continual prediction with lstm. InNinth International Conference on Artificial Neural Networks (ICANN 99), volume 2, pages 850-855
    • F.A. Gers
      ,
    • J. Schmidhuber
      ,
    • F. Cummins
  • [16]
    Multi-behavior with bottleneck features lstm for load forecasting in building energy management system
    • V. Bui
      ,
    • N.T. Le
      ,
    • V.H. Nguyen
      ,
    • J. Kim
      ,
    • Y.M. Jang
      • Electronics 10 (2021) 1026