Explaining pretrained language models' understanding of linguistic structures using construction grammar.

ABSTRACT: Construction Grammar (CxG) is a paradigm from cognitive linguistics emphasizing the connection between syntax and semantics. Rather than rules that operate on lexical items, it posits constructions as the central building blocks of language, i.e., linguistic units of different granularity that combine syntax and semantics. As a first step toward assessing the compatibility of CxG with the syntactic and semantic knowledge demonstrated by state-of-the-art pretrained language models (PLMs), we present an investigation of their capability to classify and understand one of the most commonly studied constructions, the English comparative correlative (CC). We conduct experiments examining the classification accuracy of a syntactic probe on the one hand and the models' behavior in a semanti

SUBMITTER: Weissweiler L 

PROVIDER: S-EPMC10600487 | biostudies-literature | 2023

REPOSITORIES: biostudies-literature