15 results on '"long distance dependencies"'
Search Results
2. Mutual Information Decay Curves and Hyper-parameter Grid Search Design for Recurrent Neural Architectures
- Author
-
Mahalunkar, Abhijit, Kelleher, John D., Filipe, Joaquim, Editorial Board Member, Ghosh, Ashish, Editorial Board Member, Prates, Raquel Oliveira, Editorial Board Member, Zhou, Lizhu, Editorial Board Member, Yang, Haiqin, editor, Pasupa, Kitsuchart, editor, Leung, Andrew Chi-Sing, editor, Kwok, James T., editor, Chan, Jonathan H., editor, and King, Irwin, editor
- Published
- 2020
- Full Text
- View/download PDF
3. Multi-Stream Semantics-Guided Dynamic Aggregation Graph Convolution Networks to Extract Overlapping Relations
- Author
-
Xiushan Liu, Jun Cheng, and Qin Zhang
- Subjects
Overlapping relation extraction ,multiscale structural information ,dynamic aggregation ,long distance dependencies ,refined graph ,relevant substructure ,Electrical engineering. Electronics. Nuclear engineering ,TK1-9971 - Abstract
The existing relation extraction approaches select the relevant partial dependency structures and exhibit the limitation associated with long-distance dependencies. Moreover, due to the repeated use of the irrelevant redundant information and the lack of consideration of the key semantic details, the extraction of relations is relatively complex when the entities overlap. To address this limitation and effectively exploit the relevant information while ignoring irrelevant information, this paper proposes a simple but effective multistream semantics-guided dynamic aggregation graph convolution network (SG-DAGCN) to realize the extraction of overlapping relations. The proposed model constructs the entity relation graphs by enumerating the possible candidates and external auxiliary information and adaptively manages the relevant substructure. Subsequently, this framework models the relational graphs between the entities through a dynamic aggregation graph convolution module and gradually produces the discriminative embedded features and a refined graph through the dynamic aggregation of nodes. The proposed approach can effectively leverage the rich multiscale structural information and capture the long-distance dependencies between overlapping entities in long sentences. The results of the experiments conducted on two typical benchmark datasets show that the proposed model can achieve a high level of performance and outperform other state-of-the-art methods in both qualitative and quantitative aspects.
- Published
- 2021
- Full Text
- View/download PDF
4. Processing covert dependencies: an SAT study on Mandarin wh-in-situ questions
- Author
-
Xiang, Ming, Dillon, Brian, Wagers, Matt, Liu, Fengqin, and Guo, Taomei
- Subjects
Wh-in-situ ,Chinese ,Long distance dependencies ,Covert dependencies ,Memory mechanisms ,Processing complexity ,Cognitive Sciences ,Language Studies ,Linguistics ,Languages & Linguistics - Abstract
In wh-in-situ languages like Mandarin Chinese, in which the wh-phrase remains in a canonical argument position in wh-questions, syntactic theories generally posit that a covert dependency between the in-situ position and a clause-initial syntactic operator must nonetheless hold at logical form. Wh-in-situ languages and wh-fronted languages are in this way abstractly similar. This paper investigates whether the processing of Mandarin wh-in-situ questions indeed involves constructing a long-distance dependency. Using the multiple-response speed-accuracy tradeoff (SAT) paradigm, we show that Chinese wh-in-situ questions incur more processing costs than their non-wh counterparts. Furthermore, the length of the covert dependency affects only processing accuracy, but not processing speed. This pattern suggests a content-addressable memory process underlying the construction of wh-in-situ dependencies, similar to overt long distance dependencies in English. © 2013 Springer Science+Business Media Dordrecht.
- Published
- 2014
5. The effect of decay and lexical uncertainty on processing long-distance dependencies in reading.
- Author
-
Stone, Kate, von der Malsburg, Titus, and Vasishth, Shravan
- Subjects
UNCERTAINTY ,READING ,EYE tracking ,EYE movements ,SHORT-term memory ,LONG-distance running - Abstract
To make sense of a sentence, a reader must keep track of dependent relationships between words, such as between a verb and its particle (e.g. turn the music down). In languages such as German, verb-particle dependencies often span long distances, with the particle only appearing at the end of the clause. This means that it may be necessary to process a large amount of intervening sentence material before the full verb of the sentence is known. To facilitate processing, previous studies have shown that readers can preactivate the lexical information of neighbouring upcoming words, but less is known about whether such preactivation can be sustained over longer distances. We asked the question, do readers preactivate lexical information about long-distance verb particles? In one self-paced reading and one eye tracking experiment, we delayed the appearance of an obligatory verb particle that varied only in the predictability of its lexical identity. We additionally manipulated the length of the delay in order to test two contrasting accounts of dependency processing: that increased distance between dependent elements may sharpen expectation of the distant word and facilitate its processing (an antilocality effect), or that it may slow processing via temporal activation decay (a locality effect). We isolated decay by delaying the particle with a neutral noun modifier containing no information about the identity of the upcoming particle, and no known sources of interference or working memory load. Under the assumption that readers would preactivate the lexical representations of plausible verb particles, we hypothesised that a smaller number of plausible particles would lead to stronger preactivation of each particle, and thus higher predictability of the target. This in turn should have made predictable target particles more resistant to the effects of decay than less predictable target particles. The eye tracking experiment provided evidence that higher predictability did facilitate reading times, but found evidence against any effect of decay or its interaction with predictability. The self-paced reading study provided evidence against any effect of predictability or temporal decay, or their interaction. In sum, we provide evidence from eye movements that readers preactivate long-distance lexical content and that adding neutral sentence information does not induce detectable decay of this activation. The findings are consistent with accounts suggesting that delaying dependency resolution may only affect processing if the intervening information either confirms expectations or adds to working memory load, and that temporal activation decay alone may not be a major predictor of processing time. [ABSTRACT FROM AUTHOR]
- Published
- 2020
- Full Text
- View/download PDF
6. Relative clause avoidance: Evidence for a structural parsing principle.
- Author
-
Staub, Adrian, Foppolo, Francesca, Donati, Caterina, and Cecchetto, Carlo
- Subjects
- *
EYE movements , *COMPARATIVE grammar , *LINGUISTICS , *READABILITY (Literary style) , *SEMANTICS , *PHONOLOGICAL awareness - Abstract
Three eye movement experiments investigated the processing of the syntactic ambiguity in strings such as the information that the health department provided , where the that -clause can be either a relative clause (RC) or the start of a nominal complement clause (CC; the information that the health department provided a cure ). The experiments tested the prediction that comprehenders should avoid the RC analysis because it involves an unforced filler-gap dependency. Readers showed difficulty upon disambiguation toward the RC analysis, and showed facilitated processing of the ambiguous material itself when the CC analysis was available; both patterns suggest rapid initial adoption of the CC analysis in preference to the RC analysis. The strength of the bias of a specific head noun (e.g., information ) to appear with a CC did not modulate these effects, nor were these effects reliably modulated by the tendency of an ambiguous string to be completed off-line as a CC or an RC. These results add to the evidence that structural principles guide the processing of filler-gap dependencies. [ABSTRACT FROM AUTHOR]
- Published
- 2018
- Full Text
- View/download PDF
7. DNA Replication as a Model for Computational Linguistics
- Author
-
Dahl, Veronica, Maharshak, Erez, Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Nierstrasz, Oscar, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Sudan, Madhu, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Doug, Series editor, Vardi, Moshe Y., Series editor, Weikum, Gerhard, Series editor, Mira, José, editor, Ferrández, José Manuel, editor, Álvarez, José R., editor, de la Paz, Félix, editor, and Toledo, F. Javier, editor
- Published
- 2009
- Full Text
- View/download PDF
8. Constructing covert dependencies—The case of Mandarin wh-in-situ dependency.
- Author
-
Xiang, Ming, Wang, SuiPing, and Cui, YanLing
- Subjects
- *
CHINESE people , *LANGUAGE & languages , *MEMORY - Abstract
Wh-in-situ constructions in Mandarin Chinese, as opposed to their English counterparts that front wh-phrases to the beginning of the sentence, have the same word order as regular non-wh declaratives. We argue that despite their surface word order, processing wh-in-situ constructions involves constructing a covert non-local syntactic dependency between the in-situ wh-phrase and a higher scope position at a clause boundary, leading to behavioral patterns similar to those associated with the processing of overt dependencies. In two comprehension experiments, we showed that the process of linking an in-situ wh-phrase and its scope position induces a similarity-based memory interference effect if another clause boundary position intervenes. In addition, a set of sentence completion studies also showed that the production of wh-in-situ constructions is heavily modulated by the increased working memory burden that results from planning and maintaining a non-local dependency. [ABSTRACT FROM AUTHOR]
- Published
- 2015
- Full Text
- View/download PDF
9. The effect of decay and lexical uncertainty on processing long-distance dependencies in reading
- Author
-
Kate Stone, Titus von der Malsburg, and Shravan Vasishth
- Subjects
Preactivation ,Computer science ,media_common.quotation_subject ,Entropy ,Verb ,Psychiatry and Psychology ,050105 experimental psychology ,General Biochemistry, Genetics and Molecular Biology ,Psycholinguistics ,03 medical and health sciences ,0302 clinical medicine ,Reading (process) ,Noun ,ddc:570 ,Department Linguistik ,0501 psychology and cognitive sciences ,ddc:610 ,Predictability ,Long distance dependencies ,Locality ,media_common ,eye-tracking ,Working memory ,General Neuroscience ,05 social sciences ,Statistics ,General Medicine ,prediction ,self-paced reading ,Temporal decay ,Reading ,Eye tracking ,Antilocality ,General Agricultural and Biological Sciences ,Comprehension ,030217 neurology & neurosurgery ,Sentence ,Cognitive psychology - Abstract
**This paper now appears in PeerJ, see Peer-reviewed publication DOI below** To make sense of a sentence, a reader must keep track of dependent relationships between words, such as between a verb and its particle (e.g. turn the music down). In languages such as German, verb-particle dependencies often span long distances, with the particle only appearing at the end of the clause. This means that it may be necessary to process a large amount of intervening sentence material before the full verb of the sentence is known. To facilitate processing, previous studies have shown that readers can preactivate the lexical information of neighbouring upcoming words, but less is known about whether such preactivation can be sustained over longer distances. We asked the question, do readers preactivate lexical information about long-distance verb particles? In one self-paced reading and one eye tracking experiment, we delayed the appearance of an obligatory verb particle that varied only in the predictability of its lexical identity. We additionally manipulated the length of the delay in order to test two contrasting accounts of dependency processing: that increased distance between dependent elements may sharpen expectation of the distant word and facilitate its processing (an antilocality effect), or that it may slow processing via temporal activation decay (a locality effect). We isolated decay by delaying the particle with a neutral noun modifier containing no information about the identity of the upcoming particle, and no known sources of interference or working memory load. Under the assumption that readers would preactivate the lexical representations of plausible verb particles, we hypothesised that a smaller number of plausible particles would lead to stronger preactivation of each particle, and thus higher predictability of the target. This in turn should have made predictable target particles more resistant to the effects of decay than less predictable target particles. The eye tracking experiment provided evidence that higher predictability did facilitate reading times, but found evidence against any effect of decay or its interaction with predictability. The self-paced reading study provided evidence against any effect of predictability or temporal decay, or their interaction. In sum, we provide evidence from eye movements that readers preactivate long-distance lexical content and that adding neutral sentence information does not induce detectable decay of this activation. The findings are consistent with accounts suggesting that delaying dependency resolution may only affect processing if the intervening information is not neutral, i.e., it either confirms expectations or adds to working memory load, and that temporal activation decay alone may not be a major predictor of processing time.
- Published
- 2020
- Full Text
- View/download PDF
10. 2D Correlative-Chain Conditional Random Fields for Semantic Annotation of Web Objects.
- Author
-
Ding, Yan-Hui, Li, Qing-Zhong, Dong, Yong-Quan, and Peng, Zhao-Hui
- Subjects
CONDITIONAL random fields ,COMPUTER engineering ,AUTOMATION ,CLIENT/SERVER computing ,SEMANTICS ,ANNOTATIONS ,MATHEMATICAL sequences ,WEBSITES - Abstract
Semantic annotation of Web objects is a key problem for Web information extraction. The Web contains an abundance of useful semi-structured information about real world objects, and the empirical study shows that strong two-dimensional sequence characteristics and correlative characteristics exist for Web information about objects of the same type across different Web sites. Conditional Random Fields (CRFs) are the state-of-the-art approaches taking the sequence characteristics to do better labeling. However, as the appearance of correlative characteristics between Web object elements, previous CRFs have their limitations for semantic annotation of Web objects and cannot deal with the long distance dependencies between Web object elements efficiently. To better incorporate the long distance dependencies, on one hand, this paper describes long distance dependencies by correlative edges, which are built by making good use of structured information and the characteristics of records from external databases; and on the other hand, this paper presents a two-dimensional Correlative-Chain Conditional Random Fields (2DCC-CRFs) to do semantic annotation of Web objects. This approach extends a classic model, two-dimensional Conditional Random Fields (2DCRFs), by adding correlative edges. Experimental results using a large number of real-world data collected from diverse domains show that the proposed approach can significantly improve the semantic annotation accuracy of Web objects. [ABSTRACT FROM AUTHOR]
- Published
- 2010
- Full Text
- View/download PDF
11. An Experimental Study on the Syntax of English and Egyptian Arabic: A Unified Account of Bilingual Grammatical Knowledge
- Author
-
Sedarous, Yourdanis
- Subjects
- bilingualism, syntax, code-switching, Egyptian Arabic, long distance dependencies
- Abstract
This dissertation investigates the extent to which bilingual speakers’ cognitive representations of the syntactic structures of their two languages are interconnected. This is a substantially understudied domain despite the widespread existence of bilingual/multilingual communities in the world, including the US. To draw solid conclusions about bilingual individuals’ linguistic representations of syntactic structures, in this dissertation we test bilingual individuals’ sensitivity to island and non-island wh-questions in both unilingual and code-switched contexts. Code-switching is a particularly relevant domain of investigation for determining how structures with similar surface word orders, but either similar or different derivations across the two languages, are processed as by bilingual individuals. The logic here is: if two structures share a syntactic derivation, which we classify as a shared structure, then these structures will be sensitive to the same well-formedness conditions in both unilingual and code-switched contexts. If the two structures have different syntactic derivations, which we classify as separate structures, then we will see divergent sensitivities to well-formedness conditions across the two unilingual contexts, as well as the code-switched contexts. We focused our attention on wh-in situ and wh-resumptive structures in Egyptian Arabic and English. The wh-in situ structure was chosen because, in the right pragmatic context, it has been argued to have a similar syntactic derivation across the two languages, while the wh-resumptive structure was chosen because it has been argued to have a different syntactic derivation across the two languages. We conducted a four-block experiment administered within one experimental session, testing wh-in-situ, wh-resumptive and wh-gap structures in each block. The first block tested the wh-structures in unilingual Egyptian Arabic sentences. The second block tested them in unilingual English sentences. The third and fourth blocks tested the acceptability of the wh-structures in code-switched Egyptian Arabic/English sentences. To test both island and non-island wh-in situ and wh-resumptive structures, we used a factorial design to isolate island effects from extra grammatical processing effects. Based on the results of the experiment we concluded the following: First, in line with the predictions of previous literature, we argue that the wh-in situ structure is not only similar in the surface order across both languages, but the wh-in situ structure in Egyptian Arabic and English share the same derivational properties. Second, based on the reported island sensitivity in the code-switched conditions, we argue that the wh-resumptive structure of Egyptian Arabic is formed via movement in a manner like how clause-initial wh-constituents are formed in English, but that the island sensitivities are masked in the unilingual Egyptian Arabic contexts as the distribution of resumptive pronouns is subject to both phonological and syntactic well-formedness conditions. Based on this discussion, we conclude that the wh-resumptive structure across Egyptian Arabic and English is a partially overlapping structure for the population of speakers recruited in this study, since the clause initial wh-element is formed via movement in both languages, but the insertion of resumptive pronouns is generated as part of the derivation in Egyptian Arabic, but as the result of a production effect in English.
- Published
- 2022
12. Relative clause avoidance: Evidence for a structural parsing principle
- Author
-
Adrian Staub, Francesca Foppolo, Caterina Donati, Carlo Cecchetto, University of Massachusetts [Amherst] (UMass Amherst), University of Massachusetts System (UMASS), Università degli Studi di Milano-Bicocca [Milano] (UNIMIB), Laboratoire de Linguistique Formelle (LLF UMR7110), Université Paris Diderot - Paris 7 (UPD7)-Centre National de la Recherche Scientifique (CNRS), Structures Formelles du Langage (SFL), Université Paris 8 Vincennes-Saint-Denis (UP8)-Centre National de la Recherche Scientifique (CNRS)-Université Paris Lumières (UPL), Staub, A, Foppolo, F, Donati, C, Cecchetto, C, Centre National de la Recherche Scientifique (CNRS)-Université Paris Diderot - Paris 7 (UPD7), and Université Paris 8 Vincennes-Saint-Denis (UP8)-Centre National de la Recherche Scientifique (CNRS)- Université Paris Lumières, Académie de Créteil, Campus Condorcet (UPLUM)
- Subjects
Eye movement ,Linguistics and Language ,Dependency (UML) ,Sentence processing ,Experimental and Cognitive Psychology ,computer.software_genre ,050105 experimental psychology ,Language and Linguistics ,Artificial Intelligence ,0501 psychology and cognitive sciences ,Long distance dependencies ,Language and Linguistic ,ComputingMilieux_MISCELLANEOUS ,Relative clause ,060201 languages & linguistics ,Communication ,Parsing ,business.industry ,05 social sciences ,Syntactic ambiguity ,String (computer science) ,06 humanities and the arts ,[SCCO.LING]Cognitive science/Linguistics ,Eye movements ,Neuropsychology and Physiological Psychology ,0602 languages and literature ,Artificial intelligence ,Complement (linguistics) ,Long distance dependencie ,Psychology ,business ,computer ,Relative clauses ,Natural language processing - Abstract
International audience; Three eye movement experiments investigated the processing of the syntactic ambiguity in strings such as the information that the health department provided, where the that-clause can be either a relative clause (RC) or the start of a nominal complement clause (CC; the information that the health department provided a cure). The experiments tested the prediction that comprehenders should avoid the RC analysis because it involves an unforced filler-gap dependency. Readers showed difficulty upon disambiguation toward the RC analysis, and showed facilitated processing of the ambiguous material itself when the CC analysis was available; both patterns suggest rapid initial adoption of the CC analysis in preference to the RC analysis. The strength of the bias of a specific head noun (e.g., information) to appear with a CC did not modulate these effects, nor were these effects reliably modulated by the tendency of an ambiguous string to be completed off-line as a CC or an RC. These results add to the evidence that structural principles guide the processing of filler-gap dependencies
- Published
- 2018
- Full Text
- View/download PDF
13. Processing covert dependencies: An SAT study on Mandarin wh-in-situ questions
- Author
-
Ming Xiang, Brian Dillon, Matthew Wagers, Taomei Guo, and Fengqin Liu
- Subjects
Linguistics and Language ,Dependency (UML) ,Chinese ,Computer science ,Language Studies ,Operator (linguistics) ,Memory mechanisms ,Linguistics ,Wh-in-situ ,Mandarin Chinese ,Language and Linguistics ,language.human_language ,Covert dependencies ,History and Philosophy of Science ,Covert ,Languages & Linguistics ,language ,Theoretical linguistics ,Logical form ,Cognitive Sciences ,Argument (linguistics) ,Long distance dependencies ,Processing complexity ,Comparative linguistics - Abstract
In wh-in-situ languages like Mandarin Chinese, in which the wh-phrase remains in a canonical argument position in wh-questions, syntactic theories generally posit that a covert dependency between the in-situ position and a clause-initial syntactic operator must nonetheless hold at logical form. Wh-in-situ languages and wh-fronted languages are in this way abstractly similar. This paper investigates whether the processing of Mandarin wh-in-situ questions indeed involves constructing a long-distance dependency. Using the multiple-response speed-accuracy tradeoff (SAT) paradigm, we show that Chinese wh-in-situ questions incur more processing costs than their non-wh counterparts. Furthermore, the length of the covert dependency affects only processing accuracy, but not processing speed. This pattern suggests a content-addressable memory process underlying the construction of wh-in-situ dependencies, similar to overt long distance dependencies in English. © 2013 Springer Science+Business Media Dordrecht.
- Published
- 2014
14. A corpus-based study of bridge verbs in long distance dependencies in French: a specific construction
- Author
-
Lolita Bérard, Henri-José Deulofeu, Sylvain Kahane, Lattice - Langues, Textes, Traitements informatiques, Cognition - UMR 8094 (Lattice), Département Littératures et langage - ENS Paris (LILA), École normale supérieure - Paris (ENS Paris), Université Paris sciences et lettres (PSL)-Université Paris sciences et lettres (PSL)-École normale supérieure - Paris (ENS Paris), Université Paris sciences et lettres (PSL)-Université Paris sciences et lettres (PSL)-Centre National de la Recherche Scientifique (CNRS)-Université Sorbonne Paris Cité (USPC)-Université Sorbonne Nouvelle - Paris 3, Laboratoire d'informatique Fondamentale de Marseille (LIF), Centre National de la Recherche Scientifique (CNRS)-École Centrale de Marseille (ECM)-Aix Marseille Université (AMU), Modèles, Dynamiques, Corpus (MoDyCo), Université Paris Nanterre (UPN)-Centre National de la Recherche Scientifique (CNRS), Université Sorbonne Nouvelle - Paris 3-Université Sorbonne Paris Cité (USPC)-Centre National de la Recherche Scientifique (CNRS)-Université Paris sciences et lettres (PSL)-Département Littératures et langage - ENS Paris (LILA), École normale supérieure - Paris (ENS-PSL), Université Paris sciences et lettres (PSL)-Université Paris sciences et lettres (PSL)-École normale supérieure - Paris (ENS-PSL), Université Paris sciences et lettres (PSL), Aix Marseille Université (AMU)-École Centrale de Marseille (ECM)-Centre National de la Recherche Scientifique (CNRS), and Université Sorbonne Nouvelle - Paris 3-Université Sorbonne Paris Cité (USPC)-Centre National de la Recherche Scientifique (CNRS)-Université Paris sciences et lettres (PSL)-Département Littératures et langage (LILA)
- Subjects
constructions ,long distance dependencies ,wh-words ,extraction ,spoken French syntax ,General Medicine ,[SCCO.LING]Cognitive science/Linguistics - Abstract
International audience; This paper proposes a new analysis of long distance dependencies phenomena. The data collected through corpora indicate that the bridge verb and its dependents follow a very specific template limited to a verb with a modal interpretation and clitic pronouns. We propose an analysis based on complex predicates formation, in opposition to current analyses based on clause embedding. Therefore, there is no longer a need for long dis-tance processes: the movement of the relative or interrogative pronoun remains local. All the constraints on this pattern will be formulated in constructional terms.
- Published
- 2014
15. Processing covert dependencies: An SAT study on Mandarin wh-in-situ questions
- Author
-
Xiang, M, Xiang, M, Dillon, B, Wagers, M, Liu, F, Guo, T, Xiang, M, Xiang, M, Dillon, B, Wagers, M, Liu, F, and Guo, T
- Abstract
In wh-in-situ languages like Mandarin Chinese, in which the wh-phrase remains in a canonical argument position in wh-questions, syntactic theories generally posit that a covert dependency between the in-situ position and a clause-initial syntactic operator must nonetheless hold at logical form. Wh-in-situ languages and wh-fronted languages are in this way abstractly similar. This paper investigates whether the processing of Mandarin wh-in-situ questions indeed involves constructing a long-distance dependency. Using the multiple-response speed-accuracy tradeoff (SAT) paradigm, we show that Chinese wh-in-situ questions incur more processing costs than their non-wh counterparts. Furthermore, the length of the covert dependency affects only processing accuracy, but not processing speed. This pattern suggests a content-addressable memory process underlying the construction of wh-in-situ dependencies, similar to overt long distance dependencies in English. © 2013 Springer Science+Business Media Dordrecht.
- Published
- 2014
Catalog
Discovery Service for Jio Institute Digital Library
For full access to our library's resources, please sign in.