The goal of our research is to compare novel semantic techniques for identifying implicit links between utterances in multi-participant CSCL chat conversations. Cohesion, reflected by the strength of the semantic relations behind the automatically identified links, is assessed using WordNet-based semantic distances, as well as unsupervised semantic models, i.e. Latent Semantic Analysis (LSA) and Latent Dirichlet Allocation (LDA). The analysis is built on top of the ReaderBench framework and multiple identification heuristics were compared, including: semantic cohesion metrics, normalized cohesion measures and Mihalcea’s formula. A corpus of 55 conversations in which participants used explicit links between utterances where they considered necessary for clarity was used for validation. Our study represents an in-depth analysis of multiple methods used to identify implicit links and reveals the accuracy of each technique in terms of capturing the explicit references made by users. Statistical similarity measures ensured the best overall identification accuracy when using Mihalcea’s formula, while WordNet-based techniques provided best results for un-normalized similarity scores applied on a window of 5 utterances and a time frame of 1 minute.
|Title of host publication||Making a Difference: Prioritizing Equity and Access in CSCL|
|Subtitle of host publication||12th International Conference on Computer Supported Collaborative Learning, Volume 1|
|Editors||Brian K. Smith, Marcela Borge, Emma Mercier, Kyu Yon Lim|
|Publisher||International Society of the Learning Sciences|
|Publication status||Published - 22 Jun 2017|
|Event||Making a Difference: Prioritizing Equity and Access in CSCL: 12th International Conference on Computer Supported Collaborative Learning - Philadelphia, United States|
Duration: 18 Jun 2017 → 21 Jun 2017
|Conference||Making a Difference: Prioritizing Equity and Access in CSCL|
|Abbreviated title||CSCL 2017|
|Period||18/06/17 → 21/06/17|
Gutu, G., Dascalu, M., Rebedea, T., & Trausan-Matu, S. (2017). Time and Semantic Similarity – What is the Best Alternative to Capture Implicit Links in CSCL Conversations? In B. K. Smith, M. Borge, E. Mercier, & K. Y. Lim (Eds.), Making a Difference: Prioritizing Equity and Access in CSCL: 12th International Conference on Computer Supported Collaborative Learning, Volume 1 (pp. 223-230). International Society of the Learning Sciences.