Detecting the origin of text segments efficiently
Abdel Hamid O, Behzadi B, Christoph S, Henzinger MH. 2009. Detecting the origin of text segments efficiently. 18th International World Wide Web Conference. WWW: International Conference on World Wide Web, 61–70.
Download
No fulltext has been uploaded. References only!
Conference Paper
| Published
| English
Scopus indexed
Author
Abdel Hamid, Ossama;
Behzadi, Behshad;
Christoph, Stefan;
Henzinger, MonikaISTA
Abstract
In the origin detection problem an algorithm is given a set S of documents, ordered by creation time, and a query document D. It needs to output for every consecutive sequence of k alphanumeric terms in D the earliest document in $S$ in which the sequence appeared (if such a document exists). Algorithms for the origin detection problem can, for example, be used to detect the "origin" of text segments in D and thus to detect novel content in D. They can also find the document from which the author of D has copied the most (or show that D is mostly original.) We concentrate on solutions that use only a fixed amount of memory. We propose novel algorithms for this problem and evaluate them together with a large number of previously published algorithms. Our results show that (1) detecting the origin of text segments efficiently can be done with very high accuracy even when the space used is less than 1% of the size of the documents in $S$, (2) the precision degrades smoothly with the amount of available space, (3) various estimation techniques can be used to increase the performance of the algorithms.
Publishing Year
Date Published
2009-04-01
Proceedings Title
18th International World Wide Web Conference
Publisher
Association for Computing Machinery
Page
61-70
Conference
WWW: International Conference on World Wide Web
Conference Location
Madrid, Spain
Conference Date
2009-04-20 – 2009-04-24
ISBN
IST-REx-ID
Cite this
Abdel Hamid O, Behzadi B, Christoph S, Henzinger MH. Detecting the origin of text segments efficiently. In: 18th International World Wide Web Conference. Association for Computing Machinery; 2009:61-70. doi:10.1145/1526709.1526719
Abdel Hamid, O., Behzadi, B., Christoph, S., & Henzinger, M. H. (2009). Detecting the origin of text segments efficiently. In 18th International World Wide Web Conference (pp. 61–70). Madrid, Spain: Association for Computing Machinery. https://doi.org/10.1145/1526709.1526719
Abdel Hamid, Ossama, Behshad Behzadi, Stefan Christoph, and Monika H Henzinger. “Detecting the Origin of Text Segments Efficiently.” In 18th International World Wide Web Conference, 61–70. Association for Computing Machinery, 2009. https://doi.org/10.1145/1526709.1526719.
O. Abdel Hamid, B. Behzadi, S. Christoph, and M. H. Henzinger, “Detecting the origin of text segments efficiently,” in 18th International World Wide Web Conference, Madrid, Spain, 2009, pp. 61–70.
Abdel Hamid O, Behzadi B, Christoph S, Henzinger MH. 2009. Detecting the origin of text segments efficiently. 18th International World Wide Web Conference. WWW: International Conference on World Wide Web, 61–70.
Abdel Hamid, Ossama, et al. “Detecting the Origin of Text Segments Efficiently.” 18th International World Wide Web Conference, Association for Computing Machinery, 2009, pp. 61–70, doi:10.1145/1526709.1526719.