Speeding up Local Text Reuse Detection by Locality-Sensitive Hashing
Language
Japanese
Type
Proceedings of Japanese Conferences
Authors
Masaki Nouso, Koichi Kise, Masakazu iwamura
Title
Speeding up Local Text Reuse Detection by Locality-Sensitive Hashing
Journal
Proc. First Forum on Data Engineering and Information Management
Presentation number
D8-6
Reviewed
Not reviewed
Date
March 2009
Research fields
Information Retrieval
Key
Nouso2009_FDEI (id=1077)
Abstract
Local text reuse detection is a technology to detect partial copies of documents and useful for anti-plagiarism of documents.
A problem of methods for local text reuse detection is how to make the calculation of similarity of text parts efficiently, since it is generally based on nearest neighbor search whose cost is related to the size of the database.
In order to solve this problem, we propose a method of local text reuse detection with the help of approximate nearest neighbor search.
Methods called Locality-Sensitive Hashing (LSH) and its variant called Spherical LSH are both employed to speed up the processing.
Export this publication
Tab-separated. Paste into the sheet starting at column A. Required fields that cannot be inferred are left blank.
Format definition
Edits apply immediately and stay in effect until you pick a style again or reset. First line is the default; add lines like "book: …" to override per type.
How to write the definition
Insert a field with braces like {authors}. A part enclosed in [ ... ] is omitted entirely when any field inside it is empty. Available fields:
One macro per line as \name{field}{field}…. A field name in braces is replaced by its (LaTeX-escaped) value; other text is kept. Rename macros or add lines freely — they appear in the macro selector. A line like master_thesis: thesis fixes the macro for a type (automatic choice: journals use paperdoi with a DOI, paperno with a number, else paper; conferences conf with pages, else confpaper; books book). {pages} comes as 119--124; {journal} falls back to the book title. Fields: