added --duplicates switch to reindex.pl to keep duplicate items, create new index every time to prevent duplicate results for same item