--- trunk/TODO 2006/05/14 13:42:59 494 +++ trunk/TODO 2006/10/05 14:46:50 739 @@ -13,9 +13,31 @@ + apply regex on records from input to fix-up character encodings [2.11] + add support for KinoSearch search library [2.12] + added new set-based normalizer which is pure perl code [2.13] -- support arrays for normalize/path and lookup -- add Excel input format ++ added --stats to report field and subfield usage [2.14] ++ add validator for input data [2.15] ++ add Excel input format [2.16] ++ remove WebPAC::Normalize::XML and promote WebPAC::Normalize::Set to WebPAC::Normalize [2.20] ++ support arrays for normalize/path [2.21] ++ add marc to normalize and create export MARC file [2.22] ++ implement indicators and repetable subfield in marc export [2.23] ++ add WebPAC::Output::MARC [2.24] ++ add config() and id() to WebPAC::Normalize ++ support local (by hostname) config files ++ implement marc_original_order to remap source records to marc [2.25] ++ fix statistics to use original data instead of data after modify_records ++ fix encoding and recoding issues (use UTF-8 as WebPAC native encoding) [2.26] ++ modify_file preserve order of translations in file [2.27] ++ modify_records regexpes now match just first occurence (repeat to get second...) ++ fix WebPAC::Output::MARC encoding troubles ++ generate reports (validation and stats) for each input +- rewrite lookup support to use WebPAC::Normalize +- add option to specify output marc path in config.yml +- marc_leader shouldn't really be included in hash returned by data_structure +- add checks for search directive in normalization to parser +- support splitting of config yml to multiple files - add dBase input format - remove delimiters characters from index and query entered - delete unused files in database directories - scoring for various fields in input/*.xml +- marclint - validate 035$9 as valid +- lookup to another input file