--- trunk/TODO 2006/01/07 01:40:01 343 +++ trunk/TODO 2007/02/15 22:42:51 801 @@ -7,8 +7,42 @@ + add YAML as normalize format + add more input formats (MARC::Fast and others) [2.00_6] + update to use Search::Estraier [2.09] -- fix characters generated in [% search %] (move that to Webpacus?) ++ fix characters generated in [% search %] (move that to Webpacus?) ++ fix nasty bug with repeatable subfields [2.10] ++ write pure perl Search::HyperEstraier [Search::Estraier is on CPAN] ++ apply regex on records from input to fix-up character encodings [2.11] ++ add support for KinoSearch search library [2.12] ++ added new set-based normalizer which is pure perl code [2.13] ++ added --stats to report field and subfield usage [2.14] ++ add validator for input data [2.15] ++ add Excel input format [2.16] ++ remove WebPAC::Normalize::XML and promote WebPAC::Normalize::Set to WebPAC::Normalize [2.20] ++ support arrays for normalize/path [2.21] ++ add marc to normalize and create export MARC file [2.22] ++ implement indicators and repetable subfield in marc export [2.23] ++ add WebPAC::Output::MARC [2.24] ++ add config() and id() to WebPAC::Normalize ++ support local (by hostname) config files ++ implement marc_original_order to remap source records to marc [2.25] ++ fix statistics to use original data instead of data after modify_records ++ fix encoding and recoding issues (use UTF-8 as WebPAC native encoding) [2.26] ++ modify_file preserve order of translations in file [2.27] ++ modify_records regexpes now match just first occurence (repeat to get second...) ++ fix WebPAC::Output::MARC encoding troubles ++ generate reports (validation and stats) for each input ++ rewrite lookup support to use WebPAC::Normalize [2.28] ++ marc_leader shouldn't really be included in hash returned by data_structure ++ add checks for search directive in normalization to parser ++ lookup to another input file ++ support splitting of config yml to multiple files ++ add set and get to create in-memory lookup ++ support marc_remove('*') +- leader(position,...), indicator(field,nr) nr=1|2 for MARC input +- fix-length fields (<100) support +- validate should ignore modify_file +- add option to specify output marc path in config.yml +- add dBase input format - remove delimiters characters from index and query entered - delete unused files in database directories - scoring for various fields in input/*.xml -- write pure perl Search::HyperEstraier +- marclint - validate 035$9 as valid