--- trunk/TODO	2006/05/14 13:42:59	494
+++ trunk/TODO	2007/02/15 22:42:51	801
@@ -13,9 +13,36 @@
 + apply regex on records from input to fix-up character encodings [2.11]
 + add support for KinoSearch search library [2.12]
 + added new set-based normalizer which is pure perl code [2.13]
-- support arrays for normalize/path and lookup
-- add Excel input format
++ added --stats to report field and subfield usage [2.14]
++ add validator for input data [2.15]
++ add Excel input format [2.16]
++ remove WebPAC::Normalize::XML and promote WebPAC::Normalize::Set to WebPAC::Normalize [2.20]
++ support arrays for normalize/path [2.21]
++ add marc to normalize and create export MARC file [2.22]
++ implement indicators and repetable subfield in marc export [2.23]
++ add WebPAC::Output::MARC [2.24]
++ add config() and id() to WebPAC::Normalize
++ support local (by hostname) config files
++ implement marc_original_order to remap source records to marc [2.25]
++ fix statistics to use original data instead of data after modify_records
++ fix encoding and recoding issues (use UTF-8 as WebPAC native encoding) [2.26]
++ modify_file preserve order of translations in file [2.27]
++ modify_records regexpes now match just first occurence (repeat to get second...)
++ fix WebPAC::Output::MARC encoding troubles
++ generate reports (validation and stats) for each input
++ rewrite lookup support to use WebPAC::Normalize [2.28]
++ marc_leader shouldn't really be included in hash returned by data_structure
++ add checks for search directive in normalization to parser
++ lookup to another input file
++ support splitting of config yml to multiple files
++ add set and get to create in-memory lookup
++ support marc_remove('*')
+- leader(position,...), indicator(field,nr) nr=1|2 for MARC input
+- fix-length fields (<100) support
+- validate should ignore modify_file
+- add option to specify output marc path in config.yml
 - add dBase input format
 - remove delimiters characters from index and query entered
 - delete unused files in database directories
 - scoring for various fields in input/*.xml
+- marclint - validate 035$9 as valid