Annotation of /trunk/TODO

+ add multiple databases
+ support multiple inputs to single database [2.00_1]
+ load multiple input/*.xml files for one input
+ lookups now works [2.00_3]
+ create links to other databases [2.00_4]
+ add regexp filter [2.00_5]
+ add YAML as normalize format
+ add more input formats (MARC::Fast and others) [2.00_6]
+ update to use Search::Estraier [2.09]
+ fix characters generated in [% search %] (move that to Webpacus?)
+ fix nasty bug with repeatable subfields [2.10]
+ write pure perl Search::HyperEstraier [Search::Estraier is on CPAN]
+ apply regex on records from input to fix-up character encodings [2.11]
+ add support for KinoSearch search library [2.12]
+ added new set-based normalizer which is pure perl code [2.13]
+ added --stats to report field and subfield usage [2.14]
+ add validator for input data [2.15]
+ add Excel input format [2.16]
+ remove WebPAC::Normalize::XML and promote WebPAC::Normalize::Set to WebPAC::Normalize [2.20]
+ support arrays for normalize/path [2.21]
+ add marc to normalize and create export MARC file [2.22]
+ implement indicators and repetable subfield in marc export [2.23]
+ add WebPAC::Output::MARC [2.24]
+ add config() and id() to WebPAC::Normalize
+ support local (by hostname) config files
+ implement marc_original_order to remap source records to marc [2.25]
+ fix statistics to use original data instead of data after modify_records
+ fix encoding and recoding issues (use UTF-8 as WebPAC native encoding) [2.26]
+ modify_file preserve order of translations in file [2.27]
+ modify_records regexpes now match just first occurence (repeat to get second...)
+ fix WebPAC::Output::MARC encoding troubles
+ generate reports (validation and stats) for each input
+ rewrite lookup support to use WebPAC::Normalize [2.28]
+ marc_leader shouldn't really be included in hash returned by data_structure
+ add checks for search directive in normalization to parser
+ lookup to another input file
+ support splitting of config yml to multiple files
+ add set and get to create in-memory lookup
+ support marc_remove('*')
+ fix-length fields (<100) support [2.29]
+ work without indexers installed or enabled [2.30]
+ simpliest possible conf/llin.yml as example
- load_ds/save_ds should use on-disk hash to preserve inodes
- leader(position,...), indicator(field,nr) nr=1|2 for MARC input
- validate should ignore modify_file
- add option to specify output marc path in config.yml
- add dBase input format
- remove delimiters characters from index and query entered
- delete unused files in database directories
- scoring for various fields in input/*.xml
- marclint - validate 035$9 as valid
1	dpavlin	233	+ add multiple databases
2			+ support multiple inputs to single database [2.00_1]
3	dpavlin	285	+ load multiple input/*.xml files for one input
4	dpavlin	255	+ lookups now works [2.00_3]
5	dpavlin	256	+ create links to other databases [2.00_4]
6	dpavlin	260	+ add regexp filter [2.00_5]
7	dpavlin	269	+ add YAML as normalize format
8	dpavlin	291	+ add more input formats (MARC::Fast and others) [2.00_6]
9	dpavlin	343	+ update to use Search::Estraier [2.09]
10	dpavlin	369	+ fix characters generated in [% search %] (move that to Webpacus?)
11	dpavlin	373	+ fix nasty bug with repeatable subfields [2.10]
12	dpavlin	424	+ write pure perl Search::HyperEstraier [Search::Estraier is on CPAN]
13			+ apply regex on records from input to fix-up character encodings [2.11]
14	dpavlin	431	+ add support for KinoSearch search library [2.12]
15	dpavlin	494	+ added new set-based normalizer which is pure perl code [2.13]
16	dpavlin	507	+ added --stats to report field and subfield usage [2.14]
17	dpavlin	516	+ add validator for input data [2.15]
18	dpavlin	525	+ add Excel input format [2.16]
19	dpavlin	536	+ remove WebPAC::Normalize::XML and promote WebPAC::Normalize::Set to WebPAC::Normalize [2.20]
20	dpavlin	539	+ support arrays for normalize/path [2.21]
21	dpavlin	547	+ add marc to normalize and create export MARC file [2.22]
22			+ implement indicators and repetable subfield in marc export [2.23]
23	dpavlin	584	+ add WebPAC::Output::MARC [2.24]
24	dpavlin	595	+ add config() and id() to WebPAC::Normalize
25	dpavlin	617	+ support local (by hostname) config files
26			+ implement marc_original_order to remap source records to marc [2.25]
27	dpavlin	625	+ fix statistics to use original data instead of data after modify_records
28			+ fix encoding and recoding issues (use UTF-8 as WebPAC native encoding) [2.26]
29	dpavlin	636	+ modify_file preserve order of translations in file [2.27]
30	dpavlin	663	+ modify_records regexpes now match just first occurence (repeat to get second...)
31			+ fix WebPAC::Output::MARC encoding troubles
32	dpavlin	671	+ generate reports (validation and stats) for each input
33	dpavlin	744	+ rewrite lookup support to use WebPAC::Normalize [2.28]
34			+ marc_leader shouldn't really be included in hash returned by data_structure
35	dpavlin	755	+ add checks for search directive in normalization to parser
36	dpavlin	756	+ lookup to another input file
37	dpavlin	759	+ support splitting of config yml to multiple files
38	dpavlin	789	+ add set and get to create in-memory lookup
39			+ support marc_remove('*')
40	dpavlin	815	+ fix-length fields (<100) support [2.29]
41	dpavlin	866	+ work without indexers installed or enabled [2.30]
42	dpavlin	867	+ simpliest possible conf/llin.yml as example
43	dpavlin	804	- load_ds/save_ds should use on-disk hash to preserve inodes
44	dpavlin	801	- leader(position,...), indicator(field,nr) nr=1\|2 for MARC input
45	dpavlin	759	- validate should ignore modify_file
46	dpavlin	739	- add option to specify output marc path in config.yml
47	dpavlin	411	- add dBase input format
48	dpavlin	330	- remove delimiters characters from index and query entered
49	dpavlin	218	- delete unused files in database directories
50	dpavlin	151	- scoring for various fields in input/*.xml
51	dpavlin	628	- marclint - validate 035$9 as valid