/[webpac2]/trunk/t
This is repository of my old source code which isn't updated any more. Go to git.rot13.org for current projects!
ViewVC logotype

Log of /trunk/t

View Directory Listing Directory Listing

Sticky Revision:
Revision 851 - Directory Listing
Modified Sun May 27 11:14:40 2007 UTC (16 years, 11 months ago) by dpavlin 
 r1258@llin:  dpavlin | 2007-05-27 13:14:58 +0200
 Changed delimiter_templates arguments to be more intuitive,
 disable MARC generation when running delimiters validation
 (this is just disk overhead)
Revision 849 - Directory Listing
Modified Sun May 27 10:50:37 2007 UTC (16 years, 11 months ago) by dpavlin 
 r1253@llin:  dpavlin | 2007-05-27 12:49:54 +0200
 added accumulated delimiters templates to hold all templates which are
 found in this run (and thus saved to --validate-delimiters file) while
 generating correct stats for each input
Revision 847 - Directory Listing
Modified Sun May 27 09:53:54 2007 UTC (16 years, 11 months ago) by dpavlin 
 r1250@llin:  dpavlin | 2007-05-27 11:54:28 +0200
 test creation of new file, hush debugging output
Revision 846 - Directory Listing
Modified Sun May 27 09:53:52 2007 UTC (16 years, 11 months ago) by dpavlin 
 r1249@llin:  dpavlin | 2007-05-27 11:49:30 +0200
 fix temp file handling
Revision 837 - Directory Listing
Modified Thu May 24 12:44:45 2007 UTC (16 years, 11 months ago) by dpavlin 
 r1232@llin:  dpavlin | 2007-05-24 14:44:53 +0200
 added storing and retriving of delimiters templates to file and some basic tests
Revision 835 - Directory Listing
Modified Thu May 24 10:53:50 2007 UTC (16 years, 11 months ago) by dpavlin 
 r1228@llin:  dpavlin | 2007-05-24 12:53:57 +0200
 report invalid delimiter combinations
Revision 834 - Directory Listing
Modified Thu May 24 10:53:48 2007 UTC (16 years, 11 months ago) by dpavlin 
 r1227@llin:  dpavlin | 2007-05-24 10:26:01 +0200
 generate humanly readable report or machine readable
Revision 832 - Directory Listing
Modified Wed May 23 20:03:16 2007 UTC (16 years, 11 months ago) by dpavlin 
 r1221@llin:  dpavlin | 2007-05-20 22:43:38 +0200
 added delimiters_templates report
Revision 829 - Directory Listing
Modified Sun May 20 16:19:19 2007 UTC (16 years, 11 months ago) by dpavlin 
 r1214@llin:  dpavlin | 2007-05-20 18:19:12 +0200
 more sample data
Revision 828 - Directory Listing
Modified Sun May 20 16:19:17 2007 UTC (16 years, 11 months ago) by dpavlin 
 r1213@llin:  dpavlin | 2007-05-20 18:16:02 +0200
 and fix to actually count right templates :-)
Revision 827 - Directory Listing
Modified Sun May 20 16:19:16 2007 UTC (16 years, 11 months ago) by dpavlin 
 r1212@llin:  dpavlin | 2007-05-20 17:39:01 +0200
 first try at implementation of delimiters validation
Revision 823 - Directory Listing
Modified Wed Apr 11 12:22:37 2007 UTC (17 years ago) by dpavlin 
 r1203@llin:  dpavlin | 2007-04-11 14:22:28 +0200
 spacial handling for empty subfields [0.18]
Revision 822 - Directory Listing
Modified Wed Apr 11 12:22:35 2007 UTC (17 years ago) by dpavlin 
 r1202@llin:  dpavlin | 2007-04-11 14:00:20 +0200
 remove empty subfield test data
Revision 821 - Directory Listing
Modified Wed Apr 11 12:22:33 2007 UTC (17 years ago) by dpavlin 
 r1201@llin:  dpavlin | 2007-04-11 13:54:24 +0200
 refactor filter tests
Revision 820 - Directory Listing
Modified Wed Apr 11 12:22:31 2007 UTC (17 years ago) by dpavlin 
 r1200@llin:  dpavlin | 2007-04-11 13:38:57 +0200
 cleanup test (call patch /fake/ because they are),
 added test which fails because of empty subfield modify bug
Revision 819 - Directory Listing
Modified Wed Apr 11 10:09:34 2007 UTC (17 years ago) by dpavlin 
 r1198@llin:  dpavlin | 2007-04-11 12:09:29 +0200
 prefix, suffix and surround now work correcty with empty strings and zeros
Revision 815 - Directory Listing
Modified Mon Apr 2 17:20:01 2007 UTC (17 years ago) by dpavlin 
 r1192@llin:  dpavlin | 2007-04-02 19:20:01 +0200
 added support for fix-length fields using marc_fixed [2.29]
Revision 813 - Directory Listing
Modified Sun Apr 1 21:47:47 2007 UTC (17 years, 1 month ago) by dpavlin 
 r1184@llin:  dpavlin | 2007-04-01 23:47:04 +0200
  r1182@llin:  dpavlin | 2007-04-01 23:44:03 +0200
  marc_duplicate now correctly duplicates leader data, new _get_marc_leader to
  return leader corresponding to last _get_marc_fields call, added marc_count
  which returns number of created MARC records
Revision 811 - Directory Listing
Modified Sun Apr 1 21:47:40 2007 UTC (17 years, 1 month ago) by dpavlin 
 r1179@llin:  dpavlin | 2007-04-01 22:42:35 +0200
 hush test without --debug
Revision 808 - Directory Listing
Modified Sun Apr 1 14:15:08 2007 UTC (17 years, 1 month ago) by dpavlin 
added test modify rules
Revision 800 - Directory Listing
Modified Sun Feb 4 23:10:18 2007 UTC (17 years, 2 months ago) by dpavlin 
decorate output from regexp modify with filename and line
Revision 799 - Directory Listing
Modified Sun Feb 4 15:09:01 2007 UTC (17 years, 2 months ago) by dpavlin 
minor tweaks to test modify_file
Revision 797 - Directory Listing
Modified Sun Feb 4 13:28:30 2007 UTC (17 years, 2 months ago) by dpavlin 
finish tweaking mock framework, test and fix problem with slashes in modify_record
Revision 796 - Directory Listing
Modified Sun Feb 4 12:42:43 2007 UTC (17 years, 2 months ago) by dpavlin 
a try at mocking of inputs in WebPAC::Input::Test
Revision 794 - Directory Listing
Modified Sun Feb 4 12:20:54 2007 UTC (17 years, 2 months ago) by dpavlin 
modify record test which fails (with slash /), tweaks
Revision 791 - Directory Listing
Modified Tue Jan 30 18:21:17 2007 UTC (17 years, 3 months ago) by dpavlin 
added count
Revision 787 - Directory Listing
Modified Sun Dec 10 12:56:05 2006 UTC (17 years, 4 months ago) by dpavlin 
test marc_remove('*')
Revision 784 - Directory Listing
Modified Wed Dec 6 23:43:45 2006 UTC (17 years, 4 months ago) by dpavlin 
added regex: to modify_records
Revision 781 - Directory Listing
Modified Sun Nov 5 15:03:59 2006 UTC (17 years, 5 months ago) by dpavlin 
 r1141@llin:  dpavlin | 2006-11-05 16:03:48 +0100
 subset of Project Gutenberg catalog.rdf for testing
Revision 777 - Directory Listing
Modified Sun Nov 5 14:48:12 2006 UTC (17 years, 5 months ago) by dpavlin 
 r1133@llin:  dpavlin | 2006-11-05 15:48:00 +0100
 first cut at getting Project Gutenberg's RDF as input format for WebPAC
Revision 774 - Directory Listing
Modified Fri Nov 3 20:56:21 2006 UTC (17 years, 5 months ago) by dpavlin 
another swiping API change: input->dump is gone, replaced
with input->dump_ascii which is more understandable.
If you want to override default behaviour
(which is to use Data::Dump's dump in input->fetch_rec)
define dump_ascii in low-level WebPAC::Input:: API
Revision 771 - Directory Listing
Modified Fri Nov 3 20:40:33 2006 UTC (17 years, 5 months ago) by dpavlin 
 r1123@llin:  dpavlin | 2006-11-03 21:38:14 +0100
 implement fallback dump if low-level API isn't exposing dump_rec [0.15]
Revision 768 - Directory Listing
Modified Fri Nov 3 19:41:28 2006 UTC (17 years, 5 months ago) by dpavlin 
 r1117@llin:  dpavlin | 2006-11-03 20:42:24 +0100
 cleanup API a bit. validate_errors in now validate_rec [0.10]
Revision 767 - Directory Listing
Modified Tue Oct 31 13:44:42 2006 UTC (17 years, 6 months ago) by dpavlin 
 r1115@llin:  dpavlin | 2006-10-31 14:45:15 +0100
 fix unit test by removing old lookup code (but, it's missing new one now)
Revision 766 - Directory Listing
Modified Tue Oct 31 13:19:47 2006 UTC (17 years, 6 months ago) by dpavlin 
 r1113@llin:  dpavlin | 2006-10-31 14:17:02 +0100
 cleanup normalization error message for lookups and modify tests so they don't fail anymore
Revision 761 - Directory Listing
Modified Wed Oct 25 17:10:08 2006 UTC (17 years, 6 months ago) by dpavlin 
implemented load_row and save_row closures to serialize
input databases (using WebPAC::Store probably).
This will allow lookups to share on-disk storage with
low_mem option of WebPAC::Input, which is now gone
(under pressure of 600000+ record database which we
are now testing on)
Revision 755 - Directory Listing
Modified Sun Oct 8 20:28:17 2006 UTC (17 years, 6 months ago) by dpavlin 
 r1097@llin:  dpavlin | 2006-10-08 22:24:54 +0200
 replaced generate_marc with universal have_rules [0.08]
Revision 747 - Directory Listing
Modified Sun Oct 8 12:45:39 2006 UTC (17 years, 6 months ago) by dpavlin 
cleanup
Revision 746 - Directory Listing
Modified Sun Oct 8 12:43:39 2006 UTC (17 years, 6 months ago) by dpavlin 
 r1085@llin:  dpavlin | 2006-10-08 14:40:26 +0200
 added files needed for tests, quitet log
Revision 737 - Directory Listing
Modified Thu Oct 5 14:38:45 2006 UTC (17 years, 6 months ago) by dpavlin 
 r1067@llin:  dpavlin | 2006-10-05 16:35:45 +0200
 added generate_marc to find out if normalization rules have marc* directives
Revision 736 - Directory Listing
Modified Thu Oct 5 12:57:51 2006 UTC (17 years, 6 months ago) by dpavlin 
 r1065@llin:  dpavlin | 2006-10-05 14:54:48 +0200
 actually we don't need *_load_ds, but _load_row for lookups
Revision 735 - Directory Listing
Modified Mon Oct 2 09:31:25 2006 UTC (17 years, 6 months ago) by dpavlin 
 r1063@llin:  dpavlin | 2006-10-02 11:28:37 +0200
 added load_row and save_row needed for lookups [0.14]
Revision 733 - Directory Listing
Modified Sun Oct 1 20:14:09 2006 UTC (17 years, 6 months ago) by dpavlin 
 r1059@llin:  dpavlin | 2006-10-01 15:52:48 +0200
 don't cleanup temp cache directory if in debug mode
Revision 727 - Directory Listing
Modified Fri Sep 29 19:52:21 2006 UTC (17 years, 7 months ago) by dpavlin 
 r1046@llin:  dpavlin | 2006-09-29 21:49:23 +0200
 use of top-level WebPAC::Input is enough
Revision 725 - Directory Listing
Modified Fri Sep 29 18:55:41 2006 UTC (17 years, 7 months ago) by dpavlin 
 r1042@llin:  dpavlin | 2006-09-29 20:53:01 +0200
 added _set_load_ds, and load_ds_coderef to data_structure so that lookups can call
 closure to fetch records, implemented lookup based on new format generated by
 WebPAC::Parser, test to be sure that it somewhat works :-) [0.21]
Revision 724 - Directory Listing
Modified Fri Sep 29 18:55:31 2006 UTC (17 years, 7 months ago) by dpavlin 
 r1038@llin:  dpavlin | 2006-09-29 14:27:45 +0200
 remove comments from normalize rules when parsing
Revision 719 - Directory Listing
Modified Fri Sep 29 12:24:43 2006 UTC (17 years, 7 months ago) by dpavlin 
 r1032@llin:  dpavlin | 2006-09-29 14:22:09 +0200
 dump normalize rules when in debug mode
Revision 717 - Directory Listing
Modified Tue Sep 26 18:14:14 2006 UTC (17 years, 7 months ago) by dpavlin 
 r1028@llin:  dpavlin | 2006-09-26 20:09:18 +0200
 added normalize_rules [0.06]
Revision 715 - Directory Listing
Modified Tue Sep 26 14:03:12 2006 UTC (17 years, 7 months ago) by dpavlin 
 r1024@llin:  dpavlin | 2006-09-26 16:00:56 +0200
 added load_lookup [0.12]
Revision 713 - Directory Listing
Modified Tue Sep 26 12:42:49 2006 UTC (17 years, 7 months ago) by dpavlin 
 r1020@llin:  dpavlin | 2006-09-26 14:40:34 +0200
 refactored WebPAC::Store
Revision 706 - Directory Listing
Modified Mon Sep 25 14:06:49 2006 UTC (17 years, 7 months ago) by dpavlin 
 r1006@llin:  dpavlin | 2006-09-25 16:04:39 +0200
 added have_lookup_create
Revision 705 - Directory Listing
Modified Mon Sep 25 13:46:36 2006 UTC (17 years, 7 months ago) by dpavlin 
 r1004@llin:  dpavlin | 2006-09-25 15:44:23 +0200
 test lookup_create_rules
Revision 704 - Directory Listing
Modified Mon Sep 25 13:24:25 2006 UTC (17 years, 7 months ago) by dpavlin 
 r1001@llin:  dpavlin | 2006-09-25 15:21:57 +0200
 and test it
Revision 703 - Directory Listing
Modified Mon Sep 25 13:24:09 2006 UTC (17 years, 7 months ago) by dpavlin 
 r1000@llin:  dpavlin | 2006-09-25 15:16:49 +0200
 support multiple lookups on same input file
 move _read_sources and _parse_lookups to private functions
Revision 701 - Directory Listing
Modified Mon Sep 25 12:51:47 2006 UTC (17 years, 7 months ago) by dpavlin 
 r994@llin:  dpavlin | 2006-09-25 14:49:05 +0200
 refactore support for multiple normalize files in each lookup
Revision 700 - Directory Listing
Modified Mon Sep 25 12:51:33 2006 UTC (17 years, 7 months ago) by dpavlin 
 r993@llin:  dpavlin | 2006-09-25 13:52:43 +0200
 upgrade $input->{normalize} to ARRAY
Revision 698 - Directory Listing
Modified Mon Sep 25 11:14:53 2006 UTC (17 years, 7 months ago) by dpavlin 
 r990@llin:  dpavlin | 2006-09-25 13:12:42 +0200
 new depends method to track dependencies, input in most places can be input name or
 hash with key 'name' which will be used as input (for exaple, from configuration file),
 database and input names will have correctly stripped quotes,
 begin removal of old lookup support
Revision 692 - Directory Listing
Modified Sun Sep 24 21:13:40 2006 UTC (17 years, 7 months ago) by dpavlin 
 r978@llin:  dpavlin | 2006-09-24 23:10:22 +0200
 final touches before diving into lookup creation and usage
Revision 691 - Directory Listing
Modified Sun Sep 24 21:13:36 2006 UTC (17 years, 7 months ago) by dpavlin 
 r977@llin:  dpavlin | 2006-09-24 22:21:46 +0200
 parse normalize files for lookups one by one, better error reporting
Revision 690 - Directory Listing
Modified Sun Sep 24 19:00:56 2006 UTC (17 years, 7 months ago) by dpavlin 
 r975@llin:  dpavlin | 2006-09-24 20:58:49 +0200
 report invalid databases and inputs for lookups
Revision 689 - Directory Listing
Modified Sun Sep 24 18:52:35 2006 UTC (17 years, 7 months ago) by dpavlin 
 r972@llin:  dpavlin | 2006-09-24 20:50:22 +0200
 check for valid databases and inputs [0.02]
Revision 688 - Directory Listing
Modified Sun Sep 24 18:52:31 2006 UTC (17 years, 7 months ago) by dpavlin 
 r971@llin:  dpavlin | 2006-09-24 20:04:20 +0200
 iterate_inputs now returns also database name and full database config [0.02]
Revision 687 - Directory Listing
Modified Sun Sep 24 17:49:05 2006 UTC (17 years, 7 months ago) by dpavlin 
 r969@llin:  dpavlin | 2006-09-24 19:47:01 +0200
 use Log::Log4perl for logging
Revision 686 - Directory Listing
Modified Sun Sep 24 17:25:04 2006 UTC (17 years, 7 months ago) by dpavlin 
 r966@llin:  dpavlin | 2006-09-24 19:22:45 +0200
 first cut at WebPAC::Parser which will allow lookups to be specified in
 normalization file
Revision 685 - Directory Listing
Modified Sun Sep 24 17:24:59 2006 UTC (17 years, 7 months ago) by dpavlin 
 r965@llin:  dpavlin | 2006-09-24 18:07:03 +0200
 added iterate_inputs
Revision 682 - Directory Listing
Modified Sun Sep 24 15:28:54 2006 UTC (17 years, 7 months ago) by dpavlin 
 r958@llin:  dpavlin | 2006-09-24 17:26:37 +0200
 added $config->get and $config->webpac
Revision 681 - Directory Listing
Modified Sun Sep 24 15:28:49 2006 UTC (17 years, 7 months ago) by dpavlin 
 r957@llin:  dpavlin | 2006-09-24 17:03:52 +0200
 move parts of configuration handling to WebPAC::Config
Revision 670 - Directory Listing
Modified Mon Sep 11 14:29:08 2006 UTC (17 years, 7 months ago) by dpavlin 
 r938@llin:  dpavlin | 2006-09-11 16:27:57 +0200
 tests, corrections and version bump [0.08]
Revision 669 - Directory Listing
Modified Mon Sep 11 14:29:01 2006 UTC (17 years, 7 months ago) by dpavlin 
 r937@llin:  dpavlin | 2006-09-11 16:26:07 +0200
 changed _pack_subfields_hash usage and document it
Revision 666 - Directory Listing
Modified Mon Sep 11 12:32:51 2006 UTC (17 years, 7 months ago) by dpavlin 
 r932@llin:  dpavlin | 2006-09-11 14:31:51 +0200
 simplify errors return hash, a bit better formatting of report
Revision 665 - Directory Listing
Modified Mon Sep 11 11:57:30 2006 UTC (17 years, 7 months ago) by dpavlin 
 r929@llin:  dpavlin | 2006-09-11 13:56:02 +0200
 another cut at simplification of report
Revision 659 - Directory Listing
Modified Fri Sep 8 14:35:31 2006 UTC (17 years, 7 months ago) by dpavlin 
test repeatable subfields
Revision 655 - Directory Listing
Modified Thu Sep 7 16:54:47 2006 UTC (17 years, 7 months ago) by dpavlin 
test extra subfields more deeply
Revision 654 - Directory Listing
Modified Thu Sep 7 16:41:08 2006 UTC (17 years, 7 months ago) by dpavlin 
again refactored a bit validation hash
Revision 653 - Directory Listing
Modified Thu Sep 7 15:57:48 2006 UTC (17 years, 7 months ago) by dpavlin 
added reset_errors and all_errors to validator (real reporter is still pending),
rewriten validator tests
Revision 641 - Directory Listing
Modified Wed Sep 6 20:54:47 2006 UTC (17 years, 7 months ago) by dpavlin 
refactored _pack_subfields_hash in separate function
Revision 631 - Directory Listing
Modified Wed Sep 6 14:25:16 2006 UTC (17 years, 7 months ago) by dpavlin 
 r890@llin:  dpavlin | 2006-09-06 16:24:27 +0200
 rec1 now unrolls subfields in correct order (as in source file)
Revision 625 - Directory Listing
Modified Sat Aug 26 12:00:36 2006 UTC (17 years, 8 months ago) by dpavlin 
 r878@llin:  dpavlin | 2006-08-26 14:00:08 +0200
 removed some debugging output (or moved it to debug level), few tweaks [2.26]
Revision 616 - Directory Listing
Modified Wed Aug 23 14:29:43 2006 UTC (17 years, 8 months ago) by dpavlin 
marc_original_order has now arguments in order marc_field, original_field to
be consistent with other directives
Revision 614 - Directory Listing
Modified Wed Aug 23 14:10:10 2006 UTC (17 years, 8 months ago) by dpavlin 
 r859@llin:  dpavlin | 2006-08-23 16:10:52 +0200
 test data for 2-input.t
Revision 604 - Directory Listing
Modified Sun Jul 30 14:19:54 2006 UTC (17 years, 9 months ago) by dpavlin 
 r844@llin:  dpavlin | 2006-07-30 14:24:04 +0200
 first cut at marc_original_order
Revision 603 - Directory Listing
Modified Sun Jul 23 20:19:56 2006 UTC (17 years, 9 months ago) by dpavlin 
 r842@llin:  dpavlin | 2006-07-23 22:23:52 +0200
 append subfields
Revision 599 - Directory Listing
Modified Thu Jul 13 13:55:19 2006 UTC (17 years, 9 months ago) by dpavlin 
 r835@llin:  dpavlin | 2006-07-13 15:56:53 +0200
 test modify_record
Revision 596 - Directory Listing
Modified Thu Jul 13 11:54:27 2006 UTC (17 years, 9 months ago) by dpavlin 
 r830@llin:  dpavlin | 2006-07-13 13:55:17 +0200
 don't skip tests because of -T
Revision 585 - Directory Listing
Modified Wed Jul 5 19:52:45 2006 UTC (17 years, 9 months ago) by dpavlin 
 r810@llin:  dpavlin | 2006-07-05 21:53:01 +0200
 change of parametars to WebPAC::Input
Revision 579 - Directory Listing
Modified Tue Jul 4 11:08:43 2006 UTC (17 years, 9 months ago) by dpavlin 
 r798@llin:  dpavlin | 2006-07-04 13:08:44 +0200
 changed _get_marc_fields to return arrayref, tests and fix for marc_remove(field)
Revision 578 - Directory Listing
Modified Tue Jul 4 10:34:15 2006 UTC (17 years, 9 months ago) by dpavlin 
 r796@llin:  dpavlin | 2006-07-04 12:34:13 +0200
 created WebPAC::Output::MARC and cleanup run.pl
Revision 574 - Directory Listing
Modified Mon Jul 3 21:08:07 2006 UTC (17 years, 9 months ago) by dpavlin 
added marc_duplicate and marc_remove
Revision 571 - Directory Listing
Modified Mon Jul 3 14:30:22 2006 UTC (17 years, 9 months ago) by dpavlin 
marc() now supports fields < 10 which don't have indicators and subfields
Revision 566 - Directory Listing
Modified Sun Jul 2 21:17:54 2006 UTC (17 years, 9 months ago) by dpavlin 
test split_rec_on corner cases, and fix one
Revision 564 - Directory Listing
Modified Sun Jul 2 20:14:21 2006 UTC (17 years, 9 months ago) by dpavlin 
 r772@llin:  dpavlin | 2006-07-02 22:14:37 +0200
 rough implementation of marc_leader (not tested enough)
Revision 562 - Directory Listing
Modified Sun Jul 2 16:14:41 2006 UTC (17 years, 9 months ago) by dpavlin 
added marc_compose to specify manually subfield order in MARC and
split_rec_on to split single field into parts based on regex
Revision 557 - Directory Listing
Modified Sat Jul 1 22:36:39 2006 UTC (17 years, 10 months ago) by dpavlin 
 r762@llin:  dpavlin | 2006-07-02 00:36:50 +0200
 added test data files
Revision 555 - Directory Listing
Modified Sat Jul 1 10:19:39 2006 UTC (17 years, 10 months ago) by dpavlin 
 r757@llin:  dpavlin | 2006-07-01 12:19:34 +0200
 added -d [-d -d ...] flag and test_rec_rules
Revision 553 - Directory Listing
Modified Sat Jul 1 08:55:34 2006 UTC (17 years, 10 months ago) by dpavlin 
 r754@llin:  dpavlin | 2006-07-01 10:55:40 +0200
 tweak
Revision 550 - Directory Listing
Modified Fri Jun 30 18:48:33 2006 UTC (17 years, 10 months ago) by dpavlin 
 r748@llin:  dpavlin | 2006-06-30 20:48:29 +0200
 re-implement magic again (so that it actually work in all cases consistant).
 Depend on Data::Dump to enable nice output.
Revision 547 - Directory Listing
Modified Thu Jun 29 23:19:26 2006 UTC (17 years, 10 months ago) by dpavlin 
 r742@llin:  dpavlin | 2006-06-30 01:21:24 +0200
 added marc_repetable_subfield and marc_indicators, renamed marc21 to marc [2.23]
Revision 540 - Directory Listing
Modified Thu Jun 29 15:29:41 2006 UTC (17 years, 10 months ago) by dpavlin 
 r726@llin:  dpavlin | 2006-06-29 17:31:13 +0200
 add marc21 to normalize and create MARC file from those data [2.22]
Revision 538 - Directory Listing
Modified Thu Jun 29 15:29:19 2006 UTC (17 years, 10 months ago) by dpavlin 
 r722@llin:  dpavlin | 2006-06-26 21:29:56 +0200
 make private funtions with _
Revision 536 - Directory Listing
Modified Mon Jun 26 16:39:51 2006 UTC (17 years, 10 months ago) by dpavlin 
 r719@llin:  dpavlin | 2006-06-26 18:40:57 +0200
 big refacture: depriciate and remove all normalisation formats except .pl sets (but
 old code is still available in WebPAC::Lookup::Normalize because lookups use it) [2.20]
Revision 515 - Directory Listing
Modified Tue May 16 15:23:05 2006 UTC (17 years, 11 months ago) by dpavlin 
 r681@llin:  dpavlin | 2006-05-16 17:08:13 +0200
 added validate_errors which returs all validation errors for this record
Revision 514 - Directory Listing
Modified Tue May 16 13:38:09 2006 UTC (17 years, 11 months ago) by dpavlin 
 r679@llin:  dpavlin | 2006-05-16 15:41:59 +0200
 begin work on validation framework
Revision 507 - Directory Listing
Modified Mon May 15 13:15:01 2006 UTC (17 years, 11 months ago) by dpavlin 
 r669@llin:  dpavlin | 2006-05-15 15:18:36 +0200
 added nicely formatted stats and --stats flag to run.pl
Revision 506 - Directory Listing
Modified Mon May 15 09:59:05 2006 UTC (17 years, 11 months ago) by dpavlin 
 r663@llin:  dpavlin | 2006-05-15 12:02:43 +0200
 added stats gathering
Revision 501 - Directory Listing
Modified Sun May 14 22:08:51 2006 UTC (17 years, 11 months ago) by dpavlin 
added suffix and surround, regex now skips empty and undef values
Revision 498 - Directory Listing
Modified Sun May 14 19:45:45 2006 UTC (17 years, 11 months ago) by dpavlin 
 r653@llin:  dpavlin | 2006-05-14 21:48:48 +0200
 added Excel input format
Revision 491 - Directory Listing
Modified Sun May 14 12:39:39 2006 UTC (17 years, 11 months ago) by dpavlin 
 r642@llin:  dpavlin | 2006-05-14 14:43:11 +0200
 use new WebPAC::Normalize::Set::data_structure
Revision 490 - Directory Listing
Modified Sun May 14 12:35:20 2006 UTC (17 years, 11 months ago) by dpavlin 
 r637@llin:  dpavlin | 2006-05-14 14:38:22 +0200
 added data_structure (which does most of magic), support for semi-valid data structures
Revision 489 - Directory Listing
Modified Sun May 14 12:35:10 2006 UTC (17 years, 11 months ago) by dpavlin 
 r636@llin:  dpavlin | 2006-05-14 13:46:35 +0200
 added tmimgs for comparison of normalizers
Revision 488 - Directory Listing
Modified Sun May 14 12:35:00 2006 UTC (17 years, 11 months ago) by dpavlin 
 r635@llin:  dpavlin | 2006-05-14 13:22:18 +0200
 fixed subfield
Revision 485 - Directory Listing
Modified Sun May 14 11:06:42 2006 UTC (17 years, 11 months ago) by dpavlin 
 r629@llin:  dpavlin | 2006-05-14 13:05:27 +0200
 add tests for join_with (which found a bug)
Revision 484 - Directory Listing
Modified Sun May 14 11:06:33 2006 UTC (17 years, 11 months ago) by dpavlin 
 r628@llin:  dpavlin | 2006-05-14 13:04:56 +0200
 correct normalize files to be sematically same
Revision 483 - Directory Listing
Modified Sun May 14 09:34:05 2006 UTC (17 years, 11 months ago) by dpavlin 
 r625@llin:  dpavlin | 2006-05-14 11:37:22 +0200
 added no_progress_bar for tests and cron usage
Revision 482 - Directory Listing
Modified Sun May 14 09:33:56 2006 UTC (17 years, 11 months ago) by dpavlin 
 r624@llin:  dpavlin | 2006-05-14 11:16:16 +0200
 don't stop on empty records
Revision 481 - Directory Listing
Modified Sun May 14 00:50:35 2006 UTC (17 years, 11 months ago) by dpavlin 
 r622@llin:  dpavlin | 2006-05-14 02:54:00 +0200
 display lookup just once
Revision 479 - Directory Listing
Modified Sat May 13 13:39:09 2006 UTC (17 years, 11 months ago) by dpavlin 
 r617@llin:  dpavlin | 2006-05-13 15:42:13 +0200
 dump lookup_hash
Revision 478 - Directory Listing
Modified Sat May 13 13:38:53 2006 UTC (17 years, 11 months ago) by dpavlin 
 r616@llin:  dpavlin | 2006-05-13 15:40:49 +0200
 compare lookup_hash result
Revision 477 - Directory Listing
Modified Sat May 13 12:37:45 2006 UTC (17 years, 11 months ago) by dpavlin 
 r612@llin:  dpavlin | 2006-05-13 14:40:20 +0200
 rest of fields
Revision 476 - Directory Listing
Modified Sat May 13 12:37:35 2006 UTC (17 years, 11 months ago) by dpavlin 
 r611@llin:  dpavlin | 2006-05-13 14:39:57 +0200
 test for set_lookup(undef)
Revision 474 - Directory Listing
Modified Sat May 13 12:08:05 2006 UTC (17 years, 11 months ago) by dpavlin 
 r604@llin:  dpavlin | 2006-05-13 14:10:47 +0200
 better output, use lookup_hash
Revision 473 - Directory Listing
Modified Sat May 13 12:07:56 2006 UTC (17 years, 11 months ago) by dpavlin 
 r603@llin:  dpavlin | 2006-05-13 14:08:39 +0200
 added lookup_hash for direct access to lookup data
Revision 472 - Directory Listing
Modified Sat May 13 12:07:46 2006 UTC (17 years, 11 months ago) by dpavlin 
 r602@llin:  dpavlin | 2006-05-13 13:58:08 +0200
 don't return empty elements in array, extended test set
Revision 471 - Directory Listing
Modified Sat May 13 12:07:37 2006 UTC (17 years, 11 months ago) by dpavlin 
 r601@llin:  dpavlin | 2006-05-13 13:37:01 +0200
 extended tests
Revision 470 - Directory Listing
Modified Sat May 13 12:07:27 2006 UTC (17 years, 11 months ago) by dpavlin 
 r600@llin:  dpavlin | 2006-05-13 13:07:16 +0200
 added WebPAC::Normalize::Set to unit tests
Revision 468 - Directory Listing
Modified Sat May 13 09:48:15 2006 UTC (17 years, 11 months ago) by dpavlin 
 r595@llin:  dpavlin | 2006-05-13 11:48:05 +0200
 use normalize file t/data/normalize.pl
Revision 464 - Directory Listing
Modified Fri May 12 21:46:19 2006 UTC (17 years, 11 months ago) by dpavlin 
 r588@llin:  dpavlin | 2006-05-12 23:48:46 +0200
 much improved tests
Revision 461 - Directory Listing
Modified Fri May 12 14:54:25 2006 UTC (17 years, 11 months ago) by dpavlin 
 r581@llin:  dpavlin | 2006-05-12 16:57:30 +0200
 added clean_ds, rec1 now supports fields without subfields, rec1 & rec2 now take special care
 not to auto-vivify fields, removed various cruft, tidy pod
Revision 460 - Directory Listing
Modified Fri May 12 14:07:08 2006 UTC (17 years, 11 months ago) by dpavlin 
 r579@llin:  dpavlin | 2006-05-12 16:10:11 +0200
 added new normalizer, based on set functions (and easier to use, I hope)
Revision 459 - Directory Listing
Modified Wed May 10 14:48:25 2006 UTC (17 years, 11 months ago) by dpavlin 
 r577@llin:  dpavlin | 2006-05-10 16:51:07 +0200
 fixed add_link and wrote tests for it
Revision 458 - Directory Listing
Modified Wed May 10 14:08:15 2006 UTC (17 years, 11 months ago) by dpavlin 
 r575@llin:  dpavlin | 2006-05-10 16:10:56 +0200
 use Search::Estraier 0.06 new master API to create nodes, so code here is siplified
Revision 433 - Directory Listing
Modified Mon Apr 17 16:01:12 2006 UTC (18 years ago) by dpavlin 
 r524@llin:  dpavlin | 2006-04-17 18:01:04 +0200
 added all_tags() to get sorted list of all tags in input xml
Revision 375 - Directory Listing
Modified Sun Jan 8 22:21:24 2006 UTC (18 years, 3 months ago) by dpavlin 
 r417@llin:  dpavlin | 2006-01-08 23:21:35 +0100
 fixed another corner-case
Revision 373 - Directory Listing
Modified Sun Jan 8 22:09:33 2006 UTC (18 years, 3 months ago) by dpavlin 
 r414@llin:  dpavlin | 2006-01-08 23:09:49 +0100
 and finally fix for all wired cases (I hope) [2.10]
Revision 370 - Directory Listing
Modified Sun Jan 8 21:16:22 2006 UTC (18 years, 3 months ago) by dpavlin 
 r408@llin:  dpavlin | 2006-01-08 22:16:30 +0100
 fix warning
Revision 367 - Directory Listing
Modified Sun Jan 8 20:31:28 2006 UTC (18 years, 3 months ago) by dpavlin 
 r402@llin:  dpavlin | 2006-01-08 21:28:21 +0100
 better output
Revision 366 - Directory Listing
Modified Sun Jan 8 20:27:21 2006 UTC (18 years, 3 months ago) by dpavlin 
 r395@llin:  dpavlin | 2006-01-08 21:27:12 +0100
 fix path to normalize file
Revision 365 - Directory Listing
Modified Sun Jan 8 20:27:16 2006 UTC (18 years, 3 months ago) by dpavlin 
 r394@llin:  dpavlin | 2006-01-08 20:50:57 +0100
 even more tests which fail :-)
Revision 362 - Directory Listing
Modified Sun Jan 8 20:27:01 2006 UTC (18 years, 3 months ago) by dpavlin 
 r391@llin:  dpavlin | 2006-01-08 19:19:13 +0100
 demostrate bug where subfield isn't vailable in first repetition, all later repetitions
 doesn't get set
Revision 361 - Directory Listing
Modified Sun Jan 8 20:26:57 2006 UTC (18 years, 3 months ago) by dpavlin 
 r390@llin:  dpavlin | 2006-01-08 19:02:27 +0100
 test repeatable fields
Revision 352 - Directory Listing
Modified Sat Jan 7 18:23:27 2006 UTC (18 years, 3 months ago) by dpavlin 
 r371@llin:  dpavlin | 2006-01-07 19:23:27 +0100
 make tests less chatty
Revision 316 - Directory Listing
Modified Fri Dec 23 21:37:00 2005 UTC (18 years, 4 months ago) by dpavlin 
 r12233@llin:  dpavlin | 2005-12-23 23:23:52 +0100
 and a fix to report just REAL error :-)
Revision 315 - Directory Listing
Modified Fri Dec 23 21:17:37 2005 UTC (18 years, 4 months ago) by dpavlin 
 r12231@llin:  dpavlin | 2005-12-23 23:19:04 +0100
 fix test to show bug in parsing (not hiding first delimiter if first field
 is missing in input record)
Revision 314 - Directory Listing
Modified Fri Dec 23 21:05:50 2005 UTC (18 years, 4 months ago) by dpavlin 
 r345@athlon:  dpavlin | 2005-12-21 00:54:13 +0100
 work on tests
Revision 302 - Directory Listing
Modified Mon Dec 19 21:35:37 2005 UTC (18 years, 4 months ago) by dpavlin 
cleanup test index
Revision 300 - Directory Listing
Modified Mon Dec 19 21:25:57 2005 UTC (18 years, 4 months ago) by dpavlin 
 r321@athlon:  dpavlin | 2005-12-19 22:11:49 +0100
 fix
Revision 297 - Directory Listing
Modified Mon Dec 19 19:37:07 2005 UTC (18 years, 4 months ago) by dpavlin 
 r11801@llin:  dpavlin | 2005-12-19 20:37:54 +0100
 added MARC file example
Revision 290 - Directory Listing
Modified Sun Dec 18 23:10:02 2005 UTC (18 years, 4 months ago) by dpavlin 
 r11787@llin:  dpavlin | 2005-12-19 06:10:47 +0100
 MARC indexing seems to work
Revision 286 - Directory Listing
Modified Sun Dec 18 21:06:46 2005 UTC (18 years, 4 months ago) by dpavlin 
 r11778@llin:  dpavlin | 2005-12-19 03:59:54 +0100
 move work on input
Revision 285 - Directory Listing
Modified Sun Dec 18 21:06:39 2005 UTC (18 years, 4 months ago) by dpavlin 
 r11777@llin:  dpavlin | 2005-12-19 00:02:47 +0100
 refactor Input::ISIS::* [0.02]
Revision 266 - Directory Listing
Modified Fri Dec 16 16:23:49 2005 UTC (18 years, 4 months ago) by dpavlin 
 r11737@llin:  dpavlin | 2005-12-16 21:23:53 +0100
 update test to new api
Revision 260 - Directory Listing
Modified Fri Dec 16 14:40:55 2005 UTC (18 years, 4 months ago) by dpavlin 
 r11727@llin:  dpavlin | 2005-12-16 19:41:08 +0100
 added filter{regex(s/foo/bar/)} [2.00_5]
Revision 252 - Directory Listing
Modified Thu Dec 15 17:01:04 2005 UTC (18 years, 4 months ago) by dpavlin 
 r11711@llin:  dpavlin | 2005-12-15 20:02:16 +0100
 varios tweaks to make lookups work
Revision 218 - Directory Listing
Modified Mon Dec 5 17:48:00 2005 UTC (18 years, 4 months ago) by dpavlin 
 r11539@llin:  dpavlin | 2005-12-05 16:18:58 +0100
 WebPAC::Store now uses prefix in load_ds and save_ds and requires database
 when created with new [0.06]
Revision 217 - Directory Listing
Modified Mon Dec 5 17:47:51 2005 UTC (18 years, 4 months ago) by dpavlin 
 r11536@llin:  dpavlin | 2005-12-05 15:29:47 +0100
 change on load_ds and save_ds which not accept ONLY hash (and optional
 database name if not specified when calling new WebPAC::Store)
Revision 212 - Directory Listing
Modified Mon Dec 5 17:47:16 2005 UTC (18 years, 4 months ago) by dpavlin 
 r11525@llin:  dpavlin | 2005-12-05 01:45:38 +0100
 minor tweaks, tests now pass
Revision 211 - Directory Listing
Modified Mon Dec 5 17:47:10 2005 UTC (18 years, 4 months ago) by dpavlin 
 r11523@llin:  dpavlin | 2005-12-05 01:22:00 +0100
 even more changes on the road to controlling Hyper Estraier from perl :-)
Revision 209 - Directory Listing
Modified Mon Dec 5 17:46:57 2005 UTC (18 years, 4 months ago) by dpavlin 
 r11518@llin:  dpavlin | 2005-12-04 19:43:29 +0100
 renamed WebPAC::DB to WebPAC::Store
Revision 126 - Directory Listing
Modified Thu Nov 24 11:47:21 2005 UTC (18 years, 5 months ago) by dpavlin 
 r9090@llin:  dpavlin | 2005-11-24 12:48:47 +0100
 fix
Revision 124 - Directory Listing
Modified Thu Nov 24 11:47:10 2005 UTC (18 years, 5 months ago) by dpavlin 
 r9088@llin:  dpavlin | 2005-11-24 12:20:36 +0100
 API 0.02: load_ds and save_ds now accept id => 42 as arguments
Revision 81 - Directory Listing
Modified Mon Nov 21 14:42:22 2005 UTC (18 years, 5 months ago) by dpavlin 
 r9002@llin:  dpavlin | 2005-11-21 15:43:39 +0100
 Text::Iconv working, fixed tests, minor tweaks
Revision 80 - Directory Listing
Modified Mon Nov 21 14:42:16 2005 UTC (18 years, 5 months ago) by dpavlin 
 r9001@llin:  dpavlin | 2005-11-21 15:29:13 +0100
 added WebPAC::Search::Estraier which should be callable from outside
 WebPAC (e.g. Catalyst)
Revision 70 - Directory Listing
Modified Sat Nov 19 23:48:24 2005 UTC (18 years, 5 months ago) by dpavlin 
 r8980@llin:  dpavlin | 2005-11-20 00:49:22 +0100
 implement data_structure that returns HASH and not ARRAY.
 
 Little explanation for this rationale:
 
 Array was needed back in WebPAC v1 because order of tags in import_xml was
 important. However, since we are no longer depending on order of tags in
 input/*.xml, hash is much better choice.
Revision 64 - Directory Listing
Modified Tue Nov 15 16:56:44 2005 UTC (18 years, 5 months ago) by dpavlin 
 r8894@llin:  dpavlin | 2005-11-15 17:56:56 +0100
 fixed WebPAC::Normalize::get_data to work when called with subfield which
 doesn't exist, added tests
Revision 62 - Directory Listing
Modified Tue Nov 15 14:31:12 2005 UTC (18 years, 5 months ago) by dpavlin 
 r8884@llin:  dpavlin | 2005-11-15 14:46:07 +0100
 fix small warnings
Revision 50 - Directory Listing
Modified Mon Nov 14 16:15:45 2005 UTC (18 years, 5 months ago) by dpavlin 
 r8859@llin:  dpavlin | 2005-11-14 13:37:51 +0100
 non-existing record in load_ds return undef
Revision 33 - Directory Listing
Modified Sun Jul 24 15:35:46 2005 UTC (18 years, 9 months ago) by dpavlin 
fix
Revision 31 - Directory Listing
Modified Sun Jul 24 15:03:11 2005 UTC (18 years, 9 months ago) by dpavlin 
re-worked logging, added no_log option to disable logging
Revision 30 - Directory Listing
Modified Sun Jul 24 14:20:59 2005 UTC (18 years, 9 months ago) by dpavlin 
move data to $self->{'_lookup_data'} and document that
Revision 29 - Directory Listing
Modified Sun Jul 24 11:17:44 2005 UTC (18 years, 9 months ago) by dpavlin 
some logging improvements and sample configuration file
Revision 22 - Directory Listing
Modified Sun Jul 17 22:48:25 2005 UTC (18 years, 9 months ago) by dpavlin 
beginning of unit testing and various fixes
Revision 21 - Directory Listing
Modified Sun Jul 17 22:28:11 2005 UTC (18 years, 9 months ago) by dpavlin 
fixed ISIS size
Revision 20 - Directory Listing
Modified Sun Jul 17 21:04:23 2005 UTC (18 years, 9 months ago) by dpavlin 
few more tests
Revision 19 - Directory Listing
Modified Sun Jul 17 15:04:39 2005 UTC (18 years, 9 months ago) by dpavlin 
some cleanups and bugfixes
Revision 18 - Directory Listing
Modified Sun Jul 17 14:53:37 2005 UTC (18 years, 9 months ago) by dpavlin 
first cut into WebPAC::DB
Revision 16 - Directory Listing
Modified Sun Jul 17 11:37:07 2005 UTC (18 years, 9 months ago) by dpavlin 
Added Output::WebPAC::TT to produce Template Toolkit output.
Revision 15 - Directory Listing
Modified Sun Jul 17 10:42:23 2005 UTC (18 years, 9 months ago) by dpavlin 
WebPAC::Common cleanup, most code moved to WebPAC::Normalize. Added
documentation about order of data mungling when normalising data.
Revision 14 - Directory Listing
Modified Sun Jul 17 00:04:25 2005 UTC (18 years, 9 months ago) by dpavlin 
small fixes
Revision 13 - Directory Listing
Modified Sat Jul 16 23:56:14 2005 UTC (18 years, 9 months ago) by dpavlin 
data_source seems to work
Revision 12 - Directory Listing
Modified Sat Jul 16 22:57:26 2005 UTC (18 years, 9 months ago) by dpavlin 
improvements to WebPAC::Normalize::XML
Revision 10 - Directory Listing
Modified Sat Jul 16 20:35:30 2005 UTC (18 years, 9 months ago) by dpavlin 
ISIS input is finished, low_mem option has code (and not only documentation :-)
Revision 9 - Directory Listing
Modified Sat Jul 16 17:14:43 2005 UTC (18 years, 9 months ago) by dpavlin 
a bit more work on WebPAC::Input::ISIS
Revision 8 - Directory Listing
Modified Sat Jul 16 16:48:35 2005 UTC (18 years, 9 months ago) by dpavlin 
little cleanup and first cut into WebPAC::Normalize::XML
Revision 7 - Directory Listing
Modified Sat Jul 16 16:00:19 2005 UTC (18 years, 9 months ago) by dpavlin 
lookups cleanup
Revision 6 - Directory Listing
Modified Sat Jul 16 14:44:38 2005 UTC (18 years, 9 months ago) by dpavlin 
added WebPAC::Input::ISIS
Revision 5 - Directory Listing
Modified Sat Jul 16 12:40:28 2005 UTC (18 years, 9 months ago) by dpavlin 
test also filter
Revision 4 - Directory Listing
Modified Sat Jul 16 12:37:18 2005 UTC (18 years, 9 months ago) by dpavlin 
more work on lookups, example configuration layout
Revision 3 - Directory Listing
Modified Sat Jul 16 11:07:38 2005 UTC (18 years, 9 months ago) by dpavlin 
moved implementation of lookups from older code-base
Revision 1 - Directory Listing
Added Sat Jun 25 20:23:23 2005 UTC (18 years, 10 months ago) by dpavlin 
initial import of some documentation and module structure
  ViewVC Help
Powered by ViewVC 1.1.26