Log of /trunk/t

---

Revision 566 - Directory Listing
Modified Sun Jul 2 21:17:54 2006 UTC (17 years, 9 months ago) by dpavlin

test split_rec_on corner cases, and fix one

---

Revision 564 - Directory Listing
Modified Sun Jul 2 20:14:21 2006 UTC (17 years, 9 months ago) by dpavlin

 r772@llin:  dpavlin | 2006-07-02 22:14:37 +0200
 rough implementation of marc_leader (not tested enough)

---

Revision 562 - Directory Listing
Modified Sun Jul 2 16:14:41 2006 UTC (17 years, 9 months ago) by dpavlin

added marc_compose to specify manually subfield order in MARC and
split_rec_on to split single field into parts based on regex

---

Revision 557 - Directory Listing
Modified Sat Jul 1 22:36:39 2006 UTC (17 years, 9 months ago) by dpavlin

 r762@llin:  dpavlin | 2006-07-02 00:36:50 +0200
 added test data files

---

Revision 555 - Directory Listing
Modified Sat Jul 1 10:19:39 2006 UTC (17 years, 9 months ago) by dpavlin

 r757@llin:  dpavlin | 2006-07-01 12:19:34 +0200
 added -d [-d -d ...] flag and test_rec_rules

---

Revision 553 - Directory Listing
Modified Sat Jul 1 08:55:34 2006 UTC (17 years, 9 months ago) by dpavlin

 r754@llin:  dpavlin | 2006-07-01 10:55:40 +0200
 tweak

---

Revision 550 - Directory Listing
Modified Fri Jun 30 18:48:33 2006 UTC (17 years, 9 months ago) by dpavlin

 r748@llin:  dpavlin | 2006-06-30 20:48:29 +0200
 re-implement magic again (so that it actually work in all cases consistant).
 Depend on Data::Dump to enable nice output.

---

Revision 547 - Directory Listing
Modified Thu Jun 29 23:19:26 2006 UTC (17 years, 9 months ago) by dpavlin

 r742@llin:  dpavlin | 2006-06-30 01:21:24 +0200
 added marc_repetable_subfield and marc_indicators, renamed marc21 to marc [2.23]

---

Revision 540 - Directory Listing
Modified Thu Jun 29 15:29:41 2006 UTC (17 years, 9 months ago) by dpavlin

 r726@llin:  dpavlin | 2006-06-29 17:31:13 +0200
 add marc21 to normalize and create MARC file from those data [2.22]

---

Revision 538 - Directory Listing
Modified Thu Jun 29 15:29:19 2006 UTC (17 years, 9 months ago) by dpavlin

 r722@llin:  dpavlin | 2006-06-26 21:29:56 +0200
 make private funtions with _

---

Revision 536 - Directory Listing
Modified Mon Jun 26 16:39:51 2006 UTC (17 years, 9 months ago) by dpavlin

 r719@llin:  dpavlin | 2006-06-26 18:40:57 +0200
 big refacture: depriciate and remove all normalisation formats except .pl sets (but
 old code is still available in WebPAC::Lookup::Normalize because lookups use it) [2.20]

---

Revision 515 - Directory Listing
Modified Tue May 16 15:23:05 2006 UTC (17 years, 11 months ago) by dpavlin

 r681@llin:  dpavlin | 2006-05-16 17:08:13 +0200
 added validate_errors which returs all validation errors for this record

---

Revision 514 - Directory Listing
Modified Tue May 16 13:38:09 2006 UTC (17 years, 11 months ago) by dpavlin

 r679@llin:  dpavlin | 2006-05-16 15:41:59 +0200
 begin work on validation framework

---

Revision 507 - Directory Listing
Modified Mon May 15 13:15:01 2006 UTC (17 years, 11 months ago) by dpavlin

 r669@llin:  dpavlin | 2006-05-15 15:18:36 +0200
 added nicely formatted stats and --stats flag to run.pl

---

Revision 506 - Directory Listing
Modified Mon May 15 09:59:05 2006 UTC (17 years, 11 months ago) by dpavlin

 r663@llin:  dpavlin | 2006-05-15 12:02:43 +0200
 added stats gathering

---

Revision 501 - Directory Listing
Modified Sun May 14 22:08:51 2006 UTC (17 years, 11 months ago) by dpavlin

added suffix and surround, regex now skips empty and undef values

---

Revision 498 - Directory Listing
Modified Sun May 14 19:45:45 2006 UTC (17 years, 11 months ago) by dpavlin

 r653@llin:  dpavlin | 2006-05-14 21:48:48 +0200
 added Excel input format

---

Revision 491 - Directory Listing
Modified Sun May 14 12:39:39 2006 UTC (17 years, 11 months ago) by dpavlin

 r642@llin:  dpavlin | 2006-05-14 14:43:11 +0200
 use new WebPAC::Normalize::Set::data_structure

---

Revision 490 - Directory Listing
Modified Sun May 14 12:35:20 2006 UTC (17 years, 11 months ago) by dpavlin

 r637@llin:  dpavlin | 2006-05-14 14:38:22 +0200
 added data_structure (which does most of magic), support for semi-valid data structures

---

Revision 489 - Directory Listing
Modified Sun May 14 12:35:10 2006 UTC (17 years, 11 months ago) by dpavlin

 r636@llin:  dpavlin | 2006-05-14 13:46:35 +0200
 added tmimgs for comparison of normalizers

---

Revision 488 - Directory Listing
Modified Sun May 14 12:35:00 2006 UTC (17 years, 11 months ago) by dpavlin

 r635@llin:  dpavlin | 2006-05-14 13:22:18 +0200
 fixed subfield

---

Revision 485 - Directory Listing
Modified Sun May 14 11:06:42 2006 UTC (17 years, 11 months ago) by dpavlin

 r629@llin:  dpavlin | 2006-05-14 13:05:27 +0200
 add tests for join_with (which found a bug)

---

Revision 484 - Directory Listing
Modified Sun May 14 11:06:33 2006 UTC (17 years, 11 months ago) by dpavlin

 r628@llin:  dpavlin | 2006-05-14 13:04:56 +0200
 correct normalize files to be sematically same

---

Revision 483 - Directory Listing
Modified Sun May 14 09:34:05 2006 UTC (17 years, 11 months ago) by dpavlin

 r625@llin:  dpavlin | 2006-05-14 11:37:22 +0200
 added no_progress_bar for tests and cron usage

---

Revision 482 - Directory Listing
Modified Sun May 14 09:33:56 2006 UTC (17 years, 11 months ago) by dpavlin

 r624@llin:  dpavlin | 2006-05-14 11:16:16 +0200
 don't stop on empty records

---

Revision 481 - Directory Listing
Modified Sun May 14 00:50:35 2006 UTC (17 years, 11 months ago) by dpavlin

 r622@llin:  dpavlin | 2006-05-14 02:54:00 +0200
 display lookup just once

---

Revision 479 - Directory Listing
Modified Sat May 13 13:39:09 2006 UTC (17 years, 11 months ago) by dpavlin

 r617@llin:  dpavlin | 2006-05-13 15:42:13 +0200
 dump lookup_hash

---

Revision 478 - Directory Listing
Modified Sat May 13 13:38:53 2006 UTC (17 years, 11 months ago) by dpavlin

 r616@llin:  dpavlin | 2006-05-13 15:40:49 +0200
 compare lookup_hash result

---

Revision 477 - Directory Listing
Modified Sat May 13 12:37:45 2006 UTC (17 years, 11 months ago) by dpavlin

 r612@llin:  dpavlin | 2006-05-13 14:40:20 +0200
 rest of fields

---

Revision 476 - Directory Listing
Modified Sat May 13 12:37:35 2006 UTC (17 years, 11 months ago) by dpavlin

 r611@llin:  dpavlin | 2006-05-13 14:39:57 +0200
 test for set_lookup(undef)

---

Revision 474 - Directory Listing
Modified Sat May 13 12:08:05 2006 UTC (17 years, 11 months ago) by dpavlin

 r604@llin:  dpavlin | 2006-05-13 14:10:47 +0200
 better output, use lookup_hash

---

Revision 473 - Directory Listing
Modified Sat May 13 12:07:56 2006 UTC (17 years, 11 months ago) by dpavlin

 r603@llin:  dpavlin | 2006-05-13 14:08:39 +0200
 added lookup_hash for direct access to lookup data

---

Revision 472 - Directory Listing
Modified Sat May 13 12:07:46 2006 UTC (17 years, 11 months ago) by dpavlin

 r602@llin:  dpavlin | 2006-05-13 13:58:08 +0200
 don't return empty elements in array, extended test set

---

Revision 471 - Directory Listing
Modified Sat May 13 12:07:37 2006 UTC (17 years, 11 months ago) by dpavlin

 r601@llin:  dpavlin | 2006-05-13 13:37:01 +0200
 extended tests

---

Revision 470 - Directory Listing
Modified Sat May 13 12:07:27 2006 UTC (17 years, 11 months ago) by dpavlin

 r600@llin:  dpavlin | 2006-05-13 13:07:16 +0200
 added WebPAC::Normalize::Set to unit tests

---

Revision 468 - Directory Listing
Modified Sat May 13 09:48:15 2006 UTC (17 years, 11 months ago) by dpavlin

 r595@llin:  dpavlin | 2006-05-13 11:48:05 +0200
 use normalize file t/data/normalize.pl

---

Revision 464 - Directory Listing
Modified Fri May 12 21:46:19 2006 UTC (17 years, 11 months ago) by dpavlin

 r588@llin:  dpavlin | 2006-05-12 23:48:46 +0200
 much improved tests

---

Revision 461 - Directory Listing
Modified Fri May 12 14:54:25 2006 UTC (17 years, 11 months ago) by dpavlin

 r581@llin:  dpavlin | 2006-05-12 16:57:30 +0200
 added clean_ds, rec1 now supports fields without subfields, rec1 & rec2 now take special care
 not to auto-vivify fields, removed various cruft, tidy pod

---

Revision 460 - Directory Listing
Modified Fri May 12 14:07:08 2006 UTC (17 years, 11 months ago) by dpavlin

 r579@llin:  dpavlin | 2006-05-12 16:10:11 +0200
 added new normalizer, based on set functions (and easier to use, I hope)

---

Revision 459 - Directory Listing
Modified Wed May 10 14:48:25 2006 UTC (17 years, 11 months ago) by dpavlin

 r577@llin:  dpavlin | 2006-05-10 16:51:07 +0200
 fixed add_link and wrote tests for it

---

Revision 458 - Directory Listing
Modified Wed May 10 14:08:15 2006 UTC (17 years, 11 months ago) by dpavlin

 r575@llin:  dpavlin | 2006-05-10 16:10:56 +0200
 use Search::Estraier 0.06 new master API to create nodes, so code here is siplified

---

Revision 433 - Directory Listing
Modified Mon Apr 17 16:01:12 2006 UTC (18 years ago) by dpavlin

 r524@llin:  dpavlin | 2006-04-17 18:01:04 +0200
 added all_tags() to get sorted list of all tags in input xml

---

Revision 375 - Directory Listing
Modified Sun Jan 8 22:21:24 2006 UTC (18 years, 3 months ago) by dpavlin

 r417@llin:  dpavlin | 2006-01-08 23:21:35 +0100
 fixed another corner-case

---

Revision 373 - Directory Listing
Modified Sun Jan 8 22:09:33 2006 UTC (18 years, 3 months ago) by dpavlin

 r414@llin:  dpavlin | 2006-01-08 23:09:49 +0100
 and finally fix for all wired cases (I hope) [2.10]

---

Revision 370 - Directory Listing
Modified Sun Jan 8 21:16:22 2006 UTC (18 years, 3 months ago) by dpavlin

 r408@llin:  dpavlin | 2006-01-08 22:16:30 +0100
 fix warning

---

Revision 367 - Directory Listing
Modified Sun Jan 8 20:31:28 2006 UTC (18 years, 3 months ago) by dpavlin

 r402@llin:  dpavlin | 2006-01-08 21:28:21 +0100
 better output

---

Revision 366 - Directory Listing
Modified Sun Jan 8 20:27:21 2006 UTC (18 years, 3 months ago) by dpavlin

 r395@llin:  dpavlin | 2006-01-08 21:27:12 +0100
 fix path to normalize file

---

Revision 365 - Directory Listing
Modified Sun Jan 8 20:27:16 2006 UTC (18 years, 3 months ago) by dpavlin

 r394@llin:  dpavlin | 2006-01-08 20:50:57 +0100
 even more tests which fail :-)

---

Revision 362 - Directory Listing
Modified Sun Jan 8 20:27:01 2006 UTC (18 years, 3 months ago) by dpavlin

 r391@llin:  dpavlin | 2006-01-08 19:19:13 +0100
 demostrate bug where subfield isn't vailable in first repetition, all later repetitions
 doesn't get set

---

Revision 361 - Directory Listing
Modified Sun Jan 8 20:26:57 2006 UTC (18 years, 3 months ago) by dpavlin

 r390@llin:  dpavlin | 2006-01-08 19:02:27 +0100
 test repeatable fields

---

Revision 352 - Directory Listing
Modified Sat Jan 7 18:23:27 2006 UTC (18 years, 3 months ago) by dpavlin

 r371@llin:  dpavlin | 2006-01-07 19:23:27 +0100
 make tests less chatty

---

Revision 316 - Directory Listing
Modified Fri Dec 23 21:37:00 2005 UTC (18 years, 3 months ago) by dpavlin

 r12233@llin:  dpavlin | 2005-12-23 23:23:52 +0100
 and a fix to report just REAL error :-)

---

Revision 315 - Directory Listing
Modified Fri Dec 23 21:17:37 2005 UTC (18 years, 3 months ago) by dpavlin

 r12231@llin:  dpavlin | 2005-12-23 23:19:04 +0100
 fix test to show bug in parsing (not hiding first delimiter if first field
 is missing in input record)

---

Revision 314 - Directory Listing
Modified Fri Dec 23 21:05:50 2005 UTC (18 years, 3 months ago) by dpavlin

 r345@athlon:  dpavlin | 2005-12-21 00:54:13 +0100
 work on tests

---

Revision 302 - Directory Listing
Modified Mon Dec 19 21:35:37 2005 UTC (18 years, 4 months ago) by dpavlin

cleanup test index

---

Revision 300 - Directory Listing
Modified Mon Dec 19 21:25:57 2005 UTC (18 years, 4 months ago) by dpavlin

 r321@athlon:  dpavlin | 2005-12-19 22:11:49 +0100
 fix

---

Revision 297 - Directory Listing
Modified Mon Dec 19 19:37:07 2005 UTC (18 years, 4 months ago) by dpavlin

 r11801@llin:  dpavlin | 2005-12-19 20:37:54 +0100
 added MARC file example

---

Revision 290 - Directory Listing
Modified Sun Dec 18 23:10:02 2005 UTC (18 years, 4 months ago) by dpavlin

 r11787@llin:  dpavlin | 2005-12-19 06:10:47 +0100
 MARC indexing seems to work

---

Revision 286 - Directory Listing
Modified Sun Dec 18 21:06:46 2005 UTC (18 years, 4 months ago) by dpavlin

 r11778@llin:  dpavlin | 2005-12-19 03:59:54 +0100
 move work on input

---

Revision 285 - Directory Listing
Modified Sun Dec 18 21:06:39 2005 UTC (18 years, 4 months ago) by dpavlin

 r11777@llin:  dpavlin | 2005-12-19 00:02:47 +0100
 refactor Input::ISIS::* [0.02]

---

Revision 266 - Directory Listing
Modified Fri Dec 16 16:23:49 2005 UTC (18 years, 4 months ago) by dpavlin

 r11737@llin:  dpavlin | 2005-12-16 21:23:53 +0100
 update test to new api

---

Revision 260 - Directory Listing
Modified Fri Dec 16 14:40:55 2005 UTC (18 years, 4 months ago) by dpavlin

 r11727@llin:  dpavlin | 2005-12-16 19:41:08 +0100
 added filter{regex(s/foo/bar/)} [2.00_5]

---

Revision 252 - Directory Listing
Modified Thu Dec 15 17:01:04 2005 UTC (18 years, 4 months ago) by dpavlin

 r11711@llin:  dpavlin | 2005-12-15 20:02:16 +0100
 varios tweaks to make lookups work

---

Revision 218 - Directory Listing
Modified Mon Dec 5 17:48:00 2005 UTC (18 years, 4 months ago) by dpavlin

 r11539@llin:  dpavlin | 2005-12-05 16:18:58 +0100
 WebPAC::Store now uses prefix in load_ds and save_ds and requires database
 when created with new [0.06]

---

Revision 217 - Directory Listing
Modified Mon Dec 5 17:47:51 2005 UTC (18 years, 4 months ago) by dpavlin

 r11536@llin:  dpavlin | 2005-12-05 15:29:47 +0100
 change on load_ds and save_ds which not accept ONLY hash (and optional
 database name if not specified when calling new WebPAC::Store)

---

Revision 212 - Directory Listing
Modified Mon Dec 5 17:47:16 2005 UTC (18 years, 4 months ago) by dpavlin

 r11525@llin:  dpavlin | 2005-12-05 01:45:38 +0100
 minor tweaks, tests now pass

---

Revision 211 - Directory Listing
Modified Mon Dec 5 17:47:10 2005 UTC (18 years, 4 months ago) by dpavlin

 r11523@llin:  dpavlin | 2005-12-05 01:22:00 +0100
 even more changes on the road to controlling Hyper Estraier from perl :-)

---

Revision 209 - Directory Listing
Modified Mon Dec 5 17:46:57 2005 UTC (18 years, 4 months ago) by dpavlin

 r11518@llin:  dpavlin | 2005-12-04 19:43:29 +0100
 renamed WebPAC::DB to WebPAC::Store

---

Revision 126 - Directory Listing
Modified Thu Nov 24 11:47:21 2005 UTC (18 years, 4 months ago) by dpavlin

 r9090@llin:  dpavlin | 2005-11-24 12:48:47 +0100
 fix

---

Revision 124 - Directory Listing
Modified Thu Nov 24 11:47:10 2005 UTC (18 years, 4 months ago) by dpavlin

 r9088@llin:  dpavlin | 2005-11-24 12:20:36 +0100
 API 0.02: load_ds and save_ds now accept id => 42 as arguments

---

Revision 81 - Directory Listing
Modified Mon Nov 21 14:42:22 2005 UTC (18 years, 4 months ago) by dpavlin

 r9002@llin:  dpavlin | 2005-11-21 15:43:39 +0100
 Text::Iconv working, fixed tests, minor tweaks

---

Revision 80 - Directory Listing
Modified Mon Nov 21 14:42:16 2005 UTC (18 years, 4 months ago) by dpavlin

 r9001@llin:  dpavlin | 2005-11-21 15:29:13 +0100
 added WebPAC::Search::Estraier which should be callable from outside
 WebPAC (e.g. Catalyst)

---

Revision 70 - Directory Listing
Modified Sat Nov 19 23:48:24 2005 UTC (18 years, 5 months ago) by dpavlin

 r8980@llin:  dpavlin | 2005-11-20 00:49:22 +0100
 implement data_structure that returns HASH and not ARRAY.
 
 Little explanation for this rationale:
 
 Array was needed back in WebPAC v1 because order of tags in import_xml was
 important. However, since we are no longer depending on order of tags in
 input/*.xml, hash is much better choice.

---

Revision 64 - Directory Listing
Modified Tue Nov 15 16:56:44 2005 UTC (18 years, 5 months ago) by dpavlin

 r8894@llin:  dpavlin | 2005-11-15 17:56:56 +0100
 fixed WebPAC::Normalize::get_data to work when called with subfield which
 doesn't exist, added tests

---

Revision 62 - Directory Listing
Modified Tue Nov 15 14:31:12 2005 UTC (18 years, 5 months ago) by dpavlin

 r8884@llin:  dpavlin | 2005-11-15 14:46:07 +0100
 fix small warnings

---

Revision 50 - Directory Listing
Modified Mon Nov 14 16:15:45 2005 UTC (18 years, 5 months ago) by dpavlin

 r8859@llin:  dpavlin | 2005-11-14 13:37:51 +0100
 non-existing record in load_ds return undef

---

Revision 33 - Directory Listing
Modified Sun Jul 24 15:35:46 2005 UTC (18 years, 8 months ago) by dpavlin

fix

---

Revision 31 - Directory Listing
Modified Sun Jul 24 15:03:11 2005 UTC (18 years, 8 months ago) by dpavlin

re-worked logging, added no_log option to disable logging

---

Revision 30 - Directory Listing
Modified Sun Jul 24 14:20:59 2005 UTC (18 years, 8 months ago) by dpavlin

move data to $self->{'_lookup_data'} and document that

---

Revision 29 - Directory Listing
Modified Sun Jul 24 11:17:44 2005 UTC (18 years, 8 months ago) by dpavlin

some logging improvements and sample configuration file

---

Revision 22 - Directory Listing
Modified Sun Jul 17 22:48:25 2005 UTC (18 years, 9 months ago) by dpavlin

beginning of unit testing and various fixes

---

Revision 21 - Directory Listing
Modified Sun Jul 17 22:28:11 2005 UTC (18 years, 9 months ago) by dpavlin

fixed ISIS size

---

Revision 20 - Directory Listing
Modified Sun Jul 17 21:04:23 2005 UTC (18 years, 9 months ago) by dpavlin

few more tests

---

Revision 19 - Directory Listing
Modified Sun Jul 17 15:04:39 2005 UTC (18 years, 9 months ago) by dpavlin

some cleanups and bugfixes

---

Revision 18 - Directory Listing
Modified Sun Jul 17 14:53:37 2005 UTC (18 years, 9 months ago) by dpavlin

first cut into WebPAC::DB

---

Revision 16 - Directory Listing
Modified Sun Jul 17 11:37:07 2005 UTC (18 years, 9 months ago) by dpavlin

Added Output::WebPAC::TT to produce Template Toolkit output.

---

Revision 15 - Directory Listing
Modified Sun Jul 17 10:42:23 2005 UTC (18 years, 9 months ago) by dpavlin

WebPAC::Common cleanup, most code moved to WebPAC::Normalize. Added
documentation about order of data mungling when normalising data.

---

Revision 14 - Directory Listing
Modified Sun Jul 17 00:04:25 2005 UTC (18 years, 9 months ago) by dpavlin

small fixes

---

Revision 13 - Directory Listing
Modified Sat Jul 16 23:56:14 2005 UTC (18 years, 9 months ago) by dpavlin

data_source seems to work

---

Revision 12 - Directory Listing
Modified Sat Jul 16 22:57:26 2005 UTC (18 years, 9 months ago) by dpavlin

improvements to WebPAC::Normalize::XML

---

Revision 10 - Directory Listing
Modified Sat Jul 16 20:35:30 2005 UTC (18 years, 9 months ago) by dpavlin

ISIS input is finished, low_mem option has code (and not only documentation :-)

---

Revision 9 - Directory Listing
Modified Sat Jul 16 17:14:43 2005 UTC (18 years, 9 months ago) by dpavlin

a bit more work on WebPAC::Input::ISIS

---

Revision 8 - Directory Listing
Modified Sat Jul 16 16:48:35 2005 UTC (18 years, 9 months ago) by dpavlin

little cleanup and first cut into WebPAC::Normalize::XML

---

Revision 7 - Directory Listing
Modified Sat Jul 16 16:00:19 2005 UTC (18 years, 9 months ago) by dpavlin

lookups cleanup

---

Revision 6 - Directory Listing
Modified Sat Jul 16 14:44:38 2005 UTC (18 years, 9 months ago) by dpavlin

added WebPAC::Input::ISIS

---

Revision 5 - Directory Listing
Modified Sat Jul 16 12:40:28 2005 UTC (18 years, 9 months ago) by dpavlin

test also filter

---

Revision 4 - Directory Listing
Modified Sat Jul 16 12:37:18 2005 UTC (18 years, 9 months ago) by dpavlin

more work on lookups, example configuration layout

---

Revision 3 - Directory Listing
Modified Sat Jul 16 11:07:38 2005 UTC (18 years, 9 months ago) by dpavlin

moved implementation of lookups from older code-base

---

Revision 1 - Directory Listing
Added Sat Jun 25 20:23:23 2005 UTC (18 years, 9 months ago) by dpavlin

initial import of some documentation and module structure