/[webpac2]/trunk/t
This is repository of my old source code which isn't updated any more. Go to git.rot13.org for current projects!
ViewVC logotype

Log of /trunk/t

View Directory Listing Directory Listing


Sticky Revision:

Revision 1372 - Directory Listing
Modified Thu Aug 22 08:14:43 2013 UTC (10 years, 8 months ago) by dpavlin
check existence to prevent warning


Revision 1368 - Directory Listing
Modified Mon Mar 12 19:00:00 2012 UTC (12 years, 1 month ago) by dpavlin
marc_original_order support for leader and fixed fields


Revision 1366 - Directory Listing
Modified Thu Dec 15 21:40:02 2011 UTC (12 years, 4 months ago) by dpavlin
import OAI repository

Revision 1348 - Directory Listing
Modified Sat Oct 16 17:51:13 2010 UTC (13 years, 6 months ago) by dpavlin
test data


Revision 1343 - Directory Listing
Modified Sat Oct 16 17:38:47 2010 UTC (13 years, 6 months ago) by dpavlin
tab separated values input module


Revision 1341 - Directory Listing
Modified Fri Oct 15 13:36:56 2010 UTC (13 years, 6 months ago) by dpavlin
use utf-8 encoding

Revision 1325 - Directory Listing
Modified Tue Feb 2 18:03:17 2010 UTC (14 years, 2 months ago) by dpavlin
added offset and limit [0.02]


Revision 1307 - Directory Listing
Modified Mon Sep 21 16:42:25 2009 UTC (14 years, 7 months ago) by dpavlin
cleanup WebPAC::Input

Revision 1304 - Directory Listing
Modified Sun Sep 20 21:38:15 2009 UTC (14 years, 7 months ago) by dpavlin
fix offset to skip records just like SQL databases do, and not position us on it

Revision 1277 - Directory Listing
Modified Wed Aug 19 16:24:43 2009 UTC (14 years, 8 months ago) by dpavlin
insert space before if

Revision 1265 - Directory Listing
Modified Sun Aug 9 20:10:21 2009 UTC (14 years, 8 months ago) by dpavlin
fix foreach my combination

Revision 1258 - Directory Listing
Modified Tue Jul 28 13:01:40 2009 UTC (14 years, 8 months ago) by dpavlin
fix example modify configuration to be supported
by WebPAC::Input


Revision 1257 - Directory Listing
Modified Tue Jul 28 12:43:00 2009 UTC (14 years, 8 months ago) by dpavlin
Estraier is optional, so don't test it here


Revision 1256 - Directory Listing
Modified Tue Jul 28 12:40:46 2009 UTC (14 years, 8 months ago) by dpavlin
use code from lib insted of blib


Revision 1255 - Directory Listing
Modified Tue Jul 28 12:39:19 2009 UTC (14 years, 8 months ago) by dpavlin
better utf8 test records


Revision 1254 - Directory Listing
Modified Mon Jul 27 16:24:41 2009 UTC (14 years, 8 months ago) by dpavlin
force utf-8 encoding on all data comming from file

Revision 1231 - Directory Listing
Modified Thu Jul 9 17:00:51 2009 UTC (14 years, 9 months ago) by dpavlin
fetch MARC records directly from Koha database

Just create local file out of them, they need to be
converted in hash to be really useful inside WebPAC


Revision 1214 - Directory Listing
Modified Tue Jun 2 13:14:59 2009 UTC (14 years, 10 months ago) by dpavlin
document rec_array and fix tests


Revision 1210 - Directory Listing
Modified Sat May 30 15:26:25 2009 UTC (14 years, 10 months ago) by dpavlin
 r1906@llin:  dpavlin | 2009-05-30 17:26:17 +0200
 added table name to row normalize command so we can create
 data in different tables directly from normalization file


Revision 1209 - Directory Listing
Modified Sat May 30 14:21:58 2009 UTC (14 years, 10 months ago) by dpavlin
 r1904@llin:  dpavlin | 2009-05-30 16:21:56 +0200
 better support for DOI in ISI data export


Revision 1207 - Directory Listing
Modified Fri May 29 21:37:58 2009 UTC (14 years, 10 months ago) by dpavlin
 r1900@llin:  dpavlin | 2009-05-29 23:37:57 +0200
 WebPAC::Output::DBI to dump row from normalize into database
 (so each input record can create multiple rows)


Revision 1206 - Directory Listing
Modified Fri May 29 20:55:54 2009 UTC (14 years, 10 months ago) by dpavlin
 r1898@llin:  dpavlin | 2009-05-29 22:55:52 +0200
 test rec_array and rows


Revision 1202 - Directory Listing
Modified Fri May 29 18:15:57 2009 UTC (14 years, 10 months ago) by dpavlin
 r1890@llin:  dpavlin | 2009-05-29 20:09:47 +0200
 WebPAC::Path provides mk_base_path helper function


Revision 1198 - Directory Listing
Modified Thu May 28 10:15:20 2009 UTC (14 years, 10 months ago) by dpavlin
output modules can now define add_row as opposed to add to get input row before normalization

Revision 1197 - Directory Listing
Modified Thu May 28 09:58:18 2009 UTC (14 years, 10 months ago) by dpavlin
WebPAC::Output::CouchDB now takes uri to CouchDB server,
document ids now include input name


Revision 1196 - Directory Listing
Modified Wed May 27 22:17:00 2009 UTC (14 years, 10 months ago) by dpavlin
 r1880@llin:  dpavlin | 2009-05-27 23:45:18 +0200
 added output to CouchDB


Revision 1186 - Directory Listing
Modified Tue May 19 14:46:12 2009 UTC (14 years, 11 months ago) by dpavlin
added WebPAC::Input::CSV

Revision 1147 - Directory Listing
Modified Thu Apr 23 13:20:51 2009 UTC (15 years ago) by dpavlin
 r1802@llin:  dpavlin | 2009-04-23 15:20:49 +0200
 more changes to make indexing of WebPAC::Output::SWISH work
 (but not tests yet)


Revision 1145 - Directory Listing
Modified Thu Apr 23 11:14:24 2009 UTC (15 years ago) by dpavlin
 r1798@llin:  dpavlin | 2009-04-23 13:14:23 +0200
 start support for swish-e using WebPAC::Output::SWISH


Revision 1126 - Directory Listing
Modified Mon Apr 20 13:44:40 2009 UTC (15 years ago) by dpavlin
 r1760@llin:  dpavlin | 2009-04-20 15:44:39 +0200
 tweak implementation to actually work


Revision 1125 - Directory Listing
Modified Mon Apr 20 13:42:32 2009 UTC (15 years ago) by dpavlin
 r1758@llin:  dpavlin | 2009-04-20 15:42:29 +0200
 strip down test data file size


Revision 1124 - Directory Listing
Modified Sun Apr 19 23:35:31 2009 UTC (15 years ago) by dpavlin
 r1756@llin:  dpavlin | 2009-04-20 01:35:20 +0200
 added WebPAC::Input::Ovid for citation format


Revision 1118 - Directory Listing
Modified Sun Oct 26 15:57:37 2008 UTC (15 years, 5 months ago) by dpavlin
 r1747@llin:  dpavlin | 2008-10-26 16:55:31 +0100
 bug fix: don't destroy subfields values in data hash


Revision 1117 - Directory Listing
Modified Mon Sep 22 15:34:42 2008 UTC (15 years, 7 months ago) by dpavlin
make CAM::PDF really optional


Revision 1116 - Directory Listing
Modified Mon Sep 22 15:32:24 2008 UTC (15 years, 7 months ago) by dpavlin
make WebPAC::Input::DBF optional


Revision 1115 - Directory Listing
Modified Mon Sep 22 15:09:50 2008 UTC (15 years, 7 months ago) by dpavlin
make KinoSearch optional


Revision 1114 - Directory Listing
Modified Mon Sep 22 15:07:41 2008 UTC (15 years, 7 months ago) by dpavlin
added exec flag


Revision 1113 - Directory Listing
Modified Mon Sep 22 15:06:06 2008 UTC (15 years, 7 months ago) by dpavlin
remove WebPAC::Output::Webpacus which depends on optional Jifty


Revision 1111 - Directory Listing
Modified Sat Sep 6 10:54:25 2008 UTC (15 years, 7 months ago) by dpavlin
a bit more work on marc_clone on some real records


Revision 1109 - Directory Listing
Modified Sat Sep 6 09:54:08 2008 UTC (15 years, 7 months ago) by dpavlin
 r1735@llin:  dpavlin | 2008-09-06 11:54:01 +0200
 cleanup test


Revision 1108 - Directory Listing
Modified Sun Aug 31 09:14:18 2008 UTC (15 years, 7 months ago) by dpavlin
 r1733@llin:  dpavlin | 2008-08-31 11:14:02 +0200
 beginning of marc_clone


Revision 1106 - Directory Listing
Modified Mon Aug 4 19:41:26 2008 UTC (15 years, 8 months ago) by dpavlin
 r1729@llin:  dpavlin | 2008-08-04 21:41:19 +0200
 rewrite test to dump file which require formatted output,
 reduce size of test binary xls


Revision 1101 - Directory Listing
Modified Mon Aug 4 18:34:11 2008 UTC (15 years, 8 months ago) by dpavlin
test excell file


Revision 1100 - Directory Listing
Modified Sat Aug 2 23:46:41 2008 UTC (15 years, 8 months ago) by dpavlin
Make cleanup of encodings, moving webpac closer to having
internal utf-8 representation.

This will break current code, but is really neceserry
step toward checking input encoding for validity


Revision 1095 - Directory Listing
Modified Fri Aug 1 23:41:47 2008 UTC (15 years, 8 months ago) by dpavlin
local changes


Revision 1089 - Directory Listing
Modified Mon Jan 28 18:30:07 2008 UTC (16 years, 2 months ago) by dpavlin
 r1702@llin:  dpavlin | 2008-01-28 19:29:41 +0100
 EBSCO text file export support


Revision 1088 - Directory Listing
Modified Mon Jan 28 18:30:01 2008 UTC (16 years, 2 months ago) by dpavlin
 r1699@llin:  dpavlin | 2008-01-11 19:51:52 +0100
 test round-trip of excel encoding to report bug


Revision 1087 - Directory Listing
Modified Mon Jan 28 17:53:57 2008 UTC (16 years, 2 months ago) by dpavlin
EBSCO text export example file


Revision 1079 - Directory Listing
Modified Wed Nov 28 22:52:59 2007 UTC (16 years, 4 months ago) by dpavlin
test mfn


Revision 1069 - Directory Listing
Modified Tue Nov 27 23:54:43 2007 UTC (16 years, 4 months ago) by dpavlin
 r1673@llin:  dpavlin | 2007-11-28 00:46:28 +0100
 added tests for WebPAC::Output base class and added
 single_values option


Revision 1068 - Directory Listing
Modified Tue Nov 27 23:45:28 2007 UTC (16 years, 4 months ago) by dpavlin
 r1670@llin:  dpavlin | 2007-11-28 00:13:29 +0100
 - WebPAC::Output::Excel


Revision 1062 - Directory Listing
Modified Wed Nov 21 10:09:55 2007 UTC (16 years, 5 months ago) by dpavlin
 r1661@llin:  dpavlin | 2007-11-21 11:09:52 +0100
 fix marc_template hadling of field value 0


Revision 1061 - Directory Listing
Modified Tue Nov 20 22:07:45 2007 UTC (16 years, 5 months ago) by dpavlin
 r1659@llin:  dpavlin | 2007-11-20 23:07:47 +0100
 re-insert spaces in AST after sub to create valid normalize
 source if we are using sub name {} in normalize files [2.33]


Revision 1058 - Directory Listing
Modified Tue Nov 20 10:08:55 2007 UTC (16 years, 5 months ago) by dpavlin
 r1653@llin:  dpavlin | 2007-11-20 11:08:49 +0100
 fix WebPAC::Output::Jifty to join multiple values with space
 when inserting into Jifty


Revision 1057 - Directory Listing
Modified Tue Nov 20 10:08:02 2007 UTC (16 years, 5 months ago) by dpavlin
 r1650@llin:  dpavlin | 2007-11-20 11:07:57 +0100
 final tweaks for WebPAC::Input::PDF, emit fields A .. ZZ


Revision 1056 - Directory Listing
Modified Tue Nov 20 10:08:00 2007 UTC (16 years, 5 months ago) by dpavlin
 r1649@llin:  dpavlin | 2007-11-20 10:32:15 +0100
 experimental WebPAC::Output::Jifty to create arbitrary data in
 Jifty models


Revision 1054 - Directory Listing
Modified Tue Nov 20 09:30:56 2007 UTC (16 years, 5 months ago) by dpavlin
 r1645@llin:  dpavlin | 2007-11-19 23:05:23 +0100
 added experimenal (still not working) WebPAC::Input::PDF


Revision 1050 - Directory Listing
Modified Mon Nov 19 16:50:12 2007 UTC (16 years, 5 months ago) by dpavlin
 r1636@llin:  dpavlin | 2007-11-19 17:49:11 +0100
 expose bug with subfield 0 in validation


Revision 1048 - Directory Listing
Modified Mon Nov 19 16:33:09 2007 UTC (16 years, 5 months ago) by dpavlin
 r1633@llin:  dpavlin | 2007-11-19 17:33:09 +0100
 fetch indicators with rec(900,'i1') and/or rec(900,'i2') as it should be
 (fixed bug which prevented this from working for some values like 0)


Revision 1047 - Directory Listing
Modified Mon Nov 19 15:56:05 2007 UTC (16 years, 5 months ago) by dpavlin
 r1631@llin:  dpavlin | 2007-11-19 16:56:04 +0100
 marc_template now respect marc_indicators, code cleanup


Revision 1039 - Directory Listing
Modified Mon Nov 12 12:13:57 2007 UTC (16 years, 5 months ago) by dpavlin
 r1616@llin:  dpavlin | 2007-11-12 13:13:55 +0100
 mark fields created with marc_template to ignore magic on them
 (which shuffle it around and corrupt record)


Revision 1038 - Directory Listing
Modified Mon Nov 12 11:57:00 2007 UTC (16 years, 5 months ago) by dpavlin
 r1614@llin:  dpavlin | 2007-11-12 12:56:56 +0100
 demostrate problems with marc records returned


Revision 1037 - Directory Listing
Modified Mon Nov 12 11:17:19 2007 UTC (16 years, 5 months ago) by dpavlin
 r1612@llin:  dpavlin | 2007-11-12 12:17:17 +0100
 fixed debug levels: now tests run with -d will display
 own diag messages, while -d -d will be 1st level of
 debug for WebPAC, and so on...


Revision 1036 - Directory Listing
Modified Mon Nov 12 11:10:48 2007 UTC (16 years, 5 months ago) by dpavlin
 r1610@llin:  dpavlin | 2007-11-12 12:10:45 +0100
 split MARC handling routines into WebPAC::Normalize::MARC [2.31]


Revision 1033 - Directory Listing
Modified Sun Nov 11 20:02:19 2007 UTC (16 years, 5 months ago) by dpavlin
 r1604@llin:  dpavlin | 2007-11-11 21:02:22 +0100
 and more test data


Revision 1032 - Directory Listing
Modified Sun Nov 11 20:00:29 2007 UTC (16 years, 5 months ago) by dpavlin
 r1602@llin:  dpavlin | 2007-11-11 21:00:33 +0100
 added forgoten test data


Revision 1031 - Directory Listing
Modified Sun Nov 11 19:58:57 2007 UTC (16 years, 5 months ago) by dpavlin
 r1600@llin:  dpavlin | 2007-11-11 20:59:01 +0100
 added pre and post formatting, which was half of the reason for whole thing :-)


Revision 1030 - Directory Listing
Modified Sun Nov 11 19:58:20 2007 UTC (16 years, 5 months ago) by dpavlin
 r1598@llin:  dpavlin | 2007-11-11 20:54:09 +0100
 I really want to test marc_template in separate test only...


Revision 1029 - Directory Listing
Modified Sun Nov 11 17:11:33 2007 UTC (16 years, 5 months ago) by dpavlin
more tweaks for subfield re-ordering


Revision 1027 - Directory Listing
Modified Sun Nov 11 13:52:29 2007 UTC (16 years, 5 months ago) by dpavlin
 r1592@llin:  dpavlin | 2007-11-11 14:52:29 +0100
 fix "master" test


Revision 1026 - Directory Listing
Modified Sun Nov 11 13:47:43 2007 UTC (16 years, 5 months ago) by dpavlin
 r1590@llin:  dpavlin | 2007-11-11 14:47:42 +0100
 finally marc_template( ... isis_template => [] ) works


Revision 1021 - Directory Listing
Modified Sat Nov 10 11:11:16 2007 UTC (16 years, 5 months ago) by dpavlin
 r1579@llin:  dpavlin | 2007-11-10 11:59:27 +0100
 Begin extraction of MARC functionality from WebPAC::Normalize to
 WebPAC::Normalize::MARC


Revision 1019 - Directory Listing
Modified Sat Nov 10 00:05:36 2007 UTC (16 years, 5 months ago) by dpavlin
support single fields without delimiters in marc_template


Revision 1016 - Directory Listing
Modified Thu Nov 8 17:29:03 2007 UTC (16 years, 5 months ago) by dpavlin
 r1573@llin:  dpavlin | 2007-11-08 18:29:03 +0100
 fix marc_template to produce correctly formatted MARC


Revision 1015 - Directory Listing
Modified Thu Nov 8 17:19:50 2007 UTC (16 years, 5 months ago) by dpavlin
 r1571@llin:  dpavlin | 2007-11-08 18:19:49 +0100
 added frec_eq and frec_ne to work-around our parser which removes spaces


Revision 1014 - Directory Listing
Modified Thu Nov 8 16:55:59 2007 UTC (16 years, 5 months ago) by dpavlin
 r1569@llin:  dpavlin | 2007-11-08 17:55:58 +0100
 added frec tests


Revision 1013 - Directory Listing
Modified Wed Nov 7 11:54:34 2007 UTC (16 years, 5 months ago) by dpavlin
 r1567@llin:  dpavlin | 2007-11-07 12:54:20 +0100
 huge dump of marc_template, a new way to specify mappings
 which is basically WebPAC v1 in a sub :-)


Revision 998 - Directory Listing
Modified Sun Nov 4 16:47:03 2007 UTC (16 years, 5 months ago) by dpavlin
 r1536@llin:  dpavlin | 2007-11-04 17:47:03 +0100
 better handle invalid XML files


Revision 993 - Directory Listing
Modified Sun Nov 4 14:43:47 2007 UTC (16 years, 5 months ago) by dpavlin
 r1525@llin:  dpavlin | 2007-11-04 15:34:13 +0100
 added consume_outputs which returns all output types this plugin supports.
 This will eventually come in handy for main loop to decide which outputs to
 call...


Revision 990 - Directory Listing
Modified Sun Nov 4 13:27:12 2007 UTC (16 years, 5 months ago) by dpavlin
 r1519@llin:  dpavlin | 2007-11-04 14:27:11 +0100
 get_ds did't really fit in normalize since we have to update store also


Revision 989 - Directory Listing
Modified Sun Nov 4 13:26:06 2007 UTC (16 years, 5 months ago) by dpavlin
 r1517@llin:  dpavlin | 2007-11-04 14:26:05 +0100
 New rewamp of WebPAC::Input::XML with added mungle rules (perl code really)
 to modify xml hash returned from XML::Simple


Revision 983 - Directory Listing
Modified Sun Nov 4 11:12:38 2007 UTC (16 years, 5 months ago) by dpavlin
 r1505@llin:  dpavlin | 2007-11-04 12:12:20 +0100
 renamed _set_rec to _set_ds (because it's a data_structure actually)
 and added symetric public get_ds to get whole data_structure as
 hash to manually traverse in normalization


Revision 980 - Directory Listing
Modified Sat Nov 3 13:33:19 2007 UTC (16 years, 5 months ago) by dpavlin
 r1499@llin:  dpavlin | 2007-11-03 14:31:44 +0100
 properly export isbn_10() and isbn_13()


Revision 968 - Directory Listing
Modified Fri Nov 2 13:59:10 2007 UTC (16 years, 5 months ago) by dpavlin
 r1479@llin:  dpavlin | 2007-11-02 14:59:05 +0100
 begin work on WebPAC::Input::XML


Revision 960 - Directory Listing
Modified Fri Nov 2 11:32:02 2007 UTC (16 years, 5 months ago) by dpavlin
 r1462@llin:  dpavlin | 2007-11-02 12:31:57 +0100
 ISBN support in normalization using isbn_10 and isbn_13


Revision 949 - Directory Listing
Modified Thu Nov 1 00:16:48 2007 UTC (16 years, 5 months ago) by dpavlin
 r1433@llin:  dpavlin | 2007-10-31 22:48:02 +0100
 HUGE swiping changes to implement new testing architecture
 based on all new WebPAC::Test module which makes
 test writing a joy


Revision 938 - Directory Listing
Modified Wed Oct 31 12:17:11 2007 UTC (16 years, 5 months ago) by dpavlin
 r1416@llin:  dpavlin | 2007-10-31 13:17:08 +0100
 minor tweaks


Revision 932 - Directory Listing
Modified Wed Oct 31 11:26:10 2007 UTC (16 years, 5 months ago) by dpavlin
 r1399@llin:  dpavlin | 2007-10-31 11:19:39 +0100
 Webpacus output to transfer searchable fields


Revision 924 - Directory Listing
Modified Wed Oct 31 00:26:45 2007 UTC (16 years, 5 months ago) by dpavlin
 r1394@llin:  dpavlin | 2007-10-31 01:26:46 +0100
 add new (exported by default) function force_array
 used all over the place


Revision 923 - Directory Listing
Modified Wed Oct 31 00:26:43 2007 UTC (16 years, 5 months ago) by dpavlin
 r1393@llin:  dpavlin | 2007-10-31 00:52:52 +0100
 added sorted to WebPAC::Normalize to define values which should go
 into sorted lists


Revision 920 - Directory Listing
Modified Tue Oct 30 22:46:51 2007 UTC (16 years, 5 months ago) by dpavlin
 r1386@llin:  dpavlin | 2007-10-30 23:46:53 +0100
 new WebPAC::Output::Sorted to create huge sorted lists using
 Sort::External (to keep memory under controll)


Revision 919 - Directory Listing
Modified Tue Oct 30 22:07:11 2007 UTC (16 years, 5 months ago) by dpavlin
 r1383@llin:  dpavlin | 2007-10-30 23:07:09 +0100
 added clean to start with empty index


Revision 914 - Directory Listing
Modified Tue Oct 30 20:11:04 2007 UTC (16 years, 5 months ago) by dpavlin
 r1373@llin:  dpavlin | 2007-10-30 21:11:01 +0100
 use KinoSearch::Simple and convert to new Output API


Revision 912 - Directory Listing
Modified Tue Oct 30 17:40:13 2007 UTC (16 years, 5 months ago) by dpavlin
 r1370@llin:  dpavlin | 2007-10-30 18:40:02 +0100
 rename tag to search_display which makes it more clean what does it do


Revision 911 - Directory Listing
Modified Tue Oct 30 01:53:02 2007 UTC (16 years, 5 months ago) by dpavlin
fix number of tests


Revision 909 - Directory Listing
Modified Tue Oct 30 01:46:41 2007 UTC (16 years, 5 months ago) by dpavlin
 r1362@llin:  dpavlin | 2007-10-30 02:46:05 +0100
 Show indicators (available when using WebPAC::Input::MARC) as
 first two subfileds in statistics insted in alphabetical order


Revision 908 - Directory Listing
Modified Mon Oct 29 23:20:13 2007 UTC (16 years, 5 months ago) by dpavlin
leader from WebPAC::Input::MARC is now available as rec('leader')

for mondifications within leader, use substr(rec('leader'),from,to)
instead of proposed leader(field,nr) syntax


Revision 906 - Directory Listing
Modified Mon Oct 29 22:49:46 2007 UTC (16 years, 5 months ago) by dpavlin
fix warning


Revision 904 - Directory Listing
Modified Fri Oct 12 12:07:35 2007 UTC (16 years, 6 months ago) by dpavlin
 r1355@llin:  dpavlin | 2007-10-12 14:07:29 +0200
 fix empty tags


Revision 899 - Directory Listing
Modified Wed Oct 10 19:01:57 2007 UTC (16 years, 6 months ago) by dpavlin
 r1345@llin:  dpavlin | 2007-10-10 21:01:02 +0200
 and working parser


Revision 898 - Directory Listing
Modified Wed Oct 10 19:01:55 2007 UTC (16 years, 6 months ago) by dpavlin
 r1344@llin:  dpavlin | 2007-10-10 20:34:20 +0200
 skeleton of support for ISI export format, parse headers


Revision 895 - Directory Listing
Modified Sun Oct 7 22:57:24 2007 UTC (16 years, 6 months ago) by dpavlin
 r1338@llin:  dpavlin | 2007-10-08 00:57:28 +0200
 configuration for dbf test


Revision 887 - Directory Listing
Modified Mon Sep 3 15:26:46 2007 UTC (16 years, 7 months ago) by dpavlin
 r1322@llin:  dpavlin | 2007-09-03 16:44:01 +0200
 - replace Data::Dumper usage with Data::Dump
 - rewrite WebPAC::Store to use Class::Accessor


Revision 883 - Directory Listing
Modified Thu Aug 23 20:56:59 2007 UTC (16 years, 8 months ago) by dpavlin
 r1315@llin:  dpavlin | 2007-08-23 22:52:10 +0200
 create on-disk JSON file


Revision 881 - Directory Listing
Modified Thu Aug 23 20:28:09 2007 UTC (16 years, 8 months ago) by dpavlin
 r1311@llin:  dpavlin | 2007-08-23 22:16:00 +0200
 skeleton for WebPAC::Output::JSON


Revision 875 - Directory Listing
Modified Tue Jun 26 17:46:49 2007 UTC (16 years, 9 months ago) by dpavlin
 r1303@llin:  dpavlin | 2007-06-26 19:46:53 +0200
 added dump for missing_subfield


Revision 870 - Directory Listing
Modified Thu Jun 21 23:54:41 2007 UTC (16 years, 10 months ago) by dpavlin
 r1293@llin:  dpavlin | 2007-06-22 01:46:20 +0200
 finish dbf input


Revision 869 - Directory Listing
Modified Thu Jun 21 21:26:19 2007 UTC (16 years, 10 months ago) by dpavlin
 r1290@llin:  dpavlin | 2007-06-21 23:26:25 +0200
 experimental (still unfinished) dbf input


Revision 862 - Directory Listing
Modified Sun May 27 19:28:18 2007 UTC (16 years, 10 months ago) by dpavlin
more read_validate_file tests, but still not comprihensive


Revision 858 - Directory Listing
Modified Sun May 27 17:09:47 2007 UTC (16 years, 10 months ago) by dpavlin
test validate with different files and hopefully correct problems about it


Revision 857 - Directory Listing
Modified Sun May 27 16:49:15 2007 UTC (16 years, 10 months ago) by dpavlin
implemented read_validate_file and read_validate_delimiters file, so you can
now change paths and data for each input (which run.pl does if you use
$database and/or $input variable substitution)


Revision 856 - Directory Listing
Modified Sun May 27 16:00:26 2007 UTC (16 years, 10 months ago) by dpavlin
added fill_in to create dynamic values and some tests


Revision 851 - Directory Listing
Modified Sun May 27 11:14:40 2007 UTC (16 years, 10 months ago) by dpavlin
 r1258@llin:  dpavlin | 2007-05-27 13:14:58 +0200
 Changed delimiter_templates arguments to be more intuitive,
 disable MARC generation when running delimiters validation
 (this is just disk overhead)


Revision 849 - Directory Listing
Modified Sun May 27 10:50:37 2007 UTC (16 years, 10 months ago) by dpavlin
 r1253@llin:  dpavlin | 2007-05-27 12:49:54 +0200
 added accumulated delimiters templates to hold all templates which are
 found in this run (and thus saved to --validate-delimiters file) while
 generating correct stats for each input


Revision 847 - Directory Listing
Modified Sun May 27 09:53:54 2007 UTC (16 years, 10 months ago) by dpavlin
 r1250@llin:  dpavlin | 2007-05-27 11:54:28 +0200
 test creation of new file, hush debugging output


Revision 846 - Directory Listing
Modified Sun May 27 09:53:52 2007 UTC (16 years, 10 months ago) by dpavlin
 r1249@llin:  dpavlin | 2007-05-27 11:49:30 +0200
 fix temp file handling


Revision 837 - Directory Listing
Modified Thu May 24 12:44:45 2007 UTC (16 years, 11 months ago) by dpavlin
 r1232@llin:  dpavlin | 2007-05-24 14:44:53 +0200
 added storing and retriving of delimiters templates to file and some basic tests


Revision 835 - Directory Listing
Modified Thu May 24 10:53:50 2007 UTC (16 years, 11 months ago) by dpavlin
 r1228@llin:  dpavlin | 2007-05-24 12:53:57 +0200
 report invalid delimiter combinations


Revision 834 - Directory Listing
Modified Thu May 24 10:53:48 2007 UTC (16 years, 11 months ago) by dpavlin
 r1227@llin:  dpavlin | 2007-05-24 10:26:01 +0200
 generate humanly readable report or machine readable


Revision 832 - Directory Listing
Modified Wed May 23 20:03:16 2007 UTC (16 years, 11 months ago) by dpavlin
 r1221@llin:  dpavlin | 2007-05-20 22:43:38 +0200
 added delimiters_templates report


Revision 829 - Directory Listing
Modified Sun May 20 16:19:19 2007 UTC (16 years, 11 months ago) by dpavlin
 r1214@llin:  dpavlin | 2007-05-20 18:19:12 +0200
 more sample data


Revision 828 - Directory Listing
Modified Sun May 20 16:19:17 2007 UTC (16 years, 11 months ago) by dpavlin
 r1213@llin:  dpavlin | 2007-05-20 18:16:02 +0200
 and fix to actually count right templates :-)


Revision 827 - Directory Listing
Modified Sun May 20 16:19:16 2007 UTC (16 years, 11 months ago) by dpavlin
 r1212@llin:  dpavlin | 2007-05-20 17:39:01 +0200
 first try at implementation of delimiters validation


Revision 823 - Directory Listing
Modified Wed Apr 11 12:22:37 2007 UTC (17 years ago) by dpavlin
 r1203@llin:  dpavlin | 2007-04-11 14:22:28 +0200
 spacial handling for empty subfields [0.18]


Revision 822 - Directory Listing
Modified Wed Apr 11 12:22:35 2007 UTC (17 years ago) by dpavlin
 r1202@llin:  dpavlin | 2007-04-11 14:00:20 +0200
 remove empty subfield test data


Revision 821 - Directory Listing
Modified Wed Apr 11 12:22:33 2007 UTC (17 years ago) by dpavlin
 r1201@llin:  dpavlin | 2007-04-11 13:54:24 +0200
 refactor filter tests


Revision 820 - Directory Listing
Modified Wed Apr 11 12:22:31 2007 UTC (17 years ago) by dpavlin
 r1200@llin:  dpavlin | 2007-04-11 13:38:57 +0200
 cleanup test (call patch /fake/ because they are),
 added test which fails because of empty subfield modify bug


Revision 819 - Directory Listing
Modified Wed Apr 11 10:09:34 2007 UTC (17 years ago) by dpavlin
 r1198@llin:  dpavlin | 2007-04-11 12:09:29 +0200
 prefix, suffix and surround now work correcty with empty strings and zeros


Revision 815 - Directory Listing
Modified Mon Apr 2 17:20:01 2007 UTC (17 years ago) by dpavlin
 r1192@llin:  dpavlin | 2007-04-02 19:20:01 +0200
 added support for fix-length fields using marc_fixed [2.29]


Revision 813 - Directory Listing
Modified Sun Apr 1 21:47:47 2007 UTC (17 years ago) by dpavlin
 r1184@llin:  dpavlin | 2007-04-01 23:47:04 +0200
  r1182@llin:  dpavlin | 2007-04-01 23:44:03 +0200
  marc_duplicate now correctly duplicates leader data, new _get_marc_leader to
  return leader corresponding to last _get_marc_fields call, added marc_count
  which returns number of created MARC records
 


Revision 811 - Directory Listing
Modified Sun Apr 1 21:47:40 2007 UTC (17 years ago) by dpavlin
 r1179@llin:  dpavlin | 2007-04-01 22:42:35 +0200
 hush test without --debug


Revision 808 - Directory Listing
Modified Sun Apr 1 14:15:08 2007 UTC (17 years ago) by dpavlin
added test modify rules


Revision 800 - Directory Listing
Modified Sun Feb 4 23:10:18 2007 UTC (17 years, 2 months ago) by dpavlin
decorate output from regexp modify with filename and line


Revision 799 - Directory Listing
Modified Sun Feb 4 15:09:01 2007 UTC (17 years, 2 months ago) by dpavlin
minor tweaks to test modify_file


Revision 797 - Directory Listing
Modified Sun Feb 4 13:28:30 2007 UTC (17 years, 2 months ago) by dpavlin
finish tweaking mock framework, test and fix problem with slashes in modify_record


Revision 796 - Directory Listing
Modified Sun Feb 4 12:42:43 2007 UTC (17 years, 2 months ago) by dpavlin
a try at mocking of inputs in WebPAC::Input::Test


Revision 794 - Directory Listing
Modified Sun Feb 4 12:20:54 2007 UTC (17 years, 2 months ago) by dpavlin
modify record test which fails (with slash /), tweaks


Revision 791 - Directory Listing
Modified Tue Jan 30 18:21:17 2007 UTC (17 years, 2 months ago) by dpavlin
added count


Revision 787 - Directory Listing
Modified Sun Dec 10 12:56:05 2006 UTC (17 years, 4 months ago) by dpavlin
test marc_remove('*')


Revision 784 - Directory Listing
Modified Wed Dec 6 23:43:45 2006 UTC (17 years, 4 months ago) by dpavlin
added regex: to modify_records


Revision 781 - Directory Listing
Modified Sun Nov 5 15:03:59 2006 UTC (17 years, 5 months ago) by dpavlin
 r1141@llin:  dpavlin | 2006-11-05 16:03:48 +0100
 subset of Project Gutenberg catalog.rdf for testing


Revision 777 - Directory Listing
Modified Sun Nov 5 14:48:12 2006 UTC (17 years, 5 months ago) by dpavlin
 r1133@llin:  dpavlin | 2006-11-05 15:48:00 +0100
 first cut at getting Project Gutenberg's RDF as input format for WebPAC


Revision 774 - Directory Listing
Modified Fri Nov 3 20:56:21 2006 UTC (17 years, 5 months ago) by dpavlin
another swiping API change: input->dump is gone, replaced
with input->dump_ascii which is more understandable.
If you want to override default behaviour
(which is to use Data::Dump's dump in input->fetch_rec)
define dump_ascii in low-level WebPAC::Input:: API


Revision 771 - Directory Listing
Modified Fri Nov 3 20:40:33 2006 UTC (17 years, 5 months ago) by dpavlin
 r1123@llin:  dpavlin | 2006-11-03 21:38:14 +0100
 implement fallback dump if low-level API isn't exposing dump_rec [0.15]


Revision 768 - Directory Listing
Modified Fri Nov 3 19:41:28 2006 UTC (17 years, 5 months ago) by dpavlin
 r1117@llin:  dpavlin | 2006-11-03 20:42:24 +0100
 cleanup API a bit. validate_errors in now validate_rec [0.10]


Revision 767 - Directory Listing
Modified Tue Oct 31 13:44:42 2006 UTC (17 years, 5 months ago) by dpavlin
 r1115@llin:  dpavlin | 2006-10-31 14:45:15 +0100
 fix unit test by removing old lookup code (but, it's missing new one now)


Revision 766 - Directory Listing
Modified Tue Oct 31 13:19:47 2006 UTC (17 years, 5 months ago) by dpavlin
 r1113@llin:  dpavlin | 2006-10-31 14:17:02 +0100
 cleanup normalization error message for lookups and modify tests so they don't fail anymore


Revision 761 - Directory Listing
Modified Wed Oct 25 17:10:08 2006 UTC (17 years, 6 months ago) by dpavlin
implemented load_row and save_row closures to serialize
input databases (using WebPAC::Store probably).
This will allow lookups to share on-disk storage with
low_mem option of WebPAC::Input, which is now gone
(under pressure of 600000+ record database which we
are now testing on)


Revision 755 - Directory Listing
Modified Sun Oct 8 20:28:17 2006 UTC (17 years, 6 months ago) by dpavlin
 r1097@llin:  dpavlin | 2006-10-08 22:24:54 +0200
 replaced generate_marc with universal have_rules [0.08]


Revision 747 - Directory Listing
Modified Sun Oct 8 12:45:39 2006 UTC (17 years, 6 months ago) by dpavlin
cleanup


Revision 746 - Directory Listing
Modified Sun Oct 8 12:43:39 2006 UTC (17 years, 6 months ago) by dpavlin
 r1085@llin:  dpavlin | 2006-10-08 14:40:26 +0200
 added files needed for tests, quitet log


Revision 737 - Directory Listing
Modified Thu Oct 5 14:38:45 2006 UTC (17 years, 6 months ago) by dpavlin
 r1067@llin:  dpavlin | 2006-10-05 16:35:45 +0200
 added generate_marc to find out if normalization rules have marc* directives


Revision 736 - Directory Listing
Modified Thu Oct 5 12:57:51 2006 UTC (17 years, 6 months ago) by dpavlin
 r1065@llin:  dpavlin | 2006-10-05 14:54:48 +0200
 actually we don't need *_load_ds, but _load_row for lookups


Revision 735 - Directory Listing
Modified Mon Oct 2 09:31:25 2006 UTC (17 years, 6 months ago) by dpavlin
 r1063@llin:  dpavlin | 2006-10-02 11:28:37 +0200
 added load_row and save_row needed for lookups [0.14]


Revision 733 - Directory Listing
Modified Sun Oct 1 20:14:09 2006 UTC (17 years, 6 months ago) by dpavlin
 r1059@llin:  dpavlin | 2006-10-01 15:52:48 +0200
 don't cleanup temp cache directory if in debug mode


Revision 727 - Directory Listing
Modified Fri Sep 29 19:52:21 2006 UTC (17 years, 6 months ago) by dpavlin
 r1046@llin:  dpavlin | 2006-09-29 21:49:23 +0200
 use of top-level WebPAC::Input is enough


Revision 725 - Directory Listing
Modified Fri Sep 29 18:55:41 2006 UTC (17 years, 6 months ago) by dpavlin
 r1042@llin:  dpavlin | 2006-09-29 20:53:01 +0200
 added _set_load_ds, and load_ds_coderef to data_structure so that lookups can call
 closure to fetch records, implemented lookup based on new format generated by
 WebPAC::Parser, test to be sure that it somewhat works :-) [0.21]


Revision 724 - Directory Listing
Modified Fri Sep 29 18:55:31 2006 UTC (17 years, 6 months ago) by dpavlin
 r1038@llin:  dpavlin | 2006-09-29 14:27:45 +0200
 remove comments from normalize rules when parsing


Revision 719 - Directory Listing
Modified Fri Sep 29 12:24:43 2006 UTC (17 years, 6 months ago) by dpavlin
 r1032@llin:  dpavlin | 2006-09-29 14:22:09 +0200
 dump normalize rules when in debug mode


Revision 717 - Directory Listing
Modified Tue Sep 26 18:14:14 2006 UTC (17 years, 6 months ago) by dpavlin
 r1028@llin:  dpavlin | 2006-09-26 20:09:18 +0200
 added normalize_rules [0.06]


Revision 715 - Directory Listing
Modified Tue Sep 26 14:03:12 2006 UTC (17 years, 6 months ago) by dpavlin
 r1024@llin:  dpavlin | 2006-09-26 16:00:56 +0200
 added load_lookup [0.12]


Revision 713 - Directory Listing
Modified Tue Sep 26 12:42:49 2006 UTC (17 years, 6 months ago) by dpavlin
 r1020@llin:  dpavlin | 2006-09-26 14:40:34 +0200
 refactored WebPAC::Store


Revision 706 - Directory Listing
Modified Mon Sep 25 14:06:49 2006 UTC (17 years, 7 months ago) by dpavlin
 r1006@llin:  dpavlin | 2006-09-25 16:04:39 +0200
 added have_lookup_create


Revision 705 - Directory Listing
Modified Mon Sep 25 13:46:36 2006 UTC (17 years, 7 months ago) by dpavlin
 r1004@llin:  dpavlin | 2006-09-25 15:44:23 +0200
 test lookup_create_rules


Revision 704 - Directory Listing
Modified Mon Sep 25 13:24:25 2006 UTC (17 years, 7 months ago) by dpavlin
 r1001@llin:  dpavlin | 2006-09-25 15:21:57 +0200
 and test it


Revision 703 - Directory Listing
Modified Mon Sep 25 13:24:09 2006 UTC (17 years, 7 months ago) by dpavlin
 r1000@llin:  dpavlin | 2006-09-25 15:16:49 +0200
 support multiple lookups on same input file
 move _read_sources and _parse_lookups to private functions


Revision 701 - Directory Listing
Modified Mon Sep 25 12:51:47 2006 UTC (17 years, 7 months ago) by dpavlin
 r994@llin:  dpavlin | 2006-09-25 14:49:05 +0200
 refactore support for multiple normalize files in each lookup


Revision 700 - Directory Listing
Modified Mon Sep 25 12:51:33 2006 UTC (17 years, 7 months ago) by dpavlin
 r993@llin:  dpavlin | 2006-09-25 13:52:43 +0200
 upgrade $input->{normalize} to ARRAY


Revision 698 - Directory Listing
Modified Mon Sep 25 11:14:53 2006 UTC (17 years, 7 months ago) by dpavlin
 r990@llin:  dpavlin | 2006-09-25 13:12:42 +0200
 new depends method to track dependencies, input in most places can be input name or
 hash with key 'name' which will be used as input (for exaple, from configuration file),
 database and input names will have correctly stripped quotes,
 begin removal of old lookup support


Revision 692 - Directory Listing
Modified Sun Sep 24 21:13:40 2006 UTC (17 years, 7 months ago) by dpavlin
 r978@llin:  dpavlin | 2006-09-24 23:10:22 +0200
 final touches before diving into lookup creation and usage


Revision 691 - Directory Listing
Modified Sun Sep 24 21:13:36 2006 UTC (17 years, 7 months ago) by dpavlin
 r977@llin:  dpavlin | 2006-09-24 22:21:46 +0200
 parse normalize files for lookups one by one, better error reporting


Revision 690 - Directory Listing
Modified Sun Sep 24 19:00:56 2006 UTC (17 years, 7 months ago) by dpavlin
 r975@llin:  dpavlin | 2006-09-24 20:58:49 +0200
 report invalid databases and inputs for lookups


Revision 689 - Directory Listing
Modified Sun Sep 24 18:52:35 2006 UTC (17 years, 7 months ago) by dpavlin
 r972@llin:  dpavlin | 2006-09-24 20:50:22 +0200
 check for valid databases and inputs [0.02]


Revision 688 - Directory Listing
Modified Sun Sep 24 18:52:31 2006 UTC (17 years, 7 months ago) by dpavlin
 r971@llin:  dpavlin | 2006-09-24 20:04:20 +0200
 iterate_inputs now returns also database name and full database config [0.02]


Revision 687 - Directory Listing
Modified Sun Sep 24 17:49:05 2006 UTC (17 years, 7 months ago) by dpavlin
 r969@llin:  dpavlin | 2006-09-24 19:47:01 +0200
 use Log::Log4perl for logging


Revision 686 - Directory Listing
Modified Sun Sep 24 17:25:04 2006 UTC (17 years, 7 months ago) by dpavlin
 r966@llin:  dpavlin | 2006-09-24 19:22:45 +0200
 first cut at WebPAC::Parser which will allow lookups to be specified in
 normalization file


Revision 685 - Directory Listing
Modified Sun Sep 24 17:24:59 2006 UTC (17 years, 7 months ago) by dpavlin
 r965@llin:  dpavlin | 2006-09-24 18:07:03 +0200
 added iterate_inputs


Revision 682 - Directory Listing
Modified Sun Sep 24 15:28:54 2006 UTC (17 years, 7 months ago) by dpavlin
 r958@llin:  dpavlin | 2006-09-24 17:26:37 +0200
 added $config->get and $config->webpac


Revision 681 - Directory Listing
Modified Sun Sep 24 15:28:49 2006 UTC (17 years, 7 months ago) by dpavlin
 r957@llin:  dpavlin | 2006-09-24 17:03:52 +0200
 move parts of configuration handling to WebPAC::Config


Revision 670 - Directory Listing
Modified Mon Sep 11 14:29:08 2006 UTC (17 years, 7 months ago) by dpavlin
 r938@llin:  dpavlin | 2006-09-11 16:27:57 +0200
 tests, corrections and version bump [0.08]


Revision 669 - Directory Listing
Modified Mon Sep 11 14:29:01 2006 UTC (17 years, 7 months ago) by dpavlin
 r937@llin:  dpavlin | 2006-09-11 16:26:07 +0200
 changed _pack_subfields_hash usage and document it


Revision 666 - Directory Listing
Modified Mon Sep 11 12:32:51 2006 UTC (17 years, 7 months ago) by dpavlin
 r932@llin:  dpavlin | 2006-09-11 14:31:51 +0200
 simplify errors return hash, a bit better formatting of report


Revision 665 - Directory Listing
Modified Mon Sep 11 11:57:30 2006 UTC (17 years, 7 months ago) by dpavlin
 r929@llin:  dpavlin | 2006-09-11 13:56:02 +0200
 another cut at simplification of report


Revision 659 - Directory Listing
Modified Fri Sep 8 14:35:31 2006 UTC (17 years, 7 months ago) by dpavlin
test repeatable subfields


Revision 655 - Directory Listing
Modified Thu Sep 7 16:54:47 2006 UTC (17 years, 7 months ago) by dpavlin
test extra subfields more deeply


Revision 654 - Directory Listing
Modified Thu Sep 7 16:41:08 2006 UTC (17 years, 7 months ago) by dpavlin
again refactored a bit validation hash


Revision 653 - Directory Listing
Modified Thu Sep 7 15:57:48 2006 UTC (17 years, 7 months ago) by dpavlin
added reset_errors and all_errors to validator (real reporter is still pending),
rewriten validator tests


Revision 641 - Directory Listing
Modified Wed Sep 6 20:54:47 2006 UTC (17 years, 7 months ago) by dpavlin
refactored _pack_subfields_hash in separate function


Revision 631 - Directory Listing
Modified Wed Sep 6 14:25:16 2006 UTC (17 years, 7 months ago) by dpavlin
 r890@llin:  dpavlin | 2006-09-06 16:24:27 +0200
 rec1 now unrolls subfields in correct order (as in source file)


Revision 625 - Directory Listing
Modified Sat Aug 26 12:00:36 2006 UTC (17 years, 7 months ago) by dpavlin
 r878@llin:  dpavlin | 2006-08-26 14:00:08 +0200
 removed some debugging output (or moved it to debug level), few tweaks [2.26]


Revision 616 - Directory Listing
Modified Wed Aug 23 14:29:43 2006 UTC (17 years, 8 months ago) by dpavlin
marc_original_order has now arguments in order marc_field, original_field to
be consistent with other directives


Revision 614 - Directory Listing
Modified Wed Aug 23 14:10:10 2006 UTC (17 years, 8 months ago) by dpavlin
 r859@llin:  dpavlin | 2006-08-23 16:10:52 +0200
 test data for 2-input.t


Revision 604 - Directory Listing
Modified Sun Jul 30 14:19:54 2006 UTC (17 years, 8 months ago) by dpavlin
 r844@llin:  dpavlin | 2006-07-30 14:24:04 +0200
 first cut at marc_original_order


Revision 603 - Directory Listing
Modified Sun Jul 23 20:19:56 2006 UTC (17 years, 9 months ago) by dpavlin
 r842@llin:  dpavlin | 2006-07-23 22:23:52 +0200
 append subfields


Revision 599 - Directory Listing
Modified Thu Jul 13 13:55:19 2006 UTC (17 years, 9 months ago) by dpavlin
 r835@llin:  dpavlin | 2006-07-13 15:56:53 +0200
 test modify_record


Revision 596 - Directory Listing
Modified Thu Jul 13 11:54:27 2006 UTC (17 years, 9 months ago) by dpavlin
 r830@llin:  dpavlin | 2006-07-13 13:55:17 +0200
 don't skip tests because of -T


Revision 585 - Directory Listing
Modified Wed Jul 5 19:52:45 2006 UTC (17 years, 9 months ago) by dpavlin
 r810@llin:  dpavlin | 2006-07-05 21:53:01 +0200
 change of parametars to WebPAC::Input


Revision 579 - Directory Listing
Modified Tue Jul 4 11:08:43 2006 UTC (17 years, 9 months ago) by dpavlin
 r798@llin:  dpavlin | 2006-07-04 13:08:44 +0200
 changed _get_marc_fields to return arrayref, tests and fix for marc_remove(field)


Revision 578 - Directory Listing
Modified Tue Jul 4 10:34:15 2006 UTC (17 years, 9 months ago) by dpavlin
 r796@llin:  dpavlin | 2006-07-04 12:34:13 +0200
 created WebPAC::Output::MARC and cleanup run.pl


Revision 574 - Directory Listing
Modified Mon Jul 3 21:08:07 2006 UTC (17 years, 9 months ago) by dpavlin
added marc_duplicate and marc_remove


Revision 571 - Directory Listing
Modified Mon Jul 3 14:30:22 2006 UTC (17 years, 9 months ago) by dpavlin
marc() now supports fields < 10 which don't have indicators and subfields


Revision 566 - Directory Listing
Modified Sun Jul 2 21:17:54 2006 UTC (17 years, 9 months ago) by dpavlin
test split_rec_on corner cases, and fix one


Revision 564 - Directory Listing
Modified Sun Jul 2 20:14:21 2006 UTC (17 years, 9 months ago) by dpavlin
 r772@llin:  dpavlin | 2006-07-02 22:14:37 +0200
 rough implementation of marc_leader (not tested enough)


Revision 562 - Directory Listing
Modified Sun Jul 2 16:14:41 2006 UTC (17 years, 9 months ago) by dpavlin
added marc_compose to specify manually subfield order in MARC and
split_rec_on to split single field into parts based on regex


Revision 557 - Directory Listing
Modified Sat Jul 1 22:36:39 2006 UTC (17 years, 9 months ago) by dpavlin
 r762@llin:  dpavlin | 2006-07-02 00:36:50 +0200
 added test data files


Revision 555 - Directory Listing
Modified Sat Jul 1 10:19:39 2006 UTC (17 years, 9 months ago) by dpavlin
 r757@llin:  dpavlin | 2006-07-01 12:19:34 +0200
 added -d [-d -d ...] flag and test_rec_rules


Revision 553 - Directory Listing
Modified Sat Jul 1 08:55:34 2006 UTC (17 years, 9 months ago) by dpavlin
 r754@llin:  dpavlin | 2006-07-01 10:55:40 +0200
 tweak


Revision 550 - Directory Listing
Modified Fri Jun 30 18:48:33 2006 UTC (17 years, 9 months ago) by dpavlin
 r748@llin:  dpavlin | 2006-06-30 20:48:29 +0200
 re-implement magic again (so that it actually work in all cases consistant).
 Depend on Data::Dump to enable nice output.


Revision 547 - Directory Listing
Modified Thu Jun 29 23:19:26 2006 UTC (17 years, 9 months ago) by dpavlin
 r742@llin:  dpavlin | 2006-06-30 01:21:24 +0200
 added marc_repetable_subfield and marc_indicators, renamed marc21 to marc [2.23]


Revision 540 - Directory Listing
Modified Thu Jun 29 15:29:41 2006 UTC (17 years, 9 months ago) by dpavlin
 r726@llin:  dpavlin | 2006-06-29 17:31:13 +0200
 add marc21 to normalize and create MARC file from those data [2.22]


Revision 538 - Directory Listing
Modified Thu Jun 29 15:29:19 2006 UTC (17 years, 9 months ago) by dpavlin
 r722@llin:  dpavlin | 2006-06-26 21:29:56 +0200
 make private funtions with _


Revision 536 - Directory Listing
Modified Mon Jun 26 16:39:51 2006 UTC (17 years, 9 months ago) by dpavlin
 r719@llin:  dpavlin | 2006-06-26 18:40:57 +0200
 big refacture: depriciate and remove all normalisation formats except .pl sets (but
 old code is still available in WebPAC::Lookup::Normalize because lookups use it) [2.20]


Revision 515 - Directory Listing
Modified Tue May 16 15:23:05 2006 UTC (17 years, 11 months ago) by dpavlin
 r681@llin:  dpavlin | 2006-05-16 17:08:13 +0200
 added validate_errors which returs all validation errors for this record


Revision 514 - Directory Listing
Modified Tue May 16 13:38:09 2006 UTC (17 years, 11 months ago) by dpavlin
 r679@llin:  dpavlin | 2006-05-16 15:41:59 +0200
 begin work on validation framework


Revision 507 - Directory Listing
Modified Mon May 15 13:15:01 2006 UTC (17 years, 11 months ago) by dpavlin
 r669@llin:  dpavlin | 2006-05-15 15:18:36 +0200
 added nicely formatted stats and --stats flag to run.pl


Revision 506 - Directory Listing
Modified Mon May 15 09:59:05 2006 UTC (17 years, 11 months ago) by dpavlin
 r663@llin:  dpavlin | 2006-05-15 12:02:43 +0200
 added stats gathering


Revision 501 - Directory Listing
Modified Sun May 14 22:08:51 2006 UTC (17 years, 11 months ago) by dpavlin
added suffix and surround, regex now skips empty and undef values


Revision 498 - Directory Listing
Modified Sun May 14 19:45:45 2006 UTC (17 years, 11 months ago) by dpavlin
 r653@llin:  dpavlin | 2006-05-14 21:48:48 +0200
 added Excel input format


Revision 491 - Directory Listing
Modified Sun May 14 12:39:39 2006 UTC (17 years, 11 months ago) by dpavlin
 r642@llin:  dpavlin | 2006-05-14 14:43:11 +0200
 use new WebPAC::Normalize::Set::data_structure


Revision 490 - Directory Listing
Modified Sun May 14 12:35:20 2006 UTC (17 years, 11 months ago) by dpavlin
 r637@llin:  dpavlin | 2006-05-14 14:38:22 +0200
 added data_structure (which does most of magic), support for semi-valid data structures


Revision 489 - Directory Listing
Modified Sun May 14 12:35:10 2006 UTC (17 years, 11 months ago) by dpavlin
 r636@llin:  dpavlin | 2006-05-14 13:46:35 +0200
 added tmimgs for comparison of normalizers


Revision 488 - Directory Listing
Modified Sun May 14 12:35:00 2006 UTC (17 years, 11 months ago) by dpavlin
 r635@llin:  dpavlin | 2006-05-14 13:22:18 +0200
 fixed subfield


Revision 485 - Directory Listing
Modified Sun May 14 11:06:42 2006 UTC (17 years, 11 months ago) by dpavlin
 r629@llin:  dpavlin | 2006-05-14 13:05:27 +0200
 add tests for join_with (which found a bug)


Revision 484 - Directory Listing
Modified Sun May 14 11:06:33 2006 UTC (17 years, 11 months ago) by dpavlin
 r628@llin:  dpavlin | 2006-05-14 13:04:56 +0200
 correct normalize files to be sematically same


Revision 483 - Directory Listing
Modified Sun May 14 09:34:05 2006 UTC (17 years, 11 months ago) by dpavlin
 r625@llin:  dpavlin | 2006-05-14 11:37:22 +0200
 added no_progress_bar for tests and cron usage


Revision 482 - Directory Listing
Modified Sun May 14 09:33:56 2006 UTC (17 years, 11 months ago) by dpavlin
 r624@llin:  dpavlin | 2006-05-14 11:16:16 +0200
 don't stop on empty records


Revision 481 - Directory Listing
Modified Sun May 14 00:50:35 2006 UTC (17 years, 11 months ago) by dpavlin
 r622@llin:  dpavlin | 2006-05-14 02:54:00 +0200
 display lookup just once


Revision 479 - Directory Listing
Modified Sat May 13 13:39:09 2006 UTC (17 years, 11 months ago) by dpavlin
 r617@llin:  dpavlin | 2006-05-13 15:42:13 +0200
 dump lookup_hash


Revision 478 - Directory Listing
Modified Sat May 13 13:38:53 2006 UTC (17 years, 11 months ago) by dpavlin
 r616@llin:  dpavlin | 2006-05-13 15:40:49 +0200
 compare lookup_hash result


Revision 477 - Directory Listing
Modified Sat May 13 12:37:45 2006 UTC (17 years, 11 months ago) by dpavlin
 r612@llin:  dpavlin | 2006-05-13 14:40:20 +0200
 rest of fields


Revision 476 - Directory Listing
Modified Sat May 13 12:37:35 2006 UTC (17 years, 11 months ago) by dpavlin
 r611@llin:  dpavlin | 2006-05-13 14:39:57 +0200
 test for set_lookup(undef)


Revision 474 - Directory Listing
Modified Sat May 13 12:08:05 2006 UTC (17 years, 11 months ago) by dpavlin
 r604@llin:  dpavlin | 2006-05-13 14:10:47 +0200
 better output, use lookup_hash


Revision 473 - Directory Listing
Modified Sat May 13 12:07:56 2006 UTC (17 years, 11 months ago) by dpavlin
 r603@llin:  dpavlin | 2006-05-13 14:08:39 +0200
 added lookup_hash for direct access to lookup data


Revision 472 - Directory Listing
Modified Sat May 13 12:07:46 2006 UTC (17 years, 11 months ago) by dpavlin
 r602@llin:  dpavlin | 2006-05-13 13:58:08 +0200
 don't return empty elements in array, extended test set


Revision 471 - Directory Listing
Modified Sat May 13 12:07:37 2006 UTC (17 years, 11 months ago) by dpavlin
 r601@llin:  dpavlin | 2006-05-13 13:37:01 +0200
 extended tests


Revision 470 - Directory Listing
Modified Sat May 13 12:07:27 2006 UTC (17 years, 11 months ago) by dpavlin
 r600@llin:  dpavlin | 2006-05-13 13:07:16 +0200
 added WebPAC::Normalize::Set to unit tests


Revision 468 - Directory Listing
Modified Sat May 13 09:48:15 2006 UTC (17 years, 11 months ago) by dpavlin
 r595@llin:  dpavlin | 2006-05-13 11:48:05 +0200
 use normalize file t/data/normalize.pl


Revision 464 - Directory Listing
Modified Fri May 12 21:46:19 2006 UTC (17 years, 11 months ago) by dpavlin
 r588@llin:  dpavlin | 2006-05-12 23:48:46 +0200
 much improved tests


Revision 461 - Directory Listing
Modified Fri May 12 14:54:25 2006 UTC (17 years, 11 months ago) by dpavlin
 r581@llin:  dpavlin | 2006-05-12 16:57:30 +0200
 added clean_ds, rec1 now supports fields without subfields, rec1 & rec2 now take special care
 not to auto-vivify fields, removed various cruft, tidy pod


Revision 460 - Directory Listing
Modified Fri May 12 14:07:08 2006 UTC (17 years, 11 months ago) by dpavlin
 r579@llin:  dpavlin | 2006-05-12 16:10:11 +0200
 added new normalizer, based on set functions (and easier to use, I hope)


Revision 459 - Directory Listing
Modified Wed May 10 14:48:25 2006 UTC (17 years, 11 months ago) by dpavlin
 r577@llin:  dpavlin | 2006-05-10 16:51:07 +0200
 fixed add_link and wrote tests for it


Revision 458 - Directory Listing
Modified Wed May 10 14:08:15 2006 UTC (17 years, 11 months ago) by dpavlin
 r575@llin:  dpavlin | 2006-05-10 16:10:56 +0200
 use Search::Estraier 0.06 new master API to create nodes, so code here is siplified


Revision 433 - Directory Listing
Modified Mon Apr 17 16:01:12 2006 UTC (18 years ago) by dpavlin
 r524@llin:  dpavlin | 2006-04-17 18:01:04 +0200
 added all_tags() to get sorted list of all tags in input xml


Revision 375 - Directory Listing
Modified Sun Jan 8 22:21:24 2006 UTC (18 years, 3 months ago) by dpavlin
 r417@llin:  dpavlin | 2006-01-08 23:21:35 +0100
 fixed another corner-case


Revision 373 - Directory Listing
Modified Sun Jan 8 22:09:33 2006 UTC (18 years, 3 months ago) by dpavlin
 r414@llin:  dpavlin | 2006-01-08 23:09:49 +0100
 and finally fix for all wired cases (I hope) [2.10]


Revision 370 - Directory Listing
Modified Sun Jan 8 21:16:22 2006 UTC (18 years, 3 months ago) by dpavlin
 r408@llin:  dpavlin | 2006-01-08 22:16:30 +0100
 fix warning


Revision 367 - Directory Listing
Modified Sun Jan 8 20:31:28 2006 UTC (18 years, 3 months ago) by dpavlin
 r402@llin:  dpavlin | 2006-01-08 21:28:21 +0100
 better output


Revision 366 - Directory Listing
Modified Sun Jan 8 20:27:21 2006 UTC (18 years, 3 months ago) by dpavlin
 r395@llin:  dpavlin | 2006-01-08 21:27:12 +0100
 fix path to normalize file


Revision 365 - Directory Listing
Modified Sun Jan 8 20:27:16 2006 UTC (18 years, 3 months ago) by dpavlin
 r394@llin:  dpavlin | 2006-01-08 20:50:57 +0100
 even more tests which fail :-)


Revision 362 - Directory Listing
Modified Sun Jan 8 20:27:01 2006 UTC (18 years, 3 months ago) by dpavlin
 r391@llin:  dpavlin | 2006-01-08 19:19:13 +0100
 demostrate bug where subfield isn't vailable in first repetition, all later repetitions
 doesn't get set


Revision 361 - Directory Listing
Modified Sun Jan 8 20:26:57 2006 UTC (18 years, 3 months ago) by dpavlin
 r390@llin:  dpavlin | 2006-01-08 19:02:27 +0100
 test repeatable fields


Revision 352 - Directory Listing
Modified Sat Jan 7 18:23:27 2006 UTC (18 years, 3 months ago) by dpavlin
 r371@llin:  dpavlin | 2006-01-07 19:23:27 +0100
 make tests less chatty


Revision 316 - Directory Listing
Modified Fri Dec 23 21:37:00 2005 UTC (18 years, 4 months ago) by dpavlin
 r12233@llin:  dpavlin | 2005-12-23 23:23:52 +0100
 and a fix to report just REAL error :-)


Revision 315 - Directory Listing
Modified Fri Dec 23 21:17:37 2005 UTC (18 years, 4 months ago) by dpavlin
 r12231@llin:  dpavlin | 2005-12-23 23:19:04 +0100
 fix test to show bug in parsing (not hiding first delimiter if first field
 is missing in input record)


Revision 314 - Directory Listing
Modified Fri Dec 23 21:05:50 2005 UTC (18 years, 4 months ago) by dpavlin
 r345@athlon:  dpavlin | 2005-12-21 00:54:13 +0100
 work on tests


Revision 302 - Directory Listing
Modified Mon Dec 19 21:35:37 2005 UTC (18 years, 4 months ago) by dpavlin
cleanup test index


Revision 300 - Directory Listing
Modified Mon Dec 19 21:25:57 2005 UTC (18 years, 4 months ago) by dpavlin
 r321@athlon:  dpavlin | 2005-12-19 22:11:49 +0100
 fix


Revision 297 - Directory Listing
Modified Mon Dec 19 19:37:07 2005 UTC (18 years, 4 months ago) by dpavlin
 r11801@llin:  dpavlin | 2005-12-19 20:37:54 +0100
 added MARC file example


Revision 290 - Directory Listing
Modified Sun Dec 18 23:10:02 2005 UTC (18 years, 4 months ago) by dpavlin
 r11787@llin:  dpavlin | 2005-12-19 06:10:47 +0100
 MARC indexing seems to work


Revision 286 - Directory Listing
Modified Sun Dec 18 21:06:46 2005 UTC (18 years, 4 months ago) by dpavlin
 r11778@llin:  dpavlin | 2005-12-19 03:59:54 +0100
 move work on input


Revision 285 - Directory Listing
Modified Sun Dec 18 21:06:39 2005 UTC (18 years, 4 months ago) by dpavlin
 r11777@llin:  dpavlin | 2005-12-19 00:02:47 +0100
 refactor Input::ISIS::* [0.02]


Revision 266 - Directory Listing
Modified Fri Dec 16 16:23:49 2005 UTC (18 years, 4 months ago) by dpavlin
 r11737@llin:  dpavlin | 2005-12-16 21:23:53 +0100
 update test to new api


Revision 260 - Directory Listing
Modified Fri Dec 16 14:40:55 2005 UTC (18 years, 4 months ago) by dpavlin
 r11727@llin:  dpavlin | 2005-12-16 19:41:08 +0100
 added filter{regex(s/foo/bar/)} [2.00_5]


Revision 252 - Directory Listing
Modified Thu Dec 15 17:01:04 2005 UTC (18 years, 4 months ago) by dpavlin
 r11711@llin:  dpavlin | 2005-12-15 20:02:16 +0100
 varios tweaks to make lookups work


Revision 218 - Directory Listing
Modified Mon Dec 5 17:48:00 2005 UTC (18 years, 4 months ago) by dpavlin
 r11539@llin:  dpavlin | 2005-12-05 16:18:58 +0100
 WebPAC::Store now uses prefix in load_ds and save_ds and requires database
 when created with new [0.06]


Revision 217 - Directory Listing
Modified Mon Dec 5 17:47:51 2005 UTC (18 years, 4 months ago) by dpavlin
 r11536@llin:  dpavlin | 2005-12-05 15:29:47 +0100
 change on load_ds and save_ds which not accept ONLY hash (and optional
 database name if not specified when calling new WebPAC::Store)


Revision 212 - Directory Listing
Modified Mon Dec 5 17:47:16 2005 UTC (18 years, 4 months ago) by dpavlin
 r11525@llin:  dpavlin | 2005-12-05 01:45:38 +0100
 minor tweaks, tests now pass


Revision 211 - Directory Listing
Modified Mon Dec 5 17:47:10 2005 UTC (18 years, 4 months ago) by dpavlin
 r11523@llin:  dpavlin | 2005-12-05 01:22:00 +0100
 even more changes on the road to controlling Hyper Estraier from perl :-)


Revision 209 - Directory Listing
Modified Mon Dec 5 17:46:57 2005 UTC (18 years, 4 months ago) by dpavlin
 r11518@llin:  dpavlin | 2005-12-04 19:43:29 +0100
 renamed WebPAC::DB to WebPAC::Store


Revision 126 - Directory Listing
Modified Thu Nov 24 11:47:21 2005 UTC (18 years, 5 months ago) by dpavlin
 r9090@llin:  dpavlin | 2005-11-24 12:48:47 +0100
 fix


Revision 124 - Directory Listing
Modified Thu Nov 24 11:47:10 2005 UTC (18 years, 5 months ago) by dpavlin
 r9088@llin:  dpavlin | 2005-11-24 12:20:36 +0100
 API 0.02: load_ds and save_ds now accept id => 42 as arguments


Revision 81 - Directory Listing
Modified Mon Nov 21 14:42:22 2005 UTC (18 years, 5 months ago) by dpavlin
 r9002@llin:  dpavlin | 2005-11-21 15:43:39 +0100
 Text::Iconv working, fixed tests, minor tweaks


Revision 80 - Directory Listing
Modified Mon Nov 21 14:42:16 2005 UTC (18 years, 5 months ago) by dpavlin
 r9001@llin:  dpavlin | 2005-11-21 15:29:13 +0100
 added WebPAC::Search::Estraier which should be callable from outside
 WebPAC (e.g. Catalyst)


Revision 70 - Directory Listing
Modified Sat Nov 19 23:48:24 2005 UTC (18 years, 5 months ago) by dpavlin
 r8980@llin:  dpavlin | 2005-11-20 00:49:22 +0100
 implement data_structure that returns HASH and not ARRAY.
 
 Little explanation for this rationale:
 
 Array was needed back in WebPAC v1 because order of tags in import_xml was
 important. However, since we are no longer depending on order of tags in
 input/*.xml, hash is much better choice.


Revision 64 - Directory Listing
Modified Tue Nov 15 16:56:44 2005 UTC (18 years, 5 months ago) by dpavlin
 r8894@llin:  dpavlin | 2005-11-15 17:56:56 +0100
 fixed WebPAC::Normalize::get_data to work when called with subfield which
 doesn't exist, added tests


Revision 62 - Directory Listing
Modified Tue Nov 15 14:31:12 2005 UTC (18 years, 5 months ago) by dpavlin
 r8884@llin:  dpavlin | 2005-11-15 14:46:07 +0100
 fix small warnings


Revision 50 - Directory Listing
Modified Mon Nov 14 16:15:45 2005 UTC (18 years, 5 months ago) by dpavlin
 r8859@llin:  dpavlin | 2005-11-14 13:37:51 +0100
 non-existing record in load_ds return undef


Revision 33 - Directory Listing
Modified Sun Jul 24 15:35:46 2005 UTC (18 years, 9 months ago) by dpavlin
fix


Revision 31 - Directory Listing
Modified Sun Jul 24 15:03:11 2005 UTC (18 years, 9 months ago) by dpavlin
re-worked logging, added no_log option to disable logging


Revision 30 - Directory Listing
Modified Sun Jul 24 14:20:59 2005 UTC (18 years, 9 months ago) by dpavlin
move data to $self->{'_lookup_data'} and document that


Revision 29 - Directory Listing
Modified Sun Jul 24 11:17:44 2005 UTC (18 years, 9 months ago) by dpavlin
some logging improvements and sample configuration file


Revision 22 - Directory Listing
Modified Sun Jul 17 22:48:25 2005 UTC (18 years, 9 months ago) by dpavlin
beginning of unit testing and various fixes


Revision 21 - Directory Listing
Modified Sun Jul 17 22:28:11 2005 UTC (18 years, 9 months ago) by dpavlin
fixed ISIS size


Revision 20 - Directory Listing
Modified Sun Jul 17 21:04:23 2005 UTC (18 years, 9 months ago) by dpavlin
few more tests


Revision 19 - Directory Listing
Modified Sun Jul 17 15:04:39 2005 UTC (18 years, 9 months ago) by dpavlin
some cleanups and bugfixes


Revision 18 - Directory Listing
Modified Sun Jul 17 14:53:37 2005 UTC (18 years, 9 months ago) by dpavlin
first cut into WebPAC::DB


Revision 16 - Directory Listing
Modified Sun Jul 17 11:37:07 2005 UTC (18 years, 9 months ago) by dpavlin
Added Output::WebPAC::TT to produce Template Toolkit output.


Revision 15 - Directory Listing
Modified Sun Jul 17 10:42:23 2005 UTC (18 years, 9 months ago) by dpavlin
WebPAC::Common cleanup, most code moved to WebPAC::Normalize. Added
documentation about order of data mungling when normalising data.


Revision 14 - Directory Listing
Modified Sun Jul 17 00:04:25 2005 UTC (18 years, 9 months ago) by dpavlin
small fixes


Revision 13 - Directory Listing
Modified Sat Jul 16 23:56:14 2005 UTC (18 years, 9 months ago) by dpavlin
data_source seems to work


Revision 12 - Directory Listing
Modified Sat Jul 16 22:57:26 2005 UTC (18 years, 9 months ago) by dpavlin
improvements to WebPAC::Normalize::XML


Revision 10 - Directory Listing
Modified Sat Jul 16 20:35:30 2005 UTC (18 years, 9 months ago) by dpavlin
ISIS input is finished, low_mem option has code (and not only documentation :-)


Revision 9 - Directory Listing
Modified Sat Jul 16 17:14:43 2005 UTC (18 years, 9 months ago) by dpavlin
a bit more work on WebPAC::Input::ISIS


Revision 8 - Directory Listing
Modified Sat Jul 16 16:48:35 2005 UTC (18 years, 9 months ago) by dpavlin
little cleanup and first cut into WebPAC::Normalize::XML


Revision 7 - Directory Listing
Modified Sat Jul 16 16:00:19 2005 UTC (18 years, 9 months ago) by dpavlin
lookups cleanup


Revision 6 - Directory Listing
Modified Sat Jul 16 14:44:38 2005 UTC (18 years, 9 months ago) by dpavlin
added WebPAC::Input::ISIS


Revision 5 - Directory Listing
Modified Sat Jul 16 12:40:28 2005 UTC (18 years, 9 months ago) by dpavlin
test also filter


Revision 4 - Directory Listing
Modified Sat Jul 16 12:37:18 2005 UTC (18 years, 9 months ago) by dpavlin
more work on lookups, example configuration layout


Revision 3 - Directory Listing
Modified Sat Jul 16 11:07:38 2005 UTC (18 years, 9 months ago) by dpavlin
moved implementation of lookups from older code-base


Revision 1 - Directory Listing
Added Sat Jun 25 20:23:23 2005 UTC (18 years, 10 months ago) by dpavlin
initial import of some documentation and module structure


  ViewVC Help
Powered by ViewVC 1.1.26