/[webpac2]/trunk/lib/WebPAC
This is repository of my old source code which isn't updated any more. Go to git.rot13.org for current projects!
ViewVC logotype

Log of /trunk/lib/WebPAC

View Directory Listing Directory Listing


Sticky Revision:

Revision 1373 - Directory Listing
Modified Thu Aug 22 08:16:28 2013 UTC (10 years, 9 months ago) by dpavlin
better error messages


Revision 1368 - Directory Listing
Modified Mon Mar 12 19:00:00 2012 UTC (12 years, 2 months ago) by dpavlin
marc_original_order support for leader and fixed fields


Revision 1367 - Directory Listing
Modified Thu Dec 15 21:40:37 2011 UTC (12 years, 5 months ago) by dpavlin
added _set_rec

Revision 1366 - Directory Listing
Modified Thu Dec 15 21:40:02 2011 UTC (12 years, 5 months ago) by dpavlin
import OAI repository

Revision 1365 - Directory Listing
Modified Wed May 4 13:44:07 2011 UTC (13 years ago) by dpavlin
specify KOHA_DSN

Revision 1364 - Directory Listing
Modified Thu Apr 21 17:10:04 2011 UTC (13 years, 1 month ago) by dpavlin
hush all warnings in normalize code

Revision 1363 - Directory Listing
Modified Mon Apr 11 17:29:59 2011 UTC (13 years, 1 month ago) by dpavlin
use _num suffix for numeric fields

Revision 1362 - Directory Listing
Modified Mon Apr 11 17:29:18 2011 UTC (13 years, 1 month ago) by dpavlin
fix warning


Revision 1361 - Directory Listing
Modified Wed Mar 16 20:16:42 2011 UTC (13 years, 2 months ago) by dpavlin
added sqlite_unicode to force utf-8 from SQLite

Revision 1360 - Directory Listing
Modified Tue Mar 15 22:50:20 2011 UTC (13 years, 2 months ago) by dpavlin
we are not ignoring $mfn

Revision 1359 - Directory Listing
Modified Tue Mar 15 22:47:25 2011 UTC (13 years, 2 months ago) by dpavlin
read data from RDBMS using DBI


Revision 1358 - Directory Listing
Modified Sat Nov 13 16:00:30 2010 UTC (13 years, 6 months ago) by dpavlin
added Riak Search link

Revision 1357 - Directory Listing
Modified Sat Nov 13 15:29:18 2010 UTC (13 years, 6 months ago) by dpavlin
finish riak search support


Revision 1355 - Directory Listing
Modified Sat Nov 13 01:17:09 2010 UTC (13 years, 6 months ago) by dpavlin
merge WebPAC::Output::Riak


Revision 1349 - Directory Listing
Modified Sat Oct 16 18:25:59 2010 UTC (13 years, 7 months ago) by dpavlin
fix \N NULL skipping

Revision 1347 - Directory Listing
Modified Sat Oct 16 17:51:00 2010 UTC (13 years, 7 months ago) by dpavlin
chomp lines

Revision 1346 - Directory Listing
Modified Sat Oct 16 17:47:25 2010 UTC (13 years, 7 months ago) by dpavlin
ignore \N fields (NULL)

Revision 1345 - Directory Listing
Modified Sat Oct 16 17:44:57 2010 UTC (13 years, 7 months ago) by dpavlin
generate json file on disk


Revision 1344 - Directory Listing
Modified Sat Oct 16 17:40:56 2010 UTC (13 years, 7 months ago) by dpavlin
added no_transaction


Revision 1343 - Directory Listing
Modified Sat Oct 16 17:38:47 2010 UTC (13 years, 7 months ago) by dpavlin
tab separated values input module


Revision 1327 - Directory Listing
Modified Tue Feb 9 20:14:23 2010 UTC (14 years, 3 months ago) by dpavlin
correctly decode utf-8 from marc files


Revision 1326 - Directory Listing
Modified Tue Feb 2 19:30:48 2010 UTC (14 years, 3 months ago) by dpavlin
log errors


Revision 1325 - Directory Listing
Modified Tue Feb 2 18:03:17 2010 UTC (14 years, 3 months ago) by dpavlin
added offset and limit [0.02]


Revision 1322 - Directory Listing
Modified Tue Jan 26 14:16:36 2010 UTC (14 years, 4 months ago) by dpavlin
Merge remote branch 'remotes/Sack'

Conflicts:
	bin/dump2marc.pl

Revision 1307 - Directory Listing
Modified Mon Sep 21 16:42:25 2009 UTC (14 years, 8 months ago) by dpavlin
cleanup WebPAC::Input

Revision 1306 - Directory Listing
Modified Mon Sep 21 15:48:52 2009 UTC (14 years, 8 months ago) by dpavlin
extract size from ll_db if supported

Revision 1305 - Directory Listing
Modified Sun Sep 20 22:26:27 2009 UTC (14 years, 8 months ago) by dpavlin
implement experimental (and probably broken) low-level offset and limit


Revision 1304 - Directory Listing
Modified Sun Sep 20 21:38:15 2009 UTC (14 years, 8 months ago) by dpavlin
fix offset to skip records just like SQL databases do, and not position us on it

Revision 1303 - Directory Listing
Modified Sun Sep 20 19:56:33 2009 UTC (14 years, 8 months ago) by dpavlin
implement efficiant offset


Revision 1302 - Directory Listing
Modified Sun Sep 20 19:05:56 2009 UTC (14 years, 8 months ago) by dpavlin
skip empty lines and nicer output


Revision 1296 - Directory Listing
Modified Sat Sep 19 23:29:23 2009 UTC (14 years, 8 months ago) by dpavlin
- added support for Direct Export format to existing BRS/Tagged
- specify file glob (as from ovid-download-results.pl) for multiple files


Revision 1288 - Directory Listing
Modified Sat Sep 19 08:41:06 2009 UTC (14 years, 8 months ago) by dpavlin
join PA and JI

Revision 1287 - Directory Listing
Modified Fri Sep 18 21:38:09 2009 UTC (14 years, 8 months ago) by dpavlin
- join FU and FX fields, split ID SC and DE on ;
- implemented limit and offset for speedup


Revision 1286 - Directory Listing
Modified Fri Sep 18 21:30:30 2009 UTC (14 years, 8 months ago) by dpavlin
push offset and limit to low-level modules for optimizations


Revision 1277 - Directory Listing
Modified Wed Aug 19 16:24:43 2009 UTC (14 years, 9 months ago) by dpavlin
insert space before if

Revision 1276 - Directory Listing
Modified Wed Aug 19 16:07:39 2009 UTC (14 years, 9 months ago) by dpavlin
added sane defaults if not specified in configuration file


Revision 1265 - Directory Listing
Modified Sun Aug 9 20:10:21 2009 UTC (14 years, 9 months ago) by dpavlin
fix foreach my combination

Revision 1259 - Directory Listing
Modified Tue Jul 28 13:55:44 2009 UTC (14 years, 10 months ago) by dpavlin
prune whitespaces (reverting r1204) because our parser
depends on it


Revision 1254 - Directory Listing
Modified Mon Jul 27 16:24:41 2009 UTC (14 years, 10 months ago) by dpavlin
force utf-8 encoding on all data comming from file

Revision 1247 - Directory Listing
Modified Wed Jul 22 12:53:07 2009 UTC (14 years, 10 months ago) by dpavlin
hopefully fix utf-8 encoding when sending it to swish

- remove accented characters before indexing (FIXME: done anyway by swish?)
- convert data to JSON with utf8 encoding
- remove explicit encode
- use bytes to calculate length


Revision 1244 - Directory Listing
Modified Mon Jul 20 22:00:43 2009 UTC (14 years, 10 months ago) by dpavlin
don't fallback to input name, but use first sheet instead


Revision 1236 - Directory Listing
Modified Fri Jul 10 13:54:55 2009 UTC (14 years, 10 months ago) by dpavlin
save ll_db earlier so that input_module won't die on empty input


Revision 1234 - Directory Listing
Modified Fri Jul 10 13:53:28 2009 UTC (14 years, 10 months ago) by dpavlin
don't overwrite cache marc file


Revision 1232 - Directory Listing
Modified Thu Jul 9 22:01:11 2009 UTC (14 years, 10 months ago) by dpavlin
dump items without marc instead of dieing


Revision 1231 - Directory Listing
Modified Thu Jul 9 17:00:51 2009 UTC (14 years, 10 months ago) by dpavlin
fetch MARC records directly from Koha database

Just create local file out of them, they need to be
converted in hash to be really useful inside WebPAC


Revision 1222 - Directory Listing
Modified Tue Jun 9 21:41:12 2009 UTC (14 years, 11 months ago) by dpavlin
- version bump [0.06]
- produce column names and labels for vhost/webpac2.cgi
- implement normalize callback which put Excel data into _rows and search values


Revision 1221 - Directory Listing
Modified Tue Jun 9 21:37:32 2009 UTC (14 years, 11 months ago) by dpavlin
accessor for low-level input_module


Revision 1217 - Directory Listing
Modified Tue Jun 9 18:38:36 2009 UTC (14 years, 11 months ago) by dpavlin
select sheet: worksheet param, name of input, first one


Revision 1216 - Directory Listing
Modified Tue Jun 2 13:17:24 2009 UTC (14 years, 11 months ago) by dpavlin
fix pod example for rec_array


Revision 1215 - Directory Listing
Modified Tue Jun 2 13:16:02 2009 UTC (14 years, 11 months ago) by dpavlin
more fields to join (from multi-line input)


Revision 1214 - Directory Listing
Modified Tue Jun 2 13:14:59 2009 UTC (14 years, 11 months ago) by dpavlin
document rec_array and fix tests


Revision 1212 - Directory Listing
Modified Sat May 30 20:30:26 2009 UTC (15 years ago) by dpavlin
 r1910@llin:  dpavlin | 2009-05-30 22:30:07 +0200
 wrap everything into trasaction for nice speedup (10x)
 and don't store all data in memory


Revision 1211 - Directory Listing
Modified Sat May 30 15:34:55 2009 UTC (15 years ago) by dpavlin
execute schema commands one by one to be more robust on SQLite


Revision 1210 - Directory Listing
Modified Sat May 30 15:26:25 2009 UTC (15 years ago) by dpavlin
 r1906@llin:  dpavlin | 2009-05-30 17:26:17 +0200
 added table name to row normalize command so we can create
 data in different tables directly from normalization file


Revision 1209 - Directory Listing
Modified Sat May 30 14:21:58 2009 UTC (15 years ago) by dpavlin
 r1904@llin:  dpavlin | 2009-05-30 16:21:56 +0200
 better support for DOI in ISI data export


Revision 1207 - Directory Listing
Modified Fri May 29 21:37:58 2009 UTC (15 years ago) by dpavlin
 r1900@llin:  dpavlin | 2009-05-29 23:37:57 +0200
 WebPAC::Output::DBI to dump row from normalize into database
 (so each input record can create multiple rows)


Revision 1206 - Directory Listing
Modified Fri May 29 20:55:54 2009 UTC (15 years ago) by dpavlin
 r1898@llin:  dpavlin | 2009-05-29 22:55:52 +0200
 test rec_array and rows


Revision 1205 - Directory Listing
Modified Fri May 29 20:32:13 2009 UTC (15 years ago) by dpavlin
 r1896@llin:  dpavlin | 2009-05-29 22:32:12 +0200
 added rec_array and row and small example how to create
 multiple rows from single record in input file


Revision 1204 - Directory Listing
Modified Fri May 29 19:38:09 2009 UTC (15 years ago) by dpavlin
 r1894@llin:  dpavlin | 2009-05-29 21:38:05 +0200
 don't remove whitespaces so we can have more comprex perl
 in normalize istread of mungling it becaise of removed spaces


Revision 1203 - Directory Listing
Modified Fri May 29 18:16:32 2009 UTC (15 years ago) by dpavlin
 r1892@llin:  dpavlin | 2009-05-29 20:16:29 +0200
 create output path if it doesn't exist


Revision 1202 - Directory Listing
Modified Fri May 29 18:15:57 2009 UTC (15 years ago) by dpavlin
 r1890@llin:  dpavlin | 2009-05-29 20:09:47 +0200
 WebPAC::Path provides mk_base_path helper function


Revision 1198 - Directory Listing
Modified Thu May 28 10:15:20 2009 UTC (15 years ago) by dpavlin
output modules can now define add_row as opposed to add to get input row before normalization

Revision 1197 - Directory Listing
Modified Thu May 28 09:58:18 2009 UTC (15 years ago) by dpavlin
WebPAC::Output::CouchDB now takes uri to CouchDB server,
document ids now include input name


Revision 1196 - Directory Listing
Modified Wed May 27 22:17:00 2009 UTC (15 years ago) by dpavlin
 r1880@llin:  dpavlin | 2009-05-27 23:45:18 +0200
 added output to CouchDB


Revision 1194 - Directory Listing
Modified Wed May 27 09:31:35 2009 UTC (15 years ago) by dpavlin
 r1878@llin:  dpavlin | 2009-05-27 11:31:28 +0200
 CR field in ISI format now also contains 'full' line from original
 file as well as parsed components


Revision 1187 - Directory Listing
Modified Wed May 20 14:23:54 2009 UTC (15 years ago) by dpavlin
display marc encoding (which is utf-8 by default)


Revision 1186 - Directory Listing
Modified Tue May 19 14:46:12 2009 UTC (15 years ago) by dpavlin
added WebPAC::Input::CSV

Revision 1179 - Directory Listing
Modified Wed Apr 29 18:14:17 2009 UTC (15 years, 1 month ago) by dpavlin
 r1860@llin:  dpavlin | 2009-04-29 20:11:35 +0200
 encode outgoing xml for swish-e in utf-8


Revision 1168 - Directory Listing
Modified Sat Apr 25 17:13:20 2009 UTC (15 years, 1 month ago) by dpavlin
 r1838@llin:  dpavlin | 2009-04-25 19:13:18 +0200
 don't ever never use blib (so I don't have to re-run make)


Revision 1167 - Directory Listing
Modified Sat Apr 25 17:12:44 2009 UTC (15 years, 1 month ago) by dpavlin
 r1835@llin:  dpavlin | 2009-04-25 19:12:40 +0200
 add database and input to json which is returned with search result


Revision 1165 - Directory Listing
Modified Sat Apr 25 17:11:33 2009 UTC (15 years, 1 month ago) by dpavlin
 r1832@llin:  dpavlin | 2009-04-25 18:46:39 +0200
 working on stats generation when indexing data


Revision 1161 - Directory Listing
Modified Sat Apr 25 14:18:06 2009 UTC (15 years, 1 month ago) by dpavlin
rename top-level tag to all so we can have quieries
like (all=something) in swish-e


Revision 1156 - Directory Listing
Modified Sat Apr 25 11:43:46 2009 UTC (15 years, 1 month ago) by dpavlin
include database and input into search fields


Revision 1154 - Directory Listing
Modified Sat Apr 25 10:59:43 2009 UTC (15 years, 1 month ago) by dpavlin
 r1815@llin:  dpavlin | 2009-04-25 12:59:36 +0200
 implement BW EW tokens to mark boundries of attributes


Revision 1151 - Directory Listing
Modified Fri Apr 24 17:03:11 2009 UTC (15 years, 1 month ago) by dpavlin
use mkpath instead of make_path to support older Fole::Path on production server


Revision 1149 - Directory Listing
Modified Fri Apr 24 16:58:09 2009 UTC (15 years, 1 month ago) by dpavlin
 r1804@llin:  dpavlin | 2009-04-24 18:51:47 +0200
 port webpac2.cgi to use swish-e as indexing engine
 added ProperyName data which contains JSON encoded data


Revision 1148 - Directory Listing
Modified Fri Apr 24 09:37:08 2009 UTC (15 years, 1 month ago) by dpavlin
create var/estraier if it doesn't exist


Revision 1147 - Directory Listing
Modified Thu Apr 23 13:20:51 2009 UTC (15 years, 1 month ago) by dpavlin
 r1802@llin:  dpavlin | 2009-04-23 15:20:49 +0200
 more changes to make indexing of WebPAC::Output::SWISH work
 (but not tests yet)


Revision 1145 - Directory Listing
Modified Thu Apr 23 11:14:24 2009 UTC (15 years, 1 month ago) by dpavlin
 r1798@llin:  dpavlin | 2009-04-23 13:14:23 +0200
 start support for swish-e using WebPAC::Output::SWISH


Revision 1131 - Directory Listing
Modified Tue Apr 21 21:06:30 2009 UTC (15 years, 1 month ago) by dpavlin
 r1769@llin:  dpavlin | 2009-04-21 23:05:26 +0200
 dump attribute usage to disk


Revision 1130 - Directory Listing
Modified Tue Apr 21 21:06:29 2009 UTC (15 years, 1 month ago) by dpavlin
 r1768@llin:  dpavlin | 2009-04-21 23:04:32 +0200
 hush debug output


Revision 1128 - Directory Listing
Modified Tue Apr 21 21:03:52 2009 UTC (15 years, 1 month ago) by dpavlin
 r1764@llin:  dpavlin | 2009-04-21 18:56:13 +0200
 


Revision 1126 - Directory Listing
Modified Mon Apr 20 13:44:40 2009 UTC (15 years, 1 month ago) by dpavlin
 r1760@llin:  dpavlin | 2009-04-20 15:44:39 +0200
 tweak implementation to actually work


Revision 1124 - Directory Listing
Modified Sun Apr 19 23:35:31 2009 UTC (15 years, 1 month ago) by dpavlin
 r1756@llin:  dpavlin | 2009-04-20 01:35:20 +0200
 added WebPAC::Input::Ovid for citation format


Revision 1122 - Directory Listing
Modified Mon Nov 17 21:30:05 2008 UTC (15 years, 6 months ago) by dpavlin
dump error from $@


Revision 1121 - Directory Listing
Modified Mon Nov 17 21:18:16 2008 UTC (15 years, 6 months ago) by dpavlin
better report modify errors


Revision 1118 - Directory Listing
Modified Sun Oct 26 15:57:37 2008 UTC (15 years, 7 months ago) by dpavlin
 r1747@llin:  dpavlin | 2008-10-26 16:55:31 +0100
 bug fix: don't destroy subfields values in data hash


Revision 1111 - Directory Listing
Modified Sat Sep 6 10:54:25 2008 UTC (15 years, 8 months ago) by dpavlin
a bit more work on marc_clone on some real records


Revision 1110 - Directory Listing
Modified Sat Sep 6 10:53:47 2008 UTC (15 years, 8 months ago) by dpavlin
- version dependency on MARC::Fast is handled by Makefile.PL
- include_subfields in returned hash


Revision 1109 - Directory Listing
Modified Sat Sep 6 09:54:08 2008 UTC (15 years, 8 months ago) by dpavlin
 r1735@llin:  dpavlin | 2008-09-06 11:54:01 +0200
 cleanup test


Revision 1108 - Directory Listing
Modified Sun Aug 31 09:14:18 2008 UTC (15 years, 8 months ago) by dpavlin
 r1733@llin:  dpavlin | 2008-08-31 11:14:02 +0200
 beginning of marc_clone


Revision 1107 - Directory Listing
Modified Mon Aug 4 21:47:27 2008 UTC (15 years, 9 months ago) by dpavlin
migrate internal encoding to utf-8


Revision 1105 - Directory Listing
Modified Mon Aug 4 19:35:23 2008 UTC (15 years, 9 months ago) by dpavlin
 r1724@llin:  dpavlin | 2008-08-04 21:35:00 +0200
 fix input/excel encoding problems


Revision 1100 - Directory Listing
Modified Sat Aug 2 23:46:41 2008 UTC (15 years, 9 months ago) by dpavlin
Make cleanup of encodings, moving webpac closer to having
internal utf-8 representation.

This will break current code, but is really neceserry
step toward checking input encoding for validity


Revision 1089 - Directory Listing
Modified Mon Jan 28 18:30:07 2008 UTC (16 years, 4 months ago) by dpavlin
 r1702@llin:  dpavlin | 2008-01-28 19:29:41 +0100
 EBSCO text file export support


Revision 1083 - Directory Listing
Modified Sun Dec 23 19:41:10 2007 UTC (16 years, 5 months ago) by dpavlin
report size of loaded/saved file


Revision 1080 - Directory Listing
Modified Sun Dec 2 01:43:59 2007 UTC (16 years, 5 months ago) by dpavlin
by default, update full text index


Revision 1077 - Directory Listing
Modified Wed Nov 28 22:52:01 2007 UTC (16 years, 6 months ago) by dpavlin
fake mfn to make rest of WebPAC happy


Revision 1076 - Directory Listing
Modified Wed Nov 28 22:51:43 2007 UTC (16 years, 6 months ago) by dpavlin
tweaks to statistics:
- support stats from simple field => 'value' structure
- sort fields which are not numeric correctly


Revision 1072 - Directory Listing
Modified Wed Nov 28 00:25:11 2007 UTC (16 years, 6 months ago) by dpavlin
protect values that look like Excel formulas (=something)


Revision 1071 - Directory Listing
Modified Wed Nov 28 00:01:34 2007 UTC (16 years, 6 months ago) by dpavlin
 r1677@llin:  dpavlin | 2007-11-28 01:01:39 +0100
 fix encoding of Excel files


Revision 1070 - Directory Listing
Modified Tue Nov 27 23:54:45 2007 UTC (16 years, 6 months ago) by dpavlin
 r1674@llin:  dpavlin | 2007-11-28 00:54:47 +0100
 - final tweaks to WebPAC::Output::Excel
 - version bump [2.34]


Revision 1069 - Directory Listing
Modified Tue Nov 27 23:54:43 2007 UTC (16 years, 6 months ago) by dpavlin
 r1673@llin:  dpavlin | 2007-11-28 00:46:28 +0100
 added tests for WebPAC::Output base class and added
 single_values option


Revision 1068 - Directory Listing
Modified Tue Nov 27 23:45:28 2007 UTC (16 years, 6 months ago) by dpavlin
 r1670@llin:  dpavlin | 2007-11-28 00:13:29 +0100
 - WebPAC::Output::Excel


Revision 1066 - Directory Listing
Modified Tue Nov 27 22:31:09 2007 UTC (16 years, 6 months ago) by dpavlin
 r1667@llin:  dpavlin | 2007-11-27 23:31:09 +0100
 export to as general way to set different output fields


Revision 1063 - Directory Listing
Modified Tue Nov 27 21:01:44 2007 UTC (16 years, 6 months ago) by dpavlin
pod fixes


Revision 1062 - Directory Listing
Modified Wed Nov 21 10:09:55 2007 UTC (16 years, 6 months ago) by dpavlin
 r1661@llin:  dpavlin | 2007-11-21 11:09:52 +0100
 fix marc_template hadling of field value 0


Revision 1061 - Directory Listing
Modified Tue Nov 20 22:07:45 2007 UTC (16 years, 6 months ago) by dpavlin
 r1659@llin:  dpavlin | 2007-11-20 23:07:47 +0100
 re-insert spaces in AST after sub to create valid normalize
 source if we are using sub name {} in normalize files [2.33]


Revision 1058 - Directory Listing
Modified Tue Nov 20 10:08:55 2007 UTC (16 years, 6 months ago) by dpavlin
 r1653@llin:  dpavlin | 2007-11-20 11:08:49 +0100
 fix WebPAC::Output::Jifty to join multiple values with space
 when inserting into Jifty


Revision 1057 - Directory Listing
Modified Tue Nov 20 10:08:02 2007 UTC (16 years, 6 months ago) by dpavlin
 r1650@llin:  dpavlin | 2007-11-20 11:07:57 +0100
 final tweaks for WebPAC::Input::PDF, emit fields A .. ZZ


Revision 1056 - Directory Listing
Modified Tue Nov 20 10:08:00 2007 UTC (16 years, 6 months ago) by dpavlin
 r1649@llin:  dpavlin | 2007-11-20 10:32:15 +0100
 experimental WebPAC::Output::Jifty to create arbitrary data in
 Jifty models


Revision 1055 - Directory Listing
Modified Tue Nov 20 09:30:58 2007 UTC (16 years, 6 months ago) by dpavlin
 r1646@llin:  dpavlin | 2007-11-20 10:30:52 +0100
 document column names


Revision 1054 - Directory Listing
Modified Tue Nov 20 09:30:56 2007 UTC (16 years, 6 months ago) by dpavlin
 r1645@llin:  dpavlin | 2007-11-19 23:05:23 +0100
 added experimenal (still not working) WebPAC::Input::PDF


Revision 1051 - Directory Listing
Modified Mon Nov 19 16:50:14 2007 UTC (16 years, 6 months ago) by dpavlin
 r1637@llin:  dpavlin | 2007-11-19 17:50:06 +0100
 and fix for subfield 0


Revision 1049 - Directory Listing
Modified Mon Nov 19 16:50:10 2007 UTC (16 years, 6 months ago) by dpavlin
 r1635@llin:  dpavlin | 2007-11-19 17:47:20 +0100
 fix warning


Revision 1048 - Directory Listing
Modified Mon Nov 19 16:33:09 2007 UTC (16 years, 6 months ago) by dpavlin
 r1633@llin:  dpavlin | 2007-11-19 17:33:09 +0100
 fetch indicators with rec(900,'i1') and/or rec(900,'i2') as it should be
 (fixed bug which prevented this from working for some values like 0)


Revision 1047 - Directory Listing
Modified Mon Nov 19 15:56:05 2007 UTC (16 years, 6 months ago) by dpavlin
 r1631@llin:  dpavlin | 2007-11-19 16:56:04 +0100
 marc_template now respect marc_indicators, code cleanup


Revision 1044 - Directory Listing
Modified Mon Nov 12 14:18:49 2007 UTC (16 years, 6 months ago) by dpavlin
fix variable scoping


Revision 1040 - Directory Listing
Modified Mon Nov 12 12:18:55 2007 UTC (16 years, 6 months ago) by dpavlin
 r1618@llin:  dpavlin | 2007-11-12 13:18:54 +0100
 cleanup and fixes


Revision 1039 - Directory Listing
Modified Mon Nov 12 12:13:57 2007 UTC (16 years, 6 months ago) by dpavlin
 r1616@llin:  dpavlin | 2007-11-12 13:13:55 +0100
 mark fields created with marc_template to ignore magic on them
 (which shuffle it around and corrupt record)


Revision 1038 - Directory Listing
Modified Mon Nov 12 11:57:00 2007 UTC (16 years, 6 months ago) by dpavlin
 r1614@llin:  dpavlin | 2007-11-12 12:56:56 +0100
 demostrate problems with marc records returned


Revision 1037 - Directory Listing
Modified Mon Nov 12 11:17:19 2007 UTC (16 years, 6 months ago) by dpavlin
 r1612@llin:  dpavlin | 2007-11-12 12:17:17 +0100
 fixed debug levels: now tests run with -d will display
 own diag messages, while -d -d will be 1st level of
 debug for WebPAC, and so on...


Revision 1036 - Directory Listing
Modified Mon Nov 12 11:10:48 2007 UTC (16 years, 6 months ago) by dpavlin
 r1610@llin:  dpavlin | 2007-11-12 12:10:45 +0100
 split MARC handling routines into WebPAC::Normalize::MARC [2.31]


Revision 1035 - Directory Listing
Modified Mon Nov 12 10:16:16 2007 UTC (16 years, 6 months ago) by dpavlin
 r1608@llin:  dpavlin | 2007-11-12 11:16:13 +0100
 fix debug output


Revision 1034 - Directory Listing
Modified Sun Nov 11 20:19:30 2007 UTC (16 years, 6 months ago) by dpavlin
 r1606@llin:  dpavlin | 2007-11-11 21:19:34 +0100
 removed two stub modules never really implemented


Revision 1031 - Directory Listing
Modified Sun Nov 11 19:58:57 2007 UTC (16 years, 6 months ago) by dpavlin
 r1600@llin:  dpavlin | 2007-11-11 20:59:01 +0100
 added pre and post formatting, which was half of the reason for whole thing :-)


Revision 1029 - Directory Listing
Modified Sun Nov 11 17:11:33 2007 UTC (16 years, 6 months ago) by dpavlin
more tweaks for subfield re-ordering


Revision 1028 - Directory Listing
Modified Sun Nov 11 14:22:57 2007 UTC (16 years, 6 months ago) by dpavlin
 r1594@llin:  dpavlin | 2007-11-11 15:22:56 +0100
 hush debug chatter


Revision 1026 - Directory Listing
Modified Sun Nov 11 13:47:43 2007 UTC (16 years, 6 months ago) by dpavlin
 r1590@llin:  dpavlin | 2007-11-11 14:47:42 +0100
 finally marc_template( ... isis_template => [] ) works


Revision 1025 - Directory Listing
Modified Sun Nov 11 11:54:48 2007 UTC (16 years, 6 months ago) by dpavlin
 r1588@llin:  dpavlin | 2007-11-11 12:54:45 +0100
 more changes towards isis_template


Revision 1024 - Directory Listing
Modified Sat Nov 10 11:37:47 2007 UTC (16 years, 6 months ago) by dpavlin
 r1586@llin:  dpavlin | 2007-11-10 12:37:44 +0100
 more re-factoring to support isis_template


Revision 1023 - Directory Listing
Modified Sat Nov 10 11:13:58 2007 UTC (16 years, 6 months ago) by dpavlin
 r1584@llin:  dpavlin | 2007-11-10 12:13:55 +0100
 extract template parsing into _parse_template as a step towards isis_template


Revision 1021 - Directory Listing
Modified Sat Nov 10 11:11:16 2007 UTC (16 years, 6 months ago) by dpavlin
 r1579@llin:  dpavlin | 2007-11-10 11:59:27 +0100
 Begin extraction of MARC functionality from WebPAC::Normalize to
 WebPAC::Normalize::MARC


Revision 1019 - Directory Listing
Modified Sat Nov 10 00:05:36 2007 UTC (16 years, 6 months ago) by dpavlin
support single fields without delimiters in marc_template


Revision 1018 - Directory Listing
Modified Fri Nov 9 23:46:44 2007 UTC (16 years, 6 months ago) by dpavlin
consider only one-char subfields (to correctly skip subfields key which
contains order of subfields), die on subfields which doesn't have
rename mapping defined


Revision 1017 - Directory Listing
Modified Fri Nov 9 23:41:39 2007 UTC (16 years, 6 months ago) by dpavlin
better error output, skip non-existent fields in marc_template


Revision 1016 - Directory Listing
Modified Thu Nov 8 17:29:03 2007 UTC (16 years, 6 months ago) by dpavlin
 r1573@llin:  dpavlin | 2007-11-08 18:29:03 +0100
 fix marc_template to produce correctly formatted MARC


Revision 1015 - Directory Listing
Modified Thu Nov 8 17:19:50 2007 UTC (16 years, 6 months ago) by dpavlin
 r1571@llin:  dpavlin | 2007-11-08 18:19:49 +0100
 added frec_eq and frec_ne to work-around our parser which removes spaces


Revision 1013 - Directory Listing
Modified Wed Nov 7 11:54:34 2007 UTC (16 years, 6 months ago) by dpavlin
 r1567@llin:  dpavlin | 2007-11-07 12:54:20 +0100
 huge dump of marc_template, a new way to specify mappings
 which is basically WebPAC v1 in a sub :-)


Revision 1012 - Directory Listing
Modified Wed Nov 7 09:19:29 2007 UTC (16 years, 6 months ago) by dpavlin
document frec


Revision 1011 - Directory Listing
Modified Tue Nov 6 20:26:31 2007 UTC (16 years, 6 months ago) by dpavlin
added no warnings 'redefine'; so we can define subs in normalization perl
without annoying warnings.


Revision 1006 - Directory Listing
Modified Sun Nov 4 19:10:21 2007 UTC (16 years, 6 months ago) by dpavlin
 r1553@llin:  dpavlin | 2007-11-04 20:10:22 +0100
 rest of parser depends on prune of whitespace :-\


Revision 1004 - Directory Listing
Modified Sun Nov 4 19:02:54 2007 UTC (16 years, 6 months ago) by dpavlin
 r1548@llin:  dpavlin | 2007-11-04 20:02:54 +0100
 ignore ISBNs with numbers (empty or invalid)


Revision 998 - Directory Listing
Modified Sun Nov 4 16:47:03 2007 UTC (16 years, 6 months ago) by dpavlin
 r1536@llin:  dpavlin | 2007-11-04 17:47:03 +0100
 better handle invalid XML files


Revision 997 - Directory Listing
Modified Sun Nov 4 16:20:55 2007 UTC (16 years, 6 months ago) by dpavlin
 r1534@llin:  dpavlin | 2007-11-04 17:20:48 +0100
 sync changes in WebPAC with latest model in Webpacus


Revision 993 - Directory Listing
Modified Sun Nov 4 14:43:47 2007 UTC (16 years, 6 months ago) by dpavlin
 r1525@llin:  dpavlin | 2007-11-04 15:34:13 +0100
 added consume_outputs which returns all output types this plugin supports.
 This will eventually come in handy for main loop to decide which outputs to
 call...


Revision 992 - Directory Listing
Modified Sun Nov 4 13:47:02 2007 UTC (16 years, 6 months ago) by dpavlin
 r1523@llin:  dpavlin | 2007-11-04 14:39:39 +0100
 hush all kind of debugging output


Revision 990 - Directory Listing
Modified Sun Nov 4 13:27:12 2007 UTC (16 years, 6 months ago) by dpavlin
 r1519@llin:  dpavlin | 2007-11-04 14:27:11 +0100
 get_ds did't really fit in normalize since we have to update store also


Revision 989 - Directory Listing
Modified Sun Nov 4 13:26:06 2007 UTC (16 years, 6 months ago) by dpavlin
 r1517@llin:  dpavlin | 2007-11-04 14:26:05 +0100
 New rewamp of WebPAC::Input::XML with added mungle rules (perl code really)
 to modify xml hash returned from XML::Simple


Revision 987 - Directory Listing
Modified Sun Nov 4 11:58:11 2007 UTC (16 years, 6 months ago) by dpavlin
 r1513@llin:  dpavlin | 2007-11-04 12:58:09 +0100
 dump field usage counts in debug log


Revision 986 - Directory Listing
Modified Sun Nov 4 11:55:45 2007 UTC (16 years, 6 months ago) by dpavlin
 r1511@llin:  dpavlin | 2007-11-04 12:55:43 +0100
 remove double debug output


Revision 985 - Directory Listing
Modified Sun Nov 4 11:48:00 2007 UTC (16 years, 6 months ago) by dpavlin
 r1509@llin:  dpavlin | 2007-11-04 12:47:56 +0100
 Warn that there are no field names for search


Revision 984 - Directory Listing
Modified Sun Nov 4 11:17:21 2007 UTC (16 years, 6 months ago) by dpavlin
 r1507@llin:  dpavlin | 2007-11-04 12:17:19 +0100
 sort XML files by filename before processing it (to preserve order if
 filenames are sortable and they usually are)


Revision 983 - Directory Listing
Modified Sun Nov 4 11:12:38 2007 UTC (16 years, 6 months ago) by dpavlin
 r1505@llin:  dpavlin | 2007-11-04 12:12:20 +0100
 renamed _set_rec to _set_ds (because it's a data_structure actually)
 and added symetric public get_ds to get whole data_structure as
 hash to manually traverse in normalization


Revision 982 - Directory Listing
Modified Sat Nov 3 13:35:03 2007 UTC (16 years, 6 months ago) by dpavlin
remove debug


Revision 981 - Directory Listing
Modified Sat Nov 3 13:33:21 2007 UTC (16 years, 6 months ago) by dpavlin
 r1500@llin:  dpavlin | 2007-11-03 14:32:06 +0100
 tweak


Revision 980 - Directory Listing
Modified Sat Nov 3 13:33:19 2007 UTC (16 years, 6 months ago) by dpavlin
 r1499@llin:  dpavlin | 2007-11-03 14:31:44 +0100
 properly export isbn_10() and isbn_13()


Revision 979 - Directory Listing
Modified Sat Nov 3 12:37:43 2007 UTC (16 years, 6 months ago) by dpavlin
added frec which returns first occurence of record
as scalar (for eq/ne comparison and things like that)


Revision 976 - Directory Listing
Modified Sat Nov 3 12:30:43 2007 UTC (16 years, 6 months ago) by dpavlin
if --only filter is used, we will parse just normalization files for this database.


Revision 973 - Directory Listing
Modified Fri Nov 2 14:59:12 2007 UTC (16 years, 6 months ago) by dpavlin
 r1489@llin:  dpavlin | 2007-11-02 15:59:07 +0100
 load WebPAC::Normalize::ISBN at right place


Revision 970 - Directory Listing
Modified Fri Nov 2 14:29:11 2007 UTC (16 years, 6 months ago) by dpavlin
 r1483@llin:  dpavlin | 2007-11-02 15:29:09 +0100
 return parsed XML hash


Revision 968 - Directory Listing
Modified Fri Nov 2 13:59:10 2007 UTC (16 years, 6 months ago) by dpavlin
 r1479@llin:  dpavlin | 2007-11-02 14:59:05 +0100
 begin work on WebPAC::Input::XML


Revision 967 - Directory Listing
Modified Fri Nov 2 13:11:35 2007 UTC (16 years, 6 months ago) by dpavlin
 r1475@llin:  dpavlin | 2007-11-02 14:11:19 +0100
 fix ./run.pl --config conf/foobar.yml to actually work!


Revision 960 - Directory Listing
Modified Fri Nov 2 11:32:02 2007 UTC (16 years, 6 months ago) by dpavlin
 r1462@llin:  dpavlin | 2007-11-02 12:31:57 +0100
 ISBN support in normalization using isbn_10 and isbn_13


Revision 951 - Directory Listing
Modified Thu Nov 1 00:16:52 2007 UTC (16 years, 7 months ago) by dpavlin
 r1445@llin:  dpavlin | 2007-11-01 01:15:09 +0100
 correctly create or update fileds in Webpacus


Revision 949 - Directory Listing
Modified Thu Nov 1 00:16:48 2007 UTC (16 years, 7 months ago) by dpavlin
 r1433@llin:  dpavlin | 2007-10-31 22:48:02 +0100
 HUGE swiping changes to implement new testing architecture
 based on all new WebPAC::Test module which makes
 test writing a joy


Revision 948 - Directory Listing
Modified Thu Nov 1 00:16:46 2007 UTC (16 years, 7 months ago) by dpavlin
 r1432@llin:  dpavlin | 2007-10-31 22:43:23 +0100
 shut up Log::Log4perl complaints where there is no_log param


Revision 944 - Directory Listing
Modified Wed Oct 31 18:07:33 2007 UTC (16 years, 7 months ago) by dpavlin
cleanup versions


Revision 942 - Directory Listing
Modified Wed Oct 31 14:11:44 2007 UTC (16 years, 7 months ago) by dpavlin
 r1424@llin:  dpavlin | 2007-10-31 15:11:43 +0100
 First try to produce abs_path to store (so that we can call WebPAC::Store
 from other code).
 It doesn't work, so it's hard-coded for now!


Revision 939 - Directory Listing
Modified Wed Oct 31 12:29:57 2007 UTC (16 years, 7 months ago) by dpavlin
 r1419@llin:  dpavlin | 2007-10-31 13:29:55 +0100
 - added input to indexed data
 - clean index on every invocation (should be incremental in future)


Revision 938 - Directory Listing
Modified Wed Oct 31 12:17:11 2007 UTC (16 years, 7 months ago) by dpavlin
 r1416@llin:  dpavlin | 2007-10-31 13:17:08 +0100
 minor tweaks


Revision 936 - Directory Listing
Modified Wed Oct 31 12:14:03 2007 UTC (16 years, 7 months ago) by dpavlin
 r1413@llin:  dpavlin | 2007-10-31 13:13:58 +0100
 Add input name to all output filters


Revision 933 - Directory Listing
Modified Wed Oct 31 11:26:12 2007 UTC (16 years, 7 months ago) by dpavlin
 r1407@llin:  dpavlin | 2007-10-31 12:26:06 +0100
 create Webpacus::Webpac glue to transfer configuration


Revision 932 - Directory Listing
Modified Wed Oct 31 11:26:10 2007 UTC (16 years, 7 months ago) by dpavlin
 r1399@llin:  dpavlin | 2007-10-31 11:19:39 +0100
 Webpacus output to transfer searchable fields


Revision 925 - Directory Listing
Modified Wed Oct 31 00:38:38 2007 UTC (16 years, 7 months ago) by dpavlin
 r1397@llin:  dpavlin | 2007-10-31 01:38:40 +0100
 never ever call dump unless working with debug
 (20% improvement in speed of record processing :-)


Revision 924 - Directory Listing
Modified Wed Oct 31 00:26:45 2007 UTC (16 years, 7 months ago) by dpavlin
 r1394@llin:  dpavlin | 2007-10-31 01:26:46 +0100
 add new (exported by default) function force_array
 used all over the place


Revision 923 - Directory Listing
Modified Wed Oct 31 00:26:43 2007 UTC (16 years, 7 months ago) by dpavlin
 r1393@llin:  dpavlin | 2007-10-31 00:52:52 +0100
 added sorted to WebPAC::Normalize to define values which should go
 into sorted lists


Revision 922 - Directory Listing
Modified Tue Oct 30 23:36:49 2007 UTC (16 years, 7 months ago) by dpavlin
 r1391@llin:  dpavlin | 2007-10-31 00:36:51 +0100
 report number of records indexed


Revision 920 - Directory Listing
Modified Tue Oct 30 22:46:51 2007 UTC (16 years, 7 months ago) by dpavlin
 r1386@llin:  dpavlin | 2007-10-30 23:46:53 +0100
 new WebPAC::Output::Sorted to create huge sorted lists using
 Sort::External (to keep memory under controll)


Revision 919 - Directory Listing
Modified Tue Oct 30 22:07:11 2007 UTC (16 years, 7 months ago) by dpavlin
 r1383@llin:  dpavlin | 2007-10-30 23:07:09 +0100
 added clean to start with empty index


Revision 917 - Directory Listing
Modified Tue Oct 30 21:57:36 2007 UTC (16 years, 7 months ago) by dpavlin
 r1380@llin:  dpavlin | 2007-10-30 22:57:36 +0100
 pod tweaks


Revision 915 - Directory Listing
Modified Tue Oct 30 20:27:20 2007 UTC (16 years, 7 months ago) by dpavlin
 r1376@llin:  dpavlin | 2007-10-30 21:27:19 +0100
 Added back tag for backwards compatiblity


Revision 914 - Directory Listing
Modified Tue Oct 30 20:11:04 2007 UTC (16 years, 7 months ago) by dpavlin
 r1373@llin:  dpavlin | 2007-10-30 21:11:01 +0100
 use KinoSearch::Simple and convert to new Output API


Revision 913 - Directory Listing
Modified Tue Oct 30 20:11:02 2007 UTC (16 years, 7 months ago) by dpavlin
 r1372@llin:  dpavlin | 2007-10-30 20:26:52 +0100
 first real method in common WebPAC::Output as a move towards pluggable
 outputs


Revision 912 - Directory Listing
Modified Tue Oct 30 17:40:13 2007 UTC (16 years, 7 months ago) by dpavlin
 r1370@llin:  dpavlin | 2007-10-30 18:40:02 +0100
 rename tag to search_display which makes it more clean what does it do


Revision 910 - Directory Listing
Modified Tue Oct 30 01:51:20 2007 UTC (16 years, 7 months ago) by dpavlin
 r1364@llin:  dpavlin | 2007-10-30 02:51:21 +0100
 generelize idea a bit, and sort every subfield which has more than
 one char (and is thus "special" or wrong :-) in front.


Revision 909 - Directory Listing
Modified Tue Oct 30 01:46:41 2007 UTC (16 years, 7 months ago) by dpavlin
 r1362@llin:  dpavlin | 2007-10-30 02:46:05 +0100
 Show indicators (available when using WebPAC::Input::MARC) as
 first two subfileds in statistics insted in alphabetical order


Revision 908 - Directory Listing
Modified Mon Oct 29 23:20:13 2007 UTC (16 years, 7 months ago) by dpavlin
leader from WebPAC::Input::MARC is now available as rec('leader')

for mondifications within leader, use substr(rec('leader'),from,to)
instead of proposed leader(field,nr) syntax


Revision 907 - Directory Listing
Modified Mon Oct 29 22:58:18 2007 UTC (16 years, 7 months ago) by dpavlin
fix


Revision 904 - Directory Listing
Modified Fri Oct 12 12:07:35 2007 UTC (16 years, 7 months ago) by dpavlin
 r1355@llin:  dpavlin | 2007-10-12 14:07:29 +0200
 fix empty tags


Revision 902 - Directory Listing
Modified Wed Oct 10 21:00:27 2007 UTC (16 years, 7 months ago) by dpavlin
more tags to join


Revision 901 - Directory Listing
Modified Wed Oct 10 20:05:45 2007 UTC (16 years, 7 months ago) by dpavlin
added splitting of tags into subfields (CR for now)
and ability to join tags into single line (AB)


Revision 900 - Directory Listing
Modified Wed Oct 10 19:46:58 2007 UTC (16 years, 7 months ago) by dpavlin
 r1348@llin:  dpavlin | 2007-10-10 21:46:55 +0200
 added URL to some documentation


Revision 899 - Directory Listing
Modified Wed Oct 10 19:01:57 2007 UTC (16 years, 7 months ago) by dpavlin
 r1345@llin:  dpavlin | 2007-10-10 21:01:02 +0200
 and working parser


Revision 898 - Directory Listing
Modified Wed Oct 10 19:01:55 2007 UTC (16 years, 7 months ago) by dpavlin
 r1344@llin:  dpavlin | 2007-10-10 20:34:20 +0200
 skeleton of support for ISI export format, parse headers


Revision 894 - Directory Listing
Modified Sun Oct 7 22:51:57 2007 UTC (16 years, 7 months ago) by dpavlin
 r1334@llin:  dpavlin | 2007-10-08 00:51:58 +0200
 typo


Revision 892 - Directory Listing
Modified Sun Oct 7 22:51:54 2007 UTC (16 years, 7 months ago) by dpavlin
 r1332@llin:  dpavlin | 2007-10-08 00:49:21 +0200
 few more tweaks on manual, nowhere useful yet, I'm afraid :-(


Revision 889 - Directory Listing
Modified Thu Sep 6 19:12:15 2007 UTC (16 years, 8 months ago) by dpavlin
make missing value in marc_fixed confess and fixed warning


Revision 888 - Directory Listing
Modified Mon Sep 3 15:28:33 2007 UTC (16 years, 8 months ago) by dpavlin
 r1325@llin:  dpavlin | 2007-09-03 17:28:32 +0200
 fix warning


Revision 887 - Directory Listing
Modified Mon Sep 3 15:26:46 2007 UTC (16 years, 8 months ago) by dpavlin
 r1322@llin:  dpavlin | 2007-09-03 16:44:01 +0200
 - replace Data::Dumper usage with Data::Dump
 - rewrite WebPAC::Store to use Class::Accessor


Revision 883 - Directory Listing
Modified Thu Aug 23 20:56:59 2007 UTC (16 years, 9 months ago) by dpavlin
 r1315@llin:  dpavlin | 2007-08-23 22:52:10 +0200
 create on-disk JSON file


Revision 881 - Directory Listing
Modified Thu Aug 23 20:28:09 2007 UTC (16 years, 9 months ago) by dpavlin
 r1311@llin:  dpavlin | 2007-08-23 22:16:00 +0200
 skeleton for WebPAC::Output::JSON


Revision 875 - Directory Listing
Modified Tue Jun 26 17:46:49 2007 UTC (16 years, 11 months ago) by dpavlin
 r1303@llin:  dpavlin | 2007-06-26 19:46:53 +0200
 added dump for missing_subfield


Revision 873 - Directory Listing
Modified Fri Jun 22 00:03:46 2007 UTC (16 years, 11 months ago) by dpavlin
 r1298@llin:  dpavlin | 2007-06-22 02:03:23 +0200
 input_config can be given to new or open now


Revision 871 - Directory Listing
Modified Thu Jun 21 23:54:42 2007 UTC (16 years, 11 months ago) by dpavlin
 r1294@llin:  dpavlin | 2007-06-22 01:54:51 +0200
 extract common _to_hash into WebPAC::Input::Helper


Revision 870 - Directory Listing
Modified Thu Jun 21 23:54:41 2007 UTC (16 years, 11 months ago) by dpavlin
 r1293@llin:  dpavlin | 2007-06-22 01:46:20 +0200
 finish dbf input


Revision 869 - Directory Listing
Modified Thu Jun 21 21:26:19 2007 UTC (16 years, 11 months ago) by dpavlin
 r1290@llin:  dpavlin | 2007-06-21 23:26:25 +0200
 experimental (still unfinished) dbf input


Revision 868 - Directory Listing
Modified Thu Jun 21 21:26:17 2007 UTC (16 years, 11 months ago) by dpavlin
 r1289@llin:  dpavlin | 2007-06-21 23:26:10 +0200
 * transfer input configuration hash as input_config to input module


Revision 866 - Directory Listing
Modified Thu Jun 21 12:53:41 2007 UTC (16 years, 11 months ago) by dpavlin
 r1285@llin:  dpavlin | 2007-06-21 14:53:43 +0200
 make indexers optional [2.30]


Revision 864 - Directory Listing
Modified Sun May 27 22:24:30 2007 UTC (17 years ago) by dpavlin
 r1280@llin:  dpavlin | 2007-05-28 00:24:21 +0200
 various fixes to make save_delimiters_tamplates produce output file


Revision 861 - Directory Listing
Modified Sun May 27 19:25:57 2007 UTC (17 years ago) by dpavlin
fix must_exist name


Revision 860 - Directory Listing
Modified Sun May 27 19:10:43 2007 UTC (17 years ago) by dpavlin
call low-level dump_ascii as it should


Revision 858 - Directory Listing
Modified Sun May 27 17:09:47 2007 UTC (17 years ago) by dpavlin
test validate with different files and hopefully correct problems about it


Revision 857 - Directory Listing
Modified Sun May 27 16:49:15 2007 UTC (17 years ago) by dpavlin
implemented read_validate_file and read_validate_delimiters file, so you can
now change paths and data for each input (which run.pl does if you use
$database and/or $input variable substitution)


Revision 856 - Directory Listing
Modified Sun May 27 16:00:26 2007 UTC (17 years ago) by dpavlin
added fill_in to create dynamic values and some tests


Revision 855 - Directory Listing
Modified Sun May 27 14:44:58 2007 UTC (17 years ago) by dpavlin
 r1267@llin:  dpavlin | 2007-05-27 16:44:54 +0200
 sort fields in stats


Revision 853 - Directory Listing
Modified Sun May 27 14:09:30 2007 UTC (17 years ago) by dpavlin
 r1263@llin:  dpavlin | 2007-05-27 14:36:00 +0200
 one less dump in debug mode


Revision 852 - Directory Listing
Modified Sun May 27 11:27:12 2007 UTC (17 years ago) by dpavlin
 r1261@llin:  dpavlin | 2007-05-27 13:27:55 +0200
 profiling: add sub { dump( ) } for $log->debug


Revision 851 - Directory Listing
Modified Sun May 27 11:14:40 2007 UTC (17 years ago) by dpavlin
 r1258@llin:  dpavlin | 2007-05-27 13:14:58 +0200
 Changed delimiter_templates arguments to be more intuitive,
 disable MARC generation when running delimiters validation
 (this is just disk overhead)


Revision 849 - Directory Listing
Modified Sun May 27 10:50:37 2007 UTC (17 years ago) by dpavlin
 r1253@llin:  dpavlin | 2007-05-27 12:49:54 +0200
 added accumulated delimiters templates to hold all templates which are
 found in this run (and thus saved to --validate-delimiters file) while
 generating correct stats for each input


Revision 844 - Directory Listing
Modified Sat May 26 10:40:01 2007 UTC (17 years ago) by dpavlin
work with fields which have number 0 (as opposed to 000) which has been
noticed in the wild (invalid, but --stats shouldn't really die)


Revision 843 - Directory Listing
Modified Fri May 25 19:49:39 2007 UTC (17 years ago) by dpavlin
different wording: potentially invalid combination


Revision 841 - Directory Listing
Modified Fri May 25 19:47:43 2007 UTC (17 years ago) by dpavlin
hush warning


Revision 840 - Directory Listing
Modified Thu May 24 14:42:40 2007 UTC (17 years ago) by dpavlin
 r1237@llin:  dpavlin | 2007-05-24 16:42:47 +0200
 if validate file exists, it will create file with .new extension


Revision 839 - Directory Listing
Modified Thu May 24 14:42:38 2007 UTC (17 years ago) by dpavlin
 r1236@llin:  dpavlin | 2007-05-24 16:38:02 +0200
 require path or delimiters_path


Revision 838 - Directory Listing
Modified Thu May 24 14:42:35 2007 UTC (17 years ago) by dpavlin
 r1235@llin:  dpavlin | 2007-05-24 16:34:31 +0200
 and make it really work :-)


Revision 837 - Directory Listing
Modified Thu May 24 12:44:45 2007 UTC (17 years ago) by dpavlin
 r1232@llin:  dpavlin | 2007-05-24 14:44:53 +0200
 added storing and retriving of delimiters templates to file and some basic tests


Revision 836 - Directory Listing
Modified Thu May 24 12:44:43 2007 UTC (17 years ago) by dpavlin
 r1231@llin:  dpavlin | 2007-05-24 13:00:25 +0200
 tidy machine readable output


Revision 835 - Directory Listing
Modified Thu May 24 10:53:50 2007 UTC (17 years ago) by dpavlin
 r1228@llin:  dpavlin | 2007-05-24 12:53:57 +0200
 report invalid delimiter combinations


Revision 834 - Directory Listing
Modified Thu May 24 10:53:48 2007 UTC (17 years ago) by dpavlin
 r1227@llin:  dpavlin | 2007-05-24 10:26:01 +0200
 generate humanly readable report or machine readable


Revision 832 - Directory Listing
Modified Wed May 23 20:03:16 2007 UTC (17 years ago) by dpavlin
 r1221@llin:  dpavlin | 2007-05-20 22:43:38 +0200
 added delimiters_templates report


Revision 831 - Directory Listing
Modified Wed May 23 20:03:14 2007 UTC (17 years ago) by dpavlin
 r1220@llin:  dpavlin | 2007-05-20 19:29:36 +0200
 can be called for fields without subfields now...


Revision 830 - Directory Listing
Modified Wed May 23 20:03:12 2007 UTC (17 years ago) by dpavlin
 r1219@llin:  dpavlin | 2007-05-20 19:28:41 +0200
 cleanup debugging output


Revision 828 - Directory Listing
Modified Sun May 20 16:19:17 2007 UTC (17 years ago) by dpavlin
 r1213@llin:  dpavlin | 2007-05-20 18:16:02 +0200
 and fix to actually count right templates :-)


Revision 827 - Directory Listing
Modified Sun May 20 16:19:16 2007 UTC (17 years ago) by dpavlin
 r1212@llin:  dpavlin | 2007-05-20 17:39:01 +0200
 first try at implementation of delimiters validation


Revision 826 - Directory Listing
Modified Sun May 20 16:19:13 2007 UTC (17 years ago) by dpavlin
 r1211@llin:  dpavlin | 2007-05-20 14:48:37 +0200
 Removed debugging output


Revision 825 - Directory Listing
Modified Fri May 18 21:41:19 2007 UTC (17 years ago) by dpavlin
request Biblio::Isis 0.24 to ignore empty subfields


Revision 823 - Directory Listing
Modified Wed Apr 11 12:22:37 2007 UTC (17 years, 1 month ago) by dpavlin
 r1203@llin:  dpavlin | 2007-04-11 14:22:28 +0200
 spacial handling for empty subfields [0.18]


Revision 819 - Directory Listing
Modified Wed Apr 11 10:09:34 2007 UTC (17 years, 1 month ago) by dpavlin
 r1198@llin:  dpavlin | 2007-04-11 12:09:29 +0200
 prefix, suffix and surround now work correcty with empty strings and zeros


Revision 818 - Directory Listing
Modified Thu Apr 5 21:53:52 2007 UTC (17 years, 1 month ago) by dpavlin
fix warning


Revision 817 - Directory Listing
Modified Thu Apr 5 21:50:14 2007 UTC (17 years, 1 month ago) by dpavlin
use debug level to, well, display debug


Revision 815 - Directory Listing
Modified Mon Apr 2 17:20:01 2007 UTC (17 years, 1 month ago) by dpavlin
 r1192@llin:  dpavlin | 2007-04-02 19:20:01 +0200
 added support for fix-length fields using marc_fixed [2.29]


Revision 814 - Directory Listing
Modified Sun Apr 1 21:47:48 2007 UTC (17 years, 2 months ago) by dpavlin
 r1185@llin:  dpavlin | 2007-04-01 23:47:05 +0200
  r1183@llin:  dpavlin | 2007-04-01 23:47:01 +0200
  propagate changes through documentation and actuall running code :-)
 


Revision 813 - Directory Listing
Modified Sun Apr 1 21:47:47 2007 UTC (17 years, 2 months ago) by dpavlin
 r1184@llin:  dpavlin | 2007-04-01 23:47:04 +0200
  r1182@llin:  dpavlin | 2007-04-01 23:44:03 +0200
  marc_duplicate now correctly duplicates leader data, new _get_marc_leader to
  return leader corresponding to last _get_marc_fields call, added marc_count
  which returns number of created MARC records
 


Revision 812 - Directory Listing
Modified Sun Apr 1 21:47:42 2007 UTC (17 years, 2 months ago) by dpavlin
 r1181@llin:  dpavlin | 2007-04-01 22:47:56 +0200
  r1180@llin:  dpavlin | 2007-04-01 22:47:43 +0200
  renamed $leader to $marc_leader to be consistent with other vars
 


Revision 810 - Directory Listing
Modified Sun Apr 1 21:47:38 2007 UTC (17 years, 2 months ago) by dpavlin
 r1178@llin:  dpavlin | 2007-04-01 22:39:11 +0200
 cleanup debug output


Revision 809 - Directory Listing
Modified Sun Apr 1 21:47:36 2007 UTC (17 years, 2 months ago) by dpavlin
 r1176@llin:  dpavlin | 2007-04-01 16:20:40 +0200
 add _database:database_name so we can search for it using full-text as opposed to atribute
 search (this might handy when emulating number of results for each database
 from single merged index)


Revision 800 - Directory Listing
Modified Sun Feb 4 23:10:18 2007 UTC (17 years, 3 months ago) by dpavlin
decorate output from regexp modify with filename and line


Revision 799 - Directory Listing
Modified Sun Feb 4 15:09:01 2007 UTC (17 years, 3 months ago) by dpavlin
minor tweaks to test modify_file


Revision 798 - Directory Listing
Modified Sun Feb 4 13:31:38 2007 UTC (17 years, 3 months ago) by dpavlin
store filter (no tests for it, though!)


Revision 797 - Directory Listing
Modified Sun Feb 4 13:28:30 2007 UTC (17 years, 3 months ago) by dpavlin
finish tweaking mock framework, test and fix problem with slashes in modify_record


Revision 796 - Directory Listing
Modified Sun Feb 4 12:42:43 2007 UTC (17 years, 3 months ago) by dpavlin
a try at mocking of inputs in WebPAC::Input::Test


Revision 793 - Directory Listing
Modified Sun Feb 4 12:19:51 2007 UTC (17 years, 3 months ago) by dpavlin
small tweaks on seek


Revision 791 - Directory Listing
Modified Tue Jan 30 18:21:17 2007 UTC (17 years, 4 months ago) by dpavlin
added count


Revision 788 - Directory Listing
Modified Sun Dec 10 12:56:59 2006 UTC (17 years, 5 months ago) by dpavlin
better logging


Revision 786 - Directory Listing
Modified Sun Dec 10 12:45:11 2006 UTC (17 years, 5 months ago) by dpavlin
added support for marc_remove('*') to clean whole
marc record after marc_dumplicate


Revision 785 - Directory Listing
Modified Wed Dec 6 23:44:36 2006 UTC (17 years, 5 months ago) by dpavlin
added get and set to create in-memory hash


Revision 784 - Directory Listing
Modified Wed Dec 6 23:43:45 2006 UTC (17 years, 5 months ago) by dpavlin
added regex: to modify_records


Revision 782 - Directory Listing
Modified Sun Nov 5 16:51:49 2006 UTC (17 years, 6 months ago) by dpavlin
 r1144@llin:  dpavlin | 2006-11-05 17:51:38 +0100
 report error message on errors


Revision 779 - Directory Listing
Modified Sun Nov 5 14:52:04 2006 UTC (17 years, 6 months ago) by dpavlin
 r1137@llin:  dpavlin | 2006-11-05 15:51:19 +0100
 no need to have MFN twice in record (it is also added by _to_hash)


Revision 778 - Directory Listing
Modified Sun Nov 5 14:51:59 2006 UTC (17 years, 6 months ago) by dpavlin
 r1136@llin:  dpavlin | 2006-11-05 15:49:50 +0100
 debug shouldn't auto-vivify all fields!


Revision 777 - Directory Listing
Modified Sun Nov 5 14:48:12 2006 UTC (17 years, 6 months ago) by dpavlin
 r1133@llin:  dpavlin | 2006-11-05 15:48:00 +0100
 first cut at getting Project Gutenberg's RDF as input format for WebPAC


Revision 774 - Directory Listing
Modified Fri Nov 3 20:56:21 2006 UTC (17 years, 6 months ago) by dpavlin
another swiping API change: input->dump is gone, replaced
with input->dump_ascii which is more understandable.
If you want to override default behaviour
(which is to use Data::Dump's dump in input->fetch_rec)
define dump_ascii in low-level WebPAC::Input:: API


Revision 772 - Directory Listing
Modified Fri Nov 3 20:40:38 2006 UTC (17 years, 6 months ago) by dpavlin
 r1124@llin:  dpavlin | 2006-11-03 21:39:00 +0100
 use MARC::Fast 0.05 to_ascii to implement dump_rec


Revision 771 - Directory Listing
Modified Fri Nov 3 20:40:33 2006 UTC (17 years, 6 months ago) by dpavlin
 r1123@llin:  dpavlin | 2006-11-03 21:38:14 +0100
 implement fallback dump if low-level API isn't exposing dump_rec [0.15]


Revision 770 - Directory Listing
Modified Fri Nov 3 20:21:14 2006 UTC (17 years, 6 months ago) by dpavlin
 r1120@llin:  dpavlin | 2006-11-03 21:22:05 +0100
 pod fix


Revision 768 - Directory Listing
Modified Fri Nov 3 19:41:28 2006 UTC (17 years, 6 months ago) by dpavlin
 r1117@llin:  dpavlin | 2006-11-03 20:42:24 +0100
 cleanup API a bit. validate_errors in now validate_rec [0.10]


Revision 766 - Directory Listing
Modified Tue Oct 31 13:19:47 2006 UTC (17 years, 7 months ago) by dpavlin
 r1113@llin:  dpavlin | 2006-10-31 14:17:02 +0100
 cleanup normalization error message for lookups and modify tests so they don't fail anymore


Revision 764 - Directory Listing
Modified Wed Oct 25 20:53:48 2006 UTC (17 years, 7 months ago) by dpavlin
report time needed to store lookup to disk


Revision 763 - Directory Listing
Modified Wed Oct 25 20:53:14 2006 UTC (17 years, 7 months ago) by dpavlin
refresh progress bar at least every 2 seconds (helps on huge databases where
percentages increase too slowly)


Revision 761 - Directory Listing
Modified Wed Oct 25 17:10:08 2006 UTC (17 years, 7 months ago) by dpavlin
implemented load_row and save_row closures to serialize
input databases (using WebPAC::Store probably).
This will allow lookups to share on-disk storage with
low_mem option of WebPAC::Input, which is now gone
(under pressure of 600000+ record database which we
are now testing on)


Revision 760 - Directory Listing
Modified Wed Oct 25 15:56:44 2006 UTC (17 years, 7 months ago) by dpavlin
Turn on option low_mem (which need rewrite to use db/row) if there
are more than 10000 rows (hardcoded, but should go away).

This prevents webpac from running out of memory with databases
of about 300000 records on 4Gb of (virtual) memory.


Revision 757 - Directory Listing
Modified Tue Oct 10 10:57:59 2006 UTC (17 years, 7 months ago) by dpavlin
fix dump (ugly, needs re-visiting)


Revision 755 - Directory Listing
Modified Sun Oct 8 20:28:17 2006 UTC (17 years, 7 months ago) by dpavlin
 r1097@llin:  dpavlin | 2006-10-08 22:24:54 +0200
 replaced generate_marc with universal have_rules [0.08]


Revision 753 - Directory Listing
Modified Sun Oct 8 18:43:58 2006 UTC (17 years, 7 months ago) by dpavlin
sort marc fields in output [0.04]


Revision 752 - Directory Listing
Modified Sun Oct 8 18:21:26 2006 UTC (17 years, 7 months ago) by dpavlin
move warns to debug level


Revision 750 - Directory Listing
Modified Sun Oct 8 13:24:46 2006 UTC (17 years, 7 months ago) by dpavlin
make rec() a bit more clever about returning values [0.23]


Revision 749 - Directory Listing
Modified Sun Oct 8 13:00:04 2006 UTC (17 years, 7 months ago) by dpavlin
emit error instead of warning and offer hint
(it should be automatic, but currently isn't)


Revision 743 - Directory Listing
Modified Sun Oct 8 00:38:15 2006 UTC (17 years, 7 months ago) by dpavlin
 r1077@llin:  dpavlin | 2006-10-08 02:32:39 +0200
 remove old lookup code


Revision 741 - Directory Listing
Modified Sun Oct 8 00:38:04 2006 UTC (17 years, 7 months ago) by dpavlin
 r1075@llin:  dpavlin | 2006-10-08 02:30:42 +0200
 don't polute data_structure with leader (data_structure will now
 return undef as it should if matched rules didn't have any search
 or display directives)


Revision 740 - Directory Listing
Modified Sat Oct 7 16:33:37 2006 UTC (17 years, 7 months ago) by dpavlin
 r1073@llin:  dpavlin | 2006-10-07 18:30:24 +0200
 if there is only one value, lookups will return scalar and not array


Revision 737 - Directory Listing
Modified Thu Oct 5 14:38:45 2006 UTC (17 years, 7 months ago) by dpavlin
 r1067@llin:  dpavlin | 2006-10-05 16:35:45 +0200
 added generate_marc to find out if normalization rules have marc* directives


Revision 736 - Directory Listing
Modified Thu Oct 5 12:57:51 2006 UTC (17 years, 7 months ago) by dpavlin
 r1065@llin:  dpavlin | 2006-10-05 14:54:48 +0200
 actually we don't need *_load_ds, but _load_row for lookups


Revision 735 - Directory Listing
Modified Mon Oct 2 09:31:25 2006 UTC (17 years, 7 months ago) by dpavlin
 r1063@llin:  dpavlin | 2006-10-02 11:28:37 +0200
 added load_row and save_row needed for lookups [0.14]


Revision 734 - Directory Listing
Modified Sun Oct 1 20:14:14 2006 UTC (17 years, 7 months ago) by dpavlin
 r1060@llin:  dpavlin | 2006-10-01 15:53:50 +0200
 incompatible change: data_structure files are not created inside
 'ds' directory in cache dir [0.13]


Revision 730 - Directory Listing
Modified Fri Sep 29 20:18:34 2006 UTC (17 years, 8 months ago) by dpavlin
 r1052@llin:  dpavlin | 2006-09-29 22:15:12 +0200
 don't reset lookup and config on each data_structure call


Revision 729 - Directory Listing
Modified Fri Sep 29 20:18:30 2006 UTC (17 years, 8 months ago) by dpavlin
 r1051@llin:  dpavlin | 2006-09-29 21:58:49 +0200
 make it less chatty without debug level


Revision 728 - Directory Listing
Modified Fri Sep 29 19:52:26 2006 UTC (17 years, 8 months ago) by dpavlin
 r1047@llin:  dpavlin | 2006-09-29 21:49:48 +0200
 move to new low-level API


Revision 726 - Directory Listing
Modified Fri Sep 29 19:52:17 2006 UTC (17 years, 8 months ago) by dpavlin
 r1045@llin:  dpavlin | 2006-09-29 21:38:42 +0200
 change low-level API to be OO (and remove various ugly cludges).


Revision 725 - Directory Listing
Modified Fri Sep 29 18:55:41 2006 UTC (17 years, 8 months ago) by dpavlin
 r1042@llin:  dpavlin | 2006-09-29 20:53:01 +0200
 added _set_load_ds, and load_ds_coderef to data_structure so that lookups can call
 closure to fetch records, implemented lookup based on new format generated by
 WebPAC::Parser, test to be sure that it somewhat works :-) [0.21]


Revision 724 - Directory Listing
Modified Fri Sep 29 18:55:31 2006 UTC (17 years, 8 months ago) by dpavlin
 r1038@llin:  dpavlin | 2006-09-29 14:27:45 +0200
 remove comments from normalize rules when parsing


Revision 721 - Directory Listing
Modified Fri Sep 29 12:27:47 2006 UTC (17 years, 8 months ago) by dpavlin
 r1035@llin:  dpavlin | 2006-09-29 14:25:03 +0200
 moved warn to debug 1


Revision 720 - Directory Listing
Modified Fri Sep 29 12:27:36 2006 UTC (17 years, 8 months ago) by dpavlin
 r1034@llin:  dpavlin | 2006-09-29 14:24:39 +0200
 important bugfix: this will collect ALL normalize rules for given
 database and input in single rule set


Revision 717 - Directory Listing
Modified Tue Sep 26 18:14:14 2006 UTC (17 years, 8 months ago) by dpavlin
 r1028@llin:  dpavlin | 2006-09-26 20:09:18 +0200
 added normalize_rules [0.06]


Revision 716 - Directory Listing
Modified Tue Sep 26 14:07:20 2006 UTC (17 years, 8 months ago) by dpavlin
 r1026@llin:  dpavlin | 2006-09-26 16:05:05 +0200
 pod improvements


Revision 715 - Directory Listing
Modified Tue Sep 26 14:03:12 2006 UTC (17 years, 8 months ago) by dpavlin
 r1024@llin:  dpavlin | 2006-09-26 16:00:56 +0200
 added load_lookup [0.12]


Revision 714 - Directory Listing
Modified Tue Sep 26 12:47:52 2006 UTC (17 years, 8 months ago) by dpavlin
 r1022@llin:  dpavlin | 2006-09-26 14:45:37 +0200
 make database in constructor (new) really optional (as documented :-)


Revision 713 - Directory Listing
Modified Tue Sep 26 12:42:49 2006 UTC (17 years, 8 months ago) by dpavlin
 r1020@llin:  dpavlin | 2006-09-26 14:40:34 +0200
 refactored WebPAC::Store


Revision 712 - Directory Listing
Modified Tue Sep 26 10:23:04 2006 UTC (17 years, 8 months ago) by dpavlin
 r1018@llin:  dpavlin | 2006-09-26 12:20:52 +0200
 correct creation of lookups (by database and input)


Revision 711 - Directory Listing
Modified Tue Sep 26 10:05:25 2006 UTC (17 years, 8 months ago) by dpavlin
 r1016@llin:  dpavlin | 2006-09-26 12:03:11 +0200
 make it less chatty


Revision 710 - Directory Listing
Modified Mon Sep 25 18:58:43 2006 UTC (17 years, 8 months ago) by dpavlin
 r1014@llin:  dpavlin | 2006-09-25 20:56:33 +0200
 save lookups using WebPAC::Store


Revision 708 - Directory Listing
Modified Mon Sep 25 16:07:08 2006 UTC (17 years, 8 months ago) by dpavlin
 r1010@llin:  dpavlin | 2006-09-25 17:42:39 +0200
 typo


Revision 707 - Directory Listing
Modified Mon Sep 25 15:26:12 2006 UTC (17 years, 8 months ago) by dpavlin
 r1008@llin:  dpavlin | 2006-09-25 17:23:42 +0200
 lookup creation somewhat works


Revision 706 - Directory Listing
Modified Mon Sep 25 14:06:49 2006 UTC (17 years, 8 months ago) by dpavlin
 r1006@llin:  dpavlin | 2006-09-25 16:04:39 +0200
 added have_lookup_create


Revision 705 - Directory Listing
Modified Mon Sep 25 13:46:36 2006 UTC (17 years, 8 months ago) by dpavlin
 r1004@llin:  dpavlin | 2006-09-25 15:44:23 +0200
 test lookup_create_rules


Revision 703 - Directory Listing
Modified Mon Sep 25 13:24:09 2006 UTC (17 years, 8 months ago) by dpavlin
 r1000@llin:  dpavlin | 2006-09-25 15:16:49 +0200
 support multiple lookups on same input file
 move _read_sources and _parse_lookups to private functions


Revision 702 - Directory Listing
Modified Mon Sep 25 13:08:17 2006 UTC (17 years, 8 months ago) by dpavlin
 r998@llin:  dpavlin | 2006-09-25 15:06:05 +0200
 first cuts at depends


Revision 701 - Directory Listing
Modified Mon Sep 25 12:51:47 2006 UTC (17 years, 8 months ago) by dpavlin
 r994@llin:  dpavlin | 2006-09-25 14:49:05 +0200
 refactore support for multiple normalize files in each lookup


Revision 700 - Directory Listing
Modified Mon Sep 25 12:51:33 2006 UTC (17 years, 8 months ago) by dpavlin
 r993@llin:  dpavlin | 2006-09-25 13:52:43 +0200
 upgrade $input->{normalize} to ARRAY


Revision 699 - Directory Listing
Modified Mon Sep 25 12:51:17 2006 UTC (17 years, 8 months ago) by dpavlin
 r992@llin:  dpavlin | 2006-09-25 13:48:56 +0200
 tweaks


Revision 698 - Directory Listing
Modified Mon Sep 25 11:14:53 2006 UTC (17 years, 8 months ago) by dpavlin
 r990@llin:  dpavlin | 2006-09-25 13:12:42 +0200
 new depends method to track dependencies, input in most places can be input name or
 hash with key 'name' which will be used as input (for exaple, from configuration file),
 database and input names will have correctly stripped quotes,
 begin removal of old lookup support


Revision 697 - Directory Listing
Modified Mon Sep 25 09:49:28 2006 UTC (17 years, 8 months ago) by dpavlin
 r988@llin:  dpavlin | 2006-09-25 11:47:07 +0200
 fix die


Revision 693 - Directory Listing
Modified Sun Sep 24 21:13:45 2006 UTC (17 years, 8 months ago) by dpavlin
 r979@llin:  dpavlin | 2006-09-24 23:11:30 +0200
 nit-picking


Revision 692 - Directory Listing
Modified Sun Sep 24 21:13:40 2006 UTC (17 years, 8 months ago) by dpavlin
 r978@llin:  dpavlin | 2006-09-24 23:10:22 +0200
 final touches before diving into lookup creation and usage


Revision 691 - Directory Listing
Modified Sun Sep 24 21:13:36 2006 UTC (17 years, 8 months ago) by dpavlin
 r977@llin:  dpavlin | 2006-09-24 22:21:46 +0200
 parse normalize files for lookups one by one, better error reporting


Revision 690 - Directory Listing
Modified Sun Sep 24 19:00:56 2006 UTC (17 years, 8 months ago) by dpavlin
 r975@llin:  dpavlin | 2006-09-24 20:58:49 +0200
 report invalid databases and inputs for lookups


Revision 689 - Directory Listing
Modified Sun Sep 24 18:52:35 2006 UTC (17 years, 8 months ago) by dpavlin
 r972@llin:  dpavlin | 2006-09-24 20:50:22 +0200
 check for valid databases and inputs [0.02]


Revision 688 - Directory Listing
Modified Sun Sep 24 18:52:31 2006 UTC (17 years, 8 months ago) by dpavlin
 r971@llin:  dpavlin | 2006-09-24 20:04:20 +0200
 iterate_inputs now returns also database name and full database config [0.02]


Revision 687 - Directory Listing
Modified Sun Sep 24 17:49:05 2006 UTC (17 years, 8 months ago) by dpavlin
 r969@llin:  dpavlin | 2006-09-24 19:47:01 +0200
 use Log::Log4perl for logging


Revision 686 - Directory Listing
Modified Sun Sep 24 17:25:04 2006 UTC (17 years, 8 months ago) by dpavlin
 r966@llin:  dpavlin | 2006-09-24 19:22:45 +0200
 first cut at WebPAC::Parser which will allow lookups to be specified in
 normalization file


Revision 685 - Directory Listing
Modified Sun Sep 24 17:24:59 2006 UTC (17 years, 8 months ago) by dpavlin
 r965@llin:  dpavlin | 2006-09-24 18:07:03 +0200
 added iterate_inputs


Revision 683 - Directory Listing
Modified Sun Sep 24 15:53:49 2006 UTC (17 years, 8 months ago) by dpavlin
 r961@llin:  dpavlin | 2006-09-24 17:51:08 +0200
 $config->webpac returns config HASH


Revision 682 - Directory Listing
Modified Sun Sep 24 15:28:54 2006 UTC (17 years, 8 months ago) by dpavlin
 r958@llin:  dpavlin | 2006-09-24 17:26:37 +0200
 added $config->get and $config->webpac


Revision 681 - Directory Listing
Modified Sun Sep 24 15:28:49 2006 UTC (17 years, 8 months ago) by dpavlin
 r957@llin:  dpavlin | 2006-09-24 17:03:52 +0200
 move parts of configuration handling to WebPAC::Config


Revision 677 - Directory Listing
Modified Wed Sep 13 17:44:57 2006 UTC (17 years, 8 months ago) by dpavlin
adding - after field ignores it in validation


Revision 674 - Directory Listing
Modified Tue Sep 12 14:47:25 2006 UTC (17 years, 8 months ago) by dpavlin
 r947@llin:  dpavlin | 2006-09-12 16:45:55 +0200
 fixed indexing with EstraierNative (it will be used for every database, not
 just first one), and create separate indexes for each database (we'll merge them at end)


Revision 673 - Directory Listing
Modified Mon Sep 11 20:49:37 2006 UTC (17 years, 8 months ago) by dpavlin
index to temporary path and rename at at end [0.02]


Revision 671 - Directory Listing
Modified Mon Sep 11 15:59:35 2006 UTC (17 years, 8 months ago) by dpavlin
 r942@llin:  dpavlin | 2006-09-11 17:58:32 +0200
 generate reports (validation and stats) for each input in out/report/


Revision 670 - Directory Listing
Modified Mon Sep 11 14:29:08 2006 UTC (17 years, 8 months ago) by dpavlin
 r938@llin:  dpavlin | 2006-09-11 16:27:57 +0200
 tests, corrections and version bump [0.08]


Revision 669 - Directory Listing
Modified Mon Sep 11 14:29:01 2006 UTC (17 years, 8 months ago) by dpavlin
 r937@llin:  dpavlin | 2006-09-11 16:26:07 +0200
 changed _pack_subfields_hash usage and document it


Revision 668 - Directory Listing
Modified Mon Sep 11 14:28:56 2006 UTC (17 years, 8 months ago) by dpavlin
 r936@llin:  dpavlin | 2006-09-11 16:06:01 +0200
 return subfields in alphabetical order


Revision 667 - Directory Listing
Modified Mon Sep 11 12:56:05 2006 UTC (17 years, 8 months ago) by dpavlin
 r934@llin:  dpavlin | 2006-09-11 14:55:01 +0200
 _pack_subfields_hash now support (legacy) structures with subfields definition


Revision 666 - Directory Listing
Modified Mon Sep 11 12:32:51 2006 UTC (17 years, 8 months ago) by dpavlin
 r932@llin:  dpavlin | 2006-09-11 14:31:51 +0200
 simplify errors return hash, a bit better formatting of report


Revision 665 - Directory Listing
Modified Mon Sep 11 11:57:30 2006 UTC (17 years, 8 months ago) by dpavlin
 r929@llin:  dpavlin | 2006-09-11 13:56:02 +0200
 another cut at simplification of report


Revision 664 - Directory Listing
Modified Mon Sep 11 11:57:18 2006 UTC (17 years, 8 months ago) by dpavlin
 r928@llin:  dpavlin | 2006-09-09 20:24:06 +0200
 a try at implementing of validation reporter


Revision 662 - Directory Listing
Modified Fri Sep 8 17:48:43 2006 UTC (17 years, 8 months ago) by dpavlin
open marc output file with :utf8 layer, with previous fix it fixes encoding in MARC output


Revision 661 - Directory Listing
Modified Fri Sep 8 17:47:58 2006 UTC (17 years, 8 months ago) by dpavlin
remove recoding which doesn't fit here


Revision 656 - Directory Listing
Modified Fri Sep 8 14:13:54 2006 UTC (17 years, 8 months ago) by dpavlin
don't report empty fields (should be option, really), tweaks in output


Revision 654 - Directory Listing
Modified Thu Sep 7 16:41:08 2006 UTC (17 years, 8 months ago) by dpavlin
again refactored a bit validation hash


Revision 653 - Directory Listing
Modified Thu Sep 7 15:57:48 2006 UTC (17 years, 8 months ago) by dpavlin
added reset_errors and all_errors to validator (real reporter is still pending),
rewriten validator tests


Revision 652 - Directory Listing
Modified Thu Sep 7 15:01:45 2006 UTC (17 years, 8 months ago) by dpavlin
refactored internal WebPAC::Input::* API a bit, added dump_rec,
validate is now more clever and reports all errors from database at end


Revision 647 - Directory Listing
Modified Wed Sep 6 23:13:03 2006 UTC (17 years, 8 months ago) by dpavlin
fix


Revision 646 - Directory Listing
Modified Wed Sep 6 22:42:37 2006 UTC (17 years, 8 months ago) by dpavlin
added required subfields


Revision 645 - Directory Listing
Modified Wed Sep 6 22:07:21 2006 UTC (17 years, 8 months ago) by dpavlin
check for fields which must exist or subfields which can be repeatable


Revision 643 - Directory Listing
Modified Wed Sep 6 21:10:30 2006 UTC (17 years, 8 months ago) by dpavlin
report repeatable subfields along with dump of that field from input


Revision 642 - Directory Listing
Modified Wed Sep 6 21:09:30 2006 UTC (17 years, 8 months ago) by dpavlin
make it less chatty


Revision 641 - Directory Listing
Modified Wed Sep 6 20:54:47 2006 UTC (17 years, 8 months ago) by dpavlin
refactored _pack_subfields_hash in separate function


Revision 640 - Directory Listing
Modified Wed Sep 6 19:52:36 2006 UTC (17 years, 8 months ago) by dpavlin
don't report internal 'subfields' field as error


Revision 636 - Directory Listing
Modified Wed Sep 6 19:25:22 2006 UTC (17 years, 8 months ago) by dpavlin
implement new modify_file format which is (hopefully) simplier than yaml and/or perl [2.27]
(yes, I know... It's a sin...)


Revision 634 - Directory Listing
Modified Wed Sep 6 18:08:30 2006 UTC (17 years, 8 months ago) by dpavlin
move logging to debug level


Revision 633 - Directory Listing
Modified Wed Sep 6 18:08:04 2006 UTC (17 years, 8 months ago) by dpavlin
fixed logging levels (and added better debug) [0.03]


Revision 632 - Directory Listing
Modified Wed Sep 6 17:51:07 2006 UTC (17 years, 8 months ago) by dpavlin
report each logging level once


Revision 631 - Directory Listing
Modified Wed Sep 6 14:25:16 2006 UTC (17 years, 8 months ago) by dpavlin
 r890@llin:  dpavlin | 2006-09-06 16:24:27 +0200
 rec1 now unrolls subfields in correct order (as in source file)


Revision 630 - Directory Listing
Modified Wed Sep 6 14:25:05 2006 UTC (17 years, 8 months ago) by dpavlin
 r886@llin:  dpavlin | 2006-09-05 22:51:30 +0200
 added debug log for tags


Revision 627 - Directory Listing
Modified Tue Sep 5 15:14:14 2006 UTC (17 years, 8 months ago) by dpavlin
 r884@llin:  dpavlin | 2006-09-05 17:13:36 +0200
 added preliminary support for perl native Hyper Estraier bindings


Revision 626 - Directory Listing
Modified Mon Sep 4 16:15:07 2006 UTC (17 years, 8 months ago) by dpavlin
fix MARC encoding whoes


Revision 625 - Directory Listing
Modified Sat Aug 26 12:00:36 2006 UTC (17 years, 9 months ago) by dpavlin
 r878@llin:  dpavlin | 2006-08-26 14:00:08 +0200
 removed some debugging output (or moved it to debug level), few tweaks [2.26]


Revision 624 - Directory Listing
Modified Sat Aug 26 12:00:31 2006 UTC (17 years, 9 months ago) by dpavlin
 r877@llin:  dpavlin | 2006-08-25 21:55:05 +0200
 removed traces of Text::Iconv and replaced them with Encode,
 code page 852 is now cp852 (instead of just 852) because Encode
 likes it that way, record encoding is now hard-coded to utf-8


Revision 623 - Directory Listing
Modified Sat Aug 26 12:00:25 2006 UTC (17 years, 9 months ago) by dpavlin
 r876@llin:  dpavlin | 2006-08-25 21:53:19 +0200
 remove OpenIsis support (it was broken for quite some time), make hash_filter chatty (debugging)


Revision 621 - Directory Listing
Modified Fri Aug 25 18:06:42 2006 UTC (17 years, 9 months ago) by dpavlin
 r872@llin:  dpavlin | 2006-08-25 20:06:35 +0200
 typo


Revision 620 - Directory Listing
Modified Fri Aug 25 16:20:21 2006 UTC (17 years, 9 months ago) by dpavlin
 r870@llin:  dpavlin | 2006-08-25 18:20:15 +0200
 make _add_value private to please pod coverage


Revision 619 - Directory Listing
Modified Fri Aug 25 12:31:06 2006 UTC (17 years, 9 months ago) by dpavlin
 r867@llin:  dpavlin | 2006-08-25 14:32:05 +0200
 statistics now show data before modify_records


Revision 618 - Directory Listing
Modified Fri Aug 25 12:31:01 2006 UTC (17 years, 9 months ago) by dpavlin
 r866@llin:  dpavlin | 2006-08-25 12:32:28 +0200
 finish marc_original_order and remove warning


Revision 616 - Directory Listing
Modified Wed Aug 23 14:29:43 2006 UTC (17 years, 9 months ago) by dpavlin
marc_original_order has now arguments in order marc_field, original_field to
be consistent with other directives


Revision 615 - Directory Listing
Modified Wed Aug 23 14:28:48 2006 UTC (17 years, 9 months ago) by dpavlin
added include_subfields needed for marc_original_order


Revision 613 - Directory Listing
Modified Wed Aug 23 11:04:32 2006 UTC (17 years, 9 months ago) by dpavlin
 r857@llin:  dpavlin | 2006-08-23 13:04:58 +0200
 modify_records is now applied only once for each field to prevent looping of regexpes


Revision 610 - Directory Listing
Modified Tue Aug 1 18:20:59 2006 UTC (17 years, 10 months ago) by dpavlin
KinoSearch now create separate index for each database


Revision 609 - Directory Listing
Modified Tue Aug 1 17:26:55 2006 UTC (17 years, 10 months ago) by dpavlin
automatically select clean if index is corrupted


Revision 606 - Directory Listing
Modified Tue Aug 1 13:59:47 2006 UTC (17 years, 10 months ago) by dpavlin
added --parallel option to utilize multiple CPUs in machine


Revision 605 - Directory Listing
Modified Sun Jul 30 14:23:23 2006 UTC (17 years, 10 months ago) by dpavlin
 r846@llin:  dpavlin | 2006-07-30 14:27:35 +0200
 better checking for subfield definition (for now, supported by just
 Biblio::Isis) and warn if missing (as opposed to die)


Revision 604 - Directory Listing
Modified Sun Jul 30 14:19:54 2006 UTC (17 years, 10 months ago) by dpavlin
 r844@llin:  dpavlin | 2006-07-30 14:24:04 +0200
 first cut at marc_original_order


Revision 603 - Directory Listing
Modified Sun Jul 23 20:19:56 2006 UTC (17 years, 10 months ago) by dpavlin
 r842@llin:  dpavlin | 2006-07-23 22:23:52 +0200
 append subfields


Revision 601 - Directory Listing
Modified Sun Jul 23 17:33:11 2006 UTC (17 years, 10 months ago) by dpavlin
added _debug(2) output to rec2(...)


Revision 599 - Directory Listing
Modified Thu Jul 13 13:55:19 2006 UTC (17 years, 10 months ago) by dpavlin
 r835@llin:  dpavlin | 2006-07-13 15:56:53 +0200
 test modify_record


Revision 598 - Directory Listing
Modified Thu Jul 13 13:55:15 2006 UTC (17 years, 10 months ago) by dpavlin
 r834@llin:  dpavlin | 2006-07-13 14:49:23 +0200
 fix pod


Revision 597 - Directory Listing
Modified Thu Jul 13 11:54:33 2006 UTC (17 years, 10 months ago) by dpavlin
 r831@llin:  dpavlin | 2006-07-13 13:56:19 +0200
 first cut in implementing modify_records using automatically generated regexpes


Revision 595 - Directory Listing
Modified Mon Jul 10 10:16:11 2006 UTC (17 years, 10 months ago) by dpavlin
 r827@llin:  dpavlin | 2006-07-10 12:17:16 +0200
 add config() and id() to WebPAC::Normalize


Revision 594 - Directory Listing
Modified Mon Jul 10 10:16:03 2006 UTC (17 years, 10 months ago) by dpavlin
 r826@llin:  dpavlin | 2006-07-10 10:54:14 +0200
 whitespace fix


Revision 593 - Directory Listing
Modified Sun Jul 9 15:22:39 2006 UTC (17 years, 10 months ago) by dpavlin
 r823@llin:  dpavlin | 2006-07-09 17:23:28 +0200
 stats not report repeatable subfields


Revision 592 - Directory Listing
Modified Sun Jul 9 15:22:30 2006 UTC (17 years, 10 months ago) by dpavlin
 r822@llin:  dpavlin | 2006-07-09 17:14:07 +0200
 prefix doesn't die if first parametar is undef


Revision 590 - Directory Listing
Modified Sun Jul 9 14:05:49 2006 UTC (17 years, 10 months ago) by dpavlin
fix id


Revision 589 - Directory Listing
Modified Fri Jul 7 21:48:09 2006 UTC (17 years, 10 months ago) by dpavlin
 r817@llin:  dpavlin | 2006-07-07 23:48:50 +0200
 support repeatable subfields from Biblio::Isis 0.20


Revision 587 - Directory Listing
Modified Thu Jul 6 10:31:33 2006 UTC (17 years, 10 months ago) by dpavlin
fix --marc-dump to show original row again


Revision 586 - Directory Listing
Modified Thu Jul 6 10:31:13 2006 UTC (17 years, 10 months ago) by dpavlin
better _debug(2) output


Revision 585 - Directory Listing
Modified Wed Jul 5 19:52:45 2006 UTC (17 years, 10 months ago) by dpavlin
 r810@llin:  dpavlin | 2006-07-05 21:53:01 +0200
 change of parametars to WebPAC::Input


Revision 583 - Directory Listing
Modified Wed Jul 5 00:12:08 2006 UTC (17 years, 10 months ago) by dpavlin
rec and join_with now return '' if there are no results, so they are safe to
use inside marc_compose


Revision 582 - Directory Listing
Modified Tue Jul 4 11:36:21 2006 UTC (17 years, 10 months ago) by dpavlin
 r802@llin:  dpavlin | 2006-07-04 13:36:05 +0200
 added MARC lint warning summary


Revision 579 - Directory Listing
Modified Tue Jul 4 11:08:43 2006 UTC (17 years, 10 months ago) by dpavlin
 r798@llin:  dpavlin | 2006-07-04 13:08:44 +0200
 changed _get_marc_fields to return arrayref, tests and fix for marc_remove(field)


Revision 578 - Directory Listing
Modified Tue Jul 4 10:34:15 2006 UTC (17 years, 10 months ago) by dpavlin
 r796@llin:  dpavlin | 2006-07-04 12:34:13 +0200
 created WebPAC::Output::MARC and cleanup run.pl


Revision 574 - Directory Listing
Modified Mon Jul 3 21:08:07 2006 UTC (17 years, 10 months ago) by dpavlin
added marc_duplicate and marc_remove


Revision 572 - Directory Listing
Modified Mon Jul 3 14:32:40 2006 UTC (17 years, 10 months ago) by dpavlin
fix warning with fields < 10


Revision 571 - Directory Listing
Modified Mon Jul 3 14:30:22 2006 UTC (17 years, 10 months ago) by dpavlin
marc() now supports fields < 10 which don't have indicators and subfields


Revision 568 - Directory Listing
Modified Sun Jul 2 21:30:00 2006 UTC (17 years, 10 months ago) by dpavlin
 r779@llin:  dpavlin | 2006-07-02 23:30:17 +0200
 more tuning of debug logging


Revision 566 - Directory Listing
Modified Sun Jul 2 21:17:54 2006 UTC (17 years, 10 months ago) by dpavlin
test split_rec_on corner cases, and fix one


Revision 565 - Directory Listing
Modified Sun Jul 2 20:33:13 2006 UTC (17 years, 10 months ago) by dpavlin
skip empty values in marc_compose


Revision 564 - Directory Listing
Modified Sun Jul 2 20:14:21 2006 UTC (17 years, 10 months ago) by dpavlin
 r772@llin:  dpavlin | 2006-07-02 22:14:37 +0200
 rough implementation of marc_leader (not tested enough)


Revision 562 - Directory Listing
Modified Sun Jul 2 16:14:41 2006 UTC (17 years, 10 months ago) by dpavlin
added marc_compose to specify manually subfield order in MARC and
split_rec_on to split single field into parts based on regex


Revision 554 - Directory Listing
Modified Sat Jul 1 10:19:29 2006 UTC (17 years, 11 months ago) by dpavlin
 r756@llin:  dpavlin | 2006-07-01 12:17:24 +0200
 pod improvements, added _debug


Revision 551 - Directory Listing
Modified Fri Jun 30 20:43:09 2006 UTC (17 years, 11 months ago) by dpavlin
 r750@llin:  dpavlin | 2006-06-30 22:34:44 +0200
 check if marc_record has values


Revision 550 - Directory Listing
Modified Fri Jun 30 18:48:33 2006 UTC (17 years, 11 months ago) by dpavlin
 r748@llin:  dpavlin | 2006-06-30 20:48:29 +0200
 re-implement magic again (so that it actually work in all cases consistant).
 Depend on Data::Dump to enable nice output.


Revision 548 - Directory Listing
Modified Thu Jun 29 23:29:02 2006 UTC (17 years, 11 months ago) by dpavlin
 r744@llin:  dpavlin | 2006-06-30 01:31:00 +0200
 don't chew indicators with 0 value, removed debugging warning


Revision 547 - Directory Listing
Modified Thu Jun 29 23:19:26 2006 UTC (17 years, 11 months ago) by dpavlin
 r742@llin:  dpavlin | 2006-06-30 01:21:24 +0200
 added marc_repetable_subfield and marc_indicators, renamed marc21 to marc [2.23]


Revision 544 - Directory Listing
Modified Thu Jun 29 21:52:51 2006 UTC (17 years, 11 months ago) by dpavlin
 r736@llin:  dpavlin | 2006-06-29 23:54:24 +0200
 oh, another bit of magic missing...


Revision 543 - Directory Listing
Modified Thu Jun 29 21:19:08 2006 UTC (17 years, 11 months ago) by dpavlin
 r732@llin:  dpavlin | 2006-06-29 23:20:46 +0200
 document magic (that is how WebPAC detects repeatable fields) and fix it to actually work :-)


Revision 542 - Directory Listing
Modified Thu Jun 29 21:18:59 2006 UTC (17 years, 11 months ago) by dpavlin
 r731@llin:  dpavlin | 2006-06-29 23:02:08 +0200
 implement magic to create fields and repeatable fields (which might be broken for some cases).


Revision 541 - Directory Listing
Modified Thu Jun 29 21:18:50 2006 UTC (17 years, 11 months ago) by dpavlin
 r730@llin:  dpavlin | 2006-06-29 21:33:48 +0200
 use MARC::Record 2.0 to support utf-8 encoding in MARC
 http://marcpm.sourceforge.net/


Revision 540 - Directory Listing
Modified Thu Jun 29 15:29:41 2006 UTC (17 years, 11 months ago) by dpavlin
 r726@llin:  dpavlin | 2006-06-29 17:31:13 +0200
 add marc21 to normalize and create MARC file from those data [2.22]


Revision 538 - Directory Listing
Modified Thu Jun 29 15:29:19 2006 UTC (17 years, 11 months ago) by dpavlin
 r722@llin:  dpavlin | 2006-06-26 21:29:56 +0200
 make private funtions with _


Revision 536 - Directory Listing
Modified Mon Jun 26 16:39:51 2006 UTC (17 years, 11 months ago) by dpavlin
 r719@llin:  dpavlin | 2006-06-26 18:40:57 +0200
 big refacture: depriciate and remove all normalisation formats except .pl sets (but
 old code is still available in WebPAC::Lookup::Normalize because lookups use it) [2.20]


Revision 535 - Directory Listing
Modified Mon Jun 26 16:39:42 2006 UTC (17 years, 11 months ago) by dpavlin
 r718@llin:  dpavlin | 2006-06-26 17:37:28 +0200
 remove Text::Iconv and use Encode


Revision 527 - Directory Listing
Modified Mon May 22 19:34:28 2006 UTC (18 years ago) by dpavlin
 r704@llin:  dpavlin | 2006-05-22 21:38:19 +0200
 add_link dies without proper parametars


Revision 525 - Directory Listing
Modified Mon May 22 18:26:56 2006 UTC (18 years ago) by dpavlin
 r697@llin:  dpavlin | 2006-05-22 20:30:05 +0200
 todo 2.17


Revision 524 - Directory Listing
Modified Sun May 21 19:38:56 2006 UTC (18 years ago) by dpavlin
added from and to parametars for start and end row to import


Revision 523 - Directory Listing
Modified Sun May 21 19:29:26 2006 UTC (18 years ago) by dpavlin
transfer all input variables to open_db in input module


Revision 521 - Directory Listing
Modified Thu May 18 13:49:08 2006 UTC (18 years ago) by dpavlin
 r691@llin:  dpavlin | 2006-05-18 15:52:34 +0200
 store MFN (line number, really) correctly in field 000


Revision 519 - Directory Listing
Modified Thu May 18 13:48:51 2006 UTC (18 years ago) by dpavlin
 r689@llin:  dpavlin | 2006-05-18 15:45:23 +0200
 treat field names as strings, not numbers (Excel field names are chars, not numbers)


Revision 516 - Directory Listing
Modified Tue May 16 15:23:12 2006 UTC (18 years ago) by dpavlin
 r682@llin:  dpavlin | 2006-05-16 17:27:02 +0200
 final touches on validation, added --validate to run.pl


Revision 515 - Directory Listing
Modified Tue May 16 15:23:05 2006 UTC (18 years ago) by dpavlin
 r681@llin:  dpavlin | 2006-05-16 17:08:13 +0200
 added validate_errors which returs all validation errors for this record


Revision 514 - Directory Listing
Modified Tue May 16 13:38:09 2006 UTC (18 years ago) by dpavlin
 r679@llin:  dpavlin | 2006-05-16 15:41:59 +0200
 begin work on validation framework


Revision 513 - Directory Listing
Modified Tue May 16 13:08:31 2006 UTC (18 years ago) by dpavlin
dump debug not info if skipping to mfn


Revision 507 - Directory Listing
Modified Mon May 15 13:15:01 2006 UTC (18 years ago) by dpavlin
 r669@llin:  dpavlin | 2006-05-15 15:18:36 +0200
 added nicely formatted stats and --stats flag to run.pl


Revision 506 - Directory Listing
Modified Mon May 15 09:59:05 2006 UTC (18 years ago) by dpavlin
 r663@llin:  dpavlin | 2006-05-15 12:02:43 +0200
 added stats gathering


Revision 505 - Directory Listing
Modified Sun May 14 22:38:01 2006 UTC (18 years ago) by dpavlin
fix whitespace


Revision 503 - Directory Listing
Modified Sun May 14 22:23:28 2006 UTC (18 years ago) by dpavlin
report if creating new index as result of clean option


Revision 501 - Directory Listing
Modified Sun May 14 22:08:51 2006 UTC (18 years ago) by dpavlin
added suffix and surround, regex now skips empty and undef values


Revision 498 - Directory Listing
Modified Sun May 14 19:45:45 2006 UTC (18 years ago) by dpavlin
 r653@llin:  dpavlin | 2006-05-14 21:48:48 +0200
 added Excel input format


Revision 497 - Directory Listing
Modified Sun May 14 19:45:36 2006 UTC (18 years ago) by dpavlin
 r652@llin:  dpavlin | 2006-05-14 21:47:38 +0200
 documentation fix for open_db


Revision 496 - Directory Listing
Modified Sun May 14 19:45:26 2006 UTC (18 years ago) by dpavlin
 r651@llin:  dpavlin | 2006-05-14 21:47:08 +0200
 allow 0 as valid db handle


Revision 490 - Directory Listing
Modified Sun May 14 12:35:20 2006 UTC (18 years ago) by dpavlin
 r637@llin:  dpavlin | 2006-05-14 14:38:22 +0200
 added data_structure (which does most of magic), support for semi-valid data structures


Revision 487 - Directory Listing
Modified Sun May 14 12:34:50 2006 UTC (18 years ago) by dpavlin
 r634@llin:  dpavlin | 2006-05-14 13:12:43 +0200
 don't use version which doesn't exits


Revision 486 - Directory Listing
Modified Sun May 14 11:06:52 2006 UTC (18 years ago) by dpavlin
 r630@llin:  dpavlin | 2006-05-14 13:10:04 +0200
 join_with now skips elements without a value ('' or undef)


Revision 483 - Directory Listing
Modified Sun May 14 09:34:05 2006 UTC (18 years ago) by dpavlin
 r625@llin:  dpavlin | 2006-05-14 11:37:22 +0200
 added no_progress_bar for tests and cron usage


Revision 475 - Directory Listing
Modified Sat May 13 12:37:25 2006 UTC (18 years ago) by dpavlin
 r610@llin:  dpavlin | 2006-05-13 14:38:42 +0200
 permit setup of empty lookup


Revision 473 - Directory Listing
Modified Sat May 13 12:07:56 2006 UTC (18 years ago) by dpavlin
 r603@llin:  dpavlin | 2006-05-13 14:08:39 +0200
 added lookup_hash for direct access to lookup data


Revision 472 - Directory Listing
Modified Sat May 13 12:07:46 2006 UTC (18 years ago) by dpavlin
 r602@llin:  dpavlin | 2006-05-13 13:58:08 +0200
 don't return empty elements in array, extended test set


Revision 467 - Directory Listing
Modified Sat May 13 09:48:06 2006 UTC (18 years ago) by dpavlin
 r594@llin:  dpavlin | 2006-05-13 11:47:42 +0200
 prefix will now skip undef values, better documentation


Revision 465 - Directory Listing
Modified Fri May 12 21:46:28 2006 UTC (18 years ago) by dpavlin
 r589@llin:  dpavlin | 2006-05-12 23:49:27 +0200
 lookup fix, remove warn in regex


Revision 463 - Directory Listing
Modified Fri May 12 19:59:25 2006 UTC (18 years ago) by dpavlin
 r585@llin:  dpavlin | 2006-05-12 22:02:20 +0200
 added prefix and fixed few mistakes in or die


Revision 461 - Directory Listing
Modified Fri May 12 14:54:25 2006 UTC (18 years ago) by dpavlin
 r581@llin:  dpavlin | 2006-05-12 16:57:30 +0200
 added clean_ds, rec1 now supports fields without subfields, rec1 & rec2 now take special care
 not to auto-vivify fields, removed various cruft, tidy pod


Revision 460 - Directory Listing
Modified Fri May 12 14:07:08 2006 UTC (18 years ago) by dpavlin
 r579@llin:  dpavlin | 2006-05-12 16:10:11 +0200
 added new normalizer, based on set functions (and easier to use, I hope)


Revision 459 - Directory Listing
Modified Wed May 10 14:48:25 2006 UTC (18 years ago) by dpavlin
 r577@llin:  dpavlin | 2006-05-10 16:51:07 +0200
 fixed add_link and wrote tests for it


Revision 458 - Directory Listing
Modified Wed May 10 14:08:15 2006 UTC (18 years ago) by dpavlin
 r575@llin:  dpavlin | 2006-05-10 16:10:56 +0200
 use Search::Estraier 0.06 new master API to create nodes, so code here is siplified


Revision 457 - Directory Listing
Modified Wed May 10 13:56:28 2006 UTC (18 years ago) by dpavlin
 r572@llin:  dpavlin | 2006-05-10 15:58:58 +0200
 fix die


Revision 456 - Directory Listing
Modified Wed May 10 13:56:21 2006 UTC (18 years ago) by dpavlin
 r571@llin:  dpavlin | 2006-05-09 13:39:25 +0200
 whitespace fix


Revision 437 - Directory Listing
Modified Sun Apr 30 19:06:09 2006 UTC (18 years, 1 month ago) by dpavlin
 r533@llin:  dpavlin | 2006-04-30 21:06:54 +0200
 fixed warnings


Revision 436 - Directory Listing
Modified Sun Apr 30 12:17:19 2006 UTC (18 years, 1 month ago) by dpavlin
 r531@llin:  dpavlin | 2006-04-30 14:18:00 +0200
 fix warning on undef vars


Revision 434 - Directory Listing
Modified Mon Apr 17 16:50:53 2006 UTC (18 years, 1 month ago) by dpavlin
 r527@llin:  dpavlin | 2006-04-17 18:50:54 +0200
 call finish at end of indexing, force create if index_path doesn't exist


Revision 433 - Directory Listing
Modified Mon Apr 17 16:01:12 2006 UTC (18 years, 1 month ago) by dpavlin
 r524@llin:  dpavlin | 2006-04-17 18:01:04 +0200
 added all_tags() to get sorted list of all tags in input xml


Revision 432 - Directory Listing
Modified Mon Apr 17 16:01:02 2006 UTC (18 years, 1 month ago) by dpavlin
 r523@llin:  dpavlin | 2006-04-17 17:18:35 +0200
 warn about missing fields when inserting into index


Revision 431 - Directory Listing
Modified Mon Apr 17 15:10:04 2006 UTC (18 years, 1 month ago) by dpavlin
 r520@llin:  dpavlin | 2006-04-17 17:09:51 +0200
 added support for KinoSearch [2.12]


Revision 416 - Directory Listing
Modified Sun Feb 26 23:21:50 2006 UTC (18 years, 3 months ago) by dpavlin
 r494@llin:  dpavlin | 2006-02-27 00:22:59 +0100
 implemented recode option to input (for now, just for MARC)


Revision 401 - Directory Listing
Modified Sun Feb 19 16:36:42 2006 UTC (18 years, 3 months ago) by dpavlin
 r466@llin:  dpavlin | 2006-02-19 17:45:26 +0100
 create label from database name, move from Text::Iconv to Encode


Revision 397 - Directory Listing
Modified Wed Feb 15 15:54:12 2006 UTC (18 years, 3 months ago) by dpavlin
 r458@llin:  dpavlin | 2006-02-15 17:01:53 +0100
 fix warnings


Revision 393 - Directory Listing
Modified Wed Feb 15 14:49:48 2006 UTC (18 years, 3 months ago) by dpavlin
 r445@llin:  dpavlin | 2006-01-22 14:41:41 +0100
 indent fix


Revision 376 - Directory Listing
Modified Sun Jan 8 22:41:45 2006 UTC (18 years, 4 months ago) by dpavlin
 r420@llin:  dpavlin | 2006-01-08 23:42:02 +0100
 and fix search links for '' values


Revision 375 - Directory Listing
Modified Sun Jan 8 22:21:24 2006 UTC (18 years, 4 months ago) by dpavlin
 r417@llin:  dpavlin | 2006-01-08 23:21:35 +0100
 fixed another corner-case


Revision 374 - Directory Listing
Modified Sun Jan 8 22:21:19 2006 UTC (18 years, 4 months ago) by dpavlin
 r416@llin:  dpavlin | 2006-01-08 23:21:14 +0100
 skip fields without values (and not confess) -- it's valid to have fields without
 values for correct merging of data. If it doesn't metter to output module (as it
 doesn't for Hyper Estraier) they should be ignored


Revision 373 - Directory Listing
Modified Sun Jan 8 22:09:33 2006 UTC (18 years, 4 months ago) by dpavlin
 r414@llin:  dpavlin | 2006-01-08 23:09:49 +0100
 and finally fix for all wired cases (I hope) [2.10]


Revision 372 - Directory Listing
Modified Sun Jan 8 21:50:34 2006 UTC (18 years, 4 months ago) by dpavlin
 r412@llin:  dpavlin | 2006-01-08 22:50:49 +0100
 more refactoring: joined paste_to_arr and fill_in_to_arr to _rec_to_arr


Revision 371 - Directory Listing
Modified Sun Jan 8 21:16:27 2006 UTC (18 years, 4 months ago) by dpavlin
 r409@llin:  dpavlin | 2006-01-08 22:16:39 +0100
 collect record sizes


Revision 368 - Directory Listing
Modified Sun Jan 8 20:32:06 2006 UTC (18 years, 4 months ago) by dpavlin
 r403@llin:  dpavlin | 2006-01-08 21:31:43 +0100
 refactor and better document get_data


Revision 364 - Directory Listing
Modified Sun Jan 8 20:27:11 2006 UTC (18 years, 4 months ago) by dpavlin
 r393@llin:  dpavlin | 2006-01-08 20:50:40 +0100
 better logging and minor fix to fill_arr


Revision 363 - Directory Listing
Modified Sun Jan 8 20:27:06 2006 UTC (18 years, 4 months ago) by dpavlin
 r392@llin:  dpavlin | 2006-01-08 19:54:18 +0100
 better logging debug


Revision 347 - Directory Listing
Modified Sat Jan 7 17:15:11 2006 UTC (18 years, 4 months ago) by dpavlin
 r361@llin:  dpavlin | 2006-01-07 18:15:12 +0100
 add filters in TT output template as [% f.filter(args) %] [0.07]


Revision 346 - Directory Listing
Modified Sat Jan 7 03:28:10 2006 UTC (18 years, 4 months ago) by dpavlin
fixed warning


Revision 345 - Directory Listing
Modified Sat Jan 7 02:21:18 2006 UTC (18 years, 4 months ago) by dpavlin
 r358@llin:  dpavlin | 2006-01-07 01:23:57 +0100
 push debug down to Search::Estraier::Node


Revision 344 - Directory Listing
Modified Sat Jan 7 02:05:55 2006 UTC (18 years, 4 months ago) by dpavlin
 r356@llin:  dpavlin | 2006-01-07 01:05:14 +0100
 fix failing test


Revision 343 - Directory Listing
Modified Sat Jan 7 01:40:01 2006 UTC (18 years, 4 months ago) by dpavlin
 r354@llin:  dpavlin | 2006-01-07 00:42:38 +0100
 update to use Search::Estraier [2.09]


Revision 341 - Directory Listing
Modified Mon Jan 2 11:37:08 2006 UTC (18 years, 4 months ago) by dpavlin
warn and not die if there is something in display, but not in search


Revision 340 - Directory Listing
Modified Mon Jan 2 10:58:26 2006 UTC (18 years, 4 months ago) by dpavlin
 r349@llin:  dpavlin | 2006-01-02 12:02:07 +0100
 fixed s999 fields


Revision 339 - Directory Listing
Modified Sat Dec 31 16:50:11 2005 UTC (18 years, 5 months ago) by dpavlin
 r346@llin:  dpavlin | 2005-12-31 17:53:29 +0100
 rename $offset and $limit variables to $from_rec and $to_rec to avoid confusion
 with parametars which have same names


Revision 338 - Directory Listing
Modified Sat Dec 31 16:50:06 2005 UTC (18 years, 5 months ago) by dpavlin
 r345@llin:  dpavlin | 2005-12-31 17:50:23 +0100
 better output


Revision 337 - Directory Listing
Modified Sat Dec 31 16:41:35 2005 UTC (18 years, 5 months ago) by dpavlin
 r343@llin:  dpavlin | 2005-12-31 17:44:58 +0100
 fix clash of $self->{size} from WebPAC::Input and WebPAC::Input::MARC,
 dokument _marc_size property


Revision 336 - Directory Listing
Modified Sat Dec 31 16:28:18 2005 UTC (18 years, 5 months ago) by dpavlin
 r341@llin:  dpavlin | 2005-12-31 17:31:33 +0100
 fix possible corruption of fields < 100


Revision 333 - Directory Listing
Modified Sat Dec 31 13:42:11 2005 UTC (18 years, 5 months ago) by dpavlin
try to fix infinite loop (not working)


Revision 331 - Directory Listing
Modified Tue Dec 27 23:24:36 2005 UTC (18 years, 5 months ago) by dpavlin
 r369@athlon:  dpavlin | 2005-12-28 00:27:13 +0100
 try to fix encodings in JavaScript strings (broken)


Revision 330 - Directory Listing
Modified Tue Dec 27 22:26:43 2005 UTC (18 years, 5 months ago) by dpavlin
 r367@athlon:  dpavlin | 2005-12-27 23:29:18 +0100
 minor tweaks


Revision 321 - Directory Listing
Modified Sun Dec 25 23:31:37 2005 UTC (18 years, 5 months ago) by dpavlin
 r12483@llin:  dpavlin | 2005-12-26 00:28:58 +0100
 fix warning and optional template argument for search_via_link


Revision 320 - Directory Listing
Modified Sat Dec 24 11:24:10 2005 UTC (18 years, 5 months ago) by dpavlin
added template to search_via_link


Revision 319 - Directory Listing
Modified Sat Dec 24 11:23:17 2005 UTC (18 years, 5 months ago) by dpavlin
warn if add_doc fails


Revision 318 - Directory Listing
Modified Fri Dec 23 22:52:48 2005 UTC (18 years, 5 months ago) by dpavlin
 r12237@llin:  dpavlin | 2005-12-23 23:54:36 +0100
 call new search_via_link


Revision 317 - Directory Listing
Modified Fri Dec 23 21:37:05 2005 UTC (18 years, 5 months ago) by dpavlin
 r12234@llin:  dpavlin | 2005-12-23 23:38:41 +0100
 bug fix to skip delimiter before first occurence of field in format


Revision 314 - Directory Listing
Modified Fri Dec 23 21:05:50 2005 UTC (18 years, 5 months ago) by dpavlin
 r345@athlon:  dpavlin | 2005-12-21 00:54:13 +0100
 work on tests


Revision 312 - Directory Listing
Modified Tue Dec 20 23:31:37 2005 UTC (18 years, 5 months ago) by dpavlin
 r343@athlon:  dpavlin | 2005-12-21 00:32:50 +0100
 fixed error output


Revision 311 - Directory Listing
Modified Tue Dec 20 23:16:21 2005 UTC (18 years, 5 months ago) by dpavlin
 r341@athlon:  dpavlin | 2005-12-21 00:17:34 +0100
 small documentation update


Revision 309 - Directory Listing
Modified Tue Dec 20 19:01:27 2005 UTC (18 years, 5 months ago) by dpavlin
 r336@athlon:  dpavlin | 2005-12-20 20:02:10 +0100
 use to_hash from MARC::Fast, not fetch... pfff!


Revision 308 - Directory Listing
Modified Tue Dec 20 19:01:22 2005 UTC (18 years, 5 months ago) by dpavlin
 r335@athlon:  dpavlin | 2005-12-20 20:01:21 +0100
 added debug output for record fetched from low-level API


Revision 307 - Directory Listing
Modified Tue Dec 20 00:03:04 2005 UTC (18 years, 5 months ago) by dpavlin
moved clean into WebPAC::Output::Estraier, cleanup


Revision 303 - Directory Listing
Modified Mon Dec 19 23:29:25 2005 UTC (18 years, 5 months ago) by dpavlin
fix warning


Revision 301 - Directory Listing
Modified Mon Dec 19 21:26:04 2005 UTC (18 years, 5 months ago) by dpavlin
 r322@athlon:  dpavlin | 2005-12-19 22:27:06 +0100
 make run.pl moderatly chatty (along with other modules), added command line options
 (try perldoc run.pl) new target index (to reindex all) and run (to index
 first 100 records of each database)


Revision 299 - Directory Listing
Modified Mon Dec 19 20:55:05 2005 UTC (18 years, 5 months ago) by dpavlin
 r319@athlon:  dpavlin | 2005-12-19 21:56:13 +0100
 fix database creation path [2.08]


Revision 298 - Directory Listing
Modified Mon Dec 19 19:55:21 2005 UTC (18 years, 5 months ago) by dpavlin
 r317@athlon:  dpavlin | 2005-12-19 20:56:26 +0100
 some fixes and cleanup, moved module versions to Makefile.PL


Revision 295 - Directory Listing
Modified Mon Dec 19 15:34:47 2005 UTC (18 years, 5 months ago) by dpavlin
 r11795@llin:  dpavlin | 2005-12-19 16:35:30 +0100
 fix regex filter, moved development version to real one [2.07]


Revision 292 - Directory Listing
Modified Sun Dec 18 23:34:30 2005 UTC (18 years, 5 months ago) by dpavlin
 r11790@llin:  dpavlin | 2005-12-19 06:35:06 +0100
 and small fix for codepage


Revision 291 - Directory Listing
Modified Sun Dec 18 23:34:24 2005 UTC (18 years, 5 months ago) by dpavlin
 r11789@llin:  dpavlin | 2005-12-19 06:29:24 +0100
 final tweaks, version bumping [2.00_6]


Revision 290 - Directory Listing
Modified Sun Dec 18 23:10:02 2005 UTC (18 years, 5 months ago) by dpavlin
 r11787@llin:  dpavlin | 2005-12-19 06:10:47 +0100
 MARC indexing seems to work


Revision 289 - Directory Listing
Modified Sun Dec 18 22:16:44 2005 UTC (18 years, 5 months ago) by dpavlin
 r11784@llin:  dpavlin | 2005-12-19 05:17:24 +0100
 don't use Exporter after all


Revision 287 - Directory Listing
Modified Sun Dec 18 21:06:51 2005 UTC (18 years, 5 months ago) by dpavlin
 r11779@llin:  dpavlin | 2005-12-19 04:07:22 +0100
 and fixes to make it work


Revision 286 - Directory Listing
Modified Sun Dec 18 21:06:46 2005 UTC (18 years, 5 months ago) by dpavlin
 r11778@llin:  dpavlin | 2005-12-19 03:59:54 +0100
 move work on input


Revision 285 - Directory Listing
Modified Sun Dec 18 21:06:39 2005 UTC (18 years, 5 months ago) by dpavlin
 r11777@llin:  dpavlin | 2005-12-19 00:02:47 +0100
 refactor Input::ISIS::* [0.02]


Revision 284 - Directory Listing
Modified Sun Dec 18 16:22:58 2005 UTC (18 years, 5 months ago) by dpavlin
another fix, now nodeadd works again [0.06]


Revision 280 - Directory Listing
Modified Sat Dec 17 22:32:28 2005 UTC (18 years, 5 months ago) by dpavlin
 r11767@llin:  dpavlin | 2005-12-18 04:32:59 +0100
 use WebPAC.Updater [0.05]


Revision 269 - Directory Listing
Modified Fri Dec 16 21:09:48 2005 UTC (18 years, 5 months ago) by dpavlin
 r11743@llin:  dpavlin | 2005-12-17 02:09:53 +0100
 added YAML as normalization input format


Revision 268 - Directory Listing
Modified Fri Dec 16 21:09:42 2005 UTC (18 years, 5 months ago) by dpavlin
 r11742@llin:  dpavlin | 2005-12-17 01:26:41 +0100
 cleanup


Revision 265 - Directory Listing
Modified Fri Dec 16 16:23:44 2005 UTC (18 years, 5 months ago) by dpavlin
 r11736@llin:  dpavlin | 2005-12-16 21:22:26 +0100
 die if database can't be opened, confirms to test


Revision 262 - Directory Listing
Modified Fri Dec 16 16:00:24 2005 UTC (18 years, 5 months ago) by dpavlin
 r11730@llin:  dpavlin | 2005-12-16 21:00:38 +0100
 fix warning


Revision 261 - Directory Listing
Modified Fri Dec 16 16:00:18 2005 UTC (18 years, 5 months ago) by dpavlin
 r11729@llin:  dpavlin | 2005-12-16 21:00:26 +0100
 warn about non-defined filters just once


Revision 260 - Directory Listing
Modified Fri Dec 16 14:40:55 2005 UTC (18 years, 5 months ago) by dpavlin
 r11727@llin:  dpavlin | 2005-12-16 19:41:08 +0100
 added filter{regex(s/foo/bar/)} [2.00_5]


Revision 256 - Directory Listing
Modified Fri Dec 16 01:47:20 2005 UTC (18 years, 5 months ago) by dpavlin
 r11719@llin:  dpavlin | 2005-12-16 05:47:31 +0100
 links now work [2.00_4]


Revision 255 - Directory Listing
Modified Fri Dec 16 01:04:20 2005 UTC (18 years, 5 months ago) by dpavlin
 r11716@llin:  dpavlin | 2005-12-16 05:04:26 +0100
 links to other databases allmost work


Revision 254 - Directory Listing
Modified Fri Dec 16 01:04:14 2005 UTC (18 years, 5 months ago) by dpavlin
 r11715@llin:  dpavlin | 2005-12-16 03:59:21 +0100
 added simple _new constructur for use in scripts to init logger


Revision 253 - Directory Listing
Modified Thu Dec 15 17:01:10 2005 UTC (18 years, 5 months ago) by dpavlin
 r11712@llin:  dpavlin | 2005-12-15 21:01:03 +0100
 lookups now work [2.00_3]


Revision 252 - Directory Listing
Modified Thu Dec 15 17:01:04 2005 UTC (18 years, 5 months ago) by dpavlin
 r11711@llin:  dpavlin | 2005-12-15 20:02:16 +0100
 varios tweaks to make lookups work


Revision 251 - Directory Listing
Modified Thu Dec 15 14:12:00 2005 UTC (18 years, 5 months ago) by dpavlin
various updates to make lookups work (but they don't still)


Revision 247 - Directory Listing
Modified Wed Dec 14 23:10:53 2005 UTC (18 years, 5 months ago) by dpavlin
 r11702@llin:  dpavlin | 2005-12-15 02:10:51 +0100
 bump *CORRECT* version number (pfff...)


Revision 246 - Directory Listing
Modified Wed Dec 14 23:08:11 2005 UTC (18 years, 5 months ago) by dpavlin
 r11700@llin:  dpavlin | 2005-12-15 02:08:09 +0100
 added doc for est_ua [2.00_2]


Revision 245 - Directory Listing
Modified Wed Dec 14 23:04:59 2005 UTC (18 years, 5 months ago) by dpavlin
 r11698@llin:  dpavlin | 2005-12-15 02:04:58 +0100
 bump version number


Revision 240 - Directory Listing
Modified Wed Dec 14 18:55:49 2005 UTC (18 years, 5 months ago) by dpavlin
 r11688@llin:  dpavlin | 2005-12-14 21:55:23 +0100
 missing ;


Revision 239 - Directory Listing
Modified Wed Dec 14 18:55:44 2005 UTC (18 years, 5 months ago) by dpavlin
 r11687@llin:  dpavlin | 2005-12-14 21:52:48 +0100
 added load_rec('database/prefix/mfn','template.tt') and
 load_template('template.tt') for use in TT


Revision 238 - Directory Listing
Modified Wed Dec 14 18:55:38 2005 UTC (18 years, 5 months ago) by dpavlin
 r11686@llin:  dpavlin | 2005-12-14 21:47:54 +0100
 factored out est_ua


Revision 236 - Directory Listing
Modified Tue Dec 6 23:48:11 2005 UTC (18 years, 5 months ago) by dpavlin
 r249@athlon:  dpavlin | 2005-12-07 00:52:43 +0100
 added optional database to load_ds


Revision 234 - Directory Listing
Modified Tue Dec 6 19:41:17 2005 UTC (18 years, 5 months ago) by dpavlin
 r245@athlon:  dpavlin | 2005-12-06 20:45:49 +0100
 added support for YAML lookup format


Revision 233 - Directory Listing
Modified Tue Dec 6 16:40:18 2005 UTC (18 years, 5 months ago) by dpavlin
 r243@athlon:  dpavlin | 2005-12-06 17:44:43 +0100
 support multiple inputs into same database and multiple databases [2.00_1]


Revision 220 - Directory Listing
Modified Mon Dec 5 17:48:14 2005 UTC (18 years, 5 months ago) by dpavlin
 r11542@llin:  dpavlin | 2005-12-05 16:48:07 +0100
 fix path generation /path/to/db/database/prefix#id


Revision 219 - Directory Listing
Modified Mon Dec 5 17:48:08 2005 UTC (18 years, 5 months ago) by dpavlin
 r11541@llin:  dpavlin | 2005-12-05 16:47:44 +0100
 added prefix [0.04]


Revision 218 - Directory Listing
Modified Mon Dec 5 17:48:00 2005 UTC (18 years, 5 months ago) by dpavlin
 r11539@llin:  dpavlin | 2005-12-05 16:18:58 +0100
 WebPAC::Store now uses prefix in load_ds and save_ds and requires database
 when created with new [0.06]


Revision 217 - Directory Listing
Modified Mon Dec 5 17:47:51 2005 UTC (18 years, 5 months ago) by dpavlin
 r11536@llin:  dpavlin | 2005-12-05 15:29:47 +0100
 change on load_ds and save_ds which not accept ONLY hash (and optional
 database name if not specified when calling new WebPAC::Store)


Revision 216 - Directory Listing
Modified Mon Dec 5 17:47:45 2005 UTC (18 years, 5 months ago) by dpavlin
 r11535@llin:  dpavlin | 2005-12-05 15:01:53 +0100
 added depth [0.05]


Revision 215 - Directory Listing
Modified Mon Dec 5 17:47:39 2005 UTC (18 years, 5 months ago) by dpavlin
 r11528@llin:  dpavlin | 2005-12-05 02:30:12 +0100
 create database path if not called with read_only parametar (instead of
 disabling cache) [0.04]


Revision 213 - Directory Listing
Modified Mon Dec 5 17:47:23 2005 UTC (18 years, 5 months ago) by dpavlin
 r11526@llin:  dpavlin | 2005-12-05 02:21:09 +0100
 index multiple input sources in one database


Revision 212 - Directory Listing
Modified Mon Dec 5 17:47:16 2005 UTC (18 years, 5 months ago) by dpavlin
 r11525@llin:  dpavlin | 2005-12-05 01:45:38 +0100
 minor tweaks, tests now pass


Revision 211 - Directory Listing
Modified Mon Dec 5 17:47:10 2005 UTC (18 years, 5 months ago) by dpavlin
 r11523@llin:  dpavlin | 2005-12-05 01:22:00 +0100
 even more changes on the road to controlling Hyper Estraier from perl :-)


Revision 210 - Directory Listing
Modified Mon Dec 5 17:47:04 2005 UTC (18 years, 5 months ago) by dpavlin
 r11519@llin:  dpavlin | 2005-12-05 00:20:06 +0100
 partial changes to support multiple databases


Revision 209 - Directory Listing
Modified Mon Dec 5 17:46:57 2005 UTC (18 years, 5 months ago) by dpavlin
 r11518@llin:  dpavlin | 2005-12-04 19:43:29 +0100
 renamed WebPAC::DB to WebPAC::Store


Revision 201 - Directory Listing
Modified Thu Dec 1 13:58:04 2005 UTC (18 years, 6 months ago) by dpavlin
0.03 - use uri_escape_utf8 which converts (wrongly) ISO-8859-1 to UTF-8


Revision 199 - Directory Listing
Modified Wed Nov 30 23:15:28 2005 UTC (18 years, 6 months ago) by dpavlin
WebPAC::Output::TT 0.02, added search TT filter (which should probably post
data and not get it!)


Revision 177 - Directory Listing
Modified Sun Nov 27 05:02:53 2005 UTC (18 years, 6 months ago) by dpavlin
 r11190@llin:  dpavlin | 2005-11-27 06:05:22 +0100
 reset pages < 1 to 1


Revision 156 - Directory Listing
Modified Sat Nov 26 14:37:33 2005 UTC (18 years, 6 months ago) by dpavlin
 r11150@llin:  dpavlin | 2005-11-26 15:39:52 +0100
 0.03 added support for page parametar to search


Revision 152 - Directory Listing
Modified Sat Nov 26 01:38:28 2005 UTC (18 years, 6 months ago) by dpavlin
 r11141@llin:  dpavlin | 2005-11-26 02:40:29 +0100
 one more debug message (but commented)


Revision 127 - Directory Listing
Modified Thu Nov 24 11:47:29 2005 UTC (18 years, 6 months ago) by dpavlin
 r9091@llin:  dpavlin | 2005-11-24 12:49:05 +0100
 small tweaks


Revision 125 - Directory Listing
Modified Thu Nov 24 11:47:15 2005 UTC (18 years, 6 months ago) by dpavlin
 r9089@llin:  dpavlin | 2005-11-24 12:47:02 +0100
 fixed for new Webpac::DB 0.02


Revision 124 - Directory Listing
Modified Thu Nov 24 11:47:10 2005 UTC (18 years, 6 months ago) by dpavlin
 r9088@llin:  dpavlin | 2005-11-24 12:20:36 +0100
 API 0.02: load_ds and save_ds now accept id => 42 as arguments


Revision 123 - Directory Listing
Modified Wed Nov 23 21:53:01 2005 UTC (18 years, 6 months ago) by dpavlin
 r9074@llin:  dpavlin | 2005-11-23 22:21:48 +0100
 fixes


Revision 122 - Directory Listing
Modified Wed Nov 23 21:52:55 2005 UTC (18 years, 6 months ago) by dpavlin
 r9072@llin:  dpavlin | 2005-11-23 21:31:14 +0100
 API 0.02: changed and added options to match Hyper Estraier's API


Revision 113 - Directory Listing
Modified Wed Nov 23 00:14:05 2005 UTC (18 years, 6 months ago) by dpavlin
 r9064@llin:  dpavlin | 2005-11-23 01:15:24 +0100
 minor tweak for database routines, run.pl now iterates through all entries
 (to fix problem with stopping at first deleted entry)


Revision 103 - Directory Listing
Modified Tue Nov 22 16:11:48 2005 UTC (18 years, 6 months ago) by dpavlin
 r9045@llin:  dpavlin | 2005-11-22 17:13:16 +0100
 less debug output


Revision 89 - Directory Listing
Modified Tue Nov 22 08:37:55 2005 UTC (18 years, 6 months ago) by dpavlin
 r9018@llin:  dpavlin | 2005-11-22 09:39:08 +0100
 begin to remove current_filename and headline


Revision 87 - Directory Listing
Modified Tue Nov 22 08:37:45 2005 UTC (18 years, 6 months ago) by dpavlin
 r9012@llin:  dpavlin | 2005-11-21 22:25:45 +0100
 move $log->logconfess to $self->confess so that Catalyst works


Revision 86 - Directory Listing
Modified Tue Nov 22 08:37:40 2005 UTC (18 years, 6 months ago) by dpavlin
 r9010@llin:  dpavlin | 2005-11-21 20:48:59 +0100
 make it less chatty


Revision 85 - Directory Listing
Modified Tue Nov 22 08:27:53 2005 UTC (18 years, 6 months ago) by dpavlin
fixed logdie


Revision 81 - Directory Listing
Modified Mon Nov 21 14:42:22 2005 UTC (18 years, 6 months ago) by dpavlin
 r9002@llin:  dpavlin | 2005-11-21 15:43:39 +0100
 Text::Iconv working, fixed tests, minor tweaks


Revision 80 - Directory Listing
Modified Mon Nov 21 14:42:16 2005 UTC (18 years, 6 months ago) by dpavlin
 r9001@llin:  dpavlin | 2005-11-21 15:29:13 +0100
 added WebPAC::Search::Estraier which should be callable from outside
 WebPAC (e.g. Catalyst)


Revision 75 - Directory Listing
Modified Sun Nov 20 20:32:41 2005 UTC (18 years, 6 months ago) by dpavlin
 r8991@llin:  dpavlin | 2005-11-20 21:33:38 +0100
 finished Text::Iconv support


Revision 74 - Directory Listing
Modified Sun Nov 20 20:13:39 2005 UTC (18 years, 6 months ago) by dpavlin
 r8988@llin:  dpavlin | 2005-11-20 20:46:12 +0100
 added real implementation for WebPAC::Output::Estraier along with run.pl
 script which run test indexing (which will in one point move to
 WebPAC::Simple or something like that)


Revision 73 - Directory Listing
Modified Sun Nov 20 20:13:33 2005 UTC (18 years, 6 months ago) by dpavlin
 r8987@llin:  dpavlin | 2005-11-20 13:24:44 +0100
 fixed logging


Revision 70 - Directory Listing
Modified Sat Nov 19 23:48:24 2005 UTC (18 years, 6 months ago) by dpavlin
 r8980@llin:  dpavlin | 2005-11-20 00:49:22 +0100
 implement data_structure that returns HASH and not ARRAY.
 
 Little explanation for this rationale:
 
 Array was needed back in WebPAC v1 because order of tags in import_xml was
 important. However, since we are no longer depending on order of tags in
 input/*.xml, hash is much better choice.


Revision 64 - Directory Listing
Modified Tue Nov 15 16:56:44 2005 UTC (18 years, 6 months ago) by dpavlin
 r8894@llin:  dpavlin | 2005-11-15 17:56:56 +0100
 fixed WebPAC::Normalize::get_data to work when called with subfield which
 doesn't exist, added tests


Revision 62 - Directory Listing
Modified Tue Nov 15 14:31:12 2005 UTC (18 years, 6 months ago) by dpavlin
 r8884@llin:  dpavlin | 2005-11-15 14:46:07 +0100
 fix small warnings


Revision 50 - Directory Listing
Modified Mon Nov 14 16:15:45 2005 UTC (18 years, 6 months ago) by dpavlin
 r8859@llin:  dpavlin | 2005-11-14 13:37:51 +0100
 non-existing record in load_ds return undef


Revision 45 - Directory Listing
Modified Mon Nov 14 16:12:43 2005 UTC (18 years, 6 months ago) by dpavlin
 r8854@llin:  dpavlin | 2005-11-14 01:45:01 +0100
 removed debugging, added documentation (improvement, eh?)


Revision 44 - Directory Listing
Modified Mon Nov 14 16:12:20 2005 UTC (18 years, 6 months ago) by dpavlin
 r8853@llin:  dpavlin | 2005-11-14 01:41:33 +0100
 added read_only mode


Revision 43 - Directory Listing
Modified Mon Nov 14 16:12:01 2005 UTC (18 years, 6 months ago) by dpavlin
 r8852@llin:  dpavlin | 2005-11-13 23:55:23 +0100
 generalize TT filter to tt_filter_type; d('Tag') = display in TT


Revision 42 - Directory Listing
Modified Mon Nov 14 16:11:40 2005 UTC (18 years, 6 months ago) by dpavlin
 r8851@llin:  dpavlin | 2005-11-13 22:18:25 +0100
 more work on templates. created TT filter d('TagName') to produce output in
 TT templates with type="display". Full notation is:
 
 d('TagName') or d('TagName','delmiter')
 


Revision 40 - Directory Listing
Modified Sat Nov 12 21:32:03 2005 UTC (18 years, 6 months ago) by dpavlin
confess, not die


Revision 39 - Directory Listing
Modified Sat Nov 12 21:31:47 2005 UTC (18 years, 6 months ago) by dpavlin
check for current_filename and die if need (needs more work)


Revision 38 - Directory Listing
Modified Sat Nov 12 21:21:50 2005 UTC (18 years, 6 months ago) by dpavlin
added ForceContent so that tags without attributes work, added strict checking


Revision 33 - Directory Listing
Modified Sun Jul 24 15:35:46 2005 UTC (18 years, 10 months ago) by dpavlin
fix


Revision 32 - Directory Listing
Modified Sun Jul 24 15:07:56 2005 UTC (18 years, 10 months ago) by dpavlin
fix


Revision 31 - Directory Listing
Modified Sun Jul 24 15:03:11 2005 UTC (18 years, 10 months ago) by dpavlin
re-worked logging, added no_log option to disable logging


Revision 30 - Directory Listing
Modified Sun Jul 24 14:20:59 2005 UTC (18 years, 10 months ago) by dpavlin
move data to $self->{'_lookup_data'} and document that


Revision 29 - Directory Listing
Modified Sun Jul 24 11:17:44 2005 UTC (18 years, 10 months ago) by dpavlin
some logging improvements and sample configuration file


Revision 22 - Directory Listing
Modified Sun Jul 17 22:48:25 2005 UTC (18 years, 10 months ago) by dpavlin
beginning of unit testing and various fixes


Revision 21 - Directory Listing
Modified Sun Jul 17 22:28:11 2005 UTC (18 years, 10 months ago) by dpavlin
fixed ISIS size


Revision 19 - Directory Listing
Modified Sun Jul 17 15:04:39 2005 UTC (18 years, 10 months ago) by dpavlin
some cleanups and bugfixes


Revision 18 - Directory Listing
Modified Sun Jul 17 14:53:37 2005 UTC (18 years, 10 months ago) by dpavlin
first cut into WebPAC::DB


Revision 16 - Directory Listing
Modified Sun Jul 17 11:37:07 2005 UTC (18 years, 10 months ago) by dpavlin
Added Output::WebPAC::TT to produce Template Toolkit output.


Revision 15 - Directory Listing
Modified Sun Jul 17 10:42:23 2005 UTC (18 years, 10 months ago) by dpavlin
WebPAC::Common cleanup, most code moved to WebPAC::Normalize. Added
documentation about order of data mungling when normalising data.


Revision 14 - Directory Listing
Modified Sun Jul 17 00:04:25 2005 UTC (18 years, 10 months ago) by dpavlin
small fixes


Revision 13 - Directory Listing
Modified Sat Jul 16 23:56:14 2005 UTC (18 years, 10 months ago) by dpavlin
data_source seems to work


Revision 12 - Directory Listing
Modified Sat Jul 16 22:57:26 2005 UTC (18 years, 10 months ago) by dpavlin
improvements to WebPAC::Normalize::XML


Revision 11 - Directory Listing
Modified Sat Jul 16 20:54:28 2005 UTC (18 years, 10 months ago) by dpavlin
fix


Revision 10 - Directory Listing
Modified Sat Jul 16 20:35:30 2005 UTC (18 years, 10 months ago) by dpavlin
ISIS input is finished, low_mem option has code (and not only documentation :-)


Revision 9 - Directory Listing
Modified Sat Jul 16 17:14:43 2005 UTC (18 years, 10 months ago) by dpavlin
a bit more work on WebPAC::Input::ISIS


Revision 8 - Directory Listing
Modified Sat Jul 16 16:48:35 2005 UTC (18 years, 10 months ago) by dpavlin
little cleanup and first cut into WebPAC::Normalize::XML


Revision 7 - Directory Listing
Modified Sat Jul 16 16:00:19 2005 UTC (18 years, 10 months ago) by dpavlin
lookups cleanup


Revision 6 - Directory Listing
Modified Sat Jul 16 14:44:38 2005 UTC (18 years, 10 months ago) by dpavlin
added WebPAC::Input::ISIS


Revision 4 - Directory Listing
Modified Sat Jul 16 12:37:18 2005 UTC (18 years, 10 months ago) by dpavlin
more work on lookups, example configuration layout


Revision 3 - Directory Listing
Modified Sat Jul 16 11:07:38 2005 UTC (18 years, 10 months ago) by dpavlin
moved implementation of lookups from older code-base


Revision 1 - Directory Listing
Added Sat Jun 25 20:23:23 2005 UTC (18 years, 11 months ago) by dpavlin
initial import of some documentation and module structure


  ViewVC Help
Powered by ViewVC 1.1.26