/[Sack]/trunk/bin/sack.pl
This is repository of my old source code which isn't updated any more. Go to git.rot13.org for current projects!
ViewVC logotype

Log of /trunk/bin/sack.pl

Parent Directory Parent Directory | Revision Log Revision Log


Sticky Revision:
(Current path doesn't exist after revision 113)

Revision 91 - (view) (annotate) - [select for diffs]
Modified Sat Oct 3 21:08:36 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 11374 byte(s)
Diff to previous 89
use $digest_module for remote digests

Revision 89 - (view) (annotate) - [select for diffs]
Modified Wed Sep 30 19:53:29 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 11372 byte(s)
Diff to previous 87
exit on CTRL+D

Revision 87 - (view) (annotate) - [select for diffs]
Modified Wed Sep 30 19:30:45 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 11331 byte(s)
Diff to previous 84
use SACK_DIGEST to configure digest module

Revision 84 - (view) (annotate) - [select for diffs]
Modified Tue Sep 29 16:54:05 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 11135 byte(s)
Diff to previous 82
speedup 10% by evaling one once into coderef


Revision 82 - (view) (annotate) - [select for diffs]
Modified Sat Sep 26 12:32:30 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 11029 byte(s)
Diff to previous 81
colorize ports in all messages, version bump [0.06]


Revision 81 - (view) (annotate) - [select for diffs]
Modified Sat Sep 26 10:40:05 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 10821 byte(s)
Diff to previous 80
use ansi colors for port numbers in warn messages

Revision 80 - (view) (annotate) - [select for diffs]
Modified Sat Sep 26 10:14:03 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 10527 byte(s)
Diff to previous 79
huge speedup using $merge_digest_mapping to keep information in-memory
between view runs


Revision 79 - (view) (annotate) - [select for diffs]
Modified Fri Sep 25 23:22:32 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 10262 byte(s)
Diff to previous 76
fix digest output

Revision 76 - (view) (annotate) - [select for diffs]
Modified Fri Sep 25 21:12:46 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 10196 byte(s)
Diff to previous 75
wait for all nodes before sending view

Revision 75 - (view) (annotate) - [select for diffs]
Modified Fri Sep 25 20:31:38 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 10062 byte(s)
Diff to previous 74
store pid file and kill existing sack, close socket to client

Revision 74 - (view) (annotate) - [select for diffs]
Modified Fri Sep 25 18:52:58 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 9867 byte(s)
Diff to previous 72
record all report output (reformatted) and show it with "i r" command,
version bump [0.05]


Revision 72 - (view) (annotate) - [select for diffs]
Modified Fri Sep 25 16:47:49 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 9430 byte(s)
Diff to previous 68
don't pull file from node if it's here

Revision 68 - (view) (annotate) - [select for diffs]
Modified Fri Sep 25 16:29:14 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 9431 byte(s)
Diff to previous 67
fix digest/s

Revision 67 - (view) (annotate) - [select for diffs]
Modified Fri Sep 25 14:35:54 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 9431 byte(s)
Diff to previous 64
tweaks to merge output, reopen digest on node after transfer

Revision 64 - (view) (annotate) - [select for diffs]
Modified Fri Sep 25 14:01:31 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 9181 byte(s)
Diff to previous 60
ship files over socket with client

Revision 60 - (view) (annotate) - [select for diffs]
Modified Fri Sep 25 13:02:32 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 8005 byte(s)
Diff to previous 59
tweaks in output, fix (add) node

Revision 59 - (view) (annotate) - [select for diffs]
Modified Fri Sep 25 12:24:42 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 7986 byte(s)
Diff to previous 58
print merge ticks

Revision 58 - (view) (annotate) - [select for diffs]
Modified Fri Sep 25 12:24:19 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 7876 byte(s)
Diff to previous 56
print send/receive only if smaller than 1k or with debug

Revision 56 - (view) (annotate) - [select for diffs]
Modified Fri Sep 25 10:05:45 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 7846 byte(s)
Diff to previous 55
define node just by port, we are using ssh anyway

Revision 55 - (view) (annotate) - [select for diffs]
Modified Fri Sep 25 09:38:48 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 7818 byte(s)
Diff to previous 53
added node command to add node

Revision 53 - (view) (annotate) - [select for diffs]
Modified Thu Sep 24 20:14:27 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 7747 byte(s)
Diff to previous 51
re-added $digest->sync so we see data in storableedit.pl

Revision 51 - (view) (annotate) - [select for diffs]
Modified Thu Sep 24 19:45:08 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 7730 byte(s)
Diff to previous 50
simplify and fix prefix extraction

Revision 50 - (view) (annotate) - [select for diffs]
Modified Thu Sep 24 19:21:55 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 7739 byte(s)
Diff to previous 46
merge digests from other nodes, version bump [0.04]


Revision 46 - (view) (annotate) - [select for diffs]
Modified Thu Sep 24 13:46:16 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 7040 byte(s)
Diff to previous 45
display just unique part of filename, sync digest to disk on end of view


Revision 45 - (view) (annotate) - [select for diffs]
Modified Thu Sep 24 13:37:53 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 7026 byte(s)
Diff to previous 41
turn Sack::Digest into normal perl object with new instead of open


Revision 41 - (view) (annotate) - [select for diffs]
Modified Thu Sep 24 00:00:24 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 7029 byte(s)
Diff to previous 40
better output

Revision 40 - (view) (annotate) - [select for diffs]
Modified Wed Sep 23 23:54:38 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 7024 byte(s)
Diff to previous 37
display real position in ticks

Revision 37 - (view) (annotate) - [select for diffs]
Modified Wed Sep 23 23:10:50 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 7033 byte(s)
Diff to previous 36
added unmungling to storableedit.pl

Revision 36 - (view) (annotate) - [select for diffs]
Modified Wed Sep 23 22:22:18 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 7011 byte(s)
Diff to previous 35
undigest_out, document digest key names, version bump [0.03]

Revision 35 - (view) (annotate) - [select for diffs]
Modified Wed Sep 23 21:55:08 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 7001 byte(s)
Diff to previous 33
dump output if smaller than 4k, extracted info_tabs and added files


Revision 33 - (view) (annotate) - [select for diffs]
Modified Wed Sep 23 20:28:21 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 6840 byte(s)
Diff to previous 31
extract Sack::Digest into own package and test it


Revision 31 - (view) (annotate) - [select for diffs]
Modified Wed Sep 23 18:51:32 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 7307 byte(s)
Diff to previous 30
fix SAVE output

Revision 30 - (view) (annotate) - [select for diffs]
Modified Wed Sep 23 18:44:08 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 7314 byte(s)
Diff to previous 28
- added external B-tree using BerkeleyDB::Btree on /dev/shm for efficiat digest to integer
- version bump [0.02]
- cleanup output to always start with $port for easy overview
- display ticks every 1000 and 10000 records while processing view
- don't serialize output with Data::Dump, use Storable instead to save it on disk
- extracted info into sub


Revision 28 - (view) (annotate) - [select for diffs]
Modified Tue Sep 22 22:28:40 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 6629 byte(s)
Diff to previous 26
use md5 digest to solve first memory problem with C1, but not with CR yet

Revision 26 - (view) (annotate) - [select for diffs]
Modified Tue Sep 22 21:45:04 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 6604 byte(s)
Diff to previous 25
no backtrace from warn

Revision 25 - (view) (annotate) - [select for diffs]
Modified Tue Sep 22 21:38:31 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 6602 byte(s)
Diff to previous 24
display number of records loaded

Revision 24 - (view) (annotate) - [select for diffs]
Modified Tue Sep 22 21:27:13 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 6487 byte(s)
Diff to previous 22
don't parse subfields in WebPAC::Input::ISI for nice memory usage
check if we got anything from client before unserializing it


Revision 22 - (view) (annotate) - [select for diffs]
Modified Tue Sep 22 17:19:25 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 6333 byte(s)
Diff to previous 21
fix output

Revision 21 - (view) (annotate) - [select for diffs]
Modified Tue Sep 22 17:15:03 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 6306 byte(s)
Diff to previous 20
- added $VERSION [0.01]
- exit connected nodes on SIGINT
- fix merge when shards produce array of values
- make code display debug option
- listen on 127.0.0.1 (we are using ssh tunnels anyway)
- changed commands a bit and added interactive help on h or ?


Revision 20 - (view) (annotate) - [select for diffs]
Modified Tue Sep 22 16:02:49 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 5619 byte(s)
Diff to previous 19
abort on first error

Revision 19 - (view) (annotate) - [select for diffs]
Modified Tue Sep 22 15:14:00 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 5610 byte(s)
Diff to previous 17
added --debug and move some output to it

Revision 17 - (view) (annotate) - [select for diffs]
Modified Tue Sep 22 13:40:02 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 5584 byte(s)
Diff to previous 16
fix warning

Revision 16 - (view) (annotate) - [select for diffs]
Modified Tue Sep 22 13:32:04 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 5580 byte(s)
Diff to previous 14
- support send_nodes without content playload
- warn about nodes which go away or can't be connected to (instead of die)
- get_node to fetch data over $connected socket to node (opened by send_nodes)
- send_sock to send data to node over socket
- added info command to get overwiew of sharding


Revision 14 - (view) (annotate) - [select for diffs]
Modified Tue Sep 22 10:40:32 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 4685 byte(s)
Diff to previous 13
fix prefix

Revision 13 - (view) (annotate) - [select for diffs]
Modified Tue Sep 22 10:32:59 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 4685 byte(s)
Diff to previous 12
ship results from node using Storable, merge results
(with support of + in key name to make sum)


Revision 12 - (view) (annotate) - [select for diffs]
Modified Tue Sep 22 10:00:22 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 3509 byte(s)
Diff to previous 11
find $prefix of our installation and use it


Revision 11 - (view) (annotate) - [select for diffs]
Modified Mon Sep 21 23:21:34 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 3294 byte(s)
Diff to previous 10
implement --listen port and --connect host:port to create master-slave cluster
(err, cloud) of nodes and implement send_nodes to send view to each node

added info to see connected views to commands and allow abbrivitation to single character


Revision 10 - (view) (annotate) - [select for diffs]
Modified Mon Sep 21 20:32:51 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 2016 byte(s)
Diff to previous 9
reset time on each call of report

Revision 9 - (view) (annotate) - [select for diffs]
Modified Mon Sep 21 20:05:41 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 2004 byte(s)
Diff to previous 8
fix offset and limit, rename last out/ dump to out/*.last


Revision 8 - (view) (annotate) - [select for diffs]
Modified Mon Sep 21 19:36:32 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 1918 byte(s)
Diff to previous 6
make in-memory cache local


Revision 6 - (view) (annotate) - [select for diffs]
Modified Mon Sep 21 15:41:30 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 1886 byte(s)
Diff to previous 5
added --view which can be repeated

Revision 5 - (view) (annotate) - [select for diffs]
Modified Mon Sep 21 15:36:47 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 1835 byte(s)
Diff to previous 4
display affected records and warning about empty $out

Revision 4 - (view) (annotate) - [select for diffs]
Modified Sun Sep 20 20:08:11 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 1574 byte(s)
Diff to previous 3
configurable --path, --offset and --limit


Revision 3 - (view) (annotate) - [select for diffs]
Modified Sun Sep 20 18:55:34 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 1385 byte(s)
Diff to previous 1
open out/* in vi with any of commands: vi \e out


Revision 1 - (view) (annotate) - [select for diffs]
Added Sun Sep 20 18:42:07 2009 UTC (14 years, 7 months ago) by dpavlin
File length: 1287 byte(s)
Sack - in-memory interactive object database in pure perl


This form allows you to request diffs between any two revisions of this file. For each of the two "sides" of the diff, enter a numeric revision.

  Diffs between and
  Type of Diff should be a

  ViewVC Help
Powered by ViewVC 1.1.26