/[Sack]/trunk/bin
This is repository of my old source code which isn't updated any more. Go to git.rot13.org for current projects!
ViewVC logotype

Log of /trunk/bin

View Directory Listing Directory Listing

Sticky Revision:
Revision 276 - Directory Listing
Modified Fri Apr 30 14:34:49 2010 UTC (14 years ago) by dpavlin 
pass sack_port as second argument to client

bin/split.sh can again start two nodes on localhost
Revision 261 - Directory Listing
Modified Sun Jan 31 16:44:33 2010 UTC (14 years, 3 months ago) by dpavlin 
import everything from pxelator
Revision 257 - Directory Listing
Modified Tue Jan 26 17:34:19 2010 UTC (14 years, 3 months ago) by dpavlin 
create shards from MongoDB
Revision 256 - Directory Listing
Modified Tue Jan 26 16:55:10 2010 UTC (14 years, 3 months ago) by dpavlin 
split shard creation in Sack::Shard
Revision 243 - Directory Listing
Modified Thu Nov 26 18:14:43 2009 UTC (14 years, 5 months ago) by dpavlin 
take just document from json response
Revision 242 - Directory Listing
Modified Thu Nov 26 17:32:38 2009 UTC (14 years, 5 months ago) by dpavlin 
use CouchDB Bulk Document API

speedup from 800 docs/s to 1800 docs/s... not bad :-)
Revision 239 - Directory Listing
Modified Thu Nov 26 13:44:47 2009 UTC (14 years, 5 months ago) by dpavlin 
cleanup sharding from WebPAC and allow user-defined name
Revision 238 - Directory Listing
Modified Tue Nov 24 15:21:09 2009 UTC (14 years, 5 months ago) by dpavlin 
increase shard size to 5000 records
Revision 215 - Directory Listing
Modified Sun Nov 22 17:12:27 2009 UTC (14 years, 5 months ago) by dpavlin 
added gnuplot grapher
Revision 207 - Directory Listing
Modified Sat Nov 21 13:34:53 2009 UTC (14 years, 5 months ago) by dpavlin 
align columns and fix calculations
Revision 206 - Directory Listing
Modified Sat Nov 21 13:21:34 2009 UTC (14 years, 5 months ago) by dpavlin 
display percent, records/s and estimated time
Revision 201 - Directory Listing
Modified Sun Nov 8 20:36:23 2009 UTC (14 years, 5 months ago) by dpavlin 
dump CouchDB into 1000 record shards
Revision 194 - Directory Listing
Modified Sun Nov 8 16:14:53 2009 UTC (14 years, 5 months ago) by dpavlin 
shard size as argument
Revision 190 - Directory Listing
Modified Sun Nov 8 13:44:24 2009 UTC (14 years, 5 months ago) by dpavlin 
start server and repl using splitvt
Revision 187 - Directory Listing
Modified Sun Nov 8 13:38:11 2009 UTC (14 years, 5 months ago) by dpavlin 
cleanup sharding and move shards to /tmp/sack/name/
Revision 186 - Directory Listing
Modified Sun Nov 8 13:21:01 2009 UTC (14 years, 5 months ago) by dpavlin 
shart input data into 1000 record shards
Revision 157 - Directory Listing
Modified Fri Oct 9 19:32:39 2009 UTC (14 years, 6 months ago) by dpavlin 
add --install to update all nodes in cloud
Revision 150 - Directory Listing
Modified Fri Oct 9 17:10:54 2009 UTC (14 years, 6 months ago) by dpavlin 
fix warning
Revision 146 - Directory Listing
Modified Wed Oct 7 23:11:03 2009 UTC (14 years, 6 months ago) by dpavlin 
move start_nodes and load_nodes to Sack::Lorry [0.11]
Revision 137 - Directory Listing
Modified Wed Oct 7 18:30:22 2009 UTC (14 years, 6 months ago) by dpavlin 
move commands to Sack::Lorry
Revision 135 - Directory Listing
Modified Wed Oct 7 17:57:50 2009 UTC (14 years, 6 months ago) by dpavlin 
extract duration into Sack, unify versioning [0.10]
Revision 127 - Directory Listing
Modified Wed Oct 7 16:21:33 2009 UTC (14 years, 6 months ago) by dpavlin 
better recovery from node storable serialization errors,
faster cloud startup, 
added common pid handling,
added [u]pdate to lorry which push updated code to nodes,
tweaks to output,
version bump for Sack::Node [0.08]
Revision 126 - Directory Listing
Modified Wed Oct 7 14:15:56 2009 UTC (14 years, 6 months ago) by dpavlin 
process each node once
Revision 125 - Directory Listing
Modified Wed Oct 7 14:15:06 2009 UTC (14 years, 6 months ago) by dpavlin 
process each node just once
Revision 122 - Directory Listing
Modified Wed Oct 7 12:29:12 2009 UTC (14 years, 6 months ago) by dpavlin 
execute command on each host using ssh
Revision 119 - Directory Listing
Modified Tue Oct 6 23:04:45 2009 UTC (14 years, 6 months ago) by dpavlin 
new commands: [r]estart, [sh]ell, [i]nfo [0.08]
Revision 114 - Directory Listing
Modified Mon Oct 5 23:55:06 2009 UTC (14 years, 6 months ago) by dpavlin 
remove incompatible version 0.06
Revision 113 - Directory Listing
Modified Mon Oct 5 23:53:46 2009 UTC (14 years, 6 months ago) by dpavlin 
added x for exit
Revision 112 - Directory Listing
Modified Mon Oct 5 23:53:12 2009 UTC (14 years, 6 months ago) by dpavlin 
unconditinaly copy files to nodes
Revision 110 - Directory Listing
Modified Mon Oct 5 23:20:43 2009 UTC (14 years, 6 months ago) by dpavlin 
implement v(iew) d(dump) commands
Revision 108 - Directory Listing
Modified Mon Oct 5 22:38:58 2009 UTC (14 years, 6 months ago) by dpavlin 
without params use just single localhost node
Revision 107 - Directory Listing
Modified Mon Oct 5 22:21:39 2009 UTC (14 years, 6 months ago) by dpavlin 
move ping to Sack::Lorry, display duration of operations and
implement new configuration in etc
Revision 106 - Directory Listing
Modified Mon Oct 5 22:19:54 2009 UTC (14 years, 6 months ago) by dpavlin 
simpliest possible push to nodes (on which we run dropbear, so no scp or rsync)
Revision 105 - Directory Listing
Modified Mon Oct 5 22:19:12 2009 UTC (14 years, 6 months ago) by dpavlin 
ping all hosts in cloud
Revision 102 - Directory Listing
Modified Mon Oct 5 20:31:28 2009 UTC (14 years, 6 months ago) by dpavlin 
color [port] in warn messages
Revision 101 - Directory Listing
Modified Mon Oct 5 19:34:45 2009 UTC (14 years, 6 months ago) by dpavlin 
test nodes with Net::Ping
Revision 100 - Directory Listing
Modified Sun Oct 4 14:42:48 2009 UTC (14 years, 6 months ago) by dpavlin 
re-run query repl
Revision 97 - Directory Listing
Modified Sun Oct 4 13:09:28 2009 UTC (14 years, 6 months ago) by dpavlin 
re-implement merge of results
Revision 96 - Directory Listing
Modified Sun Oct 4 12:50:10 2009 UTC (14 years, 6 months ago) by dpavlin 
rsync latest sack to nodes on startup
Revision 95 - Directory Listing
Modified Sun Oct 4 12:17:52 2009 UTC (14 years, 6 months ago) by dpavlin 
make correct shards
Revision 93 - Directory Listing
Modified Sat Oct 3 21:43:34 2009 UTC (14 years, 6 months ago) by dpavlin 
run simple view
Revision 92 - Directory Listing
Modified Sat Oct 3 21:09:51 2009 UTC (14 years, 6 months ago) by dpavlin 
begin refactor to lorry which will carry sacks for us
(creating nodes and communicating with them using Storable
traveling over sockets)
Revision 91 - Directory Listing
Modified Sat Oct 3 21:08:36 2009 UTC (14 years, 6 months ago) by dpavlin 
use $digest_module for remote digests
Revision 89 - Directory Listing
Modified Wed Sep 30 19:53:29 2009 UTC (14 years, 7 months ago) by dpavlin 
exit on CTRL+D
Revision 87 - Directory Listing
Modified Wed Sep 30 19:30:45 2009 UTC (14 years, 7 months ago) by dpavlin 
use SACK_DIGEST to configure digest module
Revision 84 - Directory Listing
Modified Tue Sep 29 16:54:05 2009 UTC (14 years, 7 months ago) by dpavlin 
speedup 10% by evaling one once into coderef
Revision 83 - Directory Listing
Modified Sat Sep 26 12:33:04 2009 UTC (14 years, 7 months ago) by dpavlin 
start cluster after update and cleanup
Revision 82 - Directory Listing
Modified Sat Sep 26 12:32:30 2009 UTC (14 years, 7 months ago) by dpavlin 
colorize ports in all messages, version bump [0.06]
Revision 81 - Directory Listing
Modified Sat Sep 26 10:40:05 2009 UTC (14 years, 7 months ago) by dpavlin 
use ansi colors for port numbers in warn messages
Revision 80 - Directory Listing
Modified Sat Sep 26 10:14:03 2009 UTC (14 years, 7 months ago) by dpavlin 
huge speedup using $merge_digest_mapping to keep information in-memory
between view runs
Revision 79 - Directory Listing
Modified Fri Sep 25 23:22:32 2009 UTC (14 years, 7 months ago) by dpavlin 
fix digest output
Revision 78 - Directory Listing
Modified Fri Sep 25 21:32:20 2009 UTC (14 years, 7 months ago) by dpavlin 
exit after update
Revision 77 - Directory Listing
Modified Fri Sep 25 21:13:25 2009 UTC (14 years, 7 months ago) by dpavlin 
use separate ssh session for sacks
Revision 76 - Directory Listing
Modified Fri Sep 25 21:12:46 2009 UTC (14 years, 7 months ago) by dpavlin 
wait for all nodes before sending view
Revision 75 - Directory Listing
Modified Fri Sep 25 20:31:38 2009 UTC (14 years, 7 months ago) by dpavlin 
store pid file and kill existing sack, close socket to client
Revision 74 - Directory Listing
Modified Fri Sep 25 18:52:58 2009 UTC (14 years, 7 months ago) by dpavlin 
record all report output (reformatted) and show it with "i r" command,
version bump [0.05]
Revision 73 - Directory Listing
Modified Fri Sep 25 18:51:42 2009 UTC (14 years, 7 months ago) by dpavlin 
fix verbosity and enlarge t61p cloud
Revision 72 - Directory Listing
Modified Fri Sep 25 16:47:49 2009 UTC (14 years, 7 months ago) by dpavlin 
don't pull file from node if it's here
Revision 71 - Directory Listing
Modified Fri Sep 25 16:37:11 2009 UTC (14 years, 7 months ago) by dpavlin 
add hostname to xterm title before port
Revision 70 - Directory Listing
Modified Fri Sep 25 16:36:24 2009 UTC (14 years, 7 months ago) by dpavlin 
trigger view from shell
Revision 69 - Directory Listing
Modified Fri Sep 25 16:29:38 2009 UTC (14 years, 7 months ago) by dpavlin 
start xterms if $DISPLAY is set
Revision 68 - Directory Listing
Modified Fri Sep 25 16:29:14 2009 UTC (14 years, 7 months ago) by dpavlin 
fix digest/s
Revision 67 - Directory Listing
Modified Fri Sep 25 14:35:54 2009 UTC (14 years, 7 months ago) by dpavlin 
tweaks to merge output, reopen digest on node after transfer
Revision 65 - Directory Listing
Modified Fri Sep 25 14:01:48 2009 UTC (14 years, 7 months ago) by dpavlin 
cleanup /dev/shm/sack.* before start
Revision 64 - Directory Listing
Modified Fri Sep 25 14:01:31 2009 UTC (14 years, 7 months ago) by dpavlin 
ship files over socket with client
Revision 63 - Directory Listing
Modified Fri Sep 25 13:49:42 2009 UTC (14 years, 7 months ago) by dpavlin 
force exit of running sack(s), use port only at connect
Revision 62 - Directory Listing
Modified Fri Sep 25 13:16:04 2009 UTC (14 years, 7 months ago) by dpavlin 
make general cloud.sh starter
Revision 61 - Directory Listing
Modified Fri Sep 25 13:15:13 2009 UTC (14 years, 7 months ago) by dpavlin 
rename
Revision 60 - Directory Listing
Modified Fri Sep 25 13:02:32 2009 UTC (14 years, 7 months ago) by dpavlin 
tweaks in output, fix (add) node
Revision 59 - Directory Listing
Modified Fri Sep 25 12:24:42 2009 UTC (14 years, 7 months ago) by dpavlin 
print merge ticks
Revision 58 - Directory Listing
Modified Fri Sep 25 12:24:19 2009 UTC (14 years, 7 months ago) by dpavlin 
print send/receive only if smaller than 1k or with debug
Revision 57 - Directory Listing
Modified Fri Sep 25 10:07:04 2009 UTC (14 years, 7 months ago) by dpavlin 
new connect with just port
Revision 56 - Directory Listing
Modified Fri Sep 25 10:05:45 2009 UTC (14 years, 7 months ago) by dpavlin 
define node just by port, we are using ssh anyway
Revision 55 - Directory Listing
Modified Fri Sep 25 09:38:48 2009 UTC (14 years, 7 months ago) by dpavlin 
added node command to add node
Revision 53 - Directory Listing
Modified Thu Sep 24 20:14:27 2009 UTC (14 years, 7 months ago) by dpavlin 
re-added $digest->sync so we see data in storableedit.pl
Revision 51 - Directory Listing
Modified Thu Sep 24 19:45:08 2009 UTC (14 years, 7 months ago) by dpavlin 
simplify and fix prefix extraction
Revision 50 - Directory Listing
Modified Thu Sep 24 19:21:55 2009 UTC (14 years, 7 months ago) by dpavlin 
merge digests from other nodes, version bump [0.04]
Revision 49 - Directory Listing
Modified Thu Sep 24 17:44:25 2009 UTC (14 years, 7 months ago) by dpavlin 
killall sack.pl before start
Revision 46 - Directory Listing
Modified Thu Sep 24 13:46:16 2009 UTC (14 years, 7 months ago) by dpavlin 
display just unique part of filename, sync digest to disk on end of view
Revision 45 - Directory Listing
Modified Thu Sep 24 13:37:53 2009 UTC (14 years, 7 months ago) by dpavlin 
turn Sack::Digest into normal perl object with new instead of open
Revision 44 - Directory Listing
Modified Thu Sep 24 12:48:08 2009 UTC (14 years, 7 months ago) by dpavlin 
Sack::Digest now uses md5 sum of value for btree and array, so
we store full value only once
Revision 41 - Directory Listing
Modified Thu Sep 24 00:00:24 2009 UTC (14 years, 7 months ago) by dpavlin 
better output
Revision 40 - Directory Listing
Modified Wed Sep 23 23:54:38 2009 UTC (14 years, 7 months ago) by dpavlin 
display real position in ticks
Revision 39 - Directory Listing
Modified Wed Sep 23 23:52:40 2009 UTC (14 years, 7 months ago) by dpavlin 
leave to interactive lorry second part of set so it can have less records than
node because it needs also to merge them
Revision 38 - Directory Listing
Modified Wed Sep 23 23:26:08 2009 UTC (14 years, 7 months ago) by dpavlin 
easy to start configuration for dual-core machine
Revision 37 - Directory Listing
Modified Wed Sep 23 23:10:50 2009 UTC (14 years, 7 months ago) by dpavlin 
added unmungling to storableedit.pl
Revision 36 - Directory Listing
Modified Wed Sep 23 22:22:18 2009 UTC (14 years, 7 months ago) by dpavlin 
undigest_out, document digest key names, version bump [0.03]
Revision 35 - Directory Listing
Modified Wed Sep 23 21:55:08 2009 UTC (14 years, 7 months ago) by dpavlin 
dump output if smaller than 4k, extracted info_tabs and added files
Revision 33 - Directory Listing
Modified Wed Sep 23 20:28:21 2009 UTC (14 years, 7 months ago) by dpavlin 
extract Sack::Digest into own package and test it
Revision 32 - Directory Listing
Modified Wed Sep 23 18:52:56 2009 UTC (14 years, 7 months ago) by dpavlin 
http://www.lothosoft.ch/thomas/perl-storableedit/storableedit-1.5.pl
Revision 31 - Directory Listing
Modified Wed Sep 23 18:51:32 2009 UTC (14 years, 7 months ago) by dpavlin 
fix SAVE output
Revision 30 - Directory Listing
Modified Wed Sep 23 18:44:08 2009 UTC (14 years, 7 months ago) by dpavlin 
- added external B-tree using BerkeleyDB::Btree on /dev/shm for efficiat digest to integer
- version bump [0.02]
- cleanup output to always start with $port for easy overview
- display ticks every 1000 and 10000 records while processing view
- don't serialize output with Data::Dump, use Storable instead to save it on disk
- extracted info into sub
Revision 29 - Directory Listing
Modified Wed Sep 23 18:41:10 2009 UTC (14 years, 7 months ago) by dpavlin 
don't dump shell debug
Revision 28 - Directory Listing
Modified Tue Sep 22 22:28:40 2009 UTC (14 years, 7 months ago) by dpavlin 
use md5 digest to solve first memory problem with C1, but not with CR yet
Revision 27 - Directory Listing
Modified Tue Sep 22 21:58:12 2009 UTC (14 years, 7 months ago) by dpavlin 
shell script to startup sack cloud
Revision 26 - Directory Listing
Modified Tue Sep 22 21:45:04 2009 UTC (14 years, 7 months ago) by dpavlin 
no backtrace from warn
Revision 25 - Directory Listing
Modified Tue Sep 22 21:38:31 2009 UTC (14 years, 7 months ago) by dpavlin 
display number of records loaded
Revision 24 - Directory Listing
Modified Tue Sep 22 21:27:13 2009 UTC (14 years, 7 months ago) by dpavlin 
don't parse subfields in WebPAC::Input::ISI for nice memory usage
check if we got anything from client before unserializing it
Revision 22 - Directory Listing
Modified Tue Sep 22 17:19:25 2009 UTC (14 years, 7 months ago) by dpavlin 
fix output
Revision 21 - Directory Listing
Modified Tue Sep 22 17:15:03 2009 UTC (14 years, 7 months ago) by dpavlin 
- added $VERSION [0.01]
- exit connected nodes on SIGINT
- fix merge when shards produce array of values
- make code display debug option
- listen on 127.0.0.1 (we are using ssh tunnels anyway)
- changed commands a bit and added interactive help on h or ?
Revision 20 - Directory Listing
Modified Tue Sep 22 16:02:49 2009 UTC (14 years, 7 months ago) by dpavlin 
abort on first error
Revision 19 - Directory Listing
Modified Tue Sep 22 15:14:00 2009 UTC (14 years, 7 months ago) by dpavlin 
added --debug and move some output to it
Revision 17 - Directory Listing
Modified Tue Sep 22 13:40:02 2009 UTC (14 years, 7 months ago) by dpavlin 
fix warning
Revision 16 - Directory Listing
Modified Tue Sep 22 13:32:04 2009 UTC (14 years, 7 months ago) by dpavlin 
- support send_nodes without content playload
- warn about nodes which go away or can't be connected to (instead of die)
- get_node to fetch data over $connected socket to node (opened by send_nodes)
- send_sock to send data to node over socket
- added info command to get overwiew of sharding
Revision 15 - Directory Listing
Modified Tue Sep 22 12:09:59 2009 UTC (14 years, 7 months ago) by dpavlin 
Debian dependencies
Revision 14 - Directory Listing
Modified Tue Sep 22 10:40:32 2009 UTC (14 years, 7 months ago) by dpavlin 
fix prefix
Revision 13 - Directory Listing
Modified Tue Sep 22 10:32:59 2009 UTC (14 years, 7 months ago) by dpavlin 
ship results from node using Storable, merge results
(with support of + in key name to make sum)
Revision 12 - Directory Listing
Modified Tue Sep 22 10:00:22 2009 UTC (14 years, 7 months ago) by dpavlin 
find $prefix of our installation and use it
Revision 11 - Directory Listing
Modified Mon Sep 21 23:21:34 2009 UTC (14 years, 7 months ago) by dpavlin 
implement --listen port and --connect host:port to create master-slave cluster
(err, cloud) of nodes and implement send_nodes to send view to each node

added info to see connected views to commands and allow abbrivitation to single character
Revision 10 - Directory Listing
Modified Mon Sep 21 20:32:51 2009 UTC (14 years, 7 months ago) by dpavlin 
reset time on each call of report
Revision 9 - Directory Listing
Modified Mon Sep 21 20:05:41 2009 UTC (14 years, 7 months ago) by dpavlin 
fix offset and limit, rename last out/ dump to out/*.last
Revision 8 - Directory Listing
Modified Mon Sep 21 19:36:32 2009 UTC (14 years, 7 months ago) by dpavlin 
make in-memory cache local
Revision 6 - Directory Listing
Modified Mon Sep 21 15:41:30 2009 UTC (14 years, 7 months ago) by dpavlin 
added --view which can be repeated
Revision 5 - Directory Listing
Modified Mon Sep 21 15:36:47 2009 UTC (14 years, 7 months ago) by dpavlin 
display affected records and warning about empty $out
Revision 4 - Directory Listing
Modified Sun Sep 20 20:08:11 2009 UTC (14 years, 7 months ago) by dpavlin 
configurable --path, --offset and --limit
Revision 3 - Directory Listing
Modified Sun Sep 20 18:55:34 2009 UTC (14 years, 7 months ago) by dpavlin 
open out/* in vi with any of commands: vi \e out
Revision 1 - Directory Listing
Added Sun Sep 20 18:42:07 2009 UTC (14 years, 7 months ago) by dpavlin 
Sack - in-memory interactive object database in pure perl
  ViewVC Help
Powered by ViewVC 1.1.26