This is repository of my old source code which isn't updated any more. Go to git.rot13.org for current projects!
Log of /trunk/lib
Directory Listing
Revision
268 -
Directory Listing
Modified
Thu Feb 4 22:36:05 2010 UTC
(14 years, 4 months ago)
by
dpavlin
bulk_load all nodes in parallel (20-40Mb/s on my network)
Revision
267 -
Directory Listing
Modified
Thu Feb 4 20:31:34 2010 UTC
(14 years, 4 months ago)
by
dpavlin
save data and image as hash of all keys to work-around filename limits
Revision
266 -
Directory Listing
Modified
Thu Feb 4 19:08:29 2010 UTC
(14 years, 4 months ago)
by
dpavlin
- move all pending node status into $info->{pending} and ignore forked for refresh
- do cpio of new version *after* fork for massive speedup
Revision
265 -
Directory Listing
Modified
Thu Feb 4 18:15:59 2010 UTC
(14 years, 4 months ago)
by
dpavlin
add pending class to nodes only if there is anything pending
Revision
264 -
Directory Listing
Modified
Mon Feb 1 22:03:02 2010 UTC
(14 years, 4 months ago)
by
dpavlin
move Results to top of page (plays well with refresh)
Revision
263 -
Directory Listing
Modified
Sun Jan 31 18:18:38 2010 UTC
(14 years, 4 months ago)
by
dpavlin
color nodes based on their state and refresh page if something is pending (load, view)
Revision
262 -
Directory Listing
Modified
Sun Jan 31 16:44:56 2010 UTC
(14 years, 4 months ago)
by
dpavlin
send Refresh: header
Revision
260 -
Directory Listing
Modified
Sun Jan 31 16:03:50 2010 UTC
(14 years, 4 months ago)
by
dpavlin
support loading of single shard
Revision
256 -
Directory Listing
Modified
Tue Jan 26 16:55:10 2010 UTC
(14 years, 4 months ago)
by
dpavlin
split shard creation in Sack::Shard
Revision
254 -
Directory Listing
Modified
Thu Dec 24 13:06:25 2009 UTC
(14 years, 5 months ago)
by
dpavlin
fix warning
Revision
253 -
Directory Listing
Modified
Fri Nov 27 13:48:54 2009 UTC
(14 years, 6 months ago)
by
dpavlin
added checkboxes to show just some keys on graph
Revision
252 -
Directory Listing
Modified
Fri Nov 27 13:48:38 2009 UTC
(14 years, 6 months ago)
by
dpavlin
relaxed filter to full key name
Revision
251 -
Directory Listing
Modified
Fri Nov 27 13:48:01 2009 UTC
(14 years, 6 months ago)
by
dpavlin
uri_unescape vars
Revision
250 -
Directory Listing
Modified
Thu Nov 26 22:36:27 2009 UTC
(14 years, 6 months ago)
by
dpavlin
tweak nodes output
Revision
249 -
Directory Listing
Modified
Thu Nov 26 22:23:52 2009 UTC
(14 years, 6 months ago)
by
dpavlin
display shard paths as title
Revision
248 -
Directory Listing
Modified
Thu Nov 26 22:18:19 2009 UTC
(14 years, 6 months ago)
by
dpavlin
refresh shard allocation from view response
Revision
247 -
Directory Listing
Modified
Thu Nov 26 22:08:36 2009 UTC
(14 years, 6 months ago)
by
dpavlin
refactor and extend client server configuration
- load shards only if they are not allready loaded
- collect client responses and return it in repl using . (dot)
- push all unknown repl commands to clients
- eval on client now returns result to server
- save will dump current chards on node to /tmp/sack.data and
reload it on next startup
Revision
245 -
Directory Listing
Modified
Thu Nov 26 19:02:01 2009 UTC
(14 years, 6 months ago)
by
dpavlin
support multiple url args which collapse into array and use it for filter
Revision
244 -
Directory Listing
Modified
Thu Nov 26 18:48:13 2009 UTC
(14 years, 6 months ago)
by
dpavlin
cleanup title and use $param->{filter} to filter graphs with regex
Revision
241 -
Directory Listing
Modified
Thu Nov 26 15:22:12 2009 UTC
(14 years, 6 months ago)
by
dpavlin
show results <h1> only if there is reasults and include gnuplot for date, keys
Revision
240 -
Directory Listing
Modified
Thu Nov 26 14:46:46 2009 UTC
(14 years, 6 months ago)
by
dpavlin
generate own data dumps, so we can be called with just $out
Revision
239 -
Directory Listing
Modified
Thu Nov 26 13:44:47 2009 UTC
(14 years, 6 months ago)
by
dpavlin
cleanup sharding from WebPAC and allow user-defined name
Revision
237 -
Directory Listing
Modified
Tue Nov 24 00:55:29 2009 UTC
(14 years, 6 months ago)
by
dpavlin
sum of all merge counts doesn't make sense
since it contains dumplicate keys from each node
Revision
236 -
Directory Listing
Modified
Tue Nov 24 00:51:03 2009 UTC
(14 years, 6 months ago)
by
dpavlin
count affected rows
Revision
235 -
Directory Listing
Modified
Tue Nov 24 00:46:19 2009 UTC
(14 years, 6 months ago)
by
dpavlin
display number of merged keys from nodes
Revision
234 -
Directory Listing
Modified
Tue Nov 24 00:02:01 2009 UTC
(14 years, 6 months ago)
by
dpavlin
count affected by return from view function
Revision
233 -
Directory Listing
Modified
Mon Nov 23 23:52:53 2009 UTC
(14 years, 6 months ago)
by
dpavlin
display first shard leter and show/hide info
Revision
232 -
Directory Listing
Modified
Mon Nov 23 23:15:31 2009 UTC
(14 years, 6 months ago)
by
dpavlin
refactor into run_view and display view overview table
Revision
229 -
Directory Listing
Modified
Mon Nov 23 20:46:30 2009 UTC
(14 years, 6 months ago)
by
dpavlin
drop Chart::Gnuplot and drive gnuplot directly
this improved output and allowed overlay of multiple datasets on single graph
Revision
228 -
Directory Listing
Modified
Mon Nov 23 20:45:35 2009 UTC
(14 years, 6 months ago)
by
dpavlin
no transport output without $debug
Revision
227 -
Directory Listing
Modified
Mon Nov 23 20:45:02 2009 UTC
(14 years, 6 months ago)
by
dpavlin
always generate dump files
Revision
225 -
Directory Listing
Modified
Mon Nov 23 19:13:56 2009 UTC
(14 years, 6 months ago)
by
dpavlin
don't die on client socket errors
Revision
224 -
Directory Listing
Modified
Mon Nov 23 19:13:33 2009 UTC
(14 years, 6 months ago)
by
dpavlin
record key and value min/max
Revision
223 -
Directory Listing
Modified
Mon Nov 23 14:39:40 2009 UTC
(14 years, 6 months ago)
by
dpavlin
create data files for gnuplot
Revision
222 -
Directory Listing
Modified
Sun Nov 22 22:57:15 2009 UTC
(14 years, 6 months ago)
by
dpavlin
improve shards output
Revision
221 -
Directory Listing
Modified
Sun Nov 22 22:34:57 2009 UTC
(14 years, 6 months ago)
by
dpavlin
factor out load_shard and display map in html
Revision
220 -
Directory Listing
Modified
Sun Nov 22 21:55:52 2009 UTC
(14 years, 6 months ago)
by
dpavlin
fix perm
Revision
219 -
Directory Listing
Modified
Sun Nov 22 21:54:25 2009 UTC
(14 years, 6 months ago)
by
dpavlin
color code nodes
red = forked
green = ping
Revision
218 -
Directory Listing
Modified
Sun Nov 22 20:48:08 2009 UTC
(14 years, 6 months ago)
by
dpavlin
generate gnuplot graphs
Revision
216 -
Directory Listing
Modified
Sun Nov 22 20:36:53 2009 UTC
(14 years, 6 months ago)
by
dpavlin
cleanup output
Revision
215 -
Directory Listing
Modified
Sun Nov 22 17:12:27 2009 UTC
(14 years, 6 months ago)
by
dpavlin
added gnuplot grapher
Revision
213 -
Directory Listing
Modified
Sun Nov 22 15:31:38 2009 UTC
(14 years, 6 months ago)
by
dpavlin
move table generation in separate package and add sorting
Revision
212 -
Directory Listing
Modified
Sat Nov 21 16:34:12 2009 UTC
(14 years, 6 months ago)
by
dpavlin
load shards and run views over web
Revision
211 -
Directory Listing
Modified
Sat Nov 21 16:12:18 2009 UTC
(14 years, 6 months ago)
by
dpavlin
reogranize $info->{shard} into path => node
Revision
210 -
Directory Listing
Modified
Sat Nov 21 15:55:24 2009 UTC
(14 years, 6 months ago)
by
dpavlin
simple http listener which dumps $info
Revision
209 -
Directory Listing
Modified
Sat Nov 21 13:59:41 2009 UTC
(14 years, 6 months ago)
by
dpavlin
use etc/cloud as default if it exists
Revision
203 -
Directory Listing
Modified
Sun Nov 8 22:56:46 2009 UTC
(14 years, 7 months ago)
by
dpavlin
added clean which drops all shards from clients
Revision
202 -
Directory Listing
Modified
Sun Nov 8 21:52:13 2009 UTC
(14 years, 7 months ago)
by
dpavlin
use Data::Dump from /srv/Sack/lib on clients
Revision
200 -
Directory Listing
Modified
Sun Nov 8 16:46:19 2009 UTC
(14 years, 7 months ago)
by
dpavlin
merge view results on shards from clients on server
Revision
199 -
Directory Listing
Modified
Sun Nov 8 16:29:36 2009 UTC
(14 years, 7 months ago)
by
dpavlin
call Sack::View from client
Revision
198 -
Directory Listing
Modified
Sun Nov 8 16:28:47 2009 UTC
(14 years, 7 months ago)
by
dpavlin
extract Sack::Merge from Sack::Lorry
Revision
196 -
Directory Listing
Modified
Sun Nov 8 16:17:59 2009 UTC
(14 years, 7 months ago)
by
dpavlin
send views to clients and collect loaded shards
Revision
195 -
Directory Listing
Modified
Sun Nov 8 16:17:21 2009 UTC
(14 years, 7 months ago)
by
dpavlin
cleanup output and some asserts
Revision
193 -
Directory Listing
Modified
Sun Nov 8 14:47:48 2009 UTC
(14 years, 7 months ago)
by
dpavlin
extracted Sack::View from old Sack::Node and test it
Revision
192 -
Directory Listing
Modified
Sun Nov 8 14:12:38 2009 UTC
(14 years, 7 months ago)
by
dpavlin
load shard by shard whole dataset into clients as
they request it
Revision
189 -
Directory Listing
Modified
Sun Nov 8 13:44:10 2009 UTC
(14 years, 7 months ago)
by
dpavlin
report unknown commands from repl
Revision
188 -
Directory Listing
Modified
Sun Nov 8 13:40:58 2009 UTC
(14 years, 7 months ago)
by
dpavlin
extract to_all
Revision
187 -
Directory Listing
Modified
Sun Nov 8 13:38:11 2009 UTC
(14 years, 7 months ago)
by
dpavlin
cleanup sharding and move shards to /tmp/sack/name/
Revision
186 -
Directory Listing
Modified
Sun Nov 8 13:21:01 2009 UTC
(14 years, 7 months ago)
by
dpavlin
shart input data into 1000 record shards
Revision
185 -
Directory Listing
Modified
Sun Nov 8 13:18:04 2009 UTC
(14 years, 7 months ago)
by
dpavlin
use Time::HiRes for duration
Revision
184 -
Directory Listing
Modified
Sun Nov 8 13:11:38 2009 UTC
(14 years, 7 months ago)
by
dpavlin
rename Sack::From to Sack::Shards
Revision
183 -
Directory Listing
Modified
Sun Nov 8 13:03:54 2009 UTC
(14 years, 7 months ago)
by
dpavlin
tweak output and put into package
Revision
182 -
Directory Listing
Modified
Sun Nov 8 12:55:53 2009 UTC
(14 years, 7 months ago)
by
dpavlin
rename repl
Revision
181 -
Directory Listing
Modified
Sun Nov 8 12:54:51 2009 UTC
(14 years, 7 months ago)
by
dpavlin
start clients from lib/Sack/
Revision
180 -
Directory Listing
Modified
Sun Nov 8 12:53:32 2009 UTC
(14 years, 7 months ago)
by
dpavlin
rename client
Revision
179 -
Directory Listing
Modified
Sun Nov 8 12:53:15 2009 UTC
(14 years, 7 months ago)
by
dpavlin
move to package, show usage and rename fork_node to fork_ssh
Revision
178 -
Directory Listing
Modified
Sun Nov 8 12:45:43 2009 UTC
(14 years, 7 months ago)
by
dpavlin
begin integration of protocol v3
Revision
162 -
Directory Listing
Modified
Fri Oct 30 14:53:22 2009 UTC
(14 years, 7 months ago)
by
dpavlin
cleanup scoping of $out and $rec
Revision
161 -
Directory Listing
Modified
Fri Oct 30 14:52:34 2009 UTC
(14 years, 7 months ago)
by
dpavlin
force node result to reference
Revision
159 -
Directory Listing
Modified
Fri Oct 23 13:08:45 2009 UTC
(14 years, 7 months ago)
by
dpavlin
fix output
Revision
158 -
Directory Listing
Modified
Fri Oct 9 19:44:41 2009 UTC
(14 years, 8 months ago)
by
dpavlin
add callback to get_from_all in Sack::Lorry [0.12]
Revision
156 -
Directory Listing
Modified
Fri Oct 9 19:12:28 2009 UTC
(14 years, 8 months ago)
by
dpavlin
use Sack::Color from here
Revision
155 -
Directory Listing
Modified
Fri Oct 9 19:12:05 2009 UTC
(14 years, 8 months ago)
by
dpavlin
color warn lines without lf in red
Revision
146 -
Directory Listing
Modified
Wed Oct 7 23:11:03 2009 UTC
(14 years, 8 months ago)
by
dpavlin
move start_nodes and load_nodes to Sack::Lorry [0.11]
Revision
144 -
Directory Listing
Modified
Wed Oct 7 20:55:14 2009 UTC
(14 years, 8 months ago)
by
dpavlin
split update_node out
Revision
143 -
Directory Listing
Modified
Wed Oct 7 20:52:20 2009 UTC
(14 years, 8 months ago)
by
dpavlin
use $Sack::VERSION
Revision
142 -
Directory Listing
Modified
Wed Oct 7 20:44:07 2009 UTC
(14 years, 8 months ago)
by
dpavlin
use $Sack::VERSION, less verbose without debug
Revision
141 -
Directory Listing
Modified
Wed Oct 7 20:42:46 2009 UTC
(14 years, 8 months ago)
by
dpavlin
fix output without DEBUG
Revision
140 -
Directory Listing
Modified
Wed Oct 7 20:14:58 2009 UTC
(14 years, 8 months ago)
by
dpavlin
don't display warn "#..." output with DEBUG enviroment set
Revision
139 -
Directory Listing
Modified
Wed Oct 7 18:58:17 2009 UTC
(14 years, 8 months ago)
by
dpavlin
fix command looping for repl
Revision
138 -
Directory Listing
Modified
Wed Oct 7 18:56:03 2009 UTC
(14 years, 8 months ago)
by
dpavlin
re-use existing ssh tunnels if we can connect to nodes
Revision
137 -
Directory Listing
Modified
Wed Oct 7 18:30:22 2009 UTC
(14 years, 8 months ago)
by
dpavlin
move commands to Sack::Lorry
Revision
135 -
Directory Listing
Modified
Wed Oct 7 17:57:50 2009 UTC
(14 years, 8 months ago)
by
dpavlin
extract duration into Sack, unify versioning [0.10]
Revision
134 -
Directory Listing
Modified
Wed Oct 7 17:47:50 2009 UTC
(14 years, 8 months ago)
by
dpavlin
sane pid messages
Revision
133 -
Directory Listing
Modified
Wed Oct 7 17:39:40 2009 UTC
(14 years, 8 months ago)
by
dpavlin
don't kill $$
Revision
132 -
Directory Listing
Modified
Wed Oct 7 17:27:43 2009 UTC
(14 years, 8 months ago)
by
dpavlin
fix kill message
Revision
131 -
Directory Listing
Modified
Wed Oct 7 17:17:52 2009 UTC
(14 years, 8 months ago)
by
dpavlin
write shard locally on lorry to speed up cloud bringup and re-seed nodes on restart
Revision
130 -
Directory Listing
Modified
Wed Oct 7 17:17:07 2009 UTC
(14 years, 8 months ago)
by
dpavlin
re-exec node on serialization error
Revision
127 -
Directory Listing
Modified
Wed Oct 7 16:21:33 2009 UTC
(14 years, 8 months ago)
by
dpavlin
better recovery from node storable serialization errors,
faster cloud startup,
added common pid handling,
added [u]pdate to lorry which push updated code to nodes,
tweaks to output,
version bump for Sack::Node [0.08]
Revision
120 -
Directory Listing
Modified
Wed Oct 7 10:05:32 2009 UTC
(14 years, 8 months ago)
by
dpavlin
don't output debug <<<< and >>>
Revision
119 -
Directory Listing
Modified
Tue Oct 6 23:04:45 2009 UTC
(14 years, 8 months ago)
by
dpavlin
new commands: [r]estart, [sh]ell, [i]nfo [0.08]
Revision
117 -
Directory Listing
Modified
Tue Oct 6 00:11:08 2009 UTC
(14 years, 8 months ago)
by
dpavlin
better messages, show result from nodes,
*_all functions now send to sorted node list
return ticks from merge and show total view records
Revision
116 -
Directory Listing
Modified
Tue Oct 6 00:07:05 2009 UTC
(14 years, 8 months ago)
by
dpavlin
added report to node view resposne and version it [0.07]
Revision
111 -
Directory Listing
Modified
Mon Oct 5 23:21:20 2009 UTC
(14 years, 8 months ago)
by
dpavlin
implement in-memory digest internal to lorry
Revision
107 -
Directory Listing
Modified
Mon Oct 5 22:21:39 2009 UTC
(14 years, 8 months ago)
by
dpavlin
move ping to Sack::Lorry, display duration of operations and
implement new configuration in etc
Revision
102 -
Directory Listing
Modified
Mon Oct 5 20:31:28 2009 UTC
(14 years, 8 months ago)
by
dpavlin
color [port] in warn messages
Revision
99 -
Directory Listing
Modified
Sun Oct 4 14:42:35 2009 UTC
(14 years, 8 months ago)
by
dpavlin
don't dump
Revision
98 -
Directory Listing
Modified
Sun Oct 4 14:39:50 2009 UTC
(14 years, 8 months ago)
by
dpavlin
reset $out before running view
Revision
97 -
Directory Listing
Modified
Sun Oct 4 13:09:28 2009 UTC
(14 years, 8 months ago)
by
dpavlin
re-implement merge of results
Revision
96 -
Directory Listing
Modified
Sun Oct 4 12:50:10 2009 UTC
(14 years, 8 months ago)
by
dpavlin
rsync latest sack to nodes on startup
Revision
95 -
Directory Listing
Modified
Sun Oct 4 12:17:52 2009 UTC
(14 years, 8 months ago)
by
dpavlin
make correct shards
Revision
93 -
Directory Listing
Modified
Sat Oct 3 21:43:34 2009 UTC
(14 years, 8 months ago)
by
dpavlin
run simple view
Revision
92 -
Directory Listing
Modified
Sat Oct 3 21:09:51 2009 UTC
(14 years, 8 months ago)
by
dpavlin
begin refactor to lorry which will carry sacks for us
(creating nodes and communicating with them using Storable
traveling over sockets)
Revision
90 -
Directory Listing
Modified
Wed Sep 30 19:54:01 2009 UTC
(14 years, 8 months ago)
by
dpavlin
added digest implementation based on shared redis server
Revision
88 -
Directory Listing
Modified
Wed Sep 30 19:53:12 2009 UTC
(14 years, 8 months ago)
by
dpavlin
added sync stub
Revision
86 -
Directory Listing
Modified
Wed Sep 30 17:23:32 2009 UTC
(14 years, 8 months ago)
by
dpavlin
extract common parts into Sack::Digest
Revision
85 -
Directory Listing
Modified
Tue Sep 29 18:04:29 2009 UTC
(14 years, 8 months ago)
by
dpavlin
rename Sack::Digest to Sack::Digest::BerkeleyDB to indicate implementation
Revision
66 -
Directory Listing
Modified
Fri Sep 25 14:35:05 2009 UTC
(14 years, 8 months ago)
by
dpavlin
added open
Revision
54 -
Directory Listing
Modified
Thu Sep 24 22:23:30 2009 UTC
(14 years, 8 months ago)
by
dpavlin
added lookup
Revision
50 -
Directory Listing
Modified
Thu Sep 24 19:21:55 2009 UTC
(14 years, 8 months ago)
by
dpavlin
merge digests from other nodes, version bump [0.04]
Revision
45 -
Directory Listing
Modified
Thu Sep 24 13:37:53 2009 UTC
(14 years, 8 months ago)
by
dpavlin
turn Sack::Digest into normal perl object with new instead of open
Revision
44 -
Directory Listing
Modified
Thu Sep 24 12:48:08 2009 UTC
(14 years, 8 months ago)
by
dpavlin
Sack::Digest now uses md5 sum of value for btree and array, so
we store full value only once
Revision
37 -
Directory Listing
Modified
Wed Sep 23 23:10:50 2009 UTC
(14 years, 8 months ago)
by
dpavlin
added unmungling to storableedit.pl
Revision
36 -
Directory Listing
Modified
Wed Sep 23 22:22:18 2009 UTC
(14 years, 8 months ago)
by
dpavlin
undigest_out, document digest key names, version bump [0.03]
Revision
34 -
Directory Listing
Modified
Wed Sep 23 21:47:32 2009 UTC
(14 years, 8 months ago)
by
dpavlin
move digest to tie interface which works for me
Revision
33 -
Directory Listing
Added
Wed Sep 23 20:28:21 2009 UTC
(14 years, 8 months ago)
by
dpavlin
extract Sack::Digest into own package and test it