1 |
Welcome to Sack 0.11 |
2 |
distributed in-memory hash |
3 |
|
4 |
Input data is ISI Export Format |
5 |
with bibliographic data |
6 |
Goal is to count countries in C1 |
7 |
|
8 |
View perl snipped which counts C1 |
9 |
(with fixes for messy data) |
10 |
|
11 |
Start lorry (master node+REPL) |
12 |
and 22 node cloud |
13 |
on 11 dual-core machines |
14 |
|
15 |
Cloud is up, loading shards |
16 |
(each node gets part of data) |
17 |
|
18 |
Notice network traffic on right |
19 |
and ssh which is compressing |
20 |
shards over our 100 Mb/s network |
21 |
|
22 |
Run view and collect results |
23 |
|
24 |
Display results |
25 |
|
26 |
Editing view code |
27 |
|
28 |
Stop cloud and exit nodes |
29 |
|
30 |
More info about Sack: |
31 |
http://blog.rot13.org/ |
32 |
|
33 |
[END] |
34 |
|