| 1 |
dpavlin |
149 |
Welcome to Sack 0.11 |
| 2 |
|
|
distributed in-memory hash |
| 3 |
|
|
|
| 4 |
|
|
Input data is ISI Export Format |
| 5 |
|
|
with bibliographic data |
| 6 |
|
|
Goal is to count countries in C1 |
| 7 |
|
|
|
| 8 |
|
|
View perl snipped which counts C1 |
| 9 |
|
|
(with fixes for messy data) |
| 10 |
|
|
|
| 11 |
|
|
Start lorry (master node+REPL) |
| 12 |
|
|
and 22 node cloud |
| 13 |
|
|
on 11 dual-core machines |
| 14 |
|
|
|
| 15 |
|
|
Cloud is up, loading shards |
| 16 |
|
|
(each node gets part of data) |
| 17 |
|
|
|
| 18 |
|
|
Notice network traffic on right |
| 19 |
|
|
and ssh which is compressing |
| 20 |
|
|
shards over our 100 Mb/s network |
| 21 |
|
|
|
| 22 |
|
|
Run view and collect results |
| 23 |
|
|
|
| 24 |
|
|
Display results |
| 25 |
|
|
|
| 26 |
|
|
Editing view code |
| 27 |
|
|
|
| 28 |
|
|
Stop cloud and exit nodes |
| 29 |
|
|
|
| 30 |
|
|
More info about Sack: |
| 31 |
|
|
http://blog.rot13.org/ |
| 32 |
|
|
|
| 33 |
|
|
[END] |
| 34 |
|
|
|
Parent Directory
| 
Revision Log