compute resource guidance

[ctb]

For 5,000 vertebrate genomes, I appear to need more than 160 GB of RAM with this command line:

-n 9 -r 10 -p k=21,k=31,k=51,dna

Trying now with 256 GB of RAM and 32 CPUs.

[ctb]

same command line - 221 GB max! 32 hours, ~6 cores.

Command exited with non-zero status 1
        Command being timed: "snakemake sketches/extra-vertebrates.sig.zip -p"
        User time (seconds): 605369.54
        System time (seconds): 31519.27
        Percent of CPU this job got: 548%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 32:16:49
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 221023992
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 992406
        Minor (reclaiming a frame) page faults: 5940569837
        Voluntary context switches: 346178608
        Involuntary context switches: 617626
        Swaps: 0
        File system inputs: 49926264
        File system outputs: 213452512
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 1