lsf

Change priorities of my own submitted jobs

南楼画角 提交于 2020-01-15 09:31:49
问题 I have many jobs running and pending. I would like to indicate the relative priority of jobs that I have submitted to the queue, that are pending, but not yet running. Is it possible to set this priority after submission? Is it possible to set this priority before submission? 回答1: You can move jobs that are pending with the btop command. btop job_ID | "job_ID[index_list]" [position] If you add [position] it means that the job will be put at that place in the queue. By default, LSF dispatches

How to optimize multithreaded program for use in LSF?

岁酱吖の 提交于 2020-01-02 10:00:24
问题 I am working on a multithreaded number crunching app, let's call it myprogram . I plan to run myprogram on IBM's LSF grid. LSF allows a job to scheduled on CPUs from different machines. For example, bsub -n 3 ... myprogram ... can allocate two CPUs from node1 and one CPU from node2. I know that I can ask LSF to allocate all 3 cores in the same node, but I am interested in the case where my job is scheduled onto different nodes. How does LSF manage this? Will myprogram be run in two different

LSF - Get ID of submitted job

女生的网名这么多〃 提交于 2019-12-30 06:07:27
问题 Say I submit a job using something like bsub pwd . Now I would like to get the job ID of that job in order to build a dependency for the next job. Is there some way I can get bsub to return the job ID? 回答1: Nils and Andrey have the answers to this specific question in shell and C/C++ environments respectively. For the purposes of building dependencies, you can also name your job with -J then build the dependency based on the job name: bsub -J "job1" <cmd1> bsub -J "job2" <cmd2> bsub -w "done

LSF - Get ID of submitted job

女生的网名这么多〃 提交于 2019-12-30 06:07:04
问题 Say I submit a job using something like bsub pwd . Now I would like to get the job ID of that job in order to build a dependency for the next job. Is there some way I can get bsub to return the job ID? 回答1: Nils and Andrey have the answers to this specific question in shell and C/C++ environments respectively. For the purposes of building dependencies, you can also name your job with -J then build the dependency based on the job name: bsub -J "job1" <cmd1> bsub -J "job2" <cmd2> bsub -w "done

LSF (bsub): how to specify a single “wrap-up” job to be run after all others finish?

六眼飞鱼酱① 提交于 2019-12-28 18:17:50
问题 BASIC PROBLEM: I want to submit N + 1 jobs to an LSF-managed Linux cluster in such a way that the ( N + 1)-st "wrap-up" job is not run until all the preceding N jobs have finished. EXTRA: If possible , it would be ideal if I could arrange matters so that the ( N + 1)-st ("wrap-up") job receives, as its first argument, a value of 0 (say) if all the previous N jobs terminated successfully, and a value different from 0 otherwise. This problem (or at least the part labeled "BASIC PROBLEM") is

LSF (bsub): how to specify a single “wrap-up” job to be run after all others finish?

微笑、不失礼 提交于 2019-12-28 18:16:16
问题 BASIC PROBLEM: I want to submit N + 1 jobs to an LSF-managed Linux cluster in such a way that the ( N + 1)-st "wrap-up" job is not run until all the preceding N jobs have finished. EXTRA: If possible , it would be ideal if I could arrange matters so that the ( N + 1)-st ("wrap-up") job receives, as its first argument, a value of 0 (say) if all the previous N jobs terminated successfully, and a value different from 0 otherwise. This problem (or at least the part labeled "BASIC PROBLEM") is

LSF (bsub): how to specify a single “wrap-up” job to be run after all others finish?

不想你离开。 提交于 2019-12-28 18:16:09
问题 BASIC PROBLEM: I want to submit N + 1 jobs to an LSF-managed Linux cluster in such a way that the ( N + 1)-st "wrap-up" job is not run until all the preceding N jobs have finished. EXTRA: If possible , it would be ideal if I could arrange matters so that the ( N + 1)-st ("wrap-up") job receives, as its first argument, a value of 0 (say) if all the previous N jobs terminated successfully, and a value different from 0 otherwise. This problem (or at least the part labeled "BASIC PROBLEM") is

How to launch multithreaded mpi processes in lsf?

本小妞迷上赌 提交于 2019-12-23 05:08:29
问题 I want to use LSF to submit a job which: runs on 4 nodes, in parallel each node has a single mpi process each process has 12 threads In the absence of LSF, I would simply launch with mpi on 4 nodes, like: mpirun -hosts host1,host2,host3,host4 -np 4 ./myprocess --numthreads=12 However, in the presence of LSF, I can't see how to do this? I'm sure there's probably a very standard way to do it, but I'm quite new to LSF. I googled around, but the answer wasn't immediately obvious to me. I found

Referencing job index in LSF job array

心已入冬 提交于 2019-12-12 18:19:12
问题 I'm trying to pass the index of a job in a job array as a parameter to another bash script. numSims=3 numTreatments=6 # uses numTreatments top rows of parameters.csv maxFail=10 j=1 while [ $j -le $numSims ]; do bsub -q someQueue -J "mySim[1-$numTreatments]%2" ./another_script.sh $LSB_JOBINDEX $j $maxFail let j=j+1 done The ultimate idea here is to submit, for each of 1,..., numTreatments , numSims jobs (simulations). I'd like two jobs running at a time ( %2 ). Outputs have the form XX

“qsub -now” equivalent using bsub

坚强是说给别人听的谎言 提交于 2019-12-11 16:49:29
问题 In SGE , we have qsub -now yes/no <command> By "-now yes" the job is scheduled immediately(if possible) or not at all . We are not put in pending queue . By "-now no " the job is put in pending queue if it cannot be executed immediately . But in LSF , we have qsub's equivalent as bsub . in bsub, we are put in pending queue, if it cannot be executed immediately. We don't have option as "-now yes" as in qsub . Do we something in bsub as "qsub -now" P.S : One solution is that we can check for