HE-LHCb/homepage
HE-LHCb/homepage
21
1
Fork 0
Code Issues Pull Requests repo.project_board Releases Wiki Activity

Update 'computing_htcondor'

Blake Leverington 2021-07-28 11:27:39 +02:00
parent 4b5e7c290d
commit 224ffe6c0b
1 changed files with 8 additions and 8 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

16
computing_htcondor.md

@ -2,9 +2,9 @@
%TOC%
Basic use, see the manual entry from the command line:
'man condor_submit'
`man condor_submit`
You can find example submission files in /auto/work/zhelezov/singularity/batch_centos7 .
You can find example submission files in `/auto/work/zhelezov/singularity/batch_centos7` .
@ -116,9 +116,9 @@ Simple test can be started from lhcba1 port 30, with command
`condor_submit -interactive`
An example of submission file is in
'/auto/work/zhelezov/singularity/batch_centos7'. Do not forget to start job submission from directory into which you can write, otherwise log files can not be written and your jobs will be in "on hold" state forever.
`/auto/work/zhelezov/singularity/batch_centos7`. Do not forget to start job submission from directory into which you can write, otherwise log files can not be written and your jobs will be in "on hold" state forever.
I still propose to use Singularity based approach when possible, demonstrated in '/auto/work/zhelezov/singularity/FCNCfitter'.
I still propose to use Singularity based approach when possible, demonstrated in `/auto/work/zhelezov/singularity/FCNCfitter`.
That allows to use SLC6 / CentOS8 / etc. without local installation on all servers.
While not really checked, I believe the environment closely mimics current CERN/DESY HTCondor. Note that defaults are conservative (everywhere) in reserved resources (1 core, 512MB RAM).
@ -143,7 +143,7 @@ The only expected change for users: singularity can be used from CentOS7 contain
The change "simplify" proposed tests, just check things are still working fine on lhcba1 port 30. Any response about the batch system behavior is still more then welcome.
Note that using --fake-root with singularity requires local configuration change (per user), let me know if you want create images.
Note that using `--fake-root` with singularity requires local configuration change (per user), let me know if you want create images.
While the following can be deducted from proposed test and PS, I forgot to mentioned the change explicitly:
condor submission from CentOS7 on lhcba1 no longer starts jobs under ubuntu, it starts them under CentOS7 (at the moment on one server only).
@ -165,13 +165,13 @@ Dear colleagues,
To test:
a) ssh to lhcba1 port 30 (f.e. 'ssh -p 30 <user name>@lhcba1').
b) run 'condor_submit -interactive' command. In short time you should be "logged in".
a) ssh to lhcba1 port 30 (f.e. `ssh -p 30 <user name>@lhcba1`).
b) run `condor_submit -interactive` command. In short time you should be "logged in".
c) check you can do everything you usually do in CentOS7 there, including running own programs, editor, etc. It can be some software requested for interactive nodes only is not installed there, but the rest is expected to work.
c*) if you plan to use Singularity from CentOS7, check it as well (except --fake-root functionality).
d) "exit" from that environment. There are just 30 slots at the moment.
Please report in case you observe any problems during this exercise. If you do, try to "ssh -p 30 <user name>@lhcb-raid03" and run failing part.
Please report in case you observe any problems during this exercise. If you do, try to `ssh -p 30 <user name>@lhcb-raid03` and run failing part.
Note that lhcba1 CentOS7 is going to be switched to this environment soon (probably next week).