编辑

我真正想要的是一种模仿SLURM的方法,一种可以安装的交互式和合理用户友好的方式.

原帖

我想用SLURM测试一些最小的例子,我试图用Ubuntu 16.04在本地机器上安装它.我跟随the most recent slurm install guide I could find,然后我开始使用sudo /etc/init.d/slurmd start开始slurmd.

[....] Starting slurmd (via systemctl): slurmd.serviceJob for slurmd.service failed because the control process exited with error code. See "systemctl status slurmd.service" and "journalctl -xe" for details.

failed!

我不知道如何解释systemctl日志：

● slurmd.service - Slurm node daemon

Loaded: loaded (/lib/systemd/system/slurmd.service; enabled; vendor preset: enabled)

Active: failed (Result: exit-code) since Thu 2017-10-26 22:49:27 EDT; 12s ago

Process: 5951 ExecStart=/usr/sbin/slurmd $SLURMD_OPTIONS (code=exited, status=1/FAILURE)

Oct 26 22:49:27 Haggunenon systemd[1]: Starting Slurm node daemon...

Oct 26 22:49:27 Haggunenon systemd[1]: slurmd.service: Control process exited, code=exited status=1

Oct 26 22:49:27 Haggunenon systemd[1]: Failed to start Slurm node daemon.

Oct 26 22:49:27 Haggunenon systemd[1]: slurmd.service: Unit entered failed state.

Oct 26 22:49:27 Haggunenon systemd[1]: slurmd.service: Failed with result 'exit-code'.

lsb_release -a给出以下内容. (是的,我知道,严格来说,KDE Neon并不完全是Ubuntu.)

o LSB modules are available.

Distributor ID: neon

Description: KDE neon User Edition 5.11

Release: 16.04

Codename: xenial

与导游说的不同,我使用了自己的用户名wlandau,我确保将/ var / lib / slurm-llnl和/ var / run / slurm-llnl chown给我.这是我的/etc/slurm-llnl/slurm.conf.

# slurm.conf file generated by configurator.html.

# Put this file on all nodes of your cluster.

# See the slurm.conf man page for more information.

#

ControlMachine=Linux0

#ControlAddr=

#BackupController=

#BackupAddr=

#

AuthType=auth/munge

CacheGroups=0

#CheckpointType=checkpoint/none

CryptoType=crypto/munge

#DisableRootJobs=NO

#EnforcePartLimits=NO

#Epilog=

#EpilogSlurmctld=

#FirstJobId=1

#MaxJobId=999999

#GresTypes=

#GroupUpdateForce=0

#GroupUpdateTime=600

#JobCheckpointDir=/var/lib/slurm-llnl/checkpoint

#JobCredentialPrivateKey=

#JobCredentialPublicCertificate=

#JobFileAppend=0

#JobRequeue=1

#JobSubmitPlugins=1

#KillOnBadExit=0

#LaunchType=launch/slurm

#Licenses=foo*4,bar

#MailProg=/usr/bin/mail

#MaxJobCount=5000

#MaxStepCount=40000

#MaxTasksPerNode=128

MpiDefault=none

#MpiParams=ports=#-#

#PluginDir=

#PlugStackConfig=

#PrivateData=jobs

ProctrackType=proctrack/pgid

#Prolog=

#PrologFlags=

#PrologSlurmctld=

#PropagatePrioProcess=0

#PropagateResourceLimits=

#PropagateResourceLimitsExcept=

#RebootProgram=

ReturnToService=1

#SallocDefaultCommand=

SlurmctldPidFile=/var/run/slurm-llnl/slurmctld.pid

SlurmctldPort=6817

SlurmdPidFile=/var/run/slurm-llnl/slurmd.pid

SlurmdPort=6818

SlurmdSpoolDir=/var/lib/slurm-llnl/slurmd

SlurmUser=wlandau

#SlurmdUser=root

#SrunEpilog=

#SrunProlog=

StateSaveLocation=/var/lib/slurm-llnl/slurmctld

SwitchType=switch/none

#TaskEpilog=

TaskPlugin=task/none

#TaskPluginParam=

#TaskProlog=

#TopologyPlugin=topology/tree

#TmpFS=/tmp

#TrackWCKey=no

#TreeWidth=

#UnkillableStepProgram=

#UsePAM=0

#

#

# TIMERS

#BatchStartTimeout=10

#CompleteWait=0

#EpilogMsgTime=2000

#GetEnvTimeout=2

#HealthCheckInterval=0

#HealthCheckProgram=

InactiveLimit=0

KillWait=30

#MessageTimeout=10

#ResvOverRun=0

MinJobAge=300

#OverTimeLimit=0

SlurmctldTimeout=120

SlurmdTimeout=300

#UnkillableStepTimeout=60

#VSizeFactor=0

Waittime=0

#

#

# SCHEDULING

#DefMemPerCPU=0

FastSchedule=1

#MaxMemPerCPU=0

#SchedulerRootFilter=1

#SchedulerTimeSlice=30

SchedulerType=sched/backfill

SchedulerPort=7321

SelectType=select/linear

#SelectTypeParameters=

#

#

# JOB PRIORITY

#PriorityFlags=

#PriorityType=priority/basic

#PriorityDecayHalfLife=

#PriorityCalcPeriod=

#PriorityFavorSmall=

#PriorityMaxAge=

#PriorityUsageResetPeriod=

#PriorityWeightAge=

#PriorityWeightFairshare=

#PriorityWeightJobSize=

#PriorityWeightPartition=

#PriorityWeightQOS=

#

#

# LOGGING AND ACCOUNTING

#AccountingStorageEnforce=0

#AccountingStorageHost=

#AccountingStorageLoc=

#AccountingStoragePass=

#AccountingStoragePort=

AccountingStorageType=accounting_storage/none

#AccountingStorageUser=

AccountingStoreJobComment=YES

ClusterName=cluster

#DebugFlags=

#JobCompHost=

#JobCompLoc=

#JobCompPass=

#JobCompPort=

JobCompType=jobcomp/none

#JobCompUser=

#JobContainerPlugin=job_container/none

JobAcctGatherFrequency=30

JobAcctGatherType=jobacct_gather/none

SlurmctldDebug=3

SlurmctldLogFile=/var/log/slurm-llnl/slurmctld.log

SlurmdDebug=3

SlurmdLogFile=/var/log/slurm-llnl/slurmd.log

#SlurmSchedLogFile=

#SlurmSchedLogLevel=

#

#

# POWER SAVE SUPPORT FOR IDLE NODES (optional)

#SuspendProgram=

#ResumeProgram=

#SuspendTimeout=

#ResumeTimeout=

#ResumeRate=

#SuspendExcNodes=

#SuspendExcParts=

#SuspendRate=

#SuspendTime=

#

#

# COMPUTE NODES

NodeName=Linux[1-32] CPUs=1 State=UNKNOWN

PartitionName=debug Nodes=Linux[1-32] Default=YES MaxTime=INFINITE State=UP

跟进

[email protected],slurmd现在开始了.但不幸的是,当我调用它时,sinfo挂起,我得到了和以前一样的错误信息.

$sudo /etc/init.d/slurmctld stop

[ ok ] Stopping slurmctld (via systemctl): slurmctld.service.

$sudo /etc/init.d/slurmctld start

[ ok ] Starting slurmctld (via systemctl): slurmctld.service.

$sinfo

slurm_load_partitions: Unable to contact slurm controller (connect failure)

$slurmd -Dvvv

slurmd: fatal: Frontend not configured correctly in slurm.conf. See man slurm.conf look for frontendname.

然后我尝试重新启动守护进程,并且slurmd无法重新开始.

$sudo /etc/init.d/slurmctld start

[....] Starting slurmd (via systemctl): slurmd.serviceJob for slurmd.service failed because the control process exited with error code. See "systemctl status slurmd.service" and "journalctl -xe" for details.

failed!

ControlMachine前面的值必须与slurmctld启动的机器上的主机名-s的输出相匹配. NodeName也是如此;它必须匹配slurmd启动的机器上的主机名-s的输出.因为你只有一台机器,它似乎被称为Haggunenon,slurm.conf中的相关行应该是：

ControlMachine=Haggunenon

[...]

NodeName=Haggunenon CPUs=1 State=UNKNOWN

如果要启动多个slurmd守护程序来模拟更大的集群,则需要使用-N选项启动slurmd(但这需要使用–enable-multiple-slurmd configure选项构建Slurm)

UPDATE.这是一个演练.我用Vagrant和VirtualBox设置了一个虚拟机(vagrant init ubuntu / xenial64; vagrant up)然后在vagrant ssh之后运行以下命令：

[email protected]:~$lsb_release -a

No LSB modules are available.

Distributor ID: Ubuntu

Description: Ubuntu 16.04.3 LTS

Release: 16.04

Codename: xenial

[email protected]:~$sudo apt-get update

Hit:1 http://archive.ubuntu.com/ubuntu xenial InRelease

Get:2 http://security.ubuntu.com/ubuntu xenial-security InRelease [102 kB]

[...]

Get:35 http://archive.ubuntu.com/ubuntu xenial-backports/universe Translation-en [3,060 B]

Fetched 23.6 MB in 4s (4,783 kB/s)

Reading package lists... Done

[email protected]:~$sudo apt-get install munge libmunge2

Reading package lists... Done

Building dependency tree

Reading state information... Done

The following NEW packages will be installed:

libmunge2 munge

0 upgraded, 2 newly installed, 0 to remove and 0 not upgraded.

Need to get 102 kB of archives.

After this operation, 351 kB of additional disk space will be used.

Get:1 http://archive.ubuntu.com/ubuntu xenial-updates/universe amd64 libmunge2 amd64 0.5.11-3ubuntu0.1 [18.4 kB]

Get:2 http://archive.ubuntu.com/ubuntu xenial-updates/universe amd64 munge amd64 0.5.11-3ubuntu0.1 [83.9 kB]

Fetched 102 kB in 0s (290 kB/s)

Selecting previously unselected package libmunge2.

(Reading database ... 57914 files and directories currently installed.)

Preparing to unpack .../libmunge2_0.5.11-3ubuntu0.1_amd64.deb ...

Unpacking libmunge2 (0.5.11-3ubuntu0.1) ...

Selecting previously unselected package munge.

Preparing to unpack .../munge_0.5.11-3ubuntu0.1_amd64.deb ...

Unpacking munge (0.5.11-3ubuntu0.1) ...

Processing triggers for libc-bin (2.23-0ubuntu9) ...

Processing triggers for man-db (2.7.5-1) ...

Processing triggers for systemd (229-4ubuntu21) ...

Processing triggers for ureadahead (0.100.0-19) ...

Setting up libmunge2 (0.5.11-3ubuntu0.1) ...

Setting up munge (0.5.11-3ubuntu0.1) ...

Generating a pseudo-random key using /dev/urandom completed.

Please refer to /usr/share/doc/munge/README.Debian for instructions to generate more secure key.

Processing triggers for libc-bin (2.23-0ubuntu9) ...

Processing triggers for systemd (229-4ubuntu21) ...

Processing triggers for ureadahead (0.100.0-19) ...

[email protected]:~$sudo apt-get install slurm-wlm slurm-wlm-basic-plugins

Reading package lists... Done

Building dependency tree

Reading state information... Done

The following additional packages will be installed:

fontconfig fontconfig-config fonts-dejavu-core freeipmi-common libcairo2 libdatrie1 libdbi1 libfontconfig1 libfreeipmi16 libgraphite2-3

[...]

python-minimal python2.7 python2.7-minimal slurm-client slurm-wlm slurm-wlm-basic-plugins slurmctld slurmd

0 upgraded, 43 newly installed, 0 to remove and 0 not upgraded.

Need to get 20.8 MB of archives.

After this operation, 87.3 MB of additional disk space will be used.

Do you want to continue? [Y/n] y

Get:1 http://archive.ubuntu.com/ubuntu xenial/main amd64 fonts-dejavu-core all 2.35-1 [1,039 kB]

[...]

Get:43 http://archive.ubuntu.com/ubuntu xenial/universe amd64 slurm-wlm amd64 15.08.7-1build1 [6,482 B]

Fetched 20.8 MB in 3s (5,274 kB/s)

Extracting templates from packages: 100%

Selecting previously unselected package fonts-dejavu-core.

(Reading database ... 57952 files and directories currently installed.)

[...]

Processing triggers for libc-bin (2.23-0ubuntu9) ...

Processing triggers for systemd (229-4ubuntu21) ...

Processing triggers for ureadahead (0.100.0-19) ...

[email protected]:~$sudo vim /etc/slurm-llnl/slurm.conf

[email protected]:~$grep -v \# /etc/slurm-llnl/slurm.conf

ControlMachine=ubuntu-xenial

AuthType=auth/munge

CacheGroups=0

CryptoType=crypto/munge

MpiDefault=none

ProctrackType=proctrack/pgid

ReturnToService=1

SlurmctldPidFile=/var/run/slurm-llnl/slurmctld.pid

SlurmctldPort=6817

SlurmdPidFile=/var/run/slurm-llnl/slurmd.pid

SlurmdPort=6818

SlurmdSpoolDir=/var/lib/slurm-llnl/slurmd

SlurmUser=ubuntu

StateSaveLocation=/var/lib/slurm-llnl/slurmctld

SwitchType=switch/none

TaskPlugin=task/none

InactiveLimit=0

KillWait=30

MinJobAge=300

SlurmctldTimeout=120

SlurmdTimeout=300

Waittime=0

FastSchedule=1

SchedulerType=sched/backfill

SchedulerPort=7321

SelectType=select/linear

AccountingStorageType=accounting_storage/none

AccountingStoreJobComment=YES

ClusterName=cluster

JobCompType=jobcomp/none

JobAcctGatherFrequency=30

JobAcctGatherType=jobacct_gather/none

SlurmctldDebug=3

SlurmctldLogFile=/var/log/slurm-llnl/slurmctld.log

SlurmdDebug=3

SlurmdLogFile=/var/log/slurm-llnl/slurmd.log

NodeName=ubuntu-xenial CPUs=1 State=UNKNOWN

PartitionName=debug Nodes=ubuntu-xenial Default=YES MaxTime=INFINITE State=UP

[email protected]:~$sudo chown ubuntu /var/log/slurm-llnl

[email protected]:~$sudo chown ubuntu /var/lib/slurm-llnl/slurmctld

[email protected]:~$sudo chown ubuntu /var/run/slurm-llnl

[email protected]:~$sudo /etc/init.d/slurmctld start

[ ok ] Starting slurmctld (via systemctl): slurmctld.service.

[email protected]:~$sudo /etc/init.d/slurmd start

[ ok ] Starting slurmd (via systemctl): slurmd.service.

最后,它给了我预期的结果：

[email protected]:~$sinfo

PARTITION AVAIL TIMELIMIT NODES STATE NODELIST

debug* up infinite 1 idle ubuntu-denial

如果按照此处的确切步骤没有帮助,请尝试运行

sudo slurmctld -Dvvv

和

sudo slurmd -Dvvv

消息应该足够明确.