View Issue Details

IDProjectCategoryView StatusLast Update
0013561CentOS-7systemdpublic2020-04-20 07:17
Reporterbogdan.sh 
PrioritynormalSeverityminorReproducibilityalways
Status newResolutionopen 
Platformx64OSCentOSOS Version7.3.1611
Product Version 
Target VersionFixed in Version 
Summary0013561: Breaking ordering cycle by deleting job when iSCSi used
DescriptionSystem is not able to process all boot jobs when iSCSi mount is used. Reproduced on different kernel versions. The issue seems to be related to systemd implementation.

3.10.0-514.26.2.el7.x86_64

# rpm -qa | egrep "systemd|iscsi" | sort
iscsi-initiator-utils-6.2.0.873-35.el7.x86_64
iscsi-initiator-utils-iscsiuio-6.2.0.873-35.el7.x86_64
systemd-219-30.el7_3.9.x86_64
systemd-libs-219-30.el7_3.9.x86_64
systemd-sysv-219-30.el7_3.9.x86_64

Iscsi disk is mounted in /etc/fstab as:
UUID="d1b32b3a-6b2c-4773-85a1-d4ebe23c1700" /var/lib/mysql ext3 _netdev,usrquota,noatime,x-systemd.wants=network-online.target 0 0

# systemctl show -p Requires,Wants,Requisite,BindsTo,PartOf,Before,After var-lib-mysql.mount
Requires=-.mount
Requisite=
Wants=system.slice quotaon.service network-online.target systemd-quotacheck.service
BindsTo=dev-disk-by\x5cx2duuid-d1b32b3a\x5cx2d6b2c\x5cx2d4773\x5cx2d85a1\x5cx2dd4ebe23c1700.device
PartOf=
Before=quotaon.service umount.target remote-fs.target systemd-quotacheck.service
After=remote-fs-pre.target network.target -.mount systemd-journald.socket system.slice dev-disk-by\x5cx2duuid-d1b32b3a\x5cx2d6b2c\x5cx2d4773\x5cx2d85a1\x5cx2dd4ebe23c1700.device network-online.target


The issue is always happening, no matter of options x-systemd in /etc/fstab . As well DefaultDependencies=no makes nothing.



After server reboot (full output):
# journalctl |egrep -i "cycle|skip|depend"
Jul 17 09:34:02 localhost.localdomain kernel: kvm-clock: using sched offset of 704511401346 cycles
Jul 17 09:34:02 localhost.localdomain kernel: Calibrating delay loop (skipped) preset value.. 4399.99 BogoMIPS (lpj=2199998)
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found ordering cycle on basic.target/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on sockets.target/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on iscsid.socket/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on sysinit.target/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on systemd-tmpfiles-setup.service/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on local-fs.target/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on quotaon.service/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on systemd-quotacheck.service/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on var-lib-mysql.mount/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on network-online.target/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on network.service/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on basic.target/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Breaking ordering cycle by deleting job sockets.target/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Job sockets.target/start deleted to break ordering cycle starting with basic.target/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found ordering cycle on paths.target/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on brandbot.path/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on sysinit.target/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on systemd-tmpfiles-setup.service/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on local-fs.target/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on quotaon.service/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on systemd-quotacheck.service/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on var-lib-mysql.mount/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on network-online.target/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on network.service/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on basic.target/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on paths.target/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Breaking ordering cycle by deleting job brandbot.path/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Job brandbot.path/start deleted to break ordering cycle starting with paths.target/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found ordering cycle on basic.target/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on sysinit.target/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on systemd-tmpfiles-setup.service/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on local-fs.target/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on quotaon.service/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on systemd-quotacheck.service/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on var-lib-mysql.mount/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on network-online.target/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on network.service/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on basic.target/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Breaking ordering cycle by deleting job systemd-tmpfiles-setup.service/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Job systemd-tmpfiles-setup.service/start deleted to break ordering cycle starting with basic.target/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found ordering cycle on basic.target/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on sysinit.target/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on local-fs.target/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on quotaon.service/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on systemd-quotacheck.service/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on var-lib-mysql.mount/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on network-online.target/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on network.service/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on basic.target/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Breaking ordering cycle by deleting job local-fs.target/start
Jul 17 13:34:03 localhost.localdomain systemd[1]: Job local-fs.target/start deleted to break ordering cycle starting with basic.target/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found ordering cycle on sysinit.target/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on systemd-tmpfiles-setup.service/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on local-fs.target/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on quotaon.service/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on systemd-quotacheck.service/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on var-lib-mysql.mount/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on network-online.target/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on network.service/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on basic.target/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on sysinit.target/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Breaking ordering cycle by deleting job systemd-tmpfiles-setup.service/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Job systemd-tmpfiles-setup.service/start deleted to break ordering cycle starting with sysinit.target/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found ordering cycle on sysinit.target/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on local-fs.target/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on quotaon.service/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on systemd-quotacheck.service/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on var-lib-mysql.mount/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on network-online.target/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on network.service/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on basic.target/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on sysinit.target/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Breaking ordering cycle by deleting job local-fs.target/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Job local-fs.target/start deleted to break ordering cycle starting with sysinit.target/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found ordering cycle on var-lib-mysql.mount/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on network-online.target/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on network.service/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on basic.target/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on sysinit.target/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on systemd-tmpfiles-setup.service/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on local-fs.target/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on quotaon.service/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on systemd-quotacheck.service/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on var-lib-mysql.mount/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Breaking ordering cycle by deleting job systemd-tmpfiles-setup.service/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Job systemd-tmpfiles-setup.service/start deleted to break ordering cycle starting with var-lib-mysql.mount/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found ordering cycle on var-lib-mysql.mount/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on network-online.target/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on network.service/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on basic.target/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on sysinit.target/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on local-fs.target/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on quotaon.service/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on systemd-quotacheck.service/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on var-lib-mysql.mount/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Breaking ordering cycle by deleting job local-fs.target/start
Jul 17 13:34:04 localhost.localdomain systemd[1]: Job local-fs.target/start deleted to break ordering cycle starting with var-lib-mysql.mount/start
Jul 17 13:34:04 localhost.localdomain acpid[405]: skipping incomplete file /etc/acpi/events/videoconf


Steps To Reproduce1. Install and update CentOS to latest
2. create iscsi target for examle with openfiler
3. configure CentOS to mount iscsi on boot over fstab
4. reboot
5. check with:
 journalctl |egrep -i "cycle|skip|depend"


100% reproducable issue.
Usually failed jobs are different from different reboots (check screenshot).
TagsNo tags attached.
abrt_hash
URL

Activities

bogdan.sh

bogdan.sh

2017-07-17 16:33

reporter  

Screenshot_20170717_135352.png (404,191 bytes)

Issue History

Date Modified Username Field Change
2017-07-17 16:33 bogdan.sh New Issue
2017-07-17 16:33 bogdan.sh File Added: Screenshot_20170717_135352.png