View Issue Details
| ID | Project | Category | View Status | Date Submitted | Last Update |
|---|---|---|---|---|---|
| 0013561 | CentOS-7 | systemd | public | 2017-07-17 16:33 | 2020-04-20 07:17 |
| Reporter | bogdan.sh | ||||
| Priority | normal | Severity | minor | Reproducibility | always |
| Status | new | Resolution | open | ||
| Platform | x64 | OS | CentOS | OS Version | 7.3.1611 |
| Product Version | |||||
| Target Version | Fixed in Version | ||||
| Summary | 0013561: Breaking ordering cycle by deleting job when iSCSi used | ||||
| Description | System is not able to process all boot jobs when iSCSi mount is used. Reproduced on different kernel versions. The issue seems to be related to systemd implementation. 3.10.0-514.26.2.el7.x86_64 # rpm -qa | egrep "systemd|iscsi" | sort iscsi-initiator-utils-6.2.0.873-35.el7.x86_64 iscsi-initiator-utils-iscsiuio-6.2.0.873-35.el7.x86_64 systemd-219-30.el7_3.9.x86_64 systemd-libs-219-30.el7_3.9.x86_64 systemd-sysv-219-30.el7_3.9.x86_64 Iscsi disk is mounted in /etc/fstab as: UUID="d1b32b3a-6b2c-4773-85a1-d4ebe23c1700" /var/lib/mysql ext3 _netdev,usrquota,noatime,x-systemd.wants=network-online.target 0 0 # systemctl show -p Requires,Wants,Requisite,BindsTo,PartOf,Before,After var-lib-mysql.mount Requires=-.mount Requisite= Wants=system.slice quotaon.service network-online.target systemd-quotacheck.service BindsTo=dev-disk-by\x5cx2duuid-d1b32b3a\x5cx2d6b2c\x5cx2d4773\x5cx2d85a1\x5cx2dd4ebe23c1700.device PartOf= Before=quotaon.service umount.target remote-fs.target systemd-quotacheck.service After=remote-fs-pre.target network.target -.mount systemd-journald.socket system.slice dev-disk-by\x5cx2duuid-d1b32b3a\x5cx2d6b2c\x5cx2d4773\x5cx2d85a1\x5cx2dd4ebe23c1700.device network-online.target The issue is always happening, no matter of options x-systemd in /etc/fstab . As well DefaultDependencies=no makes nothing. After server reboot (full output): # journalctl |egrep -i "cycle|skip|depend" Jul 17 09:34:02 localhost.localdomain kernel: kvm-clock: using sched offset of 704511401346 cycles Jul 17 09:34:02 localhost.localdomain kernel: Calibrating delay loop (skipped) preset value.. 4399.99 BogoMIPS (lpj=2199998) Jul 17 13:34:03 localhost.localdomain systemd[1]: Found ordering cycle on basic.target/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on sockets.target/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on iscsid.socket/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on sysinit.target/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on systemd-tmpfiles-setup.service/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on local-fs.target/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on quotaon.service/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on systemd-quotacheck.service/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on var-lib-mysql.mount/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on network-online.target/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on network.service/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on basic.target/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Breaking ordering cycle by deleting job sockets.target/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Job sockets.target/start deleted to break ordering cycle starting with basic.target/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found ordering cycle on paths.target/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on brandbot.path/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on sysinit.target/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on systemd-tmpfiles-setup.service/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on local-fs.target/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on quotaon.service/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on systemd-quotacheck.service/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on var-lib-mysql.mount/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on network-online.target/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on network.service/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on basic.target/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on paths.target/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Breaking ordering cycle by deleting job brandbot.path/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Job brandbot.path/start deleted to break ordering cycle starting with paths.target/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found ordering cycle on basic.target/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on sysinit.target/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on systemd-tmpfiles-setup.service/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on local-fs.target/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on quotaon.service/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on systemd-quotacheck.service/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on var-lib-mysql.mount/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on network-online.target/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on network.service/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on basic.target/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Breaking ordering cycle by deleting job systemd-tmpfiles-setup.service/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Job systemd-tmpfiles-setup.service/start deleted to break ordering cycle starting with basic.target/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found ordering cycle on basic.target/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on sysinit.target/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on local-fs.target/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on quotaon.service/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on systemd-quotacheck.service/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on var-lib-mysql.mount/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on network-online.target/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on network.service/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Found dependency on basic.target/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Breaking ordering cycle by deleting job local-fs.target/start Jul 17 13:34:03 localhost.localdomain systemd[1]: Job local-fs.target/start deleted to break ordering cycle starting with basic.target/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found ordering cycle on sysinit.target/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on systemd-tmpfiles-setup.service/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on local-fs.target/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on quotaon.service/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on systemd-quotacheck.service/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on var-lib-mysql.mount/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on network-online.target/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on network.service/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on basic.target/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on sysinit.target/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Breaking ordering cycle by deleting job systemd-tmpfiles-setup.service/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Job systemd-tmpfiles-setup.service/start deleted to break ordering cycle starting with sysinit.target/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found ordering cycle on sysinit.target/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on local-fs.target/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on quotaon.service/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on systemd-quotacheck.service/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on var-lib-mysql.mount/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on network-online.target/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on network.service/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on basic.target/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on sysinit.target/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Breaking ordering cycle by deleting job local-fs.target/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Job local-fs.target/start deleted to break ordering cycle starting with sysinit.target/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found ordering cycle on var-lib-mysql.mount/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on network-online.target/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on network.service/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on basic.target/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on sysinit.target/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on systemd-tmpfiles-setup.service/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on local-fs.target/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on quotaon.service/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on systemd-quotacheck.service/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on var-lib-mysql.mount/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Breaking ordering cycle by deleting job systemd-tmpfiles-setup.service/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Job systemd-tmpfiles-setup.service/start deleted to break ordering cycle starting with var-lib-mysql.mount/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found ordering cycle on var-lib-mysql.mount/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on network-online.target/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on network.service/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on basic.target/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on sysinit.target/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on local-fs.target/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on quotaon.service/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on systemd-quotacheck.service/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Found dependency on var-lib-mysql.mount/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Breaking ordering cycle by deleting job local-fs.target/start Jul 17 13:34:04 localhost.localdomain systemd[1]: Job local-fs.target/start deleted to break ordering cycle starting with var-lib-mysql.mount/start Jul 17 13:34:04 localhost.localdomain acpid[405]: skipping incomplete file /etc/acpi/events/videoconf | ||||
| Steps To Reproduce | 1. Install and update CentOS to latest 2. create iscsi target for examle with openfiler 3. configure CentOS to mount iscsi on boot over fstab 4. reboot 5. check with: journalctl |egrep -i "cycle|skip|depend" 100% reproducable issue. Usually failed jobs are different from different reboots (check screenshot). | ||||
| Tags | No tags attached. | ||||
| abrt_hash | |||||
| URL | |||||
