View Issue Details

IDProjectCategoryView StatusLast Update
0015532CentOS-7NetworkManagerpublic2018-12-06 11:43
Reporterdavid.byng 
PriorityurgentSeverityblockReproducibilityalways
Status newResolutionopen 
PlatformAWS EC2 XenOSCentosOS Version7.6
Product Version 
Target VersionFixed in Version 
Summary0015532: Centos 7.6 networking does not start on AWS EC2 Xen VM
DescriptionI have upgraded both a Centos and RHEL EC2 instance to 7.6 release and after reboot neither instance will allow me to connect via SSH, it seems as though the networking service does not start at boot-time.

Extract from boot-log:

Started Initial cloud-init job (pre-networking).
Reached target Network (Pre).
Starting LSB: Bring up/down networking...
Failed to start LSB: Bring up/down networking.
See 'systemctl status network.service' for details.
Steps To ReproduceCreate EC2 instance with Centos 7
sudo yum -y update
Stop EC2 instance
Start EC2 instance
Connect via SSH now impossible (due to network service failing to start)
Additional InformationBoot-log:

The selected entry will be started automatically in 1s.
The selected entry will be started automatically in 0s.
Initializing cgroup subsys cpuset
Initializing cgroup subsys cpu
Initializing cgroup subsys cpuacct
Linux version 3.10.0-957.1.3.el7.x86_64 (mockbuild@kbuilder.bsys.centos.org) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-36) (GCC) ) #1 SMP Thu Nov 29 14:49:43 UTC 2018
Command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.1.3.el7.x86_64 root=UUID=6f15c206-f516-4ee8-a4b7-89ad880647db ro console=tty0 crashkernel=auto console=ttyS0,115200 net.ifnames=0 LANG=en_US.UTF-8
e820: BIOS-provided physical RAM map:
BIOS-e820: [mem 0x0000000000000000-0x000000000009dfff] usable
BIOS-e820: [mem 0x000000000009e000-0x000000000009ffff] reserved
BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
BIOS-e820: [mem 0x0000000000100000-0x00000000efffffff] usable
BIOS-e820: [mem 0x00000000fc000000-0x00000000ffffffff] reserved
NX (Execute Disable) protection: active
SMBIOS 2.7 present.
DMI: Xen HVM domU, BIOS 4.2.amazon 08/24/2006
Hypervisor detected: Xen HVM
Xen version 4.2.
Netfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated NICs.
Blkfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated disks.
You might have to change the root device
from /dev/hd[a-d] to /dev/xvd[a-d]
in your root= kernel command line option
e820: last_pfn = 0xf0000 max_arch_pfn = 0x400000000
PAT configuration [0-7]: WB WC UC- UC WB WP UC- UC
found SMP MP-table at [mem 0x000fbc50-0x000fbc5f] mapped at [ffffffffff200c50]
RAMDISK: [mem 0x32c85000-0x3563afff]
Early table checksum verification disabled
ACPI: RSDP 00000000000ea020 00024 (v02 Xen)
ACPI: XSDT 00000000fc00e2a0 00054 (v01 Xen HVM 00000000 HVML 00000000)
ACPI: FACP 00000000fc00df60 000F4 (v04 Xen HVM 00000000 HVML 00000000)
ACPI: DSDT 00000000fc0021c0 0BD19 (v02 Xen HVM 00000000 INTL 20090123)
ACPI: FACS 00000000fc002180 00040
ACPI: APIC 00000000fc00e060 000D8 (v02 Xen HVM 00000000 HVML 00000000)
ACPI: HPET 00000000fc00e1b0 00038 (v01 Xen HVM 00000000 HVML 00000000)
ACPI: WAET 00000000fc00e1f0 00028 (v01 Xen HVM 00000000 HVML 00000000)
ACPI: SSDT 00000000fc00e220 00031 (v02 Xen HVM 00000000 INTL 20090123)
ACPI: SSDT 00000000fc00e260 00031 (v02 Xen HVM 00000000 INTL 20090123)
No NUMA configuration found
Faking a node at [mem 0x0000000000000000-0x00000000efffffff]
NODE_DATA(0) allocated [mem 0xeffd8000-0xefffefff]
Reserving 161MB of memory at 640MB for crashkernel (System RAM: 3839MB)
Zone ranges:
  DMA [mem 0x00001000-0x00ffffff]
  DMA32 [mem 0x01000000-0xffffffff]
  Normal empty
Movable zone start for each node
Early memory node ranges
  node 0: [mem 0x00001000-0x0009dfff]
  node 0: [mem 0x00100000-0xefffffff]
Initmem setup node 0 [mem 0x00001000-0xefffffff]
ACPI: PM-Timer IO Port: 0xb008
ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] disabled)
ACPI: LAPIC (acpi_id[0x02] lapic_id[0x00] disabled)
ACPI: LAPIC (acpi_id[0x03] lapic_id[0x00] disabled)
ACPI: LAPIC (acpi_id[0x04] lapic_id[0x00] disabled)
ACPI: LAPIC (acpi_id[0x05] lapic_id[0x00] disabled)
ACPI: LAPIC (acpi_id[0x06] lapic_id[0x00] disabled)
ACPI: LAPIC (acpi_id[0x07] lapic_id[0x00] disabled)
ACPI: LAPIC (acpi_id[0x08] lapic_id[0x00] disabled)
ACPI: LAPIC (acpi_id[0x09] lapic_id[0x00] disabled)
ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x00] disabled)
ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x00] disabled)
ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x00] disabled)
ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x00] disabled)
ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x00] disabled)
ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-47
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 low level)
ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 low level)
ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 low level)
Using ACPI (MADT) for SMP configuration information
ACPI: HPET id: 0x8086a201 base: 0xfed00000
smpboot: Allowing 15 CPUs, 14 hotplug CPUs
PM: Registered nosave memory: [mem 0x0009e000-0x0009ffff]
PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
e820: [mem 0xf0000000-0xfbffffff] available for PCI devices
Booting paravirtualized kernel on Xen HVM
setup_percpu: NR_CPUS:5120 nr_cpumask_bits:15 nr_cpu_ids:15 nr_node_ids:1
PERCPU: Embedded 38 pages/cpu @ffff9b4a2b600000 s118784 r8192 d28672 u262144
PV qspinlock hash table entries: 256 (order: 0, 4096 bytes)
Built 1 zonelists in Node order, mobility grouping on. Total pages: 967560
Policy zone: DMA32
Kernel command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.1.3.el7.x86_64 root=UUID=6f15c206-f516-4ee8-a4b7-89ad880647db ro console=tty0 crashkernel=auto console=ttyS0,115200 net.ifnames=0 LANG=en_US.UTF-8
PID hash table entries: 4096 (order: 3, 32768 bytes)
x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100
xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form
Memory: 2001356k/3932160k available (7664k kernel code, 396k absent, 290612k reserved, 6055k data, 1876k init)
SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=15, Nodes=1
x86/pti: Unmapping kernel while in userspace
Hierarchical RCU implementation.
    RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=15.
NR_IRQS:327936 nr_irqs:952 0
xen:events: Xen HVM callback vector for event delivery is enabled
Console: colour VGA+ 80x25
console [tty0] enabled
Cannot get hvm parameter CONSOLE_EVTCHN (18): -22!
console [ttyS0] enabled
allocated 15728640 bytes of page_cgroup
please try 'cgroup_disable=memory' option if you don't want memory cgroups
tsc: Fast TSC calibration failed
tsc: Unable to calibrate against PIT
tsc: using HPET reference calibration
tsc: Detected 2500.107 MHz processor
tsc: Detected 2500.084 MHz TSC
Calibrating delay loop (skipped), value calculated using timer frequency.. 5000.16 BogoMIPS (lpj=2500084)
pid_max: default: 32768 minimum: 301
Security Framework initialized
SELinux: Initializing.
Yama: becoming mindful.
Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes)
Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)
Mount-cache hash table entries: 8192 (order: 4, 65536 bytes)
Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes)
Initializing cgroup subsys memory
Initializing cgroup subsys devices
Initializing cgroup subsys freezer
Initializing cgroup subsys net_cls
Initializing cgroup subsys blkio
Initializing cgroup subsys perf_event
Initializing cgroup subsys hugetlb
Initializing cgroup subsys pids
Initializing cgroup subsys net_prio
mce: CPU supports 2 MCE banks
Last level iTLB entries: 4KB 512, 2MB 0, 4MB 0
Last level dTLB entries: 4KB 512, 2MB 0, 4MB 0
tlb_flushall_shift: 6
Speculative Store Bypass: Vulnerable
FEATURE SPEC_CTRL Not Present
FEATURE IBPB_SUPPORT Not Present
Spectre V2 : Vulnerable: Retpoline without IBPB
random: fast init done
ACPI: Core revision 20130517
ACPI: All ACPI Tables successfully acquired
ftrace: allocating 29188 entries in 115 pages
IRQ remapping doesn't support X2APIC mode, disable x2apic.
Switched APIC routing to physical flat.
..TIMER: vector=0x30 apic1=0 pin1=2 apic2=0 pin2=0
smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz (fam: 06, model: 3e, stepping: 04)
installing Xen timer for CPU 0
cpu 0 spinlock event irq 53
Performance Events: unsupported p6 CPU model 62 no PMU driver, software events only.
Brought up 1 CPUs
smpboot: Max logical packages: 15
smpboot: Total of 1 processors activated (5000.16 BogoMIPS)
NMI watchdog: disabled (cpu0): hardware events not enabled
NMI watchdog: Shutting down hard lockup detector on all cpus
node 0 initialised, 409949 pages in 9ms
devtmpfs: initialized
EVM: security.selinux
EVM: security.ima
EVM: security.capability
atomic64 test passed for x86-64 platform with CX8 and with SSE
pinctrl core: initialized pinctrl subsystem
RTC time: 8:30:24, date: 12/05/18
NET: Registered protocol family 16
ACPI: bus type PCI registered
acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
PCI: Using configuration type 1 for base access
ACPI: Added _OSI(Module Device)
ACPI: Added _OSI(Processor Device)
ACPI: Added _OSI(3.0 _SCP Extensions)
ACPI: Added _OSI(Processor Aggregator Device)
ACPI: Added _OSI(Linux-Dell-Video)
ACPI: Interpreter enabled
ACPI: (supports S0 S3 S4 S5)
ACPI: Using IOAPIC for interrupt routing
PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
ACPI: Enabled 2 GPEs in block 00 to 0F
ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI]
acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM
acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
acpiphp: Slot [0] registered
acpiphp: Slot [3] registered
acpiphp: Slot [4] registered
acpiphp: Slot [5] registered
acpiphp: Slot [6] registered
acpiphp: Slot [7] registered
acpiphp: Slot [8] registered
acpiphp: Slot [9] registered
acpiphp: Slot [10] registered
acpiphp: Slot [11] registered
acpiphp: Slot [12] registered
acpiphp: Slot [13] registered
acpiphp: Slot [14] registered
acpiphp: Slot [15] registered
acpiphp: Slot [16] registered
acpiphp: Slot [17] registered
acpiphp: Slot [18] registered
acpiphp: Slot [19] registered
acpiphp: Slot [20] registered
acpiphp: Slot [21] registered
acpiphp: Slot [22] registered
acpiphp: Slot [23] registered
acpiphp: Slot [24] registered
acpiphp: Slot [25] registered
acpiphp: Slot [26] registered
acpiphp: Slot [27] registered
acpiphp: Slot [28] registered
acpiphp: Slot [29] registered
acpiphp: Slot [30] registered
acpiphp: Slot [31] registered
PCI host bridge to bus 0000:00
pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]
pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]
pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
pci_bus 0000:00: root bus resource [mem 0xf0000000-0xfbffffff window]
pci_bus 0000:00: root bus resource [bus 00-ff]
pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7]
pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6]
pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177]
pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376]
* Found PM-Timer Bug on the chipset. Due to workarounds for a bug,
* this clock source is slow. Consider trying other clock sources
pci 0000:00:01.3: quirk: [io 0xb000-0xb03f] claimed by PIIX4 ACPI
ACPI: PCI Interrupt Link [LNKA] (IRQs *5 10 11)
ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
ACPI: PCI Interrupt Link [LNKD] (IRQs *5 10 11)
xen:balloon: Initialising balloon driver
vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
vgaarb: loaded
vgaarb: bridge control possible 0000:00:02.0
SCSI subsystem initialized
ACPI: bus type USB registered
usbcore: registered new interface driver usbfs
usbcore: registered new interface driver hub
usbcore: registered new device driver usb
EDAC MC: Ver: 3.0.0
PCI: Using ACPI for IRQ routing
NetLabel: Initializing
NetLabel: domain hash size = 128
NetLabel: protocols = UNLABELED CIPSOv4
NetLabel: unlabeled traffic allowed by default
HPET: 3 timers in total, 0 timers will be used for per-cpu timer
hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
hpet0: 3 comparators, 64-bit 62.500000 MHz counter
amd_nb: Cannot enumerate AMD northbridges
Switched to clocksource xen
pnp: PnP ACPI init
ACPI: bus type PNP registered
system 00:00: [mem 0x00000000-0x0009ffff] could not be reserved
system 00:01: [io 0x08a0-0x08a3] has been reserved
system 00:01: [io 0x0cc0-0x0ccf] has been reserved
system 00:01: [io 0x04d0-0x04d1] has been reserved
system 00:07: [io 0x10c0-0x1141] has been reserved
system 00:07: [io 0xb044-0xb047] has been reserved
pnp: PnP ACPI: found 8 devices
ACPI: bus type PNP unregistered
NET: Registered protocol family 2
TCP established hash table entries: 32768 (order: 6, 262144 bytes)
TCP bind hash table entries: 32768 (order: 7, 524288 bytes)
TCP: Hash tables configured (established 32768 bind 32768)
TCP: reno registered
UDP hash table entries: 2048 (order: 4, 65536 bytes)
UDP-Lite hash table entries: 2048 (order: 4, 65536 bytes)
NET: Registered protocol family 1
pci 0000:00:00.0: Limiting direct PCI/PCI transfers
pci 0000:00:01.0: PIIX3: Enabling Passive Release
pci 0000:00:01.0: Activating ISA DMA hang workarounds
Unpacking initramfs...
Freeing initrd memory: 42712k freed
RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer
RAPL PMU: hw unit of domain pp0-core 2^-16 Joules
RAPL PMU: hw unit of domain package 2^-16 Joules
RAPL PMU: hw unit of domain dram 2^-16 Joules
sha1_ssse3: Using AVX optimized SHA-1 implementation
sha256_ssse3: Using AVX optimized SHA-256 implementation
futex hash table entries: 4096 (order: 6, 262144 bytes)
Initialise system trusted keyring
audit: initializing netlink socket (disabled)
type=2000 audit(1543998625.735:1): initialized
HugeTLB registered 2 MB page size, pre-allocated 0 pages
zpool: loaded
zbud: loaded
VFS: Disk quotas dquot_6.5.2
Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
msgmni has been set to 7195
Key type big_key registered
NET: Registered protocol family 38
Key type asymmetric registered
Asymmetric key parser 'x509' registered
Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
io scheduler noop registered
io scheduler deadline registered (default)
io scheduler cfq registered
io scheduler mq-deadline registered
io scheduler kyber registered
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
pciehp: PCI Express Hot Plug Controller Driver version: 0.4
shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
ACPI: Power Button [PWRF]
input: Sleep Button as /devices/LNXSYSTM:00/LNXSLPBN:00/input/input1
ACPI: Sleep Button [SLPF]
GHES: HEST is not enabled!
xen:grant_table: Grant tables using version 1 layout
Grant table initialized
Cannot get hvm parameter CONSOLE_EVTCHN (18): -22!
Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
00:06: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
Non-volatile memory driver v1.3
Linux agpgart interface v0.103
crash memory driver: version 1.1
rdac: device handler registered
hp_sw: device handler registered
emc: device handler registered
alua: device handler registered
libphy: Fixed MDIO Bus: probed
ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
ehci-pci: EHCI PCI platform driver
ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
ohci-pci: OHCI PCI platform driver
uhci_hcd: USB Universal Host Controller Interface driver
usbcore: registered new interface driver usbserial_generic
usbserial: USB Serial support registered for generic
i8042: PNP: PS/2 Controller [PNP0303:PS2K,PNP0f13:PS2M] at 0x60,0x64 irq 1,12
serio: i8042 KBD port at 0x60,0x64 irq 1
serio: i8042 AUX port at 0x60,0x64 irq 12
mousedev: PS/2 mouse device common for all mice
input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input2
rtc_cmos 00:02: rtc core: registered rtc_cmos as rtc0
rtc_cmos 00:02: alarms up to one day, 114 bytes nvram, hpet irqs
cpuidle: using governor menu
hidraw: raw HID events driver (C) Jiri Kosina
usbcore: registered new interface driver usbhid
usbhid: USB HID core driver
drop_monitor: Initializing network drop monitor service
TCP: cubic registered
Initializing XFRM netlink socket
NET: Registered protocol family 10
NET: Registered protocol family 17
mpls_gso: MPLS GSO support
Loading compiled-in X.509 certificates
Loaded X.509 cert 'CentOS Linux kpatch signing key: ea0413152cde1d98ebdca3fe6f0230904c9ef717'
Loaded X.509 cert 'CentOS Linux Driver update signing key: 7f421ee0ab69461574bb358861dbe77762a4201b'
Loaded X.509 cert 'CentOS Linux kernel signing key: e7cef3613a9b8bd012fae7498272159bb1879c65'
registered taskstats version 1
Key type trusted registered
Key type encrypted registered
IMA: No TPM chip found, activating TPM-bypass! (rc=-19)
xenbus_probe_frontend: Device with no driver: device/vbd/768
xenbus_probe_frontend: Device with no driver: device/vif/0
  Magic number: 14:735:522
rtc_cmos 00:02: setting system clock to 2018-12-05 08:30:26 UTC (1543998626)
Freeing unused kernel memory: 1876k freed
Write protecting the kernel read-only data: 12288k
Freeing unused kernel memory: 516k freed
Freeing unused kernel memory: 600k freed
systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN)
systemd[1]: Detected virtualization xen.
systemd[1]: Detected architecture x86-64.
systemd[1]: Running in initial RAM disk.
Welcome to CentOS Linux 7 (Core) dracut-033-554.el7 (Initramfs)!
systemd[1]: No hostname configured.
systemd[1]: Set hostname to <localhost>.
systemd[1]: Initializing machine ID from random generator.
systemd[1]: Reached target Timers.
Reached target Timers.
systemd[1]: Created slice Root Slice.
Created slice Root Slice.
systemd[1]: Listening on udev Kernel Socket.
Listening on udev Kernel Socket.
systemd[1]: Created slice System Slice.
Created slice System Slice.
systemd[1]: Reached target Slices.
Reached target Slices.
systemd[1]: Listening on Journal Socket.
Listening on Journal Socket.
systemd[1]: Starting Create list of required static device nodes for the current kernel...
Starting Create list of required st... nodes for the current kernel...
systemd[1]: Starting dracut cmdline hook...
Starting dracut cmdline hook...
systemd[1]: Starting Apply Kernel Variables...
Starting Apply Kernel Variables...
systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
Started Dispatch Password Requests to Console Directory Watch.
systemd[1]: Starting Journal Service...
Starting Journal Service...
systemd[1]: Reached target Paths.
Reached target Paths.
systemd[1]: Listening on udev Control Socket.
Listening on udev Control Socket.
systemd[1]: Reached target Sockets.
Reached target Sockets.
systemd[1]: Reached target Swap.
Reached target Swap.
systemd[1]: Reached target Local File Systems.
Reached target Local File Systems.
systemd[1]: Started Journal Service.
Started Journal Service.
Started Create list of required sta...ce nodes for the current kernel.
Started Apply Kernel Variables.
Starting Create Static Device Nodes in /dev...
Started Create Static Device Nodes in /dev.
Started dracut cmdline hook.
Starting dracut pre-udev hook...
tsc: Refined TSC clocksource calibration: 2499.998 MHz
RPC: Registered named UNIX socket transport module.
RPC: Registered udp transport module.
RPC: Registered tcp transport module.
RPC: Registered tcp NFSv4.1 backchannel transport module.
Started dracut pre-udev hook.
input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input3
Starting udev Kernel Device Manager...
Started udev Kernel Device Manager.
Starting dracut pre-trigger hook...
Started dracut pre-trigger hook.
Starting udev Coldplug all Devices...
Started udev Coldplug all Devices.
Reached target System Initialization.
Reached target Basic System.
Starting dracut initqueue hook...
Mounting Configuration File System...
Mounted Configuration File System.
FDC 0 is a S82078B
scsi host0: ata_piix
scsi host1: ata_piix
ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc100 irq 14
ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc108 irq 15
blkfront: xvda: barrier or flush: disabled; persistent grants: disabled; indirect descriptors: enabled;
 xvda: xvda1
xen_netfront: Initialising Xen virtual ethernet driver
Found device /dev/disk/by-uuid/6f15c206-f516-4ee8-a4b7-89ad880647db.
Started dracut initqueue hook.
Reached target Remote File Systems (Pre).
Reached target Remote File Systems.
Starting File System Check on /dev/...6-f516-4ee8-a4b7-89ad880647db...
Started File System Check on /dev/d...206-f516-4ee8-a4b7-89ad880647db.
Mounting /sysroot...
SGI XFS with ACLs, security attributes, no debug enabled
XFS (xvda1): Mounting V5 Filesystem
XFS (xvda1): Ending clean mount
Mounted /sysroot.
Reached target Initrd Root File System.
Starting Reload Configuration from the Real Root...
Started Reload Configuration from the Real Root.
Reached target Initrd File Systems.
Reached target Initrd Default Target.
Starting dracut pre-pivot and cleanup hook...
Started dracut pre-pivot and cleanup hook.
Starting Cleaning Up and Shutting Down Daemons...
Stopped target Timers.
Stopped Cleaning Up and Shutting Down Daemons.
Stopped dracut pre-pivot and cleanup hook.
Stopped target Remote File Systems.
Stopped target Remote File Systems (Pre).
Stopped dracut initqueue hook.
Stopped target Initrd Default Target.
Stopped target Basic System.
Stopped target System Initialization.
Stopped target Local File Systems.
Stopped udev Coldplug all Devices.
Stopped dracut pre-trigger hook.
Stopping udev Kernel Device Manager...
Stopped target Swap.
Stopped Apply Kernel Variables.
Stopped target Slices.
Stopped target Paths.
Stopped Dispatch Password Requests to Console Directory Watch.
Stopped target Sockets.
Stopped udev Kernel Device Manager.
Stopped dracut pre-udev hook.
Stopped dracut cmdline hook.
Stopped Create Static Device Nodes in /dev.
Stopped Create list of required sta...ce nodes for the current kernel.
Closed udev Control Socket.
Closed udev Kernel Socket.
Starting Cleanup udevd DB...
Started Cleanup udevd DB.
Reached target Switch Root.
Starting Switch Root...
systemd-journald[106]: Received SIGTERM from PID 1 (systemd).
SELinux: Disabled at runtime.
type=1404 audit(1543998631.391:2): selinux=0 auid=4294967295 ses=4294967295
ip_tables: (C) 2000-2006 Netfilter Core Team
systemd[1]: Inserted module 'ip_tables'
Welcome to CentOS Linux 7 (Core)!
random: crng init done
Stopped Switch Root.
Stopped Journal Service.
Starting Journal Service...
Starting Create list of required st... nodes for the current kernel...
Created slice system-selinux\x2dpol...grate\x2dlocal\x2dchanges.slice.
Mounting Debug File System...
Stopped File System Check on Root Device.
Created slice User and Session Slice.
Starting Read and set NIS domainname from /etc/sysconfig/network...
Reached target rpc_pipefs.target.
Created slice system-getty.slice.
Created slice system-serial\x2dgetty.slice.
Started Forward Password Requests to Wall Directory Watch.
Mounting POSIX Message Queue File System...
Listening on udev Kernel Socket.
Stopped target Switch Root.
Stopped target Initrd File Systems.
Stopped target Initrd Root File System.
Started Dispatch Password Requests to Console Directory Watch.
Set up automount Arbitrary Executab...ats File System Automount Point.
Listening on Delayed Shutdown Socket.
Listening on /dev/initctl Compatibility Named Pipe.
Reached target Swap.
Listening on udev Control Socket.
Mounting Huge Pages File System...
Reached target Local Encrypted Volumes.
Reached target Slices.
Starting Remount Root and Kernel File Systems...
Starting Apply Kernel Variables...
Starting Setup Virtual Console...
Mounted Debug File System.
Mounted POSIX Message Queue File System.
Mounted Huge Pages File System.
Started Journal Service.
Started Create list of required sta...ce nodes for the current kernel.
Started Read and set NIS domainname from /etc/sysconfig/network.
Started Remount Root and Kernel File Systems.
Started Apply Kernel Variables.
Starting udev Coldplug all Devices...
Starting Configure read-only root support...
Starting Create Static Device Nodes in /dev...
Starting Flush Journal to Persistent Storage...
systemd-journald[1816]: Received request to flush runtime journal from PID 1
Started Configure read-only root support.
Started Create Static Device Nodes in /dev.
Started Flush Journal to Persistent Storage.
Started udev Coldplug all Devices.
Starting udev Kernel Device Manager...
Reached target Local File Systems (Pre).
Reached target Local File Systems.
Starting Preprocess NFS configuration...
Starting Import network configuration from initramfs...
Starting Load/Save Random Seed...
Started Setup Virtual Console.
Started Preprocess NFS configuration.
Started Load/Save Random Seed.
Started Import network configuration from initramfs.
Started udev Kernel Device Manager.
Starting Create Volatile Files and Directories...
Started Create Volatile Files and Directories.
Starting Security Auditing Service...
type=1305 audit(1543998633.227:3): audit_pid=2211 old=0 auid=4294967295 ses=4294967295 res=1
piix4_smbus 0000:00:01.3: SMBus base address uninitialized - upgrade BIOS or use force_addr=0xaddr
Started Security Auditing Service.
Starting Update UTMP about System Boot/Shutdown...
Started Update UTMP about System Boot/Shutdown.
Reached target System Initialization.
Started Daily Cleanup of Temporary Directories.
Reached target Timers.
Started Flexible branding.
Reached target Paths.
Listening on D-Bus System Message Bus Socket.[ 10.206823] [TTM] Zone kernel: Available graphics memory: 1843428 kiB
[TTM] Initializing pool allocator
[TTM] Initializing DMA pool allocator
Starting Initial cloud-init job (pre-networking)...
Listening on RPCbind Server Activation Socket.
[drm] fb mappable at 0xF0000000
[drm] vram aper at 0xF0000000
[drm] size 33554432
[drm] fb depth is 24
[drm] pitch is 3072
Reached target Sockets.
Reached target Basic System.
fbcon: cirrusdrmfb (fb0) is primary device
Console: switching to colour frame buffer device 128x48
cirrus 0000:00:02.0: fb0: cirrusdrmfb frame buffer device
[drm] Initialized cirrus 1.0.0 20110418 for 0000:00:02.0 on minor 0
Starting NTP client/server...
Starting Dump dmesg to /var/log/dmesg...
Starting Login Service...
Starting GSSAPI Proxy Daemon...
Started D-Bus System Message Bus.
input: PC Speaker as /devices/platform/pcspkr/input/input4
Started irqbalance daemon.
Starting Authorization Manager...
Started Dump dmesg to /var/log/dmesg.
Started GSSAPI Proxy Daemon.
Started NTP client/server.
Found device /dev/ttyS0.
Started Login Service.
Reached target NFS client services.[ 11.847402] cryptd: max_cpu_qlen set to 1000
Reached target Remote File Systems (Pre).
Reached target Remote File Systems.
Started Authorization Manager.
ppdev: user-space parallel port driver
AVX version of gcm_enc/dec engaged.
AES CTR mode by8 optimization enabled
alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni)
alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni)
intel_rapl: Found RAPL domain package
intel_rapl: Found RAPL domain core
intel_rapl: Found RAPL domain dram
EDAC sbridge: Ver: 1.1.2
cloud-init[3231]: Cloud-init v. 18.2 running 'init-local' at Wed, 05 Dec 2018 08:30:37 +0000. Up 13.56 seconds.
cloud-init[3231]: 2018-12-05 08:30:42,919 - util.py[WARNING]: Failed fetching dynamic/instance-identity from url http://169.254.169.254/2009-04-04/dynamic/instance-identity
Started Initial cloud-init job (pre-networking).
Reached target Network (Pre).
Starting LSB: Bring up/down networking...
Failed to start LSB: Bring up/down networking.
See 'systemctl status network.service' for details.
Starting Initial cloud-init job (metadata service crawler)...
Reached target Network.
Starting Sendmail Mail Transport Agent...
Starting /etc/rc.d/rc.local Compatibility...
Starting The Apache HTTP Server...
Starting Dynamic System Tuning Daemon...
Started Sendmail Mail Transport Agent.
Starting Sendmail Mail Transport Client...
Started Sendmail Mail Transport Client.
Started The Apache HTTP Server.
Started Dynamic System Tuning Daemon.
cloud-init[3808]: Cloud-init v. 18.2 running 'init' at Wed, 05 Dec 2018 08:30:47 +0000. Up 23.02 seconds.
cloud-init[3808]: ci-info: +++++++++++++++++++++++++++Net device info++++++++++++++++++++++++++++
cloud-init[3808]: ci-info: +--------+-------+-----------+-----------+-------+-------------------+
cloud-init[3808]: ci-info: | Device | Up | Address | Mask | Scope | Hw-Address |
cloud-init[3808]: ci-info: +--------+-------+-----------+-----------+-------+-------------------+
Adding 4194300k swap on /symboxswapfile. Priority:-2 extents:33 across:5300068k SSFS
cloud-init[3808]: ci-info: | eth0: | False | . | . | . | 22:00:0a:61:2a:5e |
cloud-init[3808]: ci-info: | lo: | True | 127.0.0.1 | 255.0.0.0 | . | . |
cloud-init[3808]: ci-info: | lo: | True | . | . | d | . |
cloud-init[3808]: ci-info: +--------+-------+-----------+-----------+-------+-------------------+
Started /etc/rc.d/rc.local Compatibility.
Started Initial cloud-init job (metadata service crawler).
Reached target Cloud-config availability.
Reached target Network is Online.
Starting Crash recovery kernel arming...
Starting Apply the settings specified in cloud-config...
Starting LSB: start and stop Java DBI pooled DB connections...
Starting Notify NFS peers of a restart...
Starting System Logging Service...
Starting OpenSSH server daemon...
Starting Permit User Sessions...
Started Notify NFS peers of a restart.
Started Permit User Sessions.
Started Command Scheduler.
Started Serial Getty on ttyS0.
Started Getty on tty1.
Reached target Login Prompts.
Started System Logging Service.
Started OpenSSH server daemon.
Started LSB: start and stop Java DBI pooled DB connections.
cloud-init[3914]: Cloud-init v. 18.2 running 'modules:config' at Wed, 05 Dec 2018 08:30:48 +0000. Up 24.73 seconds.
Started Apply the settings specified in cloud-config.
Starting Execute cloud user/final scripts...
cloud-init[4060]: Cloud-init v. 18.2 running 'modules:final' at Wed, 05 Dec 2018 08:30:50 +0000. Up 26.13 seconds.
cloud-init[4060]: Cloud-init v. 18.2 finished at Wed, 05 Dec 2018 08:30:50 +0000. Datasource DataSourceEc2Local. Up 26.42 seconds
Started Execute cloud user/final scripts.
Reached target Multi-User System.
Starting Update UTMP about System Runlevel Changes...
Started Update UTMP about System Runlevel Changes.
 
CentOS Linux 7 (Core)
Kernel 3.10.0-957.1.3.el7.x86_64 on an x86_64
 
my.server.com login:
Tags"Network", Amazon, aws, ec2
abrt_hash
URL

Activities

david.byng

david.byng

2018-12-05 11:21

reporter   ~0033216

Boot-up log files

cloud-init.2018-12-05.log (94,907 bytes)
dmesg.2018-12-05 (30,425 bytes)
messages.2018-12-05 (66,676 bytes)
kbsingh@karan.org

kbsingh@karan.org

2018-12-05 12:56

administrator   ~0033219

on m5.xlarge and m4.2xlarge, I dont see to have a problem with networking. Booting a 1809 image, yum upgrade, reboot and i can still ssh back in.
david.byng

david.byng

2018-12-05 12:59

reporter   ~0033220

I am using legacy M3.Medium & M3.Large instance types
david.byng

david.byng

2018-12-05 15:31

reporter   ~0033226

As noted above, I created an M5.XLarge instance and did not encounter then networking issue, so I am guessing this is an AWS incompatibility with the older Xen on the M3 instance types.
david.byng

david.byng

2018-12-06 11:01

reporter   ~0033246

I spoke to soon, this morning my M5.Large instance will not start!

Extract from boot-log:

[[32m OK [0m] Started Initial cloud-init job (pre-networking).
[[32m OK [0m] Reached target Network (Pre).
         Starting LSB: Bring up/down networking...
[ 7.804043] IPv6: ADDRCONF(NETDEV_UP): ens5: link is not ready
[ 8.540407] IPv6: ADDRCONF(NETDEV_CHANGE): ens5: link becomes ready
[[1;31mFAILED[0m] Failed to start LSB: Bring up/down networking.
See 'systemctl status network.service' for details.
david.byng

david.byng

2018-12-06 11:43

reporter   ~0033248

Apologies this error was in regard to the non-existent eth0 interface, I change my security-group and I can now SSH into the M5.Large instance, but I still can't connect to M3 class instances.

Issue History

Date Modified Username Field Change
2018-12-05 10:05 david.byng New Issue
2018-12-05 10:05 david.byng Tag Attached: "Network"
2018-12-05 10:05 david.byng Tag Attached: Amazon
2018-12-05 10:05 david.byng Tag Attached: aws
2018-12-05 10:05 david.byng Tag Attached: ec2
2018-12-05 11:21 david.byng File Added: cloud-init.2018-12-05.log
2018-12-05 11:21 david.byng File Added: dmesg.2018-12-05
2018-12-05 11:21 david.byng File Added: messages.2018-12-05
2018-12-05 11:21 david.byng Note Added: 0033216
2018-12-05 12:56 kbsingh@karan.org Note Added: 0033219
2018-12-05 12:59 david.byng Note Added: 0033220
2018-12-05 15:31 david.byng Note Added: 0033226
2018-12-06 11:01 david.byng Note Added: 0033246
2018-12-06 11:43 david.byng Note Added: 0033248