View Issue Details
ID | Project | Category | View Status | Date Submitted | Last Update |
---|---|---|---|---|---|
0016614 | CentOS-8 | Cloud-Images | public | 2019-10-16 21:14 | 2020-06-16 06:28 |
Reporter | hutter2@llnl.gov | Assigned To | |||
Priority | high | Severity | major | Reproducibility | always |
Status | resolved | Resolution | fixed | ||
Summary | 0016614: No Centos 8 AMIs | ||||
Description | I'd like to request Centos 8 AMI images. You currently provide them for Centos 6 and 7, but not 8: https://wiki.centos.org/Cloud/AWS https://aws.amazon.com/marketplace/seller-profile?id=16cb8b03-256e-4dde-8f34-1b0f377efe89 The ZFS on Linux project uses Centos AMIs for our automated testing. We currently can't release Centos 8 ZFS RPMs, since we have no way to test them without the AMIs: https://github.com/zfsonlinux/zfs/issues/9287 | ||||
Tags | centos 8 | ||||
We really need to get this resolved asap....is there a way that I can assist building the image? | |
Red Hat Enterprise Linux 8 AMI was built by Amazon Web Services. They have been available since July 2019. CentOS.org has built the previous official AMI. I am assuming it is not a technical issue to build a certified AMI, but one of priority. |
|
So where should the request be made for a Centos ami? I am not interested in the RH ami's | |
This is in the Cloud Instance SIG purview - https://wiki.centos.org/SpecialInterestGroup/CloudInstance There's a kickstart file for a generic CentOS 8 cloud image in this pull request: https://github.com/CentOS/sig-cloud-instance-build/pull/159/commits/2c542bb2b1bc54c007fbf57a5da0a3213ce73fbb There's also an outstanding pull request for an Azure image kickstart file for CentOS 8 I'm sure they would be happy to accept changes to build an AMI, should someone create one. |
|
I tried to https://github.com/CentOS/sig-cloud-instance-build/pull/159/commits/2c542bb2b1bc54c007fbf57a5da0a3213ce73fbb (and turned off BLS) and when attempting to import to AWS (amazon-import), it fails with Unsupported kernel version 4.18.0-80.el8.x86_64 Any way to fix this? |
|
I got the same error....it's a bit funny since I installed a RH 8.0 in AWS which is running the same kernel version the only difference is that the RH kernel is tagged with RH in the end. I ended up following this article https://weldr.io/Pushing-Images-to-AWS/ which works really well. |
|
If you made a CentOS 8 image and uploaded it to AWS via https://weldr.io/Pushing-Images-to-AWS/, I will try it out. Thanks | |
It works just make sure that you get both cloud-init.noarch and cloud-utils-growpart.noarch installed without cloud-utils-growpart.noarch changing the EBS disk size wont be discovered by Centos. | |
Looking at AWS us-east-1: what are the images published by owner 679593333241? That's the same owner ID as the official CentOS 7 images (e.g. ami-02eac2c0129f6376b which is the latest published). If you just go to us-east-1 > EC2 > AMIs > select Public images > search for "centos8", you'll find the images I'm talking about. For example: - ami-034a46a96c820cc75 (CentOS 8 Minimal Latest with Updates-f399b70b-09d8-4df4-ba78-bc1813b4b257-ami-063710974a98495cb.4) - ami-0c69cc337830690b6 (CentOS8-ENA-AWS-cea6f7dd-49db-40fd-a49e-16617be018a3-ami-025c3654e9b105dbb.4) And others (there's a dozen). I haven't tested any of them, but are they official? |
|
@shubbeh No; the official builds are linked in the Issue Description; https://aws.amazon.com/marketplace/seller-profile?id=16cb8b03-256e-4dde-8f34-1b0f377efe89 The only official-ish comment I could find was the Forum Moderator who seemed to not care; https://forums.centos.org/viewtopic.php?f=54&t=71951 |
|
were pretty close to getting 8.1 out of the door, as soon as that hits, i will aim to get the AMI's up within a week from 8.1 drop for x86 and aarch64. going forward, I've got 90% of the automation in place to keep the cadence rolling ( expect 4 to 5 updates a year for the base image per distro 6/7/8 in the AMP stack, and a weekly build for BYOI flow ) this is for x86_64, the aarch64 images will lag a bit, but will catchup farily quickly ( by Mar '20 is a good goal to set ) |
|
Thanks for the quick and detailed answer kbsingh. The Current 8.1 Timeline Link; https://wiki.centos.org/About/Building_8.x is 2 months in and does look close (AFAIR it ranges from 1 to 7 months). |
|
based on the current status, we shouldnt be more than a week or two to release, the challenge with that board is that it does not quantify the amount of work, so even small checks and changes trigger a package build etc. A good metric to track is the CR/ drop - once that is in, its safe to assume the content base is done, or extremely close. |
|
> were pretty close to getting 8.1 out of the door, as soon as that hits, i will aim to > get the AMI's up within a week from 8.1 drop for x86 and aarch64. Thank you kbsingh! |
|
Am very very eager for the Centos8 AMi to be available because there's a bunch of servers I want to deploy and get rid of python2! thanks |
|
I'm also anxious for the Centos8 AMI to become officially available. I noticed that there is a CentOS-8-ec2-8.1.1911-20200113.3.x86_64.qcow2 file available at https://cloud.centos.org/centos/8/x86_64/images/. Is the official AMI going to be created from this file? Thanks |
|
Any updates on this? | |
Hi, I am also waiting for CentOS 8. I need to upload servers on aws and I wanted it to be CentOS but version 7.7 with the 4.4.210 kernel has some vulnerabilities Specter and Meltdown vulnerabilities. |
|
Hi, I tried to import the CentOS-8-ec2-8.1.1911-20200113.3.x86_64.qcow2 image as an AMI after converting it into raw format. It fails because AWS doesn't recognize the kernel version: "ClientError: Unable to determine kernel version." |
|
I have found the following CentOS 8.1 images in AWS Marketplace. Not official, but working very well: CentOS 8 Minimal: https://aws.amazon.com/marketplace/pp/B083V66BJ4 CentOS Stream Minimal: https://aws.amazon.com/marketplace/pp/B0847MKS85 There are other as well, if you search . |
|
I really needed to try centos8 because there were a few specific packages in it newer than 7 which mattered, so I spun up a centos7 AWS image and then upgraded it using these instructions: https://www.tecmint.com/upgrade-centos-7-to-centos-8/ which worked pretty much perfectly, after the upgrade I rebooted and everything was working fine. |
|
I see a post from January from kbsingh@karan.org saying that the AMIs would be available shortly after 8.1 release. I do see images at https://cloud.centos.org/centos/8/x86_64/images/. So does this mean that there are still bugs and so the images were rejected by Amazon for the Marketplace? | |
Im also waiting for official CentOS 8 AMI's, any ETA on this?, thanks. | |
i sign up just to state my big disappointment that it is 10 months and centos team is not able to deploy official AWS image. Linode had their official centos 8 image almost next day after centos release. There was some confusing statements that as soon as 8.1 is relesed there will be aws cloud image. 8.1 was released 5 weeks ago and there is just nothing: not a single line in https://wiki.centos.org/About/Building_8 or https://wiki.centos.org/Cloud/AWS. it is enough to say we will not support AWS so each person still hoping for official image can switch distribution or figure it out by themselve. |
|
There are so many options with Linux https://upload.wikimedia.org/wikipedia/commons/1/1b/Linux_Distribution_Timeline.svg But fewer with an LTS option https://distrowatch.com/search.php?ostype=Linux&category=Server&origin=All&basedon=All¬basedon=None&desktop=All&architecture=All&package=All&rolling=Fixed+%28LTS%29&isosize=All&netinstall=All&language=All&defaultinit=All&status=Active#simple And fewer still that are free other than CentOS(10y) there is Ubuntu(10y), Debian(5y), and opensuse(3y). So really CentOS is only one of two options in its class. |
|
Karanbir, Do you have an update on the status of the AMI? I could not find any updates on your progress on any other forums. Where would I check for the CR/ drop? |
|
The CentOS 8 AMI will be a full year late after the RHEL 8 release if it is not released In less than a month... | |
I am able to see Centos 8 amis from this seller : https://aws.amazon.com/marketplace/pp/B07YLV9Y8H?qid=1585241885656&sr=0-1&ref_=srh_res_product_title The owner account is same as centos one : 679593333241 How is this possible? |
|
I think the official CentOS marketplace entry is this one: https://aws.amazon.com/marketplace/seller-profile?id=16cb8b03-256e-4dde-8f34-1b0f377efe89 |
|
Both share the same account number. That's why it's confusing. Is there any timeline, by when we can expect the official build on AWS? |
|
I believe all images in the AWS Marketplace are owned by the same account, and 679593333241 is the AWS Marketplace account. https://www.google.com/search?q=aws+account+id+679593333241 |
|
Any update to the likely date for official CentOS 8 AMIs? | |
Is there a technical issue as to why we don't have an official CentOS 8 AMI on AWS or is it just a prioritisation issue? Looking at a previous comment from January - "were pretty close to getting 8.1 out of the door, as soon as that hits, i will aim to get the AMI's up within a week from 8.1 drop for x86 and aarch64". CentOS 8.1 was released mid Jan and we are now in April with no official CentOS 8 AMI. |
|
The best thing here is that .. in t imes when everyone should shutdown all centos 6 servers and move forward They just leave biggest cloud provider with no solution and forcing a choice .. use official centos 7 or paid centos 8 or DIY. I cant imaging case where someone should choose centos 7 - 1 month after centos 8.x official release for new servers. Probably aws didnt pay centos so they ignore them :) |
|
I overcome my frustrations and I am using this :https://aws.amazon.com/marketplace/pp/B083V66BJ4 Yes, its paid CentOS 8, but its just one extra cent per hour. Not even a full $1 in 4 days. Minimal install, partition and filesystem is automatically extended is you choose bigger volume than default. This is all I need. |
|
I did notice that for AWS VM-Import they no longer have RHEL 8 or CentOS 8 listed as supported: https://docs.aws.amazon.com/vm-import/latest/userguide/vmie_prereqs.html. They used to have them listed, but then they were removed. RHEL 8.1 and CentOS 8.1 were never listed that I saw. Personally, I was able to work around the "Unable to determine kernel version" by putting "GRUB_ENABLE_BLSCFG=true" in /etc/default/grub. But then I got an unsupported kernel version error and noticed none of the CentOS 8.x kernels were listed in the prereqs doc. IDK if the paid AMIs got theirs in with CentOS 8 when it was supported by AWS or if they went with a manual upgrade from CentOS 7. |
|
If you look through this tracker it becomes apparent that there are lots of bugs to deal with. My guess is that they just don't have the bandwidth to get this done. After I saw a post on the forums (https://forums.centos.org/viewtopic.php?f=54&t=71951&start=10#p310689) I gave up and just downloaded the image from https://cloud.centos.org/centos/8/x86_64/images/ and made my own. It only takes a few minutes and then you have your own AMI without any of the restrictions that the AWS Marketplace places on the images because it's all yours! Just don't forget to turn on any daemons you want running and setup a user to SSH in as. I've deployed several so far and they are working great. | |
Sbingram - could you share your process for getting this work? I tried this. It couldn’t get it working | |
We’ve given up waiting and are switching to Ubuntu. This delay feels like Red Hat starving CentOS. | |
I would like to say, to those who are complaining that the CentOS AMI isn’t released, there is no obligation for anyone to release a CentOS AMI or even CentOS at all! While the project has a great history of timely releases, you don’t know if the person who builds the AMIs is sick or just had a kid or is out of work due to corona virus. It’s unfortunate to just see people complaining it isn’t released yet, instead of offering to help. The spirit of an open source project ( while many do provide amazing end user support) is while you software is free, many people donate their time and money and give up family time to get these types of things done. That said, whomever from CentOS reads this, how can I help? How can the community help? Who needs what to get this done? I’m happy to to whatever I can and wrangle people and/or resources. |
|
I know that no one is obligated to release a free CentOS AMI, but I'm willing to put my money where my mouth is. I will pay a $200 bounty by PayPal for the first step-by-step documented process for producing a working CentOS 8.1 AMI from publicly available materials, before 2020-05-20 and before any official CentOS 8.1 AMIs are released, which I am able to replicate with less than eight hours of effort on my part. I realize that $200 isn't a huge amount of money, but it's a whole lot more than $0. I've tried to do this myself, and run into the same issues with "unable to determine kernel version" that most people are reporting. Several people have claimed success in solving or working around this problem, citing things like NVMe drivers, but none so far have provided enough detail that I've been able to replicate their success. |
|
brouhaha did you try the procedure from the forums listed in my earlier post? I followed eohm's steps exactly and I don't think it required over 15-20 minutes to complete. | |
There's an easier way of doing it. Go to https://computingforgeeks.com/create-rhel-centos-8-custom-ami-for-aws-using-image-builder/ and build it. It worked for me with no issues. You should skip the last piece for the [[customizations.user]] in rhel8-base.toml. Once you create an image from the snapshot and launch an instance, you will be able to login as ec2-user. I was using a paid CentOS 8 ami temporarily to test some stuff out and I built the AMI on that instance and created my own CentOS 8 AMI. The CentOS team in general is not responsive when new releases are out. |
|
brouhaha, If you can run qemu/kvm and set up a minimal centos7 install, you can upload the raw disk image and convert it using Amazon's AMI converter tool. I did that successfully with RHEL Workstation7. I was going to give that a go with Centos8. I'll gladly accept beer tokens from you, brouhaha in return for a simple script which you can run to do most of the work. |
|
Same day AMIs from Ubuntu; https://cloud-images.ubuntu.com/locator/ec2/ |
|
@brouhaha Please contact me on shashacs51@gmail.com |
|
I tried created a qemu/kvm c8 instance and then uploaded it to an s3 bucket and tried converting it. these instructions are somwhart abbreviated: https://aws.amazon.com/premiumsupport/knowledge-center/import-server-ec2-instance/ but i got this error: "ClientError: Unable to determine kernel version." sigh. |
|
@speculatrix Do not import as an image directly, import as a snapshot, then register the image using the snapshot using this: https://docs.aws.amazon.com/cli/latest/reference/ec2/import-snapshot.html When you import as in image, the process will verify your kernel, and I think AWS is behind with kernel versions. If you import as a snapshot, there is no kernel verification. Have fun |
|
thanks @adrian27 I will give that a go. I've only used this once ever before and that was to create a genuine RHEL 7 Workstation AMI, which would have had a kernel known to AWS. yes, oddly as it seems, RHEL don't provide an official workstation AMI, I tried converting one by dubious use of rsync from a locally build w/st machine and it all started to go a bit wrong ;-) | |
@speculatrix see my post https://bugs.centos.org/view.php?id=16614#c36736 This works. I used it to build a centos 8 AMI. |
|
Like sbingram, I also followed the instructions in https://forums.centos.org/viewtopic.php?f=54&t=71951&start=10#p310689 and got a working centos8 ami. It took me a few hours to create the ami because I was unfamiliar with the process of going from raw to AWS snapshot, and I'm not allowed to create roles directly :) The other point is that you have to determine the correct device for this step in the instructions - I used lsblk: mount /dev/nvme1n1p1 /mnt |
|
thanks @adrian27 this worked. I imported my raw disk image to make a snapshot, then created an AMI, then created an EC2 instance, but I had to attach the disk to another machine and do the dracut thing and put selinux into permissive. then I attached the disk back to the EC2 instance and did a relabel, and a few tweaks, then turns it into my master centos8 ami. |
|
I'd be happy to share my AMI, but you'd want to replace the SSH keys in the root and centos user's .ssh dir and set your own passwords ;-) | |
It seems to be updated here https://cloud.centos.org/centos/8/x86_64/images/ but not here https://wiki.centos.org/Cloud/AWS/ and on Amazon. |
|
I've written up a markdown set of instructions for generating AMIs of CentOS 8 based on various bits of documentation I've been able to find. Following Amazon's documentation yields (for me, at least) an unbootable instance. The trick appears to be the need to re-run "dracut" to make things work. In case this is helpful for anyone: https://github.com/gebailey/notes/tree/master/building-centos-ec2-amis |
|
Nice, thanks @gbailey, I followed the notes you provided and that seem to have fixed it for me. I was able to convert the qcow2 image into a raw image, then I mounted & chroot:ed into it to run the dracut command, I then uploaded the image onto a AWS S3 bucket as a snapshot, and from that snapshot I created a new image, and lastly I used that image to create a new ec2. From the looks of things the ec2 is running ok, the checks are fine and I can ssh to it using my aws key as user centos :) |
|
> I followed eohm's steps exactly and I don't think it required over 15-20 minutes to complete. That comment really incentivised me to try to build an AMI myself, but since this was my first one, it took me way more time than that, so here is what I did to get it working: 1. Set up a place to run qemu-img and convert the qcow2 file to raw, I could not do it natively cause I'm on macOS 2. Imported raw image as a snapshot, following this: https://docs.aws.amazon.com/vm-import/latest/userguide/vmimport-import-snapshot.html (you may need to run previous steps to setup S3 and the importvm profile properly, just follow previous steps on the left of this same page) 3. Launched an RHEL 8 instance, created a volume from snapshot above, chrooted into it and run dracut, following https://forums.centos.org/viewtopic.php?f=54&t=71951&start=10#p310689 (link posted above in the bug). My drives just were diferent, /dev/xvdf* instead of what's in the post, but it's easily adjustable. 4. Created a new snapshot from the volume 5. Created an AMI from the second snapshot It's working great so far! Only downside in that root volume takes 100GB, I couldn't figure out how to make it smaller, but for now, it's not a big deal to me. I also made my AMI public, if anyone wants to use, the ID is the following: CentOS 8.1.1911 - ami-02ed55d40dde6cc64 |
|
Hello, are we ever going to see an "official", CentOS 8.x AMI in the marketplace or is the norm going to be build your own as per the instructions above? What's the official line on this? Would be good to know exactly what's going on instead of just waiting for it to appear :( | |
In a week or two. What week nobody knows. Dont expect any communication either. | |
There was a "CentOS AMA" (Ask me anything) on Reddit yesterday, and someone asked the question: https://www.reddit.com/r/CentOS/comments/gwnvd2/centos_ama/fsw7mg2/ |
|
We pushed and shared CentOS 8.2.2004 AMIs in all regions for both x86_64 and aarch64 architectures. AMIs list was updated here : https://wiki.centos.org/Cloud/AWS Closing this bug report |
|
Date Modified | Username | Field | Change |
---|---|---|---|
2019-10-16 21:14 | hutter2@llnl.gov | New Issue | |
2019-10-16 21:14 | hutter2@llnl.gov | Tag Attached: centos 8 | |
2019-10-30 12:01 | qvindesland | Note Added: 0035605 | |
2019-10-30 13:46 | operation.support@onerain.com | Note Added: 0035607 | |
2019-11-04 11:09 | qvindesland | Note Added: 0035636 | |
2019-11-05 23:26 | jhhaller | Note Added: 0035643 | |
2019-11-15 02:39 | raiden | Note Added: 0035695 | |
2019-11-15 08:54 | qvindesland | Note Added: 0035697 | |
2019-11-15 15:12 | raiden | Note Added: 0035700 | |
2019-11-15 15:17 | qvindesland | Note Added: 0035701 | |
2020-01-06 15:58 | shubbeh | Note Added: 0035943 | |
2020-01-09 13:54 | TimL | Note Added: 0035981 | |
2020-01-09 14:06 | kbsingh@karan.org | Note Added: 0035982 | |
2020-01-09 14:56 | TimL | Note Added: 0035983 | |
2020-01-09 15:48 | kbsingh@karan.org | Note Added: 0035984 | |
2020-01-09 19:11 | hutter2@llnl.gov | Note Added: 0035988 | |
2020-01-23 18:13 | speculatrix | Note Added: 0036106 | |
2020-01-24 02:35 | rm | Note Added: 0036109 | |
2020-01-27 10:33 | jormatuomainen | Note Added: 0036129 | |
2020-01-27 12:59 | thiago.antonio | Note Added: 0036134 | |
2020-02-05 22:21 | erouan | Note Added: 0036208 | |
2020-02-06 10:59 | adrian27 | Note Added: 0036215 | |
2020-02-07 15:17 | speculatrix | Note Added: 0036225 | |
2020-02-17 18:45 | sbingram | Note Added: 0036301 | |
2020-02-26 12:33 | DreamHealer | Note Added: 0036385 | |
2020-02-26 15:25 | drekinov | Note Added: 0036387 | |
2020-02-26 22:09 | TimL | Note Added: 0036392 | |
2020-03-11 13:29 | operation.support@onerain.com | Note Added: 0036489 | |
2020-03-23 16:29 | TimL | Note Added: 0036551 | |
2020-03-26 17:11 | shashaa35 | Note Added: 0036588 | |
2020-03-26 17:21 | speculatrix | Note Added: 0036589 | |
2020-03-26 19:09 | shashaa35 | Note Added: 0036590 | |
2020-03-26 19:39 | sbutler | Note Added: 0036591 | |
2020-03-31 15:15 | iay | Note Added: 0036628 | |
2020-04-09 11:59 | chrixm | Note Added: 0036661 | |
2020-04-09 12:04 | drekinov | Note Added: 0036662 | |
2020-04-09 12:12 | adrian27 | Note Added: 0036663 | |
2020-04-09 15:13 | sbutler | Note Added: 0036665 | |
2020-04-09 20:52 | sbingram | Note Added: 0036668 | |
2020-04-09 21:30 | punkrokk | Note Added: 0036669 | |
2020-04-09 21:46 | michael_sis | Note Added: 0036670 | |
2020-04-09 21:59 | punkrokk | Note Added: 0036672 | |
2020-04-20 19:07 | brouhaha | Note Added: 0036734 | |
2020-04-20 20:05 | sbingram | Note Added: 0036735 | |
2020-04-20 21:26 | 3cents | Note Added: 0036736 | |
2020-04-20 23:24 | speculatrix | Note Added: 0036738 | |
2020-04-23 18:52 | TimL | Note Added: 0036758 | |
2020-04-25 18:43 | shashaa35 | Note Added: 0036769 | |
2020-04-27 10:28 | speculatrix | Note Added: 0036771 | |
2020-04-27 10:47 | adrian27 | Note Added: 0036773 | |
2020-04-27 17:23 | speculatrix | Note Added: 0036776 | |
2020-04-27 17:37 | 3cents | Note Added: 0036777 | |
2020-04-28 22:34 | rm | Note Added: 0036804 | |
2020-04-29 16:39 | speculatrix | Note Added: 0036818 | |
2020-04-29 16:43 | speculatrix | Note Added: 0036819 | |
2020-05-12 07:26 | lee.jnk | Note Added: 0036922 | |
2020-05-13 17:27 | gbailey | Note Added: 0036929 | |
2020-05-14 15:24 | DreamHealer | Note Added: 0036931 | |
2020-05-17 13:30 | brunojcm | Note Added: 0036952 | |
2020-06-04 15:25 | drmunki | Note Added: 0037036 | |
2020-06-05 10:39 | 3cents | Note Added: 0037041 | |
2020-06-06 05:02 | tvartom | Note Added: 0037047 | |
2020-06-16 06:28 | arrfab | Status | new => resolved |
2020-06-16 06:28 | arrfab | Resolution | open => fixed |
2020-06-16 06:28 | arrfab | Note Added: 0037121 |