View Issue Details

IDProjectCategoryView StatusLast Update
0016614CentOS-8Cloud-Imagespublic2020-06-16 06:28
Reporterhutter2@llnl.gov 
PriorityhighSeveritymajorReproducibilityalways
Status resolvedResolutionfixed 
Product Version 
Target VersionFixed in Version 
Summary0016614: No Centos 8 AMIs
DescriptionI'd like to request Centos 8 AMI images. You currently provide them for Centos 6 and 7, but not 8:

https://wiki.centos.org/Cloud/AWS
https://aws.amazon.com/marketplace/seller-profile?id=16cb8b03-256e-4dde-8f34-1b0f377efe89

The ZFS on Linux project uses Centos AMIs for our automated testing. We currently can't release Centos 8 ZFS RPMs, since we have no way to test them without the AMIs:

https://github.com/zfsonlinux/zfs/issues/9287
Tagscentos 8

Activities

qvindesland

qvindesland

2019-10-30 12:01

reporter   ~0035605

We really need to get this resolved asap....is there a way that I can assist building the image?
operation.support@onerain.com

operation.support@onerain.com

2019-10-30 13:46

reporter   ~0035607

Red Hat Enterprise Linux 8 AMI was built by Amazon Web Services. They have been available since July 2019.
CentOS.org has built the previous official AMI.
I am assuming it is not a technical issue to build a certified AMI, but one of priority.
qvindesland

qvindesland

2019-11-04 11:09

reporter   ~0035636

So where should the request be made for a Centos ami? I am not interested in the RH ami's
jhhaller

jhhaller

2019-11-05 23:26

reporter   ~0035643

This is in the Cloud Instance SIG purview - https://wiki.centos.org/SpecialInterestGroup/CloudInstance
 
There's a kickstart file for a generic CentOS 8 cloud image in this pull request:
 https://github.com/CentOS/sig-cloud-instance-build/pull/159/commits/2c542bb2b1bc54c007fbf57a5da0a3213ce73fbb

There's also an outstanding pull request for an Azure image kickstart file for CentOS 8

I'm sure they would be happy to accept changes to build an AMI, should someone create one.
raiden

raiden

2019-11-15 02:39

reporter   ~0035695

I tried to https://github.com/CentOS/sig-cloud-instance-build/pull/159/commits/2c542bb2b1bc54c007fbf57a5da0a3213ce73fbb (and turned off BLS) and when attempting to import to AWS (amazon-import), it fails with

Unsupported kernel version 4.18.0-80.el8.x86_64

Any way to fix this?
qvindesland

qvindesland

2019-11-15 08:54

reporter   ~0035697

I got the same error....it's a bit funny since I installed a RH 8.0 in AWS which is running the same kernel version the only difference is that the RH kernel is tagged with RH in the end.

I ended up following this article https://weldr.io/Pushing-Images-to-AWS/ which works really well.
raiden

raiden

2019-11-15 15:12

reporter   ~0035700

If you made a CentOS 8 image and uploaded it to AWS via https://weldr.io/Pushing-Images-to-AWS/, I will try it out. Thanks
qvindesland

qvindesland

2019-11-15 15:17

reporter   ~0035701

It works just make sure that you get both cloud-init.noarch and cloud-utils-growpart.noarch installed without cloud-utils-growpart.noarch changing the EBS disk size wont be discovered by Centos.
shubbeh

shubbeh

2020-01-06 15:58

reporter   ~0035943

Looking at AWS us-east-1: what are the images published by owner 679593333241? That's the same owner ID as the official CentOS 7 images (e.g. ami-02eac2c0129f6376b which is the latest published). If you just go to us-east-1 > EC2 > AMIs > select Public images > search for "centos8", you'll find the images I'm talking about. For example:
- ami-034a46a96c820cc75 (CentOS 8 Minimal Latest with Updates-f399b70b-09d8-4df4-ba78-bc1813b4b257-ami-063710974a98495cb.4)
- ami-0c69cc337830690b6 (CentOS8-ENA-AWS-cea6f7dd-49db-40fd-a49e-16617be018a3-ami-025c3654e9b105dbb.4)
And others (there's a dozen). I haven't tested any of them, but are they official?
TimL

TimL

2020-01-09 13:54

reporter   ~0035981

@shubbeh No; the official builds are linked in the Issue Description;
https://aws.amazon.com/marketplace/seller-profile?id=16cb8b03-256e-4dde-8f34-1b0f377efe89

The only official-ish comment I could find was the Forum Moderator who seemed to not care;
https://forums.centos.org/viewtopic.php?f=54&t=71951
kbsingh@karan.org

kbsingh@karan.org

2020-01-09 14:06

administrator   ~0035982

were pretty close to getting 8.1 out of the door, as soon as that hits, i will aim to get the AMI's up within a week from 8.1 drop for x86 and aarch64.

going forward, I've got 90% of the automation in place to keep the cadence rolling ( expect 4 to 5 updates a year for the base image per distro 6/7/8 in the AMP stack, and a weekly build for BYOI flow )

this is for x86_64, the aarch64 images will lag a bit, but will catchup farily quickly ( by Mar '20 is a good goal to set )
TimL

TimL

2020-01-09 14:56

reporter   ~0035983

Thanks for the quick and detailed answer kbsingh.

The Current 8.1 Timeline Link;
https://wiki.centos.org/About/Building_8.x
is 2 months in and does look close (AFAIR it ranges from 1 to 7 months).
kbsingh@karan.org

kbsingh@karan.org

2020-01-09 15:48

administrator   ~0035984

based on the current status, we shouldnt be more than a week or two to release, the challenge with that board is that it does not quantify the amount of work, so even small checks and changes trigger a package build etc.

A good metric to track is the CR/ drop - once that is in, its safe to assume the content base is done, or extremely close.
hutter2@llnl.gov

hutter2@llnl.gov

2020-01-09 19:11

reporter   ~0035988

> were pretty close to getting 8.1 out of the door, as soon as that hits, i will aim to
> get the AMI's up within a week from 8.1 drop for x86 and aarch64.

Thank you kbsingh!
speculatrix

speculatrix

2020-01-23 18:13

reporter   ~0036106

Am very very eager for the Centos8 AMi to be available because there's a bunch of servers I want to deploy and get rid of python2!

thanks
rm

rm

2020-01-24 02:35

reporter   ~0036109

I'm also anxious for the Centos8 AMI to become officially available.

I noticed that there is a CentOS-8-ec2-8.1.1911-20200113.3.x86_64.qcow2 file available at https://cloud.centos.org/centos/8/x86_64/images/. Is the official AMI going to be created from this file?

Thanks
jormatuomainen

jormatuomainen

2020-01-27 10:33

reporter   ~0036129

Any updates on this?
thiago.antonio

thiago.antonio

2020-01-27 12:59

reporter   ~0036134

Hi,
I am also waiting for CentOS 8.
I need to upload servers on aws and I wanted it to be CentOS but version 7.7 with the 4.4.210 kernel has some
vulnerabilities Specter and Meltdown vulnerabilities.
erouan

erouan

2020-02-05 22:21

reporter   ~0036208

Hi,

I tried to import the CentOS-8-ec2-8.1.1911-20200113.3.x86_64.qcow2 image as an AMI after converting it into raw format. It fails because AWS doesn't recognize the kernel version: "ClientError: Unable to determine kernel version."
adrian27

adrian27

2020-02-06 10:59

reporter   ~0036215

I have found the following CentOS 8.1 images in AWS Marketplace. Not official, but working very well:

CentOS 8 Minimal: https://aws.amazon.com/marketplace/pp/B083V66BJ4
CentOS Stream Minimal: https://aws.amazon.com/marketplace/pp/B0847MKS85

There are other as well, if you search .
speculatrix

speculatrix

2020-02-07 15:17

reporter   ~0036225

I really needed to try centos8 because there were a few specific packages in it newer than 7 which mattered, so I spun up a centos7 AWS image and then upgraded it using these instructions:
https://www.tecmint.com/upgrade-centos-7-to-centos-8/

which worked pretty much perfectly, after the upgrade I rebooted and everything was working fine.
sbingram

sbingram

2020-02-17 18:45

reporter   ~0036301

I see a post from January from kbsingh@karan.org saying that the AMIs would be available shortly after 8.1 release. I do see images at https://cloud.centos.org/centos/8/x86_64/images/. So does this mean that there are still bugs and so the images were rejected by Amazon for the Marketplace?
DreamHealer

DreamHealer

2020-02-26 12:33

reporter   ~0036385

Im also waiting for official CentOS 8 AMI's, any ETA on this?, thanks.
drekinov

drekinov

2020-02-26 15:25

reporter   ~0036387

i sign up just to state my big disappointment that it is 10 months and centos team is not able to deploy official AWS image.
Linode had their official centos 8 image almost next day after centos release.
There was some confusing statements that as soon as 8.1 is relesed there will be aws cloud image. 8.1 was released 5 weeks ago and there is just nothing: not a single line in https://wiki.centos.org/About/Building_8 or https://wiki.centos.org/Cloud/AWS.
it is enough to say we will not support AWS so each person still hoping for official image can switch distribution or figure it out by themselve.
TimL

TimL

2020-02-26 22:09

reporter   ~0036392

There are so many options with Linux
https://upload.wikimedia.org/wikipedia/commons/1/1b/Linux_Distribution_Timeline.svg

But fewer with an LTS option
https://distrowatch.com/search.php?ostype=Linux&category=Server&origin=All&basedon=All&notbasedon=None&desktop=All&architecture=All&package=All&rolling=Fixed+%28LTS%29&isosize=All&netinstall=All&language=All&defaultinit=All&status=Active#simple

And fewer still that are free other than CentOS(10y) there is Ubuntu(10y), Debian(5y), and opensuse(3y).
So really CentOS is only one of two options in its class.
operation.support@onerain.com

operation.support@onerain.com

2020-03-11 13:29

reporter   ~0036489

Karanbir,
Do you have an update on the status of the AMI? I could not find any updates on your progress on any other forums.
Where would I check for the CR/ drop?
TimL

TimL

2020-03-23 16:29

reporter   ~0036551

The CentOS 8 AMI will be a full year late after the RHEL 8 release if it is not released In less than a month...
shashaa35

shashaa35

2020-03-26 17:11

reporter   ~0036588

I am able to see Centos 8 amis from this seller : https://aws.amazon.com/marketplace/pp/B07YLV9Y8H?qid=1585241885656&sr=0-1&ref_=srh_res_product_title
The owner account is same as centos one : 679593333241
How is this possible?
speculatrix

speculatrix

2020-03-26 17:21

reporter   ~0036589

I think the official CentOS marketplace entry is this one:
https://aws.amazon.com/marketplace/seller-profile?id=16cb8b03-256e-4dde-8f34-1b0f377efe89
shashaa35

shashaa35

2020-03-26 19:09

reporter   ~0036590

Both share the same account number. That's why it's confusing.
Is there any timeline, by when we can expect the official build on AWS?
sbutler

sbutler

2020-03-26 19:39

reporter   ~0036591

I believe all images in the AWS Marketplace are owned by the same account, and 679593333241 is the AWS Marketplace account.

https://www.google.com/search?q=aws+account+id+679593333241
iay

iay

2020-03-31 15:15

reporter   ~0036628

Any update to the likely date for official CentOS 8 AMIs?
chrixm

chrixm

2020-04-09 11:59

reporter   ~0036661

Is there a technical issue as to why we don't have an official CentOS 8 AMI on AWS or is it just a prioritisation issue?

Looking at a previous comment from January - "were pretty close to getting 8.1 out of the door, as soon as that hits, i will aim to get the AMI's up within a week from 8.1 drop for x86 and aarch64". CentOS 8.1 was released mid Jan and we are now in April with no official CentOS 8 AMI.
drekinov

drekinov

2020-04-09 12:04

reporter   ~0036662

The best thing here is that .. in t imes when everyone should shutdown all centos 6 servers and move forward

They just leave biggest cloud provider with no solution and forcing a choice .. use official centos 7 or paid centos 8 or DIY.
I cant imaging case where someone should choose centos 7 - 1 month after centos 8.x official release for new servers.

Probably aws didnt pay centos so they ignore them :)
adrian27

adrian27

2020-04-09 12:12

reporter   ~0036663

I overcome my frustrations and I am using this :https://aws.amazon.com/marketplace/pp/B083V66BJ4

Yes, its paid CentOS 8, but its just one extra cent per hour. Not even a full $1 in 4 days.

Minimal install, partition and filesystem is automatically extended is you choose bigger volume than default. This is all I need.
sbutler

sbutler

2020-04-09 15:13

reporter   ~0036665

I did notice that for AWS VM-Import they no longer have RHEL 8 or CentOS 8 listed as supported: https://docs.aws.amazon.com/vm-import/latest/userguide/vmie_prereqs.html. They used to have them listed, but then they were removed. RHEL 8.1 and CentOS 8.1 were never listed that I saw.

Personally, I was able to work around the "Unable to determine kernel version" by putting "GRUB_ENABLE_BLSCFG=true" in /etc/default/grub. But then I got an unsupported kernel version error and noticed none of the CentOS 8.x kernels were listed in the prereqs doc. IDK if the paid AMIs got theirs in with CentOS 8 when it was supported by AWS or if they went with a manual upgrade from CentOS 7.
sbingram

sbingram

2020-04-09 20:52

reporter   ~0036668

If you look through this tracker it becomes apparent that there are lots of bugs to deal with. My guess is that they just don't have the bandwidth to get this done. After I saw a post on the forums (https://forums.centos.org/viewtopic.php?f=54&t=71951&start=10#p310689) I gave up and just downloaded the image from https://cloud.centos.org/centos/8/x86_64/images/ and made my own. It only takes a few minutes and then you have your own AMI without any of the restrictions that the AWS Marketplace places on the images because it's all yours! Just don't forget to turn on any daemons you want running and setup a user to SSH in as. I've deployed several so far and they are working great.
punkrokk

punkrokk

2020-04-09 21:30

reporter   ~0036669

Sbingram - could you share your process for getting this work? I tried this. It couldn’t get it working
michael_sis

michael_sis

2020-04-09 21:46

reporter   ~0036670

We’ve given up waiting and are switching to Ubuntu. This delay feels like Red Hat starving CentOS.
punkrokk

punkrokk

2020-04-09 21:59

reporter   ~0036672

I would like to say, to those who are complaining that the CentOS AMI isn’t released, there is no obligation for anyone to release a CentOS AMI or even CentOS at all!

While the project has a great history of timely releases, you don’t know if the person who builds the AMIs is sick or just had a kid or is out of work due to corona virus. It’s unfortunate to just see people complaining it isn’t released yet, instead of offering to help.

The spirit of an open source project ( while many do provide amazing end user support) is while you software is free, many people donate their time and money and give up family time to get these types of things done.

That said, whomever from CentOS reads this, how can I help? How can the community help? Who needs what to get this done? I’m happy to to whatever I can and wrangle people and/or resources.
brouhaha

brouhaha

2020-04-20 19:07

reporter   ~0036734

I know that no one is obligated to release a free CentOS AMI, but I'm willing to put my money where my mouth is. I will pay a $200 bounty by PayPal for the first step-by-step documented process for producing a working CentOS 8.1 AMI from publicly available materials, before 2020-05-20 and before any official CentOS 8.1 AMIs are released, which I am able to replicate with less than eight hours of effort on my part. I realize that $200 isn't a huge amount of money, but it's a whole lot more than $0.

I've tried to do this myself, and run into the same issues with "unable to determine kernel version" that most people are reporting. Several people have claimed success in solving or working around this problem, citing things like NVMe drivers, but none so far have provided enough detail that I've been able to replicate their success.
sbingram

sbingram

2020-04-20 20:05

reporter   ~0036735

brouhaha did you try the procedure from the forums listed in my earlier post? I followed eohm's steps exactly and I don't think it required over 15-20 minutes to complete.
3cents

3cents

2020-04-20 21:26

reporter   ~0036736

There's an easier way of doing it. Go to https://computingforgeeks.com/create-rhel-centos-8-custom-ami-for-aws-using-image-builder/ and build it. It worked for me with no issues. You should skip the last piece for the [[customizations.user]] in rhel8-base.toml.
Once you create an image from the snapshot and launch an instance, you will be able to login as ec2-user.
I was using a paid CentOS 8 ami temporarily to test some stuff out and I built the AMI on that instance and created my own CentOS 8 AMI.
The CentOS team in general is not responsive when new releases are out.
speculatrix

speculatrix

2020-04-20 23:24

reporter   ~0036738

brouhaha,
If you can run qemu/kvm and set up a minimal centos7 install, you can upload the raw disk image and convert it using Amazon's AMI converter tool. I did that successfully with RHEL Workstation7. I was going to give that a go with Centos8.
I'll gladly accept beer tokens from you, brouhaha in return for a simple script which you can run to do most of the work.
TimL

TimL

2020-04-23 18:52

reporter   ~0036758

Same day AMIs from Ubuntu;
https://cloud-images.ubuntu.com/locator/ec2/
shashaa35

shashaa35

2020-04-25 18:43

reporter   ~0036769

@brouhaha
Please contact me on shashacs51@gmail.com
speculatrix

speculatrix

2020-04-27 10:28

reporter   ~0036771

I tried created a qemu/kvm c8 instance and then uploaded it to an s3 bucket and tried converting it.

these instructions are somwhart abbreviated:
https://aws.amazon.com/premiumsupport/knowledge-center/import-server-ec2-instance/


but i got this error: "ClientError: Unable to determine kernel version."

sigh.
adrian27

adrian27

2020-04-27 10:47

reporter   ~0036773

@speculatrix

Do not import as an image directly, import as a snapshot, then register the image using the snapshot using this: https://docs.aws.amazon.com/cli/latest/reference/ec2/import-snapshot.html

When you import as in image, the process will verify your kernel, and I think AWS is behind with kernel versions. If you import as a snapshot, there is no kernel verification.

Have fun
speculatrix

speculatrix

2020-04-27 17:23

reporter   ~0036776

thanks @adrian27 I will give that a go. I've only used this once ever before and that was to create a genuine RHEL 7 Workstation AMI, which would have had a kernel known to AWS. yes, oddly as it seems, RHEL don't provide an official workstation AMI, I tried converting one by dubious use of rsync from a locally build w/st machine and it all started to go a bit wrong ;-)
3cents

3cents

2020-04-27 17:37

reporter   ~0036777

@speculatrix see my post https://bugs.centos.org/view.php?id=16614#c36736

This works. I used it to build a centos 8 AMI.
rm

rm

2020-04-28 22:34

reporter   ~0036804

Like sbingram, I also followed the instructions in https://forums.centos.org/viewtopic.php?f=54&t=71951&start=10#p310689 and got a working centos8 ami.

It took me a few hours to create the ami because I was unfamiliar with the process of going from raw to AWS snapshot, and I'm not allowed to create roles directly :)

The other point is that you have to determine the correct device for this step in the instructions - I used lsblk:
mount /dev/nvme1n1p1 /mnt
speculatrix

speculatrix

2020-04-29 16:39

reporter   ~0036818

thanks @adrian27 this worked. I imported my raw disk image to make a snapshot, then created an AMI, then created an EC2 instance, but I had to attach the disk to another machine and do the dracut thing and put selinux into permissive.
then I attached the disk back to the EC2 instance and did a relabel, and a few tweaks, then turns it into my master centos8 ami.
speculatrix

speculatrix

2020-04-29 16:43

reporter   ~0036819

I'd be happy to share my AMI, but you'd want to replace the SSH keys in the root and centos user's .ssh dir and set your own passwords ;-)
lee.jnk

lee.jnk

2020-05-12 07:26

reporter   ~0036922

It seems to be updated here

https://cloud.centos.org/centos/8/x86_64/images/

but not here

https://wiki.centos.org/Cloud/AWS/

and on Amazon.
gbailey

gbailey

2020-05-13 17:27

reporter   ~0036929

I've written up a markdown set of instructions for generating AMIs of CentOS 8 based on various bits of documentation I've been able to find. Following Amazon's documentation yields (for me, at least) an unbootable instance. The trick appears to be the need to re-run "dracut" to make things work.

In case this is helpful for anyone:
https://github.com/gebailey/notes/tree/master/building-centos-ec2-amis
DreamHealer

DreamHealer

2020-05-14 15:24

reporter   ~0036931

Nice, thanks @gbailey, I followed the notes you provided and that seem to have fixed it for me.

I was able to convert the qcow2 image into a raw image,
then I mounted & chroot:ed into it to run the dracut command,
I then uploaded the image onto a AWS S3 bucket as a snapshot,
and from that snapshot I created a new image,
and lastly I used that image to create a new ec2.

From the looks of things the ec2 is running ok, the checks are fine and I can ssh to it using my aws key as user centos :)
brunojcm

brunojcm

2020-05-17 13:30

reporter   ~0036952

> I followed eohm's steps exactly and I don't think it required over 15-20 minutes to complete.

That comment really incentivised me to try to build an AMI myself, but since this was my first one, it took me way more time than that, so here is what I did to get it working:

1. Set up a place to run qemu-img and convert the qcow2 file to raw, I could not do it natively cause I'm on macOS
2. Imported raw image as a snapshot, following this: https://docs.aws.amazon.com/vm-import/latest/userguide/vmimport-import-snapshot.html (you may need to run previous steps to setup S3 and the importvm profile properly, just follow previous steps on the left of this same page)
3. Launched an RHEL 8 instance, created a volume from snapshot above, chrooted into it and run dracut, following https://forums.centos.org/viewtopic.php?f=54&t=71951&start=10#p310689 (link posted above in the bug). My drives just were diferent, /dev/xvdf* instead of what's in the post, but it's easily adjustable.
4. Created a new snapshot from the volume
5. Created an AMI from the second snapshot

It's working great so far! Only downside in that root volume takes 100GB, I couldn't figure out how to make it smaller, but for now, it's not a big deal to me.

I also made my AMI public, if anyone wants to use, the ID is the following:

CentOS 8.1.1911 - ami-02ed55d40dde6cc64
drmunki

drmunki

2020-06-04 15:25

reporter   ~0037036

Hello, are we ever going to see an "official", CentOS 8.x AMI in the marketplace or is the norm going to be build your own as per the instructions above? What's the official line on this? Would be good to know exactly what's going on instead of just waiting for it to appear :(
3cents

3cents

2020-06-05 10:39

reporter   ~0037041

In a week or two. What week nobody knows. Dont expect any communication either.
tvartom

tvartom

2020-06-06 05:02

reporter   ~0037047

There was a "CentOS AMA" (Ask me anything) on Reddit yesterday, and someone asked the question:

https://www.reddit.com/r/CentOS/comments/gwnvd2/centos_ama/fsw7mg2/
arrfab

arrfab

2020-06-16 06:28

administrator   ~0037121

We pushed and shared CentOS 8.2.2004 AMIs in all regions for both x86_64 and aarch64 architectures.
AMIs list was updated here : https://wiki.centos.org/Cloud/AWS
Closing this bug report

Issue History

Date Modified Username Field Change
2019-10-16 21:14 hutter2@llnl.gov New Issue
2019-10-16 21:14 hutter2@llnl.gov Tag Attached: centos 8
2019-10-30 12:01 qvindesland Note Added: 0035605
2019-10-30 13:46 operation.support@onerain.com Note Added: 0035607
2019-11-04 11:09 qvindesland Note Added: 0035636
2019-11-05 23:26 jhhaller Note Added: 0035643
2019-11-15 02:39 raiden Note Added: 0035695
2019-11-15 08:54 qvindesland Note Added: 0035697
2019-11-15 15:12 raiden Note Added: 0035700
2019-11-15 15:17 qvindesland Note Added: 0035701
2020-01-06 15:58 shubbeh Note Added: 0035943
2020-01-09 13:54 TimL Note Added: 0035981
2020-01-09 14:06 kbsingh@karan.org Note Added: 0035982
2020-01-09 14:56 TimL Note Added: 0035983
2020-01-09 15:48 kbsingh@karan.org Note Added: 0035984
2020-01-09 19:11 hutter2@llnl.gov Note Added: 0035988
2020-01-23 18:13 speculatrix Note Added: 0036106
2020-01-24 02:35 rm Note Added: 0036109
2020-01-27 10:33 jormatuomainen Note Added: 0036129
2020-01-27 12:59 thiago.antonio Note Added: 0036134
2020-02-05 22:21 erouan Note Added: 0036208
2020-02-06 10:59 adrian27 Note Added: 0036215
2020-02-07 15:17 speculatrix Note Added: 0036225
2020-02-17 18:45 sbingram Note Added: 0036301
2020-02-26 12:33 DreamHealer Note Added: 0036385
2020-02-26 15:25 drekinov Note Added: 0036387
2020-02-26 22:09 TimL Note Added: 0036392
2020-03-11 13:29 operation.support@onerain.com Note Added: 0036489
2020-03-23 16:29 TimL Note Added: 0036551
2020-03-26 17:11 shashaa35 Note Added: 0036588
2020-03-26 17:21 speculatrix Note Added: 0036589
2020-03-26 19:09 shashaa35 Note Added: 0036590
2020-03-26 19:39 sbutler Note Added: 0036591
2020-03-31 15:15 iay Note Added: 0036628
2020-04-09 11:59 chrixm Note Added: 0036661
2020-04-09 12:04 drekinov Note Added: 0036662
2020-04-09 12:12 adrian27 Note Added: 0036663
2020-04-09 15:13 sbutler Note Added: 0036665
2020-04-09 20:52 sbingram Note Added: 0036668
2020-04-09 21:30 punkrokk Note Added: 0036669
2020-04-09 21:46 michael_sis Note Added: 0036670
2020-04-09 21:59 punkrokk Note Added: 0036672
2020-04-20 19:07 brouhaha Note Added: 0036734
2020-04-20 20:05 sbingram Note Added: 0036735
2020-04-20 21:26 3cents Note Added: 0036736
2020-04-20 23:24 speculatrix Note Added: 0036738
2020-04-23 18:52 TimL Note Added: 0036758
2020-04-25 18:43 shashaa35 Note Added: 0036769
2020-04-27 10:28 speculatrix Note Added: 0036771
2020-04-27 10:47 adrian27 Note Added: 0036773
2020-04-27 17:23 speculatrix Note Added: 0036776
2020-04-27 17:37 3cents Note Added: 0036777
2020-04-28 22:34 rm Note Added: 0036804
2020-04-29 16:39 speculatrix Note Added: 0036818
2020-04-29 16:43 speculatrix Note Added: 0036819
2020-05-12 07:26 lee.jnk Note Added: 0036922
2020-05-13 17:27 gbailey Note Added: 0036929
2020-05-14 15:24 DreamHealer Note Added: 0036931
2020-05-17 13:30 brunojcm Note Added: 0036952
2020-06-04 15:25 drmunki Note Added: 0037036
2020-06-05 10:39 3cents Note Added: 0037041
2020-06-06 05:02 tvartom Note Added: 0037047
2020-06-16 06:28 arrfab Status new => resolved
2020-06-16 06:28 arrfab Resolution open => fixed
2020-06-16 06:28 arrfab Note Added: 0037121