View Issue Details

Jump to NotesJump to History
IDProjectCategoryView StatusDate SubmittedLast Update
0017308CentOS-7ImageMagickpublic2020-04-29 15:452020-04-30 14:21
ReporterMatthew.Jochum Assigned To 
PrioritynormalSeveritymajorReproducibilityalways
Status newResolutionopen 
Platformx86_64OSCentOSOS Version7.8
Summary0017308: ImageMagick 6.9 Upgrade Causes Huge Increase in CPU and Memory Usage
DescriptionYesterday we upgraded our test hosts to CentOS 7.8, which included an upgrade to ImageMagick from 6.7 to 6.9. This upgrade caused a noticeable and detrimental effect in the use of the convert command. Processing time went from ~3 seconds to ~26 seconds in our 5425x5424 pixel images. The delays scaled by a factor of 4x, given the X by Y increase in pixels.
Steps To Reproducecd /dev/shm

wget https://cdn.star.nesdis.noaa.gov/GOES16/ABI/FD/09/5424x5424.jpg

convert -version

time convert -define registry:temporary-path=/dev/shm/ -limit memory 2gb 20201201440_GOES16-ABI-FD-02-LOWLIGHT4-5424x5424.jpg -gravity south -chop 0x12 -font Liberation-Sans-Regular -pointsize 40 -fill black -gravity South label:'April 29 2020 14:40Z GOES-East ABI Band 1o - Full Disk' -gravity Center -append /opt/deployed/goes16-imagery//noaa_logo//noaa_logo_350px.png -gravity SouthWest -geometry +24+42 -composite -resize 5424x5424! OLD_IM.jpg

sudo yum versionlock clear && sudo yum -y update ImageMagick 1</dev/null 2</dev/null

convert -version

time convert -define registry:temporary-path=/dev/shm/ -limit memory 2gb 20201201440_GOES16-ABI-FD-02-LOWLIGHT4-5424x5424.jpg -gravity south -chop 0x12 -font Liberation-Sans-Regular -pointsize 40 -fill black -gravity South label:'April 29 2020 14:40Z GOES-East ABI Band 10 - Full Disk' -gravity Center -append /opt/deployed/goes16-imagery//noaa_logo//noaa_logo_350px.png -gravity SouthWest -geometry +24+42 -composite -resize 5424x5424! NEW_IM.jpg

Additional InformationWe produce nearly 1 million JPGs every day from our satellite data. Any increase in CPU usage, memory usage, or overall processing time has a ripple effect that is hard to recover from, given the rapidity volume(MB) of data.
TagsImageMagick CentOS7
abrt_hash
URLhttps://www.star.nesdis.noaa.gov/goes/index.php

Activities

ManuelWolfshant

ManuelWolfshant

2020-04-29 17:04

manager   ~0036821

Since CentOS only rebuilds from the sources provided by RH, only they can provide fixes. Therefore I suggest to open a bug at bugzilla.redhat.com. For easier tracking, please crosslink this bug and the one from b.r.c.
khaytsus

khaytsus

2020-04-29 21:05

reporter   ~0036826

I do VERY SIMPLE processing with Image Magick, basically the text "A=1 4/29/2020" that's generated daily for something of mine, and mine started shifting all the text off the top of the page and took about 4x as long. I added a manual pointsize to the labels and that made it return to creating instantly for me. I hope this helps.

I originally had this, which was slow and broken (no "A=1" text):
convert -background transparent \( -size 300x200 -gravity North label:"A:1" \) \( -size 100x100 -gravity South label:"4/29/2020" \) +append -trim test.png

Realized that without -gravity North it worked, but was very slow, so on a whim added the pointsize:
convert -background transparent \( -size 300x200 -pointsize 150 label:"A=1" \) \( -size 100x100 -pointsize 20 -gravity South label:"4/29/2020" \) +append -trim test.png
Matthew.Jochum

Matthew.Jochum

2020-04-30 14:21

reporter   ~0036832

https://bugzilla.redhat.com/show_bug.cgi?id=1829533

Issue History

Date Modified Username Field Change
2020-04-29 15:45 Matthew.Jochum New Issue
2020-04-29 15:45 Matthew.Jochum Tag Attached: ImageMagick CentOS7
2020-04-29 17:04 ManuelWolfshant Note Added: 0036821
2020-04-29 21:05 khaytsus Note Added: 0036826
2020-04-30 14:21 Matthew.Jochum Note Added: 0036832