View Issue Details

IDProjectCategoryView StatusLast Update
0016067Buildsysgit.centos.orgpublic2019-08-12 19:48
Reporterquanah 
PrioritynormalSeveritymajorReproducibilityalways
Status newResolutionopen 
Summary0016067: With migration to new git.centos.org configuration, it is no longer possible to git fetch
DescriptionI have my own local fork of the OpenLDAP RPM repo from git.centos.org. I add a remote for the centos repository. Since the migration to the new git.centos.org, it is no longer possible to use git fetch to retrieve the updated refs etc
Steps To ReproduceAdd the git.centos.org remote:

git remote add centos-upstream https://git.centos.org/rpms/openldap.git
git fetch centos-upstream (At this point, it hangs forever)

Debugging shows:

GIT_TRACE=1 GIT_TRACE_PACK_ACCESS=1 git fetch -v --progress centos-upstream
15:50:40.254118 git.c:419 trace: built-in: git fetch -v --progress centos-upstream
15:50:40.256525 run-command.c:643 trace: run_command: GIT_DIR=.git git-remote-https centos-upstream https://git.centos.org/rpms/openldap.git
15:50:40.908100 run-command.c:643 trace: run_command: git fetch-pack --stateless-rpc --stdin --lock-pack --include-tag --thin https://git.centos.org/rpms/openldap.git/
15:50:40.915182 git.c:419 trace: built-in: git fetch-pack --stateless-rpc --stdin --lock-pack --include-tag --thin https://git.centos.org/rpms/openldap.git/
15:50:40.916827 packfile.c:1592 .git/objects/pack/pack-005025242b48b2e8cf1e93d9215d803f12fa74ae.pack 3880
15:50:40.921629 packfile.c:1592 .git/objects/pack/pack-005025242b48b2e8cf1e93d9215d803f12fa74ae.pack 1703
15:50:40.922190 packfile.c:1592 .git/objects/pack/pack-005025242b48b2e8cf1e93d9215d803f12fa74ae.pack 12
15:50:40.922484 packfile.c:1592 .git/objects/pack/pack-005025242b48b2e8cf1e93d9215d803f12fa74ae.pack 3193
15:50:40.922531 packfile.c:1592 .git/objects/pack/pack-005025242b48b2e8cf1e93d9215d803f12fa74ae.pack 3025
15:50:40.922552 packfile.c:1592 .git/objects/pack/pack-005025242b48b2e8cf1e93d9215d803f12fa74ae.pack 2519
15:50:40.922572 packfile.c:1592 .git/objects/pack/pack-005025242b48b2e8cf1e93d9215d803f12fa74ae.pack 2858
15:50:40.922592 packfile.c:1592 .git/objects/pack/pack-005025242b48b2e8cf1e93d9215d803f12fa74ae.pack 2687
15:50:40.922612 packfile.c:1592 .git/objects/pack/pack-005025242b48b2e8cf1e93d9215d803f12fa74ae.pack 2186
15:50:40.922632 packfile.c:1592 .git/objects/pack/pack-005025242b48b2e8cf1e93d9215d803f12fa74ae.pack 2016
15:50:40.922712 packfile.c:1592 .git/objects/pack/pack-005025242b48b2e8cf1e93d9215d803f12fa74ae.pack 2353
15:50:40.923153 packfile.c:1592 .git/objects/pack/pack-005025242b48b2e8cf1e93d9215d803f12fa74ae.pack 3360
15:50:40.923446 packfile.c:1592 .git/objects/pack/pack-005025242b48b2e8cf1e93d9215d803f12fa74ae.pack 567
POST git-upload-pack (gzip 1166 to 550 bytes)
15:50:43.108756 packfile.c:1592 .git/objects/pack/pack-005025242b48b2e8cf1e93d9215d803f12fa74ae.pack 885
15:50:43.109386 packfile.c:1592 .git/objects/pack/pack-005025242b48b2e8cf1e93d9215d803f12fa74ae.pack 195


(It is now 16:30, so 40 minutes later, no progress)


I can directly clone the repository w/o issue, so the problem seems specific to the fetch capability.
TagsNo tags attached.

Activities

quanah

quanah

2019-05-10 23:18

reporter   ~0034444

Just to note, it's still stuck at the same spot, all these hours later.
smooge

smooge

2019-05-14 17:35

reporter   ~0034464

What is the ip address you are coming from and what is the timezone for the logs to try and align with any logs?
quanah

quanah

2019-05-14 17:40

reporter   ~0034465

IP address should be 47.208.128.44 and the timezone in the log file above is GMT/Zulu time.

Thanks!
quanah

quanah

2019-05-14 17:41

reporter   ~0034466

Although it's possible that the IP may be different, as my ISP did reset the connection recently (I don't recall if it was before/after I ran the fetch command). If necessary, I can re-run it.
paelzer

paelzer

2019-06-03 07:40

reporter   ~0034582

Hi,
I wanted to mention that I'm affected by the same for quite a while (a few weeks maybe).
I also used to have remotes added and git fetch hang on them.

To check on the only obvious difference being no master branch I have played with -m and -t options but to no useful effect.
I have realized you can have centos remotes syncing, even multiple of them together like https://git.centos.org/rpms/qemu-kvm and https://git.centos.org/rpms/qemu-kvm-ma.git.
As long as there are no others.

It might be related to "which other" remotes are in the repository but I haven't found the detail that makes the difference.
quanah

quanah

2019-06-03 16:04

reporter   ~0034588

I only have the one remote. Still unable to fetch.
quanah

quanah

2019-06-27 15:06

reporter   ~0034748

Hello, anyone? This is a serious problem with the centos git migration. Can this please be examined and resolved? Thanks!
quanah

quanah

2019-07-22 13:41

reporter   ~0034863

Still unable to git fetch. Currently what I get is:

GIT_CURL_VERBOSE=1 GIT_TRACE=1 git fetch -vvv centos-upstream
13:39:41.902699 git.c:439 trace: built-in: git fetch -vvv centos-upstream
13:39:41.905264 run-command.c:663 trace: run_command: GIT_DIR=.git git-remote-https centos-upstream https://git.centos.org/rpms/openldap.git
* Couldn't find host git.centos.org in the .netrc file; using defaults
* Trying 8.43.84.211...
* TCP_NODELAY set
* Connected to git.centos.org (8.43.84.211) port 443 (#0)
* found 133 certificates in /etc/ssl/certs/ca-certificates.crt
* found 402 certificates in /etc/ssl/certs
* ALPN, offering http/1.1
* SSL connection using TLS1.2 / ECDHE_RSA_AES_256_GCM_SHA384
* server certificate verification OK
* server certificate status verification SKIPPED
* common name: git.centos.org (matched)
* server certificate expiration date OK
* server certificate activation date OK
* certificate public key: RSA
* certificate version: #3
* subject: C=US,ST=North Carolina,L=Raleigh,O=Red Hat Inc.,CN=git.centos.org
* start date: Fri, 17 Nov 2017 00:00:00 GMT
* expire date: Tue, 12 Jan 2021 12:00:00 GMT
* issuer: C=US,O=DigiCert Inc,OU=www.digicert.com,CN=DigiCert SHA2 High Assurance Server CA
* compression: NULL
* ALPN, server did not agree to a protocol
> GET /rpms/openldap.git/info/refs?service=git-upload-pack HTTP/1.1
Host: git.centos.org
User-Agent: git/2.22.0
Accept: */*
Accept-Encoding: deflate, gzip
Accept-Language: en-US, *;q=0.9
Pragma: no-cache

< HTTP/1.1 200 OK
< Date: Mon, 22 Jul 2019 13:39:42 GMT
< Server: Apache/2.4.6 (CentOS) OpenSSL/1.0.2k-fips mod_wsgi/3.4 Python/2.7.5
< x-xss-protection: 1; mode=block
< content-security-policy: default-src 'none'
< x-content-type-options: nosniff
< strict-transport-security: max-age=31536000
< cache-control: no-cache
< x-frame-options: DENY
< referrer-policy: no-referrer
< x-repospanner-nodename: centos01
< Set-Cookie: pagure=eyJfcGVybWFuZW50Ijp0cnVlLCJjc3JmIjp7IiBiIjoiWlRnMlltUTJaVEF5WldWbVlXRmxNalk0T1RNNU5qQXlZMlU1T1RnNU5UQXdOVE00TTJJMk53PT0ifX0.EBdOHg.QPseQ7_eQcKvBFrD9DVlpDy2bxA; Expires=
Thu, 22-Aug-2019 13:39:42 GMT; Secure; HttpOnly; Path=/
< Transfer-Encoding: chunked
< Content-Type: application/x-git-upload-pack-advertisement
<
* Connection #0 to host git.centos.org left intact
13:39:42.698249 run-command.c:663 trace: run_command: git fetch-pack --stateless-rpc --stdin --lock-pack --include-tag --thin -v -v https://git.centos.org/rpms/openldap.git/
13:39:42.706014 git.c:439 trace: built-in: git fetch-pack --stateless-rpc --stdin --lock-pack --include-tag --thin -v -v https://git.centos.org/rpms/openldap.git/
Server supports multi_ack_detailed
Server supports no-done
Server supports side-band-64k
Server supports allow-tip-sha1-in-want
Server supports allow-reachable-sha1-in-want
Server version is repoSpanner/0.5+10.e4df0439a0f696f71c1f2fee285dc2022d435839.el7.infra
Marking 6e577a6c4330e5f42c16d9e596c7e027db3c08a5 as complete
Marking c07fc219baac7a9b7efed657e6bbf2cb360d56e0 as complete
Marking 5f1ff0fa439f4db242330974a14c2457c01fad53 as complete
Marking 0ddf00d8ba812e0f088b44c8bdfed2ca0a2219e3 as complete
Marking 64434bd317cb08c08c47798120a1f09250f670a7 as complete
Marking 3b147ac26c8c89946c769c75944e25038025b338 as complete
Marking 066b15f7509827eca22614ca0f007109a1bcb898 as complete
Marking 465fbd8853cd05852896d1f0247cf9e271689cd0 as complete
Marking 7ea064495417c61a9e776c11a6d831dbf2394d65 as complete
Marking cb81eb15e762376df3e6224899892cbf5273109b as complete
Marking c86ef4c371a4799e9f4e1afe3da3630ed7c64b91 as complete
Marking 17ff3c55e3176ad9e96c37bcc7871f88d0ad7e17 as complete
want a37f561028822f3373dd2ebfe07ad1fbb6bff0a4 (refs/heads/c4)
want a37f561028822f3373dd2ebfe07ad1fbb6bff0a4 (refs/heads/c5)
want a37f561028822f3373dd2ebfe07ad1fbb6bff0a4 (refs/heads/c5-plus)
want a37f561028822f3373dd2ebfe07ad1fbb6bff0a4 (refs/heads/c6)
want a37f561028822f3373dd2ebfe07ad1fbb6bff0a4 (refs/heads/c6-plus)
already have 17ff3c55e3176ad9e96c37bcc7871f88d0ad7e17 (refs/heads/c7)
already have 0da05883d57c32e55b7ccd04018d880ad867551b (refs/heads/c7-alt)
want 3b9fe0adfb3ecc590fe36b36e4561a708b892083 (refs/heads/c8)
have 6e577a6c4330e5f42c16d9e596c7e027db3c08a5
have c07fc219baac7a9b7efed657e6bbf2cb360d56e0
have 5f1ff0fa439f4db242330974a14c2457c01fad53
have 0ddf00d8ba812e0f088b44c8bdfed2ca0a2219e3
have 64434bd317cb08c08c47798120a1f09250f670a7
have 3b147ac26c8c89946c769c75944e25038025b338
have 066b15f7509827eca22614ca0f007109a1bcb898
have 465fbd8853cd05852896d1f0247cf9e271689cd0
have 7ea064495417c61a9e776c11a6d831dbf2394d65
have cb81eb15e762376df3e6224899892cbf5273109b
have c86ef4c371a4799e9f4e1afe3da3630ed7c64b91
have 17ff3c55e3176ad9e96c37bcc7871f88d0ad7e17
have 0da05883d57c32e55b7ccd04018d880ad867551b
have b710131f729eb3f63ea0f4631665574bd40b5612
have 17dfde8fba0b30412ef708fd5e4e3ade8d2e0c62
have dc1b8b9716fdacf5b71967857620e01e3cc0ae59
POST git-upload-pack (gzip 1166 to 550 bytes)
* Couldn't find host git.centos.org in the .netrc file; using defaults
* Found bundle for host git.centos.org: 0x556c455c7da0 [can pipeline]
* Re-using existing connection! (#0) with host git.centos.org
* Connected to git.centos.org (8.43.84.211) port 443 (#0)
> POST /rpms/openldap.git/git-upload-pack HTTP/1.1
Host: git.centos.org
User-Agent: git/2.22.0
Accept-Encoding: deflate, gzip
Content-Type: application/x-git-upload-pack-request
Accept: application/x-git-upload-pack-result
Content-Encoding: gzip
Content-Length: 550

* upload completely sent off: 550 out of 550 bytes
< HTTP/1.1 200 OK
< Date: Mon, 22 Jul 2019 13:39:42 GMT
< Server: Apache/2.4.6 (CentOS) OpenSSL/1.0.2k-fips mod_wsgi/3.4 Python/2.7.5
< x-xss-protection: 1; mode=block
< content-security-policy: default-src 'none'
< x-content-type-options: nosniff
< strict-transport-security: max-age=31536000
< cache-control: no-cache
< x-frame-options: DENY
< referrer-policy: no-referrer
< x-repospanner-nodename: centos01
< Set-Cookie: pagure=eyJfcGVybWFuZW50Ijp0cnVlLCJjc3JmIjp7IiBiIjoiT0dZME5qTm1NakptTVdaaU5HVTRZalZoTUdObE5EbGlPV0V4TVRKaE9XSXhOMlV3TTJZMVlnPT0ifX0.EBdOIA.0LpNZmDV-PVyny0D6ip_zTgERIs; Expires=Thu, 22-Aug-2019 13:39:44 GMT; Secure; HttpOnly; Path=/
< Content-Length: 285
< Content-Type: text/plain; charset=utf-8
<
* Connection #0 to host git.centos.org left intact
got ack 3 17ff3c55e3176ad9e96c37bcc7871f88d0ad7e17
got ack 3 0da05883d57c32e55b7ccd04018d880ad867551b
got ack 4 b710131f729eb3f63ea0f4631665574bd40b5612
got ack 4 17dfde8fba0b30412ef708fd5e4e3ade8d2e0c62
got ack 4 dc1b8b9716fdacf5b71967857620e01e3cc0ae59
done


Then nothing further occurs. This makes it virtually impossible to maintain my forked repository. When will there be an update on this, it's been over 2 months since CentOS broke this.
halovan

halovan

2019-08-12 19:48

reporter   ~0034968

I wanted to mention that I, too, seem to be affected by the same issue for a few months now. We track multiple repositories, and about two months ago, saw the same issue.

Our work around has been to remove the repo locally and redo the clone and add locally tracked repo manually in order to perform what used to be a simple fetch. Getting this fixed would allow us to get back to a normal workflow.

Issue History

Date Modified Username Field Change
2019-05-10 16:30 quanah New Issue
2019-05-10 23:18 quanah Note Added: 0034444
2019-05-14 17:35 smooge Note Added: 0034464
2019-05-14 17:40 quanah Note Added: 0034465
2019-05-14 17:41 quanah Note Added: 0034466
2019-06-03 07:40 paelzer Note Added: 0034582
2019-06-03 16:04 quanah Note Added: 0034588
2019-06-27 15:06 quanah Note Added: 0034748
2019-07-22 13:41 quanah Note Added: 0034863
2019-08-12 19:48 halovan Note Added: 0034968