View Issue Details

IDProjectCategoryView StatusLast Update
0000238AlmaLinux-8-OTHERpublic2022-05-24 06:06
Reporterakqroldhaber Assigned To 
PrioritynormalSeveritytextReproducibilityalways
Status newResolutionopen 
Platformx68_64OSAlmaLinux OS Version8.6
Summary0000238: RH Satellite 6 - Sync AlmaLinux 8 Appstream Repo "https://repo.almalinux.org/almalinux/8/AppStream/x86_64/os/" fails
DescriptionRH Satellite 6 - Sync AlmaLinux 8 Appstream Repo "https://repo.almalinux.org/almalinux/8/AppStream/x86_64/os/" fails with
"PLP0000: Importer indicated a failed response".

Sync Upstream https://repo.almalinux.org/almalinux/8.6/AppStream/ fails with "RPM1004: Error retrieving metadata: Not Found"
TagsNo tags attached.
abrt_hash
URL

Activities

Hitamashi

2022-05-20 07:57

reporter   ~0000568

Similar issue found on katello
Current version:
pulp-server-2.21.5-1.el7.noarch
katello-3.18.4-1.el7.noarch
foreman-2.3.5-1.el7.noarch

---
Output katello task:
{"pulp_tasks"=>
  [{"exception"=>nil,
    "task_type"=>"pulp.server.managers.repo.sync.sync",
    "_href"=>"/pulp/api/v2/tasks/de72077f-561c-4ff8-b6cf-ad47b90d6c34/",
    "task_id"=>"de72077f-561c-4ff8-b6cf-ad47b90d6c34",
    "tags"=>
     ["pulp:repository:f2ba1795-07bc-432d-9d87-95c9e5333310",
      "pulp:action:sync"],
    "finish_time"=>"2022-05-19T23:22:42Z",
    "_ns"=>"task_status",
    "start_time"=>"2022-05-19T23:21:08Z",
    "traceback"=>
     "Traceback (most recent call last):\n" +
     " File \"/usr/lib/python2.7/site-packages/celery/app/trace.py\", line 367, in trace_task\n" +
     " R = retval = fun(*args, **kwargs)\n" +
     " File \"/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py\", line 688, in __call__\n" +
     " return super(Task, self).__call__(*args, **kwargs)\n" +
     " File \"/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py\", line 110, in __call__\n" +
     " return super(PulpTask, self).__call__(*args, **kwargs)\n" +
     " File \"/usr/lib/python2.7/site-packages/celery/app/trace.py\", line 622, in __protected_call__\n" +
     " return self.run(*args, **kwargs)\n" +
     " File \"/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py\", line 860, in sync\n" +
     " raise pulp_exceptions.PulpExecutionException(_('Importer indicated a failed response'))\n" +
     "PulpExecutionException: Importer indicated a failed response\n",
    "spawned_tasks"=>[],
    "progress_report"=>
     {"yum_importer"=>
       {"content"=>
         {"items_total"=>0,
          "state"=>"FINISHED",
          "error_details"=>[],
          "details"=>
           {"rpm_total"=>0, "rpm_done"=>0, "drpm_total"=>0, "drpm_done"=>0},
          "size_total"=>0,
          "size_left"=>0,
          "items_left"=>0},
        "comps"=>{"state"=>"NOT_STARTED"},
        "purge_duplicates"=>{"state"=>"NOT_STARTED"},
        "distribution"=>
         {"items_total"=>0,
          "state"=>"FINISHED",
          "error_details"=>[],
          "items_left"=>0},
        "modules"=>{"state"=>"FINISHED"},
        "errata"=>{"state"=>"FAILED", "error"=>"'arch'"},
        "metadata"=>{"state"=>"FINISHED"}}},
    "queue"=>"[email protected]",
    "state"=>"error",
    "worker_name"=>"[email protected]",
    "result"=>nil,
    "error"=>
     {"code"=>"PLP0000",
      "data"=>{},
      "description"=>"Importer indicated a failed response",
      "sub_errors"=>[]},
    "_id"=>{"$oid"=>"6286cc4234e7113fe908e1d0"},
    "id"=>"6286cc4234e7113fe908e1d0"}],
 "contents_changed"=>true,
 "poll_attempts"=>{"total"=>100, "failed"=>1}}
---

---
Log generated by pulp when katello task failed:
2022-05-20T04:24:55.689073+00:00 myserver pulp: pulp_rpm.plugins.importers.yum.sync:INFO: [fb39f8d5] Generating metadata databases.
2022-05-20T04:25:01.582925+00:00 myserver pulp: pulp_rpm.plugins.importers.yum.sync:INFO: [fb39f8d5] Determining which units need to be downloaded.
2022-05-20T04:25:21.044596+00:00 myserver pulp: pulp_rpm.plugins.importers.yum.sync:INFO: [fb39f8d5] Downloading 0 RPMs.
2022-05-20T04:25:25.041468+00:00 myserver pulp: pulp_rpm.plugins.importers.yum.repomd.alternate:INFO: [fb39f8d5] The content container reported: {'downloads': {}, 'total_sou
rces': 0} for base URL: https://repo.almalinux.org/almalinux/8/PowerTools/x86_64/os/
2022-05-20T04:25:25.044808+00:00 myserver pulp: pulp_rpm.plugins.importers.yum.sync:INFO: [fb39f8d5] Downloading additional units.
2022-05-20T04:25:25.170243+00:00 myserver pulp: py.warnings:WARNING: (2485-60864) /usr/lib/python2.7/site-packages/requests/packages/urllib3/connectionpool.py:852: InsecureR
equestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
2022-05-20T04:25:25.170424+00:00 myserver pulp: py.warnings:WARNING: (2485-60864) InsecureRequestWarning)
2022-05-20T04:25:25.170606+00:00 myserver pulp: py.warnings:WARNING: (2485-60864)
2022-05-20T04:25:25.201472+00:00 myserver pulp: nectar.downloaders.threaded:INFO: Download succeeded: https://repo.almalinux.org/almalinux/8/PowerTools/x86_64/os/.treeinfo.
2022-05-20T04:25:26.194570+00:00 myserver pulp: pulp_rpm.plugins.importers.yum.parse.treeinfo:INFO: [fb39f8d5] upstream distribution unchanged and force_full not set; skippi
ng
2022-05-20T04:25:26.921826+00:00 myserver pulp: kombu.transport.qpid:INFO: Connected to qpid with SASL mechanism ANONYMOUS
2022-05-20T04:25:27.253469+00:00 myserver pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fb39f8d5] (2485-05792) 'arch'
2022-05-20T04:25:27.253675+00:00 myserver pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fb39f8d5] (2485-05792) Traceback (most recent call last):
2022-05-20T04:25:27.253870+00:00 myserver pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fb39f8d5] (2485-05792) File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/
importers/yum/sync.py", line 316, in run
2022-05-20T04:25:27.254092+00:00 myserver pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fb39f8d5] (2485-05792) self.get_errata(metadata_files)
2022-05-20T04:25:27.254231+00:00 myserver pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fb39f8d5] (2485-05792) File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/
importers/yum/sync.py", line 924, in get_errata
2022-05-20T04:25:27.254346+00:00 myserver pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fb39f8d5] (2485-05792) updateinfo.process_package_element, additive_type=True
)
2022-05-20T04:25:27.254459+00:00 myserver pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fb39f8d5] (2485-05792) File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/
importers/yum/sync.py", line 1006, in save_fileless_units
2022-05-20T04:25:27.254585+00:00 myserver pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fb39f8d5] (2485-05792) for model in package_info_generator:
2022-05-20T04:25:27.254752+00:00 myserver pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fb39f8d5] (2485-05792) File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/
importers/yum/repomd/packages.py", line 64, in package_list_generator
2022-05-20T04:25:27.254900+00:00 myserver pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fb39f8d5] (2485-05792) package_info = process_func(element)
2022-05-20T04:25:27.255022+00:00 myserver pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fb39f8d5] (2485-05792) File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/
importers/yum/repomd/updateinfo.py", line 33, in process_package_element
2022-05-20T04:25:27.255196+00:00 myserver pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fb39f8d5] (2485-05792) pkglists = map(_parse_pkglist, element.findall('pkglis
t') or [])
2022-05-20T04:25:27.255321+00:00 myserver pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fb39f8d5] (2485-05792) File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/
importers/yum/repomd/updateinfo.py", line 102, in _parse_pkglist
2022-05-20T04:25:27.255460+00:00 myserver pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fb39f8d5] (2485-05792) return map(_parse_collection, element.findall('collect
ion') or [])
2022-05-20T04:25:27.255631+00:00 myserver pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fb39f8d5] (2485-05792) File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/
importers/yum/repomd/updateinfo.py", line 116, in _parse_collection
2022-05-20T04:25:27.255780+00:00 myserver pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fb39f8d5] (2485-05792) ret['module'] = _parse_module(module_elements[0])
2022-05-20T04:25:27.255947+00:00 myserver pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fb39f8d5] (2485-05792) File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/
importers/yum/repomd/updateinfo.py", line 175, in _parse_module
2022-05-20T04:25:27.256096+00:00 myserver pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fb39f8d5] (2485-05792) 'arch': element.attrib['arch'],
2022-05-20T04:25:27.256212+00:00 myserver pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [fb39f8d5] (2485-05792) KeyError: 'arch'
2022-05-20T04:25:27.354490+00:00 myserver pulp: pulp.server.event.http:INFO: [fb39f8d5] (2485-05792) {"call_report": {"exception": null, "task_type": "pulp.server.managers.r
epo.sync.sync", "_href": "/pulp/api/v2/tasks/fb39f8d5-e4c4-45b1-aa75-b9bc177f2940/", "task_id": "fb39f8d5-e4c4-45b1-aa75-b9bc177f2940", "tags": ["pulp:repository:f2ba1795-07bc-432d-9d87-95c9e5333310", "pulp:action:sync"], "finish_time": null, "_ns": "task_status", "start_time": "2022-05-20T04:24:49Z", "traceback": null, "spawned_tasks": [], "progress_report": {"yum_importer": {"content": {"items_total": 0, "state": "FINISHED", "error_details": [], "details": {"rpm_total": 0, "rpm_done": 0, "drpm_total": 0, "drpm_done": 0}, "size_total": 0, "size_left": 0, "items_left": 0}, "comps": {"state": "NOT_STARTED"}, "purge_duplicates": {"state": "NOT_STARTED"}, "distribution": {"items_total": 0, "state": "FINISHED", "error_details": [], "items_left": 0}, "modules": {"state": "FINISHED"}, "errata": {"state": "FAILED", "error": "'arch'"}, "metadata": {"state": "FINISHED"}}}, "state": "running", "worker_name": "[email protected]", "result": null, "error": null, "_id": {"$oid": "6287181134e7113fe92e92f6"}, "id": "6287181134e7113fe92e92f6"}, "event_type": "repo.sync.finish", "payload": {"importer_id": "yum_importer", "exception": null, "repo_id": "f2ba1795-07bc-432d-9d87-95c9e5333310", "traceback": null, "started": "2022-05-20T04:24:49Z", "_ns": "repo_sync_results", "completed": "2022-05-20T04:25:27Z", "importer_type_id": "yum_importer", "error_message": null, "summary": {"modules": {"state": "FINISHED"}, "content": {"state": "FINISHED"}, "comps": {"state": "NOT_STARTED"}, "purge_duplicates": {"state": "NOT_STARTED"}, "distribution": {"state": "FINISHED"}, "errata": {"state": "FAILED"}, "metadata": {"state": "FINISHED"}}, "added_count": 0, "result": "failed", "updated_count": 52, "details": {"modules": {"state": "FINISHED"}, "content": {"size_total": 0, "items_left": 0, "items_total": 0, "state": "FINISHED", "size_left": 0, "details": {"rpm_total": 0, "rpm_do
2022-05-20T04:25:27.356141+00:00 myserver pulp: pulp.server.event.http:INFO: [fb39f8d5] (2485-05792) ne": 0, "drpm_total": 0, "drpm_done": 0}, "error_details": []}, "comps": {"state": "NOT_STARTED"}, "purge_duplicates": {"state": "NOT_STARTED"}, "distribution": {"items_total": 0, "state": "FINISHED", "error_details": [], "items_left": 0}, "errata": {"state": "FAILED", "error": "'arch'"}, "metadata": {"state": "FINISHED"}}, "id": "62871837320fa809b570ad68", "removed_count": 0}}
2022-05-20T04:25:27.386817+00:00 myserver pulp: pulp.server.event.http:ERROR: [fb39f8d5] Received HTTP 404 from HTTP notifier to https://myserver/katello/api/v2/repositories/sync_complete?token=mqtAbrNHxFMeUiqXLNk9SB3zWbV3vRQg.
2022-05-20T04:25:27.397559+00:00 myserver pulp: pulp.server.async.tasks:INFO: [fb39f8d5] Task failed : [fb39f8d5-e4c4-45b1-aa75-b9bc177f2940]
---

alukoshko

2022-05-23 22:36

administrator   ~0000573

Hi.
There was issue in updateinfo.xml metadata that prevented AppStream to be synced.
Could you try again?

akqroldhaber

2022-05-24 06:06

reporter   ~0000578

Hello alukoshko,

the problem is fixed, syncing AlmaLinux 8 Appstream Repo works now without any issues.
Thanks for fixing the promlem.

Issue History

Date Modified Username Field Change
2022-05-17 15:33 akqroldhaber New Issue
2022-05-20 07:57 Hitamashi Note Added: 0000568
2022-05-23 22:36 alukoshko Note Added: 0000573
2022-05-24 06:06 akqroldhaber Note Added: 0000578