infrastructure/fedora-infrastructure

greenwave in staging is blocked on dogpile #7836

New issue

Closed

opened 2019-05-24 14:09:36 +00:00 by lholecek · 4 comments

lholecek commented

2019-05-24 14:09:36 +00:00

After fixing #7818 it seems the consumer is now blocked by dogpile (maybe memcached pod problem).

[greenwave.consumers.resultsdb INFO] Greenwave resultsdb handler listening on: ['org.fedoraproject.staging.taskotron.result.new']
[greenwave.consumers.fedora_messaging_consumer INFO] Sending message received to: ResultsDBHandler
[greenwave.consumers.resultsdb DEBUG] Processing message "{'msg': {'task': {'type': 'koji_build', 'item': 'graphviz-2.40.1-39.fc29', 'name': 'dist.rpmgrill.elf-checks'}, 'result': {'id': 23526664, 'submit_time': '2019-04-24 14:40:06 UTC', 'prev_outcome': None, 'outcome': 'FAILED', 'log_url': 'https://taskotron.stg.fedoraproject.org/artifacts/all/748d0752-669e-11e9-8059-5254003dbbef/tests.yml/rpmgrill.json' }}}"
[greenwave.consumers.resultsdb DEBUG] Considering subject koji_build: 'graphviz-2.40.1-39.fc29'
[greenwave.consumers.resultsdb DEBUG] Invalidating cache for 'greenwave.resources:CachedResults|koji_build graphviz-2.40.1-39.fc29 dist.rpmgrill.elf-checks'
[greenwave.consumers.resultsdb DEBUG] Invalidating cache for 'greenwave.resources:CachedResults|koji_build graphviz-2.40.1-39.fc29 None'
[dogpile.lock DEBUG] NeedRegenerationException
[dogpile.lock DEBUG] no value, waiting for create lock

Can anyone try to redeploy the pod?

After fixing #7818 it seems the consumer is now blocked by dogpile (maybe memcached pod problem). ``` [greenwave.consumers.resultsdb INFO] Greenwave resultsdb handler listening on: ['org.fedoraproject.staging.taskotron.result.new'] [greenwave.consumers.fedora_messaging_consumer INFO] Sending message received to: ResultsDBHandler [greenwave.consumers.resultsdb DEBUG] Processing message "{'msg': {'task': {'type': 'koji_build', 'item': 'graphviz-2.40.1-39.fc29', 'name': 'dist.rpmgrill.elf-checks'}, 'result': {'id': 23526664, 'submit_time': '2019-04-24 14:40:06 UTC', 'prev_outcome': None, 'outcome': 'FAILED', 'log_url': 'https://taskotron.stg.fedoraproject.org/artifacts/all/748d0752-669e-11e9-8059-5254003dbbef/tests.yml/rpmgrill.json' }}}" [greenwave.consumers.resultsdb DEBUG] Considering subject koji_build: 'graphviz-2.40.1-39.fc29' [greenwave.consumers.resultsdb DEBUG] Invalidating cache for 'greenwave.resources:CachedResults|koji_build graphviz-2.40.1-39.fc29 dist.rpmgrill.elf-checks' [greenwave.consumers.resultsdb DEBUG] Invalidating cache for 'greenwave.resources:CachedResults|koji_build graphviz-2.40.1-39.fc29 None' [dogpile.lock DEBUG] NeedRegenerationException [dogpile.lock DEBUG] no value, waiting for create lock ``` Can anyone try to redeploy the pod? cc @pingou

gnaponie commented

2019-05-24 14:10:40 +00:00

Metadata Update from @gnaponie:

Issue tagged with: greenwave

**Metadata Update from @gnaponie**: - Issue tagged with: greenwave

kevin commented

2019-05-24 15:06:22 +00:00

I've re-deployed the greenwave memcached pod.

I've re-deployed the greenwave memcached pod.

kevin commented

2019-05-24 15:11:26 +00:00

I then re-deployed the consumer pod and it seems to be processing now. There's some tracebacks in the logs, but that might be normal?

I then re-deployed the consumer pod and it seems to be processing now. There's some tracebacks in the logs, but that might be normal?

kevin commented

2019-05-24 15:11:26 +00:00

Metadata Update from @kevin:

Issue close_status updated to: Fixed
Issue status updated to: Closed (was: Open)

**Metadata Update from @kevin**: - Issue close_status updated to: Fixed - Issue status updated to: Closed (was: Open)

Sign in to join this conversation.

No labels

Fixed with Explanation

Initiative Worthy

Insufficient data

Closed As/Will Not

mini-initiative

Needs investigation

packager_workflow_blocker

🔥 URGENT 🔥

Waiting on Assignee

Waiting on External

Waiting on Reporter

release-monitoring

request-for-resources

websites-general

No milestone

No project

No assignees

3 participants

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: infrastructure/fedora-infrastructure#7836

No description provided.