Commit graph

43 commits

Author SHA1 Message Date
Michal Konecny
09418d9216 [flatpak-indexer] Use the correct jinja statements
Signed-off-by: Michal Konecny <mkonecny@redhat.com>
2025-02-12 16:54:37 +01:00
Michal Konecny
4f1b6b050b [flatpak-indexer] Add missing macro
I forgot to add macro I'm using for loading config file.

Signed-off-by: Michal Konecny <mkonecny@redhat.com>
2025-02-12 16:48:07 +01:00
Michal Konecny
d2588c8049 [flatpak-indexer] Enable quay.io support
This is the first experiment to make flatpak-indexer working with quay.io.

Signed-off-by: Michal Konecny <mkonecny@redhat.com>
2025-02-12 16:33:48 +01:00
1c1f94b24a flatpak-indexer - rename yml templates to .j2
Signed-off-by: Ryan Lerch <rlerch@redhat.com>
2025-01-14 08:37:32 +10:00
89f6f1fc32 Fix majority of remaining yamllint warnings and errors
Signed-off-by: Ryan Lerch <rlerch@redhat.com>
2024-11-28 17:31:45 +10:00
Kevin Fenzi
db10e83150 flatpak-indexer: switch back to f40 for now.
flatpak-indexer uses redis, but f41+ doesn't have it.
Until we can switch to valkey or something lets just move back to f40.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-11-06 15:45:42 -08:00
Kevin Fenzi
e3e2cb1d93 odcs: retire service ( infra 12192 )
Time to retire ODCS. ELN is moved off and that was the last thing using
it. Thanks for all the service ODCS!

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-09-24 18:21:51 +00:00
Owen W. Taylor
473d46624c Update flatpak-indexer to pull in fix for hanging tests
Sometimes the tests run while building the image would hang:

7f3fd03975

fixes this, which should increase pipeline reliability.
2024-05-09 13:46:55 -04:00
Owen W. Taylor
29001c9704 Add Flatpak indexes for ppc64le
With new Flatpak build system, we're now building Flatpaks for ppc64le
as well.

Signed-off-by: Owen W. Taylor <otaylor@fishsoup.net>
2023-10-10 10:18:10 -04:00
Kevin Fenzi
5ceb8b9e05 flatpak-indexer: fix indentation on imagestreams
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-10-05 13:44:35 -07:00
Kevin Fenzi
4d0a458a75 flatpak-indexer: update to new upstream
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-10-05 11:58:51 -07:00
Kevin Fenzi
d294aacbe1 flatpak-indexer: update version to pick up fix for new f39 flatpaks indexing
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-10-05 11:02:19 -07:00
Kevin Fenzi
1551d42f45 openshift: next CRD
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-02-13 11:54:08 -08:00
Kalev Lember
ffe87832dd flatpak-indexer: Update to a new upstream
This fixes a flake8 test failure that's breaking the deploy.

Signed-off-by: Kalev Lember <klember@redhat.com>
2022-10-06 16:02:44 +00:00
Kalev Lember
d98436d1e8 flatpak-indexer: add missing . to odcs_uri
Signed-off-by: Kalev Lember <klember@redhat.com>
2022-10-06 16:01:19 +00:00
Kevin Fenzi
88acf9c72c flatpak-indexer: add odcs_url
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-10-05 22:41:10 -07:00
Kevin Fenzi
3688c1508d flatpak indexer: update to new bugfix release
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-25 11:33:36 -07:00
Kevin Fenzi
9399fbb4f0 flatpak-indexer: move to ocp4 in prod also
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-06-15 11:19:08 -07:00
Kevin Fenzi
217e7d73ee flatpak-indexer / staging: update upstream deploy ref
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-05-31 13:37:03 -07:00
Owen W. Taylor
1d6c2939f5 flatpak-indexer: use ubi8/python-39
flatpak-indexer now uses some Python-3.9 features.
2022-05-31 18:56:54 +00:00
Kevin Fenzi
a8ffd59c46 flatpak-indexer: update staging and move to ocp4 cluster
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-05-27 12:51:01 -07:00
Kevin Fenzi
3516b92e73 flatpak_indexer: upgrade prod to version with newer release info.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2021-10-01 09:52:38 -07:00
Kevin Fenzi
7baad65a3e flatpak_indexer: update to upstream version with fixes in stg
See https://pagure.io/fedora-infrastructure/issue/10251

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2021-10-01 09:30:49 -07:00
Owen W. Taylor
2ad2899256 flatpak-indexer: Update to a new upstream
The important change here is to retry to connect when we lose our connection
to rabbitmq.fedoraproject.org. (https://pagure.io/fedora-infrastructure/issue/9794)

be75c716bae720c45e720f8e1cecab01f4355bd3..98645617cd8529c042f1c398b283264a66a4bea5

Owen W. Taylor (6):
      run-redis.sh: bind only to localhost and set a (trivial) password
      release_info.py: Fix typo in the release name for F35
      bodhi_change_monitor: handle exceptions when talking to fedora-messaging
      bodhi_change_monitor: Don't just retry on stream lost, retry on connection refused
      bodhi_change_monitor: Retry on ssl.SSLError
      bodhi_change_monitor: Improve logging of exceptions

Signed-off-by: Owen W. Taylor <otaylor@fishsoup.net>
2021-05-03 19:04:10 +00:00
Owen W. Taylor
801f96c950 Rebase flatpak-indexer to include robustness improving upstream commits
git shortlog 665c80047a7c15145faa8d77b60fadd2feebb1e1..be75c716bae720c45e720f8e1cecab01f4355bd3
Owen W. Taylor (4):
      Make code to handle disconnections shared between DeltaGenerator and Differ
      Indexer: Remove unchanged-registry-data short-circuit
      Cleaner: check for and remove dangling tardiff:result objects
      Differ: Handle the case where a queued task references a missing spec
2021-03-29 21:27:02 +00:00
Owen W. Taylor
94ad45c15d flatpak-indexer: Fix the mount path for the redis data volume
Redis is configured to store its data in /data, so mount the persistent
volume there rather than on /var/lib/redis/data.

Signed-off-by: Owen W. Taylor <otaylor@fishsoup.net>
2021-03-29 13:38:10 -04:00
Owen W. Taylor
30c5662b93 Update flatpak-indexer to add F34 release information
$ git shortlog 999b10d..665c800
Owen W. Taylor (1):
      release_info.py: Update for F34 => branched
2021-03-29 16:09:30 +00:00
Owen W. Taylor
5b4dd3cbf3 flatpak-indexer: update to a newer upstream
* Fix permissions on generated tardiff files
 * Clean up unused deltas and icons
 * Update times in config files to be readable (30m) rather than
   now-deprecated mix of seconds (1800) and days.
2021-03-12 12:59:51 -05:00
Owen W. Taylor
ba0a7b4c85 flatpak-indexer/templates/configmap.yml: include arm64 indexes
We are now building Flatpaks for aarch64 - while we don't yet have
a working runtime, write architecture-specific for aarch64, using
the container-world name of 'arm64'.
2021-03-11 07:48:42 -05:00
Owen W. Taylor
df15370222 flatpak-indexer: fix icon/delta urls for staging
Were showing up as registrystg.fedoraproject.org

Signed-off-by: Owen W. Taylor <otaylor@fishsoup.net>
2021-03-09 21:02:28 +00:00
Owen W. Taylor
506b3727b7 flatpak-indexer: update to newer upstream, fixing redis binding
Pull in  redis/docker-entrypoint.sh: listen on all interfaces

b239f79e58

This should make redis accessible on the redis service and not just
locally in the redis container.
2021-03-01 19:51:12 -05:00
Owen W. Taylor
7c245c1acf flatpak-indexer: fix project name in redis URL 2021-03-01 16:35:18 -05:00
Owen W. Taylor
30a8d3a72d flatpak-indexer: use stringData not data in secret.yml
This matches what we do for other applications.
2021-03-01 16:32:15 -05:00
Owen W. Taylor
bbfe6e38fd flatpak-indexer: fix environment variable name for redis password
Match the environment variable in the deploymentconfig to that used
in the configmap (REDIS_PASSWORD)

Signed-off-by: Owen W. Taylor <otaylor@fishsoup.net>
2021-03-01 11:54:00 -05:00
Owen W. Taylor
3f7de2e870 flatpak-indexer: fix typo in image change trigger for flatpak-indexer
The 'containerNames' parameter was incorrectly cut-and-pasted from
the flatpak-indexer-differ deployment config.

Signed-off-by: Owen W. Taylor <otaylor@fishsoup.net>
2021-03-01 11:54:00 -05:00
Owen W. Taylor
2e59f661ab flatpak-indexer: fix volumeName for flatpak-indexer-storage
The volumeName was a cut-and-paste error from flatpak-indexer-storage-redis

Signed-off-by: Owen W. Taylor <otaylor@fishsoup.net>
2021-02-25 15:33:52 -05:00
Owen W. Taylor
6378b75d37 flatpak-indexer: Update source reference
Pull in commit 17dab90f206:

 redis/Dockerfile: loosen the permissions on etc/redis

Signed-off-by: Owen W. Taylor <otaylor@fishsoup.net>
2021-02-25 15:32:47 -05:00
Owen W. Taylor
636d797c0b flatpak-indexer: fix kind for flatpak-indexer-build
Should be ImageStreamTag not ImageStream. We ended up with a destination
of flatpak-indexer:latest:latest, when a default tag of :latest was added.

Signed-off-by: Owen W. Taylor <otaylor@fishsoup.net>
2021-02-25 14:42:31 -05:00
Owen W. Taylor
39472fb526 flatpak-indexer: fixes for flatpak-indexer-build
* Output the build to the correct imagestream - it was outputing
  to the flatpak-indexer-tardiff stream from a cut-and-paste mistake
* Add a ImageChange trigger for the from: image - we want to trigger
  a rebuild if the ubi8/python-38 image changes by itself, even if
  the flatpak-indexer-tardiff image where we get the tardiff binary from
  isn't rebuilt.

Signed-off-by: Owen W. Taylor <otaylor@fishsoup.net>
2021-02-25 12:04:00 -05:00
Owen W. Taylor
e2d5093aee Update storage configuration
* Specify a volumeName for the persistant volume claims (on initial deploy
  to staging, these PVC's got bound to random volume...)
* Name the PVC's to exactly match the volume names, including a -stg suffix
  for staging
* Reduce the requested size for the redis volume to 1Gi.
2021-02-24 16:29:09 +00:00
Owen W. Taylor
1acc6aeade openshift-apps/flatpak-indexer: Remove a reference to a non-existent secret volume
The deployment config for flatpak-indexer referenced a secret volume that
in the Red Hat internal deployment of flatpak-indexer holds a client certificate,
but is not needed for Fedora.

Signed-off-by: Owen W. Taylor <otaylor@fishsoup.net>
2021-02-24 16:29:09 +00:00
Owen W. Taylor
32ba71a9b8 openshift-apps/flatpak-indexer: fix wrong URL to upstream repo
One of the references to the upstream repository referenced
https://pagure.io/flatpak-indexer, but at least for now, the code
lives at https://github.com/owtaylor/flatpak-indexer.

Signed-off-by: Owen W. Taylor <otaylor@fishsoup.net>
2021-02-23 16:28:50 -05:00
Owen W. Taylor
69e318a10a Add a flatpak-indexer openshift service
flatpak-indexer replaces regindexer for creating an index of Fedora
Flatpaks. It adds an additional capability - creating "diffs" between image versions
allowing for incremental updates.

Add a new openshift namespace: flatpak-indexer, with three deploymentconfigs
in it:

 - flatpak-indexer: generates the index
 - flatpak-indexer-differ: worker(s) to run the expensive tardiff operation
 - redis: used for cache and communication between indexer and differ

The staging version of the indexer targets the *production* bodhi/koji/registry,
since we don't have useful Flatpak content in staging. This could be changed.

The registry reverse proxy configuration is updated to a slightly different
set of generated indexes (the 'annotations' indexes for F31 and older are
now suffixed with -annotations, and the 'labels' indexes unsuffixed.)

Signed-off-by: Owen W. Taylor <otaylor@fishsoup.net>
2021-02-05 21:19:30 +00:00