Commit graph

32 commits

Author SHA1 Message Date
Kevin Fenzi
1cab62674b koji / manual / staging sync: fixes from recent sync
* The password was being set to the prod one
* The allowed ip in the database was the phx2 one. ;(
* The sequences were too low, prod already passed those, so increase
  them.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-10-03 10:03:52 -07:00
Jiri Podivin
f513e7cbcd Linting python scripts
Signed-off-by: Jiri Podivin <jpodivin@redhat.com>
2024-09-18 19:57:29 +00:00
Kevin Fenzi
abee63c966 postgresql_server: adjust backups for db-datanommer02
Currently backups are taking 17-18 hours with 4 threads.
Now that we have 16 cpus defined there, lets bump that up to 8 and see
if that lowers things much. If not we can look at moving to another
compression, but the database is very large so lots of compression is
good to save disk space.

Also filter out another output of the backup job that causes cron
emails.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-05-20 10:28:04 -07:00
Kevin Fenzi
98ccbf3156 postgresql / servers: fix db-fas01 not having temp_buffers and rename backup-database for db-koji01
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-06-16 14:58:36 -07:00
Kevin Fenzi
bd50c6e4bc db-koji02: make sure backup uses all cpus
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-04-24 21:34:28 +02:00
Kevin Fenzi
1613c724ca postgresql-server: sadly, "all" doesn't match replication, that has to be seperate.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-04-24 21:34:13 +02:00
Kevin Fenzi
8f025109bf Revert "postgresql_server: drop this cleanup script to see if the problem still even occurs."
This reverts commit f68a9eb6dbc2003ed6136ba71e30fcb1c3180608.
2020-04-24 21:34:07 +02:00
Kevin Fenzi
7ef0ae55e9 postgresql_server: drop this cleanup script to see if the problem still even occurs.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-04-24 21:34:07 +02:00
Kevin Fenzi
8dcc3712af Switch anitya backups to use --exclude-table-data rather than excluding entire tables
This allows people to use the db dump without having to manually create the missing tables.
2018-10-10 16:19:19 +00:00
Kevin Fenzi
f0c596c427 Try and make a public anitya dump with the right tables. 2018-10-08 17:41:07 +00:00
Stephen Smoogen
1719435ec7 try to make pxz a little less likely to starve itselv 2018-06-25 16:26:59 +00:00
Kevin Fenzi
069bfc9a41 only keep the last backup on hosts, it iss copied to backup server anyhow 2018-06-07 23:38:46 +00:00
Pierre-Yves Chibon
4de44ac0fc Fix query in the datanommer SAR script
Signed-off-by: Pierre-Yves Chibon <pingou@pingoured.fr>
2018-05-22 10:21:42 +02:00
Patrick Uiterwijk
8797997ab2 Get rid of temporary files alltogether
Signed-off-by: Patrick Uiterwijk <puiterwijk@redhat.com>
2018-05-18 13:13:47 +02:00
Patrick Uiterwijk
2fb0b14230 Do not keep full file in memory
Signed-off-by: Patrick Uiterwijk <puiterwijk@redhat.com>
2018-05-18 13:06:04 +02:00
Patrick Uiterwijk
b6f06b4a27 Get rid of postgres warning
Signed-off-by: Patrick Uiterwijk <puiterwijk@redhat.com>
2018-05-18 13:03:34 +02:00
Pierre-Yves Chibon
e4055e1d87 Add SAR script for datagrepper/datanommer
Signed-off-by: Pierre-Yves Chibon <pingou@pingoured.fr>
2018-05-16 12:15:37 +02:00
Kevin Fenzi
c29d896faa double this as sometimes it is too small a range 2017-10-10 01:15:16 +00:00
Kevin Fenzi
7eb4c6cae4 add a random delay up to 1 hour for db backup jobs so we do not have a thundering herd on db01 2017-10-05 00:48:45 +00:00
Kevin Fenzi
6b0faf84c0 use pxz for database dumps, might make them a good deal faster 2017-10-04 20:06:40 +00:00
Stephen Smoogen
e3c0199dad make another set of stg ip changes 2017-09-29 15:24:58 +00:00
Kevin Fenzi
0c983d9fd9 Fix the cron so it runs correctly. 2016-04-13 18:22:49 +00:00
Kevin Fenzi
f0d34369c5 Add script from jberkus to kill idle/locked transactions and log information about them on db-koji01 2016-04-13 17:46:41 +00:00
Kevin Fenzi
81e587bfa2 Only keep 2 days of db's not 3 2016-04-10 22:56:42 +00:00
Kevin Fenzi
28b402ded1 Add missing fasdb cleanup sessions cron job. 2015-04-27 16:24:27 +00:00
Kevin Fenzi
fee2f37cc3 Exclude any sessions table data from db backups. 2015-04-02 17:56:55 +00:00
Kevin Fenzi
1af3349e63 Add larger shared_memory value to other db servers 2014-12-08 14:50:57 +00:00
Ralph Bean
6910ca6b48 Delete old postgresql backups. 2014-11-12 16:56:44 +00:00
Kevin Fenzi
1dc2945f12 Add koji cleanup sessions on koji database server. 2014-10-01 20:29:25 +00:00
Ralph Bean
5e32fe5643 Move postgres backup cron task inside a bash flavored script. 2014-01-13 16:16:27 +00:00
Ralph Bean
db6fdf9bb0 Add a second config file for postgresql. 2014-01-10 20:52:18 +00:00
Ralph Bean
c1a97c4a40 Add a postgres config to the postgres role. 2014-01-10 20:40:08 +00:00