Commit graph

30 commits

Author SHA1 Message Date
Stephen Smoogen
9e2d651e09 We can do daily count data 2 days back and not 3 2022-02-08 09:31:55 -05:00
Stephen Smoogen
f79e5d1b43 Add in a message to dbus to see if we can get why files arent getting sorted
Signed-off-by: Stephen Smoogen <ssmoogen@redhat.com>
2021-09-30 13:45:39 -04:00
Stephen Smoogen
bb9864402f For some reason we are not sorting the files even though the script says we are. Try to get a result to find out why
Signed-off-by: Stephen Smoogen <ssmoogen@redhat.com>
2021-09-29 18:16:43 +00:00
Nils Philippsen
cb61463c26 Allow presets for message bodies
This lets users of simple_message_to_bus predefine items which should be
present in all message bodies this way:

export MSGBODY_PRESET="key1=value1 key2=value2"

This doesn't work with spaces in either keys or values, any quotation
will be used verbatim.

Signed-off-by: Nils Philippsen <nils@redhat.com>
2021-09-09 12:40:56 +02:00
Nils Philippsen
a3203d29d9 Get rid of implicit message topic prefix
Callers of simple_message_to_bus need to set and export MSGTOPIC_PREFIX
explicitly.

This decouples the fedora-messaging-utils and web-data-analysis roles.

Additionally, don't assume /bin/sh is /bin/bash.

Signed-off-by: Nils Philippsen <nils@redhat.com>
2021-09-09 12:40:56 +02:00
Adam Saleh
db936062b3 Add more message-based tracing to log01 scripts 2021-08-11 11:18:17 +00:00
Stephen Smoogen
184f33b98a turn off moving averages as I dont have time to rewrite the code with newer pandas syntax and python3 2020-07-02 14:24:10 -04:00
Stephen Smoogen
dd3d48189f need to have condense-mirrorlogs do its sort in /tmp and not /srv/tmp 2020-07-01 13:36:52 -04:00
Stephen Smoogen
bd8cdf0133 move the logs analysis up one more day and see how that works. 2020-04-24 21:34:12 +02:00
Stephen Smoogen
6dbfcf8b18 move the merge down 1 day to try and catch up with actual date 2020-04-24 21:34:12 +02:00
Stephen Smoogen
e587deb968 and we put in a fixme for something later 2017-01-12 19:17:45 +00:00
Stephen Smoogen
48465378bc take out the sort -m as that doesnt work 2016-06-07 23:41:16 +00:00
Stephen Smoogen
ee5d4cbd9e clean up some problems 2016-06-02 18:19:41 +00:00
Stephen Smoogen
acda0d3bd1 T not t.. case matters. 2016-05-29 16:00:00 +00:00
Stephen Smoogen
6068802824 a bad sort breaks eggs 2016-05-28 14:32:13 +00:00
Stephen Smoogen
c2cab42924 dont stick csv files in random places 2016-05-08 15:11:55 +00:00
Stephen Smoogen
8ad78cfb40 and we have moving averages 2016-05-07 15:29:18 +00:00
Stephen Smoogen
fd2c7b7ff3 add in logic for making a file which is needed to sort things 2016-05-06 13:53:37 +00:00
Stephen Smoogen
f327c7e0f2 brain hurts. 2016-05-06 12:46:08 +00:00
Stephen Smoogen
561c8e995c well that was silly 2016-05-06 12:30:54 +00:00
Stephen Smoogen
2b3fb60c4c and that is how we overwrite our old data. not with a bang, but with a whimper 2016-05-05 20:03:09 +00:00
Stephen Smoogen
bcb3611abb and we have the initial items for a getfedora daily stats 2016-05-05 19:56:03 +00:00
Stephen Smoogen
036abe4f74 shell logic mistake.. very slow now just slow 2016-05-05 12:04:29 +00:00
Stephen Smoogen
30b7e1a744 and we removed the -f 2016-05-05 11:46:54 +00:00
Stephen Smoogen
cc78cd2cd9 remember when you move stuff to change the variable. 2016-05-04 20:26:02 +00:00
Stephen Smoogen
88987189e2 make it a little easier to check what is being done as we add more data 2016-05-04 20:14:44 +00:00
Stephen Smoogen
0707acc995 put the mirror data into a subdir 2016-05-04 19:53:18 +00:00
Stephen Smoogen
7eb6de4243 and we now are much faster on getting the data because I took a walk 2016-05-04 19:12:46 +00:00
Stephen Smoogen
5b50279f89 add some more script items for daily csv 2016-05-04 19:04:46 +00:00
Stephen Smoogen
4f8471d08e add the scripts for data-analysis 2016-05-04 17:00:23 +00:00