'fix version in setup.py, it was using commas'

'fix version in setup.py'

'remove code for fetching categories'

Remove code for processing a new category

Update sample with FILE_CACHE_PATH

Add deletion of files, such as MOVED, from the cache.

Fixes https://github.com/FreshPorts/freshports/issues/468

Clear cache for sanity-tests

re: https://github.com/FreshPorts/freshports/issues/451

This does mean that the sanity test list is cleared each time a commit occurs.
That is overkill. However, going the other way creates more work and more
code. Simple cache clearing is better cache clearing.

When we're finished checking the queue, check again.

This avoids the race condition where more stuff is added to the queue and we
miss it because we are processing the queue already.

Correctly report the missing directory

Start using the spooling directory. This has been in use on dev since at
least Sep 17 2022. Time to spread it around.

'require ssl, really, this time, for real'

'require ssl'

require ssl

Remove extraneous space

Fix a copy/paste error when displaying the name of the retry directory

'handle the cache_clearing_commits table'

'correctly document what directories are used'

'reverse accidental renaming'

'better layout for autoplist'

Properly name this tag

Convert from daemontools to daemon

'latest release'

Add more logging which is helpful when dealing with directory permission
issues

Swap from `` to $()

Confirm to this naming convention

.txt    - email
.xml    - xml
.log    - loading of commit
.errors - any errors caught

Change the mv .txt file to a cp/rm to avoid:

mv: /var/db/freshports/message-queues/recent/2020.07.11.07.46.58.18048.txt: set owner/group (was: 10002/10001): Operation not permitted

Better configurtion file comments

Start using these file names:

 email: 2020.07.11.07.46.34.15635.txt
   xml: 2020.07.11.07.46.34.15635.xml
errors: 2020.07.11.07.46.34.15635.errors

Other scripts will need updating for .loading, which will become .log

Fix the detection of required directories.

Good to go for testing.

I got sidetracking creating fp-daemon on the git branch but then
re-discovered my work here.

Move fp-daemon up to the main directory and delete the rest.

I couldn't see another way to just bring in one file

Remove this whole directory created in error

Create the git version of fp-daemon

Starting with the the FreshPorts for git daemon and use that.

The former takes XMl and laods it. The latter will take email and create XML
for the former.

Start using the newly created load_xml_into_db.pl, not
load_xml_into_db_git.pl, because it will work with both git and subversion.

Also, rm -f

Fix INGRESS_SVN_BASEDIR variable

change FP_DAEMON to INGRESS_SVN

fp-daemon -> ingress_svn because of rename

Complete the rename from fp-daemon-git to ingress_svn

'first package'

Correct FLAGDIR 

fp-daemon for svn commits is going to be needed on the git branch for a
while.

The signals directory lives under FRESHPORTS_BASEDIR not FRESHPORTS_MSGDIR

'Mention that our MSGDIR is also defined in the freshports configuration file'

'output the main files upon startup'

Add INGRESS_MSGDIR to the configuration file

output the main files upon startup

Correct FRESHPORTS_MSGDIR

'renamed from fp-freshports to freshports'

This repo was moved to ingress

Rename everything fp-ingress to ingress

Rename fp-freshports to freshports

Move config.sh.sample to config/fp-ingress.sh

Move from logger(1) to echo(1)

remove files required only for daemontools, which is no longer used to run
this script.

remove files required only for daemontools, which is no longer used to run
this script.

'Move configuration file:

-. /usr/local/etc/freshports/daemon-config.sh
+. /usr/local/etc/freshports/fp-ingress.sh
'

Move configuration file:

-. /usr/local/etc/freshports/daemon-config.sh
+. /usr/local/etc/freshports/fp-ingress.sh

Move configuration file:

-. /usr/local/etc/freshports/daemon-config.sh
+. /usr/local/etc/freshports/fp-freshports.sh

'Move configuration file from config.sh to . /usr/local/etc/freshports/daemon-config.sh'

'Move to daemon(8)'

'move fr1m sysutconfiguration file to /usr/local/etc/freshports/daemon-config.sh'

'move fr1m sysutconfiguration file to /usr/local/etc/freshports/daemon-config.sh'

Change configuration file
from: config.sh
  to: /usr/local/etc/freshports/daemon-config.sh

Start using FRESHPORTS_* variables

this daemon doesn't need a incoming directory any more

I'm moving to two daemons:

fp-freshports - same function as fp-daemon had
fp-ingress    - processing incoming commits into XML
                this is partly the mailfilter script
                and part of what fp-daemon.sh once did.

Renamed this to fp-freshports

It is being named after the user it runs as

Taken from the subversion version of this code, we now have something with
works with git.

Branch for work on git

Mention where the real code is in dev

'if the rollback fails, say so'

'add category and packages cache clearing'

Add ability to clear packages cache via zfs rollback

Add in the category cache which I'm sure is needed in prod

Convert all lingering print to syslog.

Remove commented out code

'remove "nothing found" logger command It fills up the logs.'

'make it work'

Remove superfluous comments
use NEWS_CACHE_DIR instead of NEWS_CACHE_PATH

Use path for cache/news because glob.glob is not working

has_key is gone in Python 3

While here, add more debugging.

Updates for Python 3

Upgrades for Python 3.6

'Start doing cp & use mv and rm instead'

Instead of using mv which caused:
/usr/local/bin/readproctitle service errors: ...message-queues/recent/2019.07.15.15.42.07.48391.txt.raw: set owner/group (was: 10002/10001): Operation not permitted\nmv: /var/db/freshports/message-queues/recent/2019.07.15.15.43.31.53460.txt.raw: set owner/group (was: 10002/10001): Operation not permitted\nmv: /var/db/freshports/message-queues/recent/2019.07.15.15.45.39.56551.txt.raw: set owner/group (was: 10002/10001): Operation not permitted\n

use cp and rm

even when using this example:
[dan@dev-ingress01:~] $ ls -l ~ingress/message-queues/ ~freshports/message-queues/
/var/db/freshports/message-queues/:
total 248
drwxr-xr-x  18 freshports  freshports   18 Jul  2 03:16 archive
drwxr-xr-x  10 freshports  freshports   18 Jun 10 22:03 retry

/var/db/ingress/message-queues/:
total 3
drwxr-xr-x  2 root     ingress     10 Mar 20 13:53 DUPS
drwxrwxr-x  2 ingress  freshports   2 Jul 15 15:29 incoming

if job-waiting.pl dies, log it.

'When things go wrong, log it'

Rename freshports to fp-daemon

''

Remove quotes. They are retained in the string and won't work with glob

'use True and False, proper Python values, not true/false'

Make ClearMiscCaches compile

Adjust for what works

Addl fp-listen to clear news cache etc when a commit occurs

'improve config and path to script'

Better logging, to local3, which is what FreshPorts uses.

Update the code for use with psycopg2, as grabbed from jester, but not
checked in.

move fp-listen.py to a subdiretory

log to  facility=syslog.LOG_LOCAL3

add setup.py

start using configparser

Fix scriptdir typo

Upgrade for new freshports user approach

The incoming directory is under ingress

Upgrade to new directory structure

Update the samples to the latest stuff we are using

Add and use FLAGDIR

Add a trailing newline

Seems we do not use BASEDIR here

when processing a new category, fetch /www/en/ports/categories

Yes, we should use configuration items for these URLS...

Ignore supervise

ignore config.py

Add code for listen_category_new

Merge from FreshPorts2 to HEAD

while . was not working on 6.2-prerelease
Let's use while true instead

Replace config.sh.sample with config.py.sample and start using it.

Ignore log

Add RCS ID.
Correctly specify the cache path
Better syslogging.
Move to deleting cache entries one by one, and deleting from
the cache needed table one by one.  Commit after each.  Sounds fair to me.

Add these

ignore these

Remove fp2migration

When OFFLINE, do not process the queue.  Otherwise, you wind up with unprocessed
files in the RECENT directory.

Serialize the processing of all updates

If message processing fails move all files to the retry directory

update copyright year

This commit was manufactured by cvs2svn to create tag 'FreshPorts-VuXML'.

move the raw message into the recent directory instead of the raw directory

A new way of doing the queues

This commit was manufactured by cvs2svn to create branch 'FreshPorts2'.

Tidy up the directories

move failed files to a new retry directory

Put copyrights into scripts

This service is down by default

things to do before running

First commit

oops, never put this into CVS

daemontools is a nice way to keep scripts around as daemons.