Stop calling FreshPorts::SpecialProcessingFiles::Eat

Add the shell script that corresponds to the perl script

Set commit_log_ports.port_epoch

Handle new field: quoted_port_epoch

Grab PKGNAMEPREFIX and PKGNAMESUFFIX
rename pkgname => package_name

Add new columns to ports table:
  no_latest_link
  no_package
  pkgname
  portepoch

example:

freshports.org=# select no_latest_link, no_package, pkgname, portepoch from ports_active where name = 'dgd-net';
 no_latest_link | no_package |    pkgname    | portepoch
----------------+------------+---------------+-----------
                |            | dgd-net-1.1.8 | 0
(1 row)

freshports.org=#

There is no date_modified column.  Remove usage.

put the -w back in

Pass in database handle

how to process the vuxml changes

The start of using vuxml

Raname package from vuxml-parsing to vuxml_parsing

Set the broken field.

Start using "ISO-8859-1" and not "UTF-8".  This fixes the umlaut problems.

Add messages for Observer/Observable

Whitespace changes only

use the right paths so that reinstalling this port works.

remove @dates, which is no longer used.

Start using AddUpdatingXref

Update copyright year

Original code from Travis Campbell.  Slightly modified by Dan Langille
to work with STDIN and write to database.

Ignore vacuum.sh

Process slave ports when the master port is updated.

Back out the change.  The blank line code has been tested in production for
some time, but it's not thought to be necessary.  The error it is detecting
should not occur.  It may be better to fail with when this error occurs.

For a given master port, return all the slave ports.

Set the depends_lib field

Add stub for refreshing slave ports.

Use cvsup host not xeon host.

Comment out some debugging information.

Remove directories no longer used

A port can be marked as IGNORE.  Start processing that value from the makefile.
All makes now use: LOCALBASE=/nonexistentlocal X11BASE=/nonexistentx
This will allow ports marked as BROKEN to be queried as if they were being
loaded into a empty machine (i.e. no ports installed).

Idea from:     Oliver Eikemeier <eikemeier@fillmore-labs.com>
Brought up by: Thierry Thomas <thierry@pompo.net>

Better format this output.
Group them by Date

Correctly state whether or not committer notifications are enabled.

Handle hourly stats

Based up on report-notifications.pl, this script does not need to refer to
report_frequency because it is run on demand.
We refer to security_notice.date_added not commit_log.date_added
The next step is to remove all reference to frequency.

Add

improve reporting, use Online

Start using OFFLINE

Only email the committer if they are opted in

Move the "This message was generated..." phrase to the bottom of the email.

Security Report ID should be 5, not 6

Start using FreshPorts::ReportConstants::Footer

remove dirname which was unused

Update copyright.
move WatchURL, ReportSubscriptionURL here from various report scripts
Create FreshPorts::ReportConstants::Footer

Remove unused code

Script for creating summary for daily totals.

Move comments closed to relevant code

Fetch all files.  Let the called routine validate the files.

Start using special processing

Add more samples

cronjob

use chomp

First cut.  Needs to start using stored procedure PortsMovedAdd.

Forced commit to fix previous commit message.
Track duplicate file names in case of corrupted commit messages.

improve error collection

white space changes (tab align, convert space to tabs etc)
remove commented out code

Verify that WEBSITEURL is defined.

When processing a commit, check to see if the Makefile is there.  If it isn't,
error out and mention that if this is a repocopy, please ignore this error.
While here, put the Makefile pathname into $Makefile, and stop repeating
the use of MakefileDirectory/$FreshPorts::Constants::FILE_MAKEFILE

whitespace

Keep the error message with the port name
Always CC the system admin on sanity errors

Add: WEBSITEURL CACHEDIR STAGINGDIR

Add details on how to use formail to load an archive.

Replace commit_log_ports_extra with commit_log_ports_elements.
Same concept, but larger scope.  This new table cross references a commit
to ports and files outside ports.

Any ports tree commit which touches a file not belonging to a port (e.g.
ports/INDEX) will result in an entry in this table.

Include the element_id for the file within the File structure

Call RecordPortsTreeButNonPortCommits if we have a commit with no ports.

Remove unused values

whitespace changes

Remove incorrect package declaration.

Now that main page update has gone away, we need the ability to refresh
the daily summaries.  One day, we'll start using it...

We no longer use these files.

If no files are found during a regular GetFiles procedure, try invoking
GetFilesImported instead.  This will process any file imports.

Whitespace adjustment.
When we cannot open Mail::Sender, log the error using LOG_ERR not LOG_NOTICE.

Remove "use housekeeping".
Remove RefreshMainPage function because we no longer do this.

Allow CommitMessageID and CommitMessageSubject to be included in
the notification.

If Committer Notifications are turned off, don't include the part
about why you are getting this message.  It'll be going to the system
owner, who should know why...

Add SystemOwnerEmail
some minor whitespace changes

Use `hostname` not `$hostname` to get the hostname.

Each category has a pkg/COMMENT file which describes that category.
When a new category is encountered, if we cannot fetch pkg/COMMENT, then go
with a fake description.

Wrap all committer messages at column 72.
Tidy up the email code to make it easier to read.

Improve the error reporting during sanity testing.  I found a case where
we got an error such as this: "/usr/home/dan/ports/french/homard/Makefile",
line 56: Need an operator (caused by spaces instead of tabs in a section
such as do-install:).  In such cases, no results are returned from the
make command.  Instead, the errors will be captured in the tmp file
we created to capture ERROUT.

Add two new functions: SetActive and SetDeleted.

Sometimes a port can be deleted in one commit, and a later
commit will remove a missed file.  If this port is deleted, don't refresh it.
If we don't need to refresh it, we don't need to save it.

Include the error code in the email

Remove the temp error collection files when and where we should.  Not where
we are.

- Use ports_active, not ports, so we don't have to check if a
port has been deleted.  Which means we don't need to refer
to the element table at all.  So remove all that code.

- Use tabs to delimit things instead of :

Remove extraneous remove

Update copyright notice

Remove control Ms

This commit was manufactured by cvs2svn to create tag
'FreshPorts_2003_05_04'.

Add defaults for email.pm

fix typos

Remove housekeeping calls because we don't need that any more

move to a better directory structure

Better handling and reporting of non-fatal errors.

check for config file

also ignore config.sh

By default, do not notify committers of problems.  Otherwise we'll have
each test system telling them.

Adjust things for Postfix address extentions
(i.e. foo+bar@example.org) and to allow procmail to fail softly.

Use this file to set configuration parameters such
as the location of the msgs tree and the scripts directory location.

remove an echo

Use a different approach to pathnames.
This should make it easier for one user to process multiple
cvs-all streams.

Better handle the lack of a pkg-descr file

improve debugging and avoid undefined values for special conditions.

Message format has changed.  End of files now indicated by ______...

change the report id to be the correct value
add security_notice to FROM list in SQL
better debugging messages

remove debugging code

remove references to bchosting by request.  They are away for a while..

This commit was manufactured by cvs2svn to create tag 'RELEASE-beta-
2003_03_07'.

whitespace

module for new table

add support for commit_log_ports_ignore

whitespace

Only fetch files for port tree commits

Place removal of pkg directory to be after make command has run.
Ignore COMMENTFILE.  COMMENT should now always work.
remove large unused portion of needs_refrseh for new ports

print the command as part of debugging

Start using COMMENT and COMMENTFILE to cope with recent changes

white space changes to SQL

remove ^M

in perl, we use 0, not FALSE

turn autocommit off
do the rollback/commit
some whitespace changes

how about some instructions, for the next time we do this

include the database name in the message

white space changes only

white space changes only

add X-header

Add headers to each mail message.

Add a new parameter, Headers.

white space changes

Tell them about the multiple watch lists

add update_status
whitespace changes

Fix missing '
include constants.pm

whitespace changes
Add FreshPorts::Constants::ReportDeletedPorts

Whitespace changes

improve the error checking and reporting

Check the return value on that message open

add report-notification.pl and report-new-ports.pl

fix debugging

Start using email.pm

Start using Mail::Sender

add trim and trim_multiple_to_single

Never fetch files before refreshing all ports touched by this commit (RefreshAllPortsTouchedByCommit)

Add hostname to error messages

try using $revision instead of HEAD

use the new PORTCOMMENT features if no pkg-comment file is found

Uncomment SendWatchNoticePersonal which is a big mistake to comment out.

wrap text at 82, change whitespace formating, and put URL at end of note

try case insensitive

Announce the new report subscription service

Add option to not refresh files on disk
useful when getting around build problems

Update to use report-subscriptions table.

require committer_opt_in

Display the ports which need refreshing

change final test

don't hardcode the db name in the error msg

Remove debugging code

changes for committer opt-in

Catch errors on the fetch so they don't appear in the .errors file

start distinguishing from a Port and a non-Port refresh

final changes...

fix `

better handle processing of the log message

Add bchosting notice

Add suggestions from Piet Delport <pjd@303.za.net>

first commit

New results

Fix up message and URLs.

Remove duplicates by fixing SQL

First commit

searchlog.txt is now in dynamic

Move status.html to dynamic

spell Calculated

Add fortnight, weekly, and monthly

Add port count and new port count to message.

Add daily stats

Change the titles slightly and links better to ports-new.php

first commit

start using revision

start using the revision

use the defined HEAD

Start using version, but we'll use HEAD for now.

First commit - a cron job for running daily statistics.

Add this tarfile.

change .php3 to .php

merge to FreshPorts1 from HEAD

send one message per user

PR142 - after refreshing a port, queue the date into the daily_refreshes
        table so that the daily summaries are updated.

Add committer to message

cater for older xml encodings without EncodingLosses

tag the file as UTF-9

Add EncodingLosses

Tidy up the interval.

Remember to use the system time adjustment

Merge to branch

commit to head

move RefreshMainPage and GetMaxCommitLogPortId to cache.pm

also check the daily_refreshes file

reflect new location of CreateDailySummary in cache.pm

No longer needed

Move freshports_ConvertPortPathToStandardLocation to port.pm

clean up the file

Put this on the branch

This is a great port for installing ports needed by FreshPorts

Let's use fetch, not lynx

This commit was manufactured by cvs2svn to create branch 'FreshPorts2'.

PR 112
watch_notice_log.frequency_id needs to be implemented

changing frequency to frequency_id
check scripts/email.pl and AddToLogs

update copyright

There is no need to grab the commit_log id first.  It will be obtained
by the commit_log class.

Add Makefile.inc to the list of things we ignore

Put the committer into the output

*** empty log message ***

sleep at the start of the script, not the end.
if an error occurs, we don't retry it right away.

update copyright
change return value of 3 to 0 if all is well
we don't move files around.  the fp-daemon script does

need to create the directories

display the full file name when processing

All make commands must refer to the correct ports tree via PORTSDIR=

adjust debugging code

Don't die with an error, just report it.
We will clear refresh_now so the SP
doesn't have to.

let's use fetch instead of lynx

remember to install procmail

missed this

let's make this into a daemon-type script for use with daemontools.

remember to include housekeeping module

Start using the housekeeping class

After refreshing a port, update housekeeping.

Let's have a look at the Makefiles before we use them.  If they are
ASCII Text, then they are probably a Makefile.  If not, they are probably
HTML, and that means the fetch failed.

only do the table update if a new port has been committed.

no longer a need to touch a file after refreshing.

To speed up the home page, we are going to cache the data in a table.
The main page will then read from that table.  The main page will
be updated every minute.

Start using "make master-sites-all" instead of "make -V MASTERSITES"

refresh-unrefreshed-ports.pl stays as it was, refreshing unrefreshed ports
based on commit_log_ports.needs_refresh.

script to create ~/msgs

If an invalid file action is found, display it as well as report it.

allow incoming parameter to set limit
If file_action = 'I' (import) used add and change filename to '.../Makefile'

remember to clear out MessageTo in case there is more than one recipient.

oops, use PST not EST

Create a monthly compression archive.
note that the other compress script appears to be unused.

if the code dies, email me

Add new commit_log class
Start using new ReportError function from utilities.pm instead of calling
SysLog and die.

doh!  do not hard code path names!

When an error occurs when processing a make file, return the error to the
calling function.  Then, don't update the port because it's not ready

umm, ports-supfile is in ~/scripts not ~/

PR#21
cater for imported sources.  With a recent change implemented by Josef Karthauser,
imported source cvs-all message do contain a BRANCH.  However, the
message do not contain a LOG section.  Thus the XML field is empty.

Get around the problem with a minor reorganization of the code.
Grab the message subject. Grab the log.  If the log is empty, use
the subject.

ALSO: white space changes.

add copyright

convert to PostgreSQL

upgrade to postgresql.

Now that this is done, the next step is to get some of you on the Develop list
to start tracking your ports via fp2.freshports.org.  BUT FIRST I'll have to
upgrade that site to the latest database and scripts as found in
lists-test.freshports.org.  Watch this space.

add another simple test

simple whitespace change

daily summary changes
 - use category/port format
 - add time-ajustment factor to cater for time zone differences

- correct where the script was still using ports.needs_refresh instead of
  commit_log_ports.needs_refresh.
- for now, we will fetch every file touch by a port commit.  I still
  don't have a solution for files included by Makefile.

Handle deleted ports better.
Remove the path-to-ports so it works with symlinks.

oops.  fix a typo

after refreshing a port from newly fetched files,
let's actually save the results to the database.

handle port_version

update to use commit_log_ports.needs_refresh not ports.needs_refresh

start using $ENV{HOME} so we know the correct home directory without modifying
this config file.

Update this script to use commit_log_ports.needs_refresh
instead of ports.needs_refresh  PR56

Add call to script to archive out messages.

It appears we have a working solution for storing port version with each
commit.

remove comments no longer relevant

Add the new archive-messages.sh.  call this from cron.
it will call the improved archive-logs.sh which will
move the msgs away from the main directory and archive them.

test for packages.exists file before we grep from it

provide a new option: -O (Overwrite)

when processing an XML file, if the supplied message id exists, delete it
and continue processing.  Useful when you need to reprocess a message
for some reason.

upgrade to FP2

Remove some commented out code

New FP2 version of script

This commit was manufactured by cvs2svn to create branch 'FreshPorts2'.

Add copyright notice
expand messages when Makefile errors occur

add some testing scripts

don't save commit_log_id unless it is supplied.

ensure we take the commit date before
we clear out all the date values.

If the version isn't set, don't try to display it

Don't do any of the port update things if there are no ports.
This mainly reduces the size of the log file.

Remove trailing / from 'use lib' statement.

If a port has been deleted, make sure we delete the element which
corresponds to that port.

remove CommitLogElementsInsert
replace EnsureCategoryAndPortExist with SaveChangesToPortsTree
create _CompileListOfPorts which replaces the fuctionality of EnsureCategoryAndPortExist

Instead of saving a port as we go along, we will compile a list of ports based
on the files we find.  Once all files are processed and saved to the database,
we have our list.  Then we process the files again, setting the needs_refresh
value for the port affected by this file.  If we find that the Makefile for
a port has been deleted, we set needs_refresh = 0.

first commit

if the port is new and has not been deleted, then set needs_refresh.

separate out the refreshing of a port from the saving of a commit message.

Spell the path correctly

use SystemID not SystemBranchID

fix typos

check for failed file open

PR 4 solved.
scan the lines following the subject and include them as part of the subject
if they start with 9 spaces.

The previous commit was in error.

PR 15

Previously the log message was terminated at the first occurance of:

  Revision
  PR:
  Submitted by:
  Approved by:
  Reviewed by:
To Unsubscribe

Now it's only:

   Revision
To Unsubscribe

Also, populate the ObtainedFrom field while we are here.

This commit was manufactured by cvs2svn to create branch 'FreshPorts1'.

add the revision field.

Use new class: commit_log_port

updates

Get those values from the result set.

use the right id

set the commit id before saving

remove code we've already converted

remove unneeded comment

first commit

Now processing the files and ports correctly.
now we just have to parse the file names and update the port needs_refresh.

Create a hash of ports...

fetch by partial name

just a checkpoint

Remove GetDBHandle and use the one provided by FreshPorts::Database.

use $dbh not $dbh_pg

use the recently created FreshPorts::Category and FreshPorts::Port classes

Just another checkpoint

This commit was manufactured by cvs2svn to create tag 'beta'.

Add the ID to the file

backups are handled by another user now

better the grammar

fix path to lastupdate.

fix typo

fix typo in last commit

Put the database connect into freshports_database.pm and use
freshports_database.pm.sample as the example.

get the path right

updates

fix up crontabs

pick a better password

fix syntax error

Don't create a pkg directory here.  Let's do it where we
run the make -V.  then we'll remove it.
this catches the pre-everything bug.

change path.  This should really become a local configuration item

change paths

Update locations

fresh updates from the website

first commits

This commit was manufactured by cvs2svn to create tag 'release1_1'.

First commit

Added logs of time stamp printing so I could see where things took up time.

*** empty log message ***

Hmmm, it assumed that a port commit started with cvs commit: ports/
now, it doesn't.  the ports/ bit can be anywhere on the subject: line.
Modified Files:
	log-catcher.awk

changed pkg/DESCR to pkg-descr and other changes associated with new ports
layout.
Modified Files:
	ports.pm

first commit
Added Files:
	fetch-cvs-file.sh

Cater for  ports which are deleted, then reimported.  We have them in the
tree, but they are deleted.  Just set them "status = 'A'" and get on with it.
Modified Files:
	updates.pl

damn, forgot the db login
Modified Files:
	updates.pl

change db and password to values which obviously need changing.
Modified Files:
	updates.pl

final changes before freshports 1.1

Committing in .

Modified Files:
	log-catcher.awk log-catcher.pl

Modified Files:
	updates.pl

rename change_log_details.change_port_id to change_log_port_id
Modified Files:
	updates.pl

add a zero to the mask (to make it octal?  or hex?)
Modified Files:
	portschange.pm