This code no longer used. see svn+ssh://svnusers@svn.int.unixathome.org/freshports-1/ingress instead Split the code into two parts: 1 - scripts run from the command line 2 - Perl modules used by some of those scripts
'-m'
'improve logging messages'
Do a better logging attempt
remove extraneous declaration of $FreshPorts::Config::JailBaseDir
'Fix SHEBANG issue in Makefile.pl'
Whitespace only
use /usr/local/bin/perl
'perl string comparison is eq not =='
String comparison is eq, not ==
'Sys::Syslog, not Syslog'
Sys::Syslog, not Syslog
'Remove FreshPorts:: from DBI references, erroneously added.'
Remove FreshPorts:: from DBI references, erroneously added.
'Try newly checked in scripts'
'Try newly checked in scripts'
Prepend all use and require with FreshPorts::
Add this, used when building FreshPorts-Modules
If the file is blank, return from _GetRealPath
Remove trailing whitespace from a couple of lines
'fix breaking of path:dir[:target] dependencies tuples into dir[:target] tuples'
Fix the splitting of path:dir[:target] into dir:[:target] re https://www.freebsd.org/doc/en_US.ISO8859-1/books/porters-handbook/makefile-depend.html With help from https://gist.github.com/ktracer
'simple changes in process_vuxml to be closer to original code'
Reduce the scope for $fh Revert declaration of $p to orignal location
Remove spurious committer_opt_in include introduced in r4906
'I think4threquire SSL on connection; fix vuln processing'
'I think4threquire SSL on connection; fix vuln processing'
Although I think this script is no longer used, let's update it.
white space and comments
Fix the stale filehandle issue with processing vuxml errors. It seems we are creating a new $fh value each time through the loop. While that approach worked with HANDLE, it does not work with IO::File. We were getting errors such as: no element found at line 1, column 0, byte 0 at /usr/local/lib/perl5/site_perl/mach/5.24/XML/Parser.pm line 187. I think that is indictative of an empty file. I encountered similar messages when printing the contents of the $fh before invoking the parser but those messages went away if I did a seek to te beginning of the file before parsing. I also noticed that the processing worked for the first vuln it processed, but never for the second. Invoking the script again allowed another vuln to get processed, and so on. That is what led me to the 'reuse' issue. I also tried a $p->DESTROY(); ... this also allowed things to work but this commit is a much better solution.
Remove spurious entries Adjust whitespace
Require SSL on connection
'I think the vuln processing is fixed'
'I think the vuln processing is fixed'
I think I've fixed the vuln issue
Better SQL
Updates not previously saved
fix trailing newline
Fix trailing newline
Fix trailing newlines
Add trailing newline
Better formatting
'When adding a dependency to the database, strip any @py27 or :configure type stuff first'
When adding a dependency to the database, strip any @py27 or :configure type stuff first.
'-m'
Umm, move the code into the if, so it's not executed every time.
'-m'
Remove generate_plist from updating the ports tree. That column has been removed.
'-m'
Ignore empty lines
'-m'
'-m'
When there is no generate_plist, be sure to delete what's there.
Added when we have a bunch of FreshPorts::Ports_generate_plist=HASH(0x806d9f0d8) see https://svn.int.unixathome.org/viewvc.cgi/freshports-1/scripts/trunk/port.pm?view=annotate#l1234 I changed $this->{generate_plist} to $generate_plist
Add trailing '
Fix SPOOLINGDIR
'adjust dyndirectory locations'
'8djust dyndirectory locations'
We use constants. Declare that.
Remove unused code: * summary-all-days-create.pl * test_DailySummary.pl * test_FileBasename.pl
Remove log-munger code long not used
Remove old unused code: log-catcher
Adjust this to suit new directory locations
Deprecated in favour of queue-status.pl, used by Nagios.
'adjust dynamic to cache'
adjust references to dynamic so they refer to the new structure
Fix the signals directory
'Correctly count files in ports tree. config.sh and config.pm improvements'
'Correctly count files in ports tree. config.sh and config.pm improvements'
Comment update
Avoid counting . files, such as .svn, which will artifically inflact the number
'use the correct user for checking missing categories on ports'
Use the correct user.
'fix hourly_stats db connection'
Add in missing my
'hourly_stats is now RO connection'
Connect read-only
Set ConnectionType if not supplied.
Whitespace only
'Allow database connections without parmeters to default sensibly'
Connect as RO
Allow for no incoming ConnectionType and default it to commits
'Add RO database connections'
Remove FREEBSDCVSUPHOST, no longer user set DBUSER='reading', because most .sh scripts should be readonly
Add whitespace
When connecting, ask for a RO connection
* Add optional parameter when invoking FreshPorts::Database::GetDBHandle * use $FreshPorts::Constants::DB_ConnectionType => SOMEVALUE * possible values are: * $FreshPorts::Constants::DB_ConnectionType_ReadOnly * $FreshPorts::Constants::DB_ConnectionType_Commits * $FreshPorts::Constants::DB_ConnectionType_Listener
Add FreshPorts::Constants::DB_ConnectionType for use when calling FreshPorts::Database::GetDBHandle
* add user_listening and password * add user_readonly and password
Add three database connection types: * Commits - used by default * read only - will become the default soon * listening - used by fp-daemon
Sort by count and name
Archive messges using the proper directory
use MSGDIR for archiving, not something we make up locally
Remove blank line
'stop using HANDLE for vuxml, use FILE::IO instead'
Better vuxml to avoid HANDLE errors
Stop using HANDLE and start using File::IO This will hopefully avoid: Name "main::HANDLE" used only once: possible typo at ./process_vuxml.pl line 89. This should have been included in revision 4905
Stop using HANDLE and start using File::IO This will hopefully avoid: Name "main::HANDLE" used only once: possible typo at ./process_vuxml.pl line 89.
When not refreshing explain: this port *** EITHER *** does not need a refresh *** OR *** we were told not to fetch
'make for better status gathering'
Cater for different queues used on different hosts
We're going to a single tier queue. No more multiple queues.
Do not invoke LOGGER before it is defined via config.sh Add more logging calls
Alter this script so that each port is always updated. Remove ValueHasChanged() Become branch aware, because we have active ports on branches.
'make set-generate_plist.pl work'
Make this script work
'remove pkg_plist and makefile'
remove pkg_plist and makefile re https://github.com/FreshPorts/freshports/issues/53
Whitespace only
'add missing make-generate-plist.sh'
Add make-generate-plist.sh
Sometimes, you need to refresh from head..
'Add more logging during initial processing of message'
Add more logging during initial processing of message. * Branch * Subject * message-id
'Reinstated erroneously removed code. Add in JailConfigurePlist'
Reinstate the depends_* trimming erroneously removed in a recent commit. While here, remove unnecessary references to SVNDIR_CHROOT
Add missing JailConfigurePlist
'add missing file for generate_plist'
Add missing file
'Fix path to perl'
Use the correct path for perl
'Stop using paths in DEPENDS. Start using generate_plist'
better logging
Add generate_plist feature. Fixes https://github.com/FreshPorts/freshports/issues/50 This will give us a better pkg-plist solution. Stop using full path names in depends field: * depends_build * depends_run * depends_lib * fetch_depends * extract_depends * patch_depends We were storing taking a As a result, we no longer need these functions: * freshports_ConvertPortPathToStandardLocation() * depends_stripper()
better logging
better logging
Use FreshPorts::Utilities::Report not syslog
Use FreshPorts::Utilities::Report
Start using FreshPorts::Utilities::Report
Add Report($;$) which takes a level and a message. Use this function internally. Start logging via local3 so we can capture that via syslog
Stop using . for concatenation
Invoke logger via local3.info to help direct all syslog messages to /var/log/freshports
Invoke logger via local3.info to help direct all syslog messages to /var/log/freshports/
rename Verify/README to Verify/README.txt
rename Verify/README to Verify/README.txt
Rename to be like all the others
Adjust UMASK to be group writable (002) Adjust regex to consider only headers (:h) When discarding a message, log the Date, From, and Subject, much like a delivery.
use vars.sh.sample
Rename for better FreeBSD compatibility
We have a sample file, we should use it
A little more logging
use /usr/local/bin/perl, not /usr/bin/perl
Change /usr/bin/perl to /usr/local/bin/perl
BConvert config.pm.sample to new directory structure
Migrate to new directory layout
Document that it needs fixing with respect to directories
Better mailfiltering
Add more logging. Make better use of to instead of cc
Specify Maildir despite using neither Maildir nor mbox. Why? I suspect it might make a difference in how the files are saved. Maildir saves to a temp file, then moves it o the final destination. We want that behavior. Under procmail, it was designed to save to a temp file, then mv. Now that we are using maildrop and Maildir, let's use their save/mv instead of doing it ourselves. Mind you, perhaps procmail did that too? Forwarding email address must be prefixed with a ! Stop doing the save/mv we did in procmail. Let Maildir handle that.
Document the move to maildrop
Release 1.0.2
Add support for maildrop
Release 1.0.1
Update, becase we don't do anything here, it all comes from the port.
Bring up to date with new directories. We no longer need foo+bar addresses because the recipient is now a dedicated user (i.e. not dan).
Add base to the list of part we process, despite it not being used yet. using https not http
Start using https instead of http
Adjust to the new directory layout to be introduced at 8xdtu.freshports.org
Remove, no longer required
I am not sure why we needed this directory
Use a constant for the email address
Reverse previous commit and leave config.sh in this directory. Instead, we will create a symlink to /usr/local/etc/freshports/config.sh Why? Pulling in a config.pm file for perl might be more difficult. Might as well use symlinks for both.
Move config.sh to /usr/local/etc/config.sh
Release 1.0.0
Avoid new stuff on branches fixes #29
Add stuff for ports dri
Add a commit
For making new branches. This script should be run this by hand.
Add pkg-plist and Makefile to the things stored in the ports table
This refreshes all ports, not just those on head
Not having a distfile is not an error
Cater for new columns associated with no-packages https://github.com/FreshPorts/freshports/issues/9 - Not all ports have packages
Most of these changes allow for commits to ports on branches and the associated updates to any slave ports. * Add distinfo field to ports table * rename _GetPKGMESSAGE() to _GetFileContentsFromJail() because we are using it for both pkg-message and distinfo. * introduce CreatePortOnBranch()
pg_lasterror -> pg_last_error
Better debugging message whitespace
Better sleep and associated retry
The test must always be relative to PORTSDIR
* Master ports are always defined on head, because they may not exist on the branch It may occur that someone changes the master port on a branch, but highly unlikely * Remove extraneous fields from SQL query * pg_lasterror -> pg_last_error
Better retry / & delay times
pg_lasterror -> pg_last_error
add some debugging capability
Set distinfo.
Do the commit each time. Don't check distinfo.
Set master sites
make master-site-all has been replaced by make -V _MASTER_SITES_ALL
set $result before you test it. I have no idea why this bug did not arise earlier. That's terrible.
Keep track of elapsed time for svn up
Add pkgmessage to the ports table
Consider the interval, number of commits in past 5 minutes when reporting queue status.
set branch and add more debugging statements
Give a full path to HEAD
Properly quote the incoming file. re 201601062012.u06KC53V085831@repo.freebsd.org
use /usr/local/bin/perl
Set branch before proceeding
Add more checks and use the right dir.
Add comment regarding use of branches.
Give better starting points
whitespace
Whitespace only
Better debugging
Attempt to prepend $PORTSDIR to each depends
add
whitespace only
Use a newly created constant
Use the configuration user, not hardcoded user
Print my SQL
Move the flag removal to the end of the tasks
We have pkg version and pkg_version is gone.
Cater for branches, and set a starting point; you can change that later via code
Cater for branches
Allow for --fetch for fetching before running (defaults to 1) --message_id=MESSAGE_ID_FROM_COMMIT --port=www/bacula-sysutils
Allow one port to be refreshed
Correctly name some depends fields
Change the wrapper used because the old one has trouble with more recent perl? "This shouldn't happen at /usr/local/lib/perl5/5.18/Text/Wrap.pm line 84." -use Text::Wrap; +use Text::Wrapper;
Encode stuff
Better logging
Add error reporting
This servers is on FreeBSD 10 now
Better
Better logging
Remove AlreadyInserted code
Remove WHERE
This works.
Commits
require, not requires
This needs branches
$uses not uses$
Validate dates
Add FETCH_DEPENDS, EXTRACT_DEPENDS, PATCH_DEPENDS, and USES
Correct a print
Make it so we do not have to maintain this. Courtesy of bdrewrey
Update to a better formula
Add files we need in the jail
Cater for a couple more mailing lists
Now that host and dbname are in config.sh, remove them from here.
Add db connection information
Use ports_active, not ports_all, so we avoid deleted ports
updates
Use Mozilla::CA to deal with certificates
Add the changes to deal with branches
Works
Add. Incomplete.
Better error handling if pkg-descr goes wrong
Better debugging and make use of the jail paths
Fix Revision label on logging output.
Avoid duplicate entries in commit_log_ports_elements table
Commit it all!
Remove LooksLikeAMakefile(). We no longer get files via cvsweb, we get them via svn up.
Add savePortTableOnly()
Don't save on errors remove unused code whitespace
We might want to do a different kind of save
Cater for branch RELEASE*
Remove unused code Mention branch on error messages
Cater for yet another special Subject
Use eq not == for strings
Do not report failed dependency additions on branches
Cater for Subjects such as: Subject: svn commit: r341906 - in head: . dns dns/bind96 multimedia - 201401310024.s0V0OxDq013147@svn.freebsd.org - http://docs.freebsd.org/cgi/mid.cgi?201401310024.s0V0OxDq013147
Pass CommitBranch when saving port details
Cater for change to head proper, such as - http://svnweb.freebsd.org/base?view=revision&revision=261303 - http://docs.freebsd.org/cgi/mid.cgi?201401302226.s0UMQpDr065857
whitespace
Add SVNBaseDir
Not used
Update for Branches
Ignore everything after: Changes in other areas also in this revision
Correct the branch for the docs list
Now that we are using a perl module to get the List Id, fix the ID for the src list
use head, not HEAD.
Remove _FetchFilesNeedingRefresh_DELETE_ME()
Start using a better way of getting mailing list properties.
Correctly print the jails
Go some way to detecting commits to branches and split the filename accordingly
Remove Pathname_ID. It is not used.
include FRESHPORTS_FREEBSD_SVN_URL and PORTS_SVN
PORTSDIR is needed by process_vuxml.sh
PostgreSQL now has autovacuum
Get rid of this MySQL antiquity
cater for scheidell (ports committer)
Once you see Directory Properties, we're done.
Get the messages subject properly
Set long description / homepage
Remove PORTSDIR
comments out OPTIONSFILE
Add comment
Say which flag is not set
Don't test for an existing file from outside the jail. Drop the test entirely and just go get the contents.
Monitor incoming as well
no more Cwd or File-PathConvert.
add JailMasterSitesScript, JailShowConfigScript, JailDescr add _GetRealPath so we get the right description file
Start using a hostname for the database connection
add hostname to database connection
Add FreeBSDVersion = 9 I should find a way to do this without having the bump the versin all the time...
Add some more jail scripts
Fix comment
Add vars/sh
We do the installing from the configuration directory
Avoid an uninitialized value message. See http://news.freshports.org/2013/07/09/xmlwriter-upgrade-causes-fatal-error/
Use the jail to get the pkg-descr
To refresh certain broken pkg-descr commits
not sure why this wasn't already in here...
Remove commented out code
Fix the setting of port.last_commit_id on new ports
Add more jail stuff
use new jail for make master sites
Get the port name in there, and order the output
Fix how we update in place. Do this by deleting, then inserting. It gives better results without getting very complex on updates.
Update instructions for running
Add
Retire cvsup-local-tree
Retiring this script now that SVN is used
Add
Add samples for config.pn and config.sh
Also display the required sudoers entries
Add trailing ;
Update to use the jail scripts
Add
Fix up
Fix...
Add support for the jail
Add the scripts for creating and running the jail infrastructure.
Fix /UPGRADING and /MOVED
Update to reflect locations in SVN
Start using Text::Unidecode from converters/p5-Text-Unidecode to handle UTF-8 to ASCII conversion.
Better handle file translating
remove code not required in prod
add p5-Email-Mime
Update to use MIME ports
Update our list of things we need.
Do not syslog messages about the queues. We cover that now via Nagios
Add / to the db root prefixes
Update to full pathes
spell it right
match the results of _FetchFilesNeedingRefresh
Correctly name all columns in the result set
Add in the repo names
- update for storing svn revision in the commit_log table - start doing an svn up on the revision name, not the individual files
Tell us the failure value
- remove the unused function GetFreeBSDRepository(), which always returned src. - add GetRevision() so we know the repository revision for this commit
Updates, base on what I had in config.pm
- start using PORTSVN as the PORTSDIR for our local ports tree - this lets us use svn up to grab updates - add a sanity test for CATEGORIES to ensure it contains the primary - category - ^ that is useful for repo copies - UsualPortsTreeLocation is /usr/ports, not /usr - This is because our incoming file names are prefixed with ports/ to - reflect the existing tree structure in our database which was set up when FreeBSD used cvs for the ports tree, not svn as it - now does - start fetching files from svn using svn up - this will be useful for directories involved in repo copies. No more - missing Makefiles on svn mv. - in such cases, the file being fetched will be blank, but the directory is - not.
Do not do a -w on the perl call
Add another debugging statement Be more explicit on a regex: use .* instead of *
Trim any leading/trailing whitespace in file names
- instead of processing the entire vuln.xlm file, look at each one and compare the checksum. Process only the different ones
- Start using svn cat for fetching files.
- Append to the vuxml.log, don't just overwrite it - inlude some timestamps
Adjust for changes to vuxml_mark_commits... supply a named paramter
- start saving checksum - provide a method for fetching a checksum, based on vid
Adjust for the different format of the SVN tag
- adjust for new approach of updating just the vuln that have changed
- adjust for new approach of updating just the vuln that have changed - this script now just processed one vuln at a time - record the checksum - keep track of whether or not we updated the database so our caller can take action based upon that - add more detailed debugging statements
Do not fetch directories. Only files.
Remove ======
Handle the special case of 'ports' directory.
Assume ports repository and adjust the URL so it works...
Assume ports repository and adjust the URL so it works...
Ignore CVSROOT so we don't create a category and fetch it...
Start fetching from SVN, not CVS
Add the script for fetching files from SVN
Remove trail PROPS message Use the correct List-Id for the post-svn-head list
When element_id is null, use null, not a space
Now we know the List Id...
Rename a variable
- prepare for FreeBSD move of post to svn - alter svn processing so it prepends a repository name to all filenames - create process_mail.pm (FreshPorts::ProcessMail) which contains a few - common functions for parsing svn messages - move some functions from process_mail.pl to process_mail.pm - alter process_mail.pl to reference FreshPorts::ProcessMail - GetOS_RepoPrefix() is the function that gets the repo name - while here, remove process_cvs_mail.pl & process_svn_mail.pl which were deprecated by respective .pm files some time ago
If a given field is undefined, use '' instead.
Use the new FreshPorts::CommitterOptIn::GetErrorCount() function
Better comment regarding the main loop
Enhance an existing debugging message
Add GetErrorCount()
Correct a flag mentioned in usage statement
- better format a call to FreshPorts::CommitterOptIn::RecordErrorDetails() - add missing DEPENDS as a sanity test failure - add more debugging related to depends evaluation - in sanity test failures, mention DEPENDS that cannot be translated to a - dependency
Whitespace adjustment
Check for OFFLINE
Correctly spell the table name.
Fix, thanks to crees
Convert /./ to / in pathnames
More debugging output
Do for _RecordPortFilesTouchedByThatCommit() what we just did for _CompileListOfPorts()
Avoid a situation where a file at the category level is mistaken for a port. See 201205251025.q4PAPOvV092118@repoman.freebsd.org
Add more debugging information. This stemed from 201205251025.q4PAPOvV092118@repoman.freebsd.org
Allow for svn doc mailing list.
Add script for checking number of ports without entries in the categories table.
More comments regarding partial vuln processing
Mention where we'd need to change stuff for partial vuln.xml processing.
whitespace
Add some comments regarding partial processing of vuln.xml based on keeping an MD5 of each vuln
Remove pkg from the list of constants. Issue raised by bapt re ports-mgmt/pkg
Don't go deep
Remember to clear the ports_vulnerable table when processing
Do not die if no files are found. That can happen, say with an svn cp
If no valid expiration date, ignore the supplied value.
Change tab to spaces Put the / in 'quotes' to avoid division.
Add ip_address
Add another list
Add **OBSOLETE** CVS commit messages for the entire tree
Add missing pm
Add in projects
Some updates for port dependencies.
Introduce, and start using, process_svn_mail.pm for processing SVN commits. This has been in use on svn.freshports.org for quite some time. This change allows freebsd-cvs.sh to invoke process_mail.pl, which decides if this is an email we can process.
Set the value of FetchOK
Update
Have a max depth of 1.
Be sure to strip the depends before inserting.
Add
Add port_dependencies
Correctly spell license, and correct a bug which prevented license from being correctly picked up. REPORTED BY: Thierry Thomas" <thierry@pompo.net>
Add for Nagios
Add password token purging
The ability to delete old password tokens
Add.
Add support for license
Add another test.
Cater for empty change values
Add
Allow FreeBSD 8
Remove X11BASE
Set RESTRICTED correctly.
Keep the constants and utilities in there.
Commits to vendor branches slightly differs from normal commits. From Oleksandr Tymoshenko <gonzo@bluezbox.com>
Add new script amended by Oleksandr Tymoshenko (gonzo@)
Add better handling of cache update for things such as GIDs, UIDs, LEGAL, etc.
Now that we are not using ConvertFilePath, we aren't picking up the Freeze. Fix that.
Cast greatest() to ::date
We don't need to use db_escape() any more. DBI does proper PostgreSQL quoting.
Add details for FreeBSD 7. Incorporate changes suggested by koitsu@
Invoke NullIFEmpty on several more port fields.
Treat restricted and no_cdrom with special care for NULL
Correctly handle is_interactive to avoid setting that field to ENULL.
Start using NULLIfEmpty()
Remove _NULLIfEmpty() as it is now part of utilities.pm Start using the new location.
Move NULLIfEmpty() here from port.pm
Start escaping stuff going into the port table.
Start escaping the additions to the commit_log table.
Add a few debugging hints
Add db_escape, which escpaes stuff for PostgreSQL, E'stuff'
For showconfig: - use OPTIONSFILE=/nonexistent - remove LOCALBASE and X11BASE
Add ports.showconfig
Ready to go
Get the pathname right.
Wrong website. :)
Add, incomplete.
ignore OFFLINE
Don't echo the parm. check for valid parm, and if none, echo usage.
Check for OFFLINE
Add support for fp-listen
Add a log message
Remove irrelevant comments Add a full path to the OFFLINE file
Check for OFFLINE
Add a script for taking the website offline for maintenance
I now think ConvertFilePath is wrong. I should not munge the file name like that. Do it at fetch time!
Better handle failed master-sites-all
Cater for no vulns
Give a proper count of vulns and ports.
Invoke FreshPorts::Utilities::InitSyslog();
Do a better log message
Try syslog
Set the Queue as a configuration item.
We no longer patch
Use the native ports infrastructure instead of own patch MASTERPORT => MASTER_PORT
We no longer patch. The previous patch was to just keep the code instead of abandoning it.
How to patch on the fly.
we no longer patch
We don't patch any more
add ports/Mk/bsd.port.mk
We patch less for a while
No longer needed.
Remove. Covered by other patch: bsd.port.mk.master-slave-patch
Use more constants Fetch files before invoking scripts
Remove inaccurate comments referring to ./process_moved.sh Log more information This script no long fetches the file. That should occur before this script is invoked.
Log more information Use the CVSWEB URL from config.sh
When we can't fetch all the files, report an error and exit the loop.
Add a ConvertFilePath($FilePath) Cater for older commits, without a repository set in the message.
Remove PORTDIR from MASTERPORT. Some ports do this in a wonky way. For example: category | name | master_port --------------+----------------------------------------+----------------------------------------------- graphics | ocaml-lablgl | /usr/home/dan/ports/devel/ocaml-camlidl archivers | ocaml-zip | /usr/home/dan/ports/devel/ocaml-camlidl security | ocaml-cryptgps | /usr/home/dan/ports/devel/ocaml-camlidl x11-toolkits | ocaml-lablgtk | //usr/home/dan/ports/devel/ocaml-camlidl japanese | kinput2-canna+sj3 | /usr/home/dan/ports/japanese/kinput2-freewnn/ japanese | kinput2-canna+sj3+wnn6 | //usr/home/dan/ports/japanese/kinput2-freewnn/ japanese | kinput2-canna+sj3+wnn7 | /usr/home/dan/ports/japanese/kinput2-freewnn/ japanese | kinput2-canna+wnn7 | //usr/home/dan/ports/japanese/kinput2-freewnn/ japanese | kinput2-canna+wnn6 | /usr/home/dan/ports/japanese/kinput2-freewnn/ japanese | kinput2-sj3+wnn7 | //usr/home/dan/ports/japanese/kinput2-freewnn/ japanese | kinput2-wnn7 | /usr/home/dan/ports/japanese/kinput2-freewnn/ japanese | kinput2-freewnn+sj3 | //usr/home/dan/ports/japanese/kinput2-freewnn/ japanese | kinput2-wnn6 | /usr/home/dan/ports/japanese/kinput2-freewnn/ japanese | kinput2-canna | //usr/home/dan/ports/japanese/kinput2-freewnn/ japanese | kinput2-canna+freewnn | /usr/home/dan/ports/japanese/kinput2-freewnn/ japanese | kinput2-canna+freewnn+sj3 | //usr/home/dan/ports/japanese/kinput2-freewnn/ japanese | kinput2-sj3+wnn6 | /usr/home/dan/ports/japanese/kinput2-freewnn/ japanese | kinput2-sj3 | //usr/home/dan/ports/japanese/kinput2-freewnn/ math | spooles-mpich | /usr/home/dan/ports/math/spooles/ science | mpqc-mpich | //usr/home/dan/ports/science/mpqc/ x11-toolkits | fltk-threads | /usr/home/dan/ports/x11-toolkits/fltk/
Add:
43 18 * * * ${DIR}/cvsup-local-tree
which replaces the old command line version... which started to get ugly
Add
Add FREEBSDCVSUPHOST
One of these compared items may be empty. So add an X so they aren't.
remove inaccurate comment
that should be sysutils/bacula-server, not bacula-server.
Add the master port tests
Test via the ports tree
patch with -N
Check that bacula-client is a slave port of bacula-server. We could make this a list of such ports, but that's for future work.
Comment out a debug statement.
Clarify the diagnostic message when a category is not found
Use FreshPorts::Config::Fetch_Retry_Limit and $FreshPorts::Config::Fetch_Sleep_Time
Add a \n
Add the names of the files which receive special processing.
Remove extraneous line
Take a better approach when checking for non ASCII files... Don't look for HTML anywhere in the file output. Just look for it at the start of the line.
Do not munge the result value when fetching a file
Provide knobs to set fetch sleep intervals and fetch retries. This should improve handling of network comms problems.
Remove 2nd instance of my declaration.
Better error logging
Add scripts-log
Let's do logger, not echo for these errors.
Give a better cvsup example
This should be run whether or not we are OFFLINE Simplify the script.
Add
Add these patches for the ports Mk system
Oh, we're using the old style of cache file name when flushing the cache. And we aren't finding anything. So the cache is never cleared. This is a problem.
process_moved.sh, process_updating.sh, and process_vuxml.sh are no longer wrong from crontab.
Start using a DIRLOG for keeping track of what happens
Add code to append the repo name to CVSROOT in each commit. Each cvs-all email contains a line of this form: FreeBSD doc repository where doc is the name of the repository. It is important to append the repository name to CVSROOT for any commits to the CVSROOT/ directory.
Use the new ReportErrorEmailNoPrint().
add ReportErrorEmailNoPrint() and alter _ReportErrorHelper() to conditionally print the error message.
White space only
Fix the ports freeze processing. It seems I broke with a previous commit. Reported by: Benedict Reuschling
Move back to the main cvsweb site.
Remove the hardcoded links to the design contest.
AnnouncementsGet() -> AnnouncementsGetPlain()
Add http://www.freshports.org/DesignContestVoting/
Start using FRESHPORTS_FREEBSD_CVS_URL While here, output more useful debugging information.
Fixed typo
add FRESHPORTS_FREEBSD_CVS_URL
Add more debugging output
add ~checkout~ to the URL we are fetching. This avoid getting HTML in cvsweb3.
./perl -> perl
The most-watched.pl needs to have a path to dynamic, and trailing ; before the }
Add
Add count of file in the ports tree
Oh, if you find a category that does not exist, that is OK. It just has not been populated yet. No worries.
Add a trail \n to debugging. Mention the file we are creating for www/en/ports/categories processing
Add textproc/p5-Text-CSV_XS as a dependency
Add special processing of www/en/ports/categories
Add a script for updating the category description based upon www/en/ports/categories
Order them right....
Order by date, lower(name)
Toggle sense of new for a vuln
Put the * for a modified vuln outside the hyperlink
Put t/f in output for a modified vuln
If the vuln is not new, but modified, put a * beside the name.
Remove line left over from merge.
Merge from FreshPorts2 to HEAD
When removing items from the cache, we are wildcarding now, so use glob, and delete each matching file.
Cast our net a little wide for cache entries.
Enable cache removal
Add GetErrors(). Allow others to get the errors already recorded. Added for Sanity Test Failures.
Remove the commit and rollback code. This is now handled by the xml_munge code.
When errors occur, record them in the Sanity Test Failures table
Add sanity_test_failures_id_seq
Add Sanity Test Failures
Calculate the latest vulnerabilities
Output the latest vulnerabilities
*** empty log message ***
Make sure of Debug_FetchBeforeSavingPort Better formatting of debug information
Convert all whitespace in cagegories to a single space
Add Debug_FetchBeforeSavingPort
Better debugging output
Disable caching now that we are using fp-listen
Only show active ports
Invoke most-watched.pl on a weekly basis.
Add the most watched ports count for linimon
Add Precedence: bulk
We now fetch just one category page, and it is not HTML. The fetched page actually just calls a stored procedure.
Remember to clear out the cache when updating a port
The reports of my death have been wrong. Use VUXML instead.
Add link to http://www.vuxml.org/freebsd/ for use by security notification report.
Update the copyright year, while adjusting whitespace only elsewhere
Better description of items required, including trailing slashes.
If the description is null, tell the users something useful instead of a blank line.
If we don't quote the NEWSCASHEDIR glob, it works. Nice.
correctly spell cache
Correctly spell cache
Get ready to clear the news cache too
Simplify the removal of items from cache.
There was a caching problem where cache entries were not deleted as expected. This turned out to be a permissions issue. There is code here that will be removed with the next commit. It was just kind of a shame to delete it without committing it.... ;)
Change how we remove from cache. Do it for just the one file. Do an ls before and after.
Correctly use the return value from FetchAllFiles().
Move the cache clearing code from PortsRefreshed to UpdateEnds.
- Tell observers about UpdateBegins and UpdateEnds - Take note of the return value from FetchAllFiles and do not refresh ports if it fails. - Event if there was a fetch problem, tell the observers that refresh has been completed, so they make take action (in this case, they mark ports as vulnerable)
When using FetchFile(), take note of the return value and propogate it up to our caller.
Add UpdateBegins and UpdateEnds.
cach -> cache
files -> file : go singular.
whitespace only
Save the Ports for later cache flushing. This means we can process the cache removal requests after the transactions have been completed.
Use the new path to cache files, which is a ports-tree-like directory structure. When we pass in CommitLogPorts, it is now category/port string.
When the transaction has been committed, tell the observers.
Add TransactionCommitted Update copyright
Update copyright
If caching fails, report an error.
Update copyright year.
Add php4-extensions
If the file we get back is not ASCII, tell the committer. Use unlink, not rm.
Fix problem with cache removal. Only attempt removal if cache entry exists. Use unlink instead of rm. Fix typo: Finsihed => Finished
Remove entries from the cache after refreshing.
Remove an extra -V some whitespace changes
Go case-insensitive.
Fix the caching path
Add some ability to remove ports from the cache.
Whitespace only.
forced commit to note that we now do a case insensitive check on Message-ID
Cater for null timezones
Allow AFFECTS to span multiple lines
Update to a more complete list of ports that need to be installed
Update copyright year. Look for pkg_version in the right place on FreeBSD 4 and FreeBSD 6
Update copyright year, standard headers.
For virtual categories, this is the description: This is a virtual category. No description is available.
For virtual categories, give 'no description available'
Make sure the port is active.
New patches
Add RefreshDescription() Cater for non primary categories by setting element_ID to null when no value is provided.
Provide a way to set the cagtegory description from the make files
Include the URL into the FreshPorts webserver for each port that had trouble. Provide a bit more space before listing the errors. If notifications are disabled, tell me who the committer was.
Set the refresh flag when a commit is processed.
add a flag for cache refresh
Do better caching of all the options.
Start caching the categories.php page
Add a partially completed script for checking that Deleted Ports are deleted and that non-deleted ports are not.
correctly name and locate the file
Move from category/pkg/COMMENT to make -V COMMENT.
Set is_interactive
Add this file
Add is interactive
Add is interacgtive
added: is_interactive, only_for_archs, not_for_archs. now also checks for invalid expiration_date.
Look for jobs waiting to be run.
Add and use $FreshPorts::Config::JobWaiting. This flag is used by fp-daemon.sh to seralize jobs.
Use the correct variable name for expiration_date Properly quote or don't quote the value depending on whether or not it is NULL While here, renumber the numbers so they are sequential.
use eq not == for strings.
Add an EOF message
Provide Auto-Submitted: auto-generated support. Thanks to Donal Diamond <donal.diamond@gmail.com> for the suggestion. See http://www.faqs.org/rfcs/rfc3834.html
When a new commit comes in, part the ports as vulnerable or not.
Add stats functions for ports.expiration_date
New script
Add expiration_date
Add comments about doing the file processing after the files have been fetched.
We now use Cwd, not File::ConvertPath
Add Stats_PortCountVulnerable()
Add ports-new.php
BASEIDR => BASEDIR
We now use Cwd, not File::PathConvert
stop using File::PathConvert, and use Cwd instead
Sort output by date field only
We no longer use packageexists. Remove it.
Remove the file, only if it exists.
Add restricted and no_cdrom fields
A script to set initial values for restricted and no_cdrom fields of the ports table. Does not clear out existing values.
Add statistics for restricted and no_cdrom ports
Remove begin_work() and put a my on the ErrorFound.
Put transaction control here Pass the database handle into the XML_Munge object After processing, rollback or commit, as appropriate.
Remove commit/rollback as it's now in xml_munge()
Add Set_Rollback_Needed() and $_RollbackNeeded and return the value from process()
Remove the database connection from this file. It is now supplied with object
creation.
Replace $dbh with $self->{dbh}
Display both the output from the Make command and the error file when an error is detected.
For the observer object, provide a database handle during creation.
Create the observer object first, then the xml munging object.
(Just because we can)
refer to $class->{dbh}, not $dbh
When ports are refreshed, update the ports_vulnerable table
On PortsRefreshed, supply a new value: CommitLogPorts
Functions to manipulate the ports_vulnerability database.
Whitespace only
Correct a comment
whitespace changes only
When dealing with a cancelled vuln, remember to delete the vuln from the database if we are updating in place.
Add DeleteByVID()
Add devel/pear-HTML_Page2
Add two new functions: MarkOneCommit() RecordVulnerabilitiesForThisPortVersion()
update_database_vuxml() now takes a whole vuxml structure, not just an ID
Mark vulnerable commits during processing
Add new function MarkVulnerableCommits()
Start using VUXMLMUTEX
Add vuxml_mutex
Remove unneeded /'s
whitespace changes only
Start using DISTDIR so that references to SAME come up correctly
Add DISTDIR
Handle splits that involve a ,
Streamline error handling
Supply the filename as input parameter, not STDIN
When commit is already processed, that's not an error
Capture the RCS details of the vuln.xml file
remove unneeded print messages
Add DateLessThanDate() and RecentlyAdded() both of which use Date::Calc
Remove commented out code.
Always test before committing. echo should be print
Creat -> Create
Add this package
Echo that we are doing special processing.
forced commit. Add FilesFetched
Observer the FilesFetched event. Keep track of whether or not the ports tree infrastructure needs to be patched based up on the files that are in this commit
Forced commit: This file performs any patches needed to the ports tree infrastructure as required by FreshPorts.
backout previous commit, which was whitespace only and in error
Forced commit. Code now notifies observer after files have been fetched.
*** empty log message ***
Rename update_database to more correctly refer to database_insert
Order the data by ID, so it retains the original ordering. add print()
*** empty log message ***
Use vuxml_affected_id when retrieving. Add set_id(), set_vuxml_affected_id(), set_name(), and print()
Print packages. comment out debugging code.
Comment out printing
Create a print() routine.
Alter FetchByVID() to take a parameter Add FetchPackages()
Alter to return a bunch of packages not an affects. This makes things conceptually easier.
FetchByVID() now takes the vuln id as a parameter
comment out debugging
Remember to empty out objects before using them again.
Whitespace changes
remove unused shift in empty() Remove unneeded quote in save()
update the SQL keywords
Remove extra comma from UPDATE
add empty() and FetchByVuXMLAffectedID()
Add functions for setting values
Add Empty(), add some whitespace
add fetch by id, and empty()
Add empty()
First attempt at grabbing all package information for a vuxml entry
Add newline to EOF
add FetchByVID
whitespace only
clean up _initialize
remove unnecessary code from _initialize
Allow for updates
Fix broken HTML by adding a = after TITLE
First work towards incremental updates of vuxml instead of wiping the tables and starting from scratch again.
Add FetchByVID() Alter Save() to allow for updates
white space changes only
Add commits.html cache
Remove unused usage
We don't use this anymore
We no longer use this.
Add TITLE / hover text to the hyperlinks
Whitespace only
remove most 'use lib' as they are unnecessary.
Let's make this actually update the fields it claims to upgrade
Set the ports.last_commit_id field for those ports that have no such value.
This commit was manufactured by cvs2svn to create tag 'FreshPorts-VuXML'.
If we are offline, do nothing.
Put a standard header into the file
Log the things we process. The approvers files is in CVSROOT, not CVSROOT-ports
The file for is processing UPDATING is /dynamic/refresh_updating
Use full path to BaseDir. Include new options we have been missing to date. vuxml, etc
use ' not " Use :: not : for the config package.
Update with process_updating.sh and process_vuxml.sh
*** empty log message ***
Play catch up: add UPDATINGFLAGFILE PORTSFREEZEFILE VUXMLFLAGFILE
This file was taken from process_vuxml.pl and will now be the file that just loads the vuxml file into the database. process_vuxml.pl will soon load the file, and mark the commits.
If we pass '' to a sub, then invoke a shell script, that is missed as a parameter. So the usage is invoked. Not nice. So use , '"''" instead. While debugging this problem, improve the debugging output.
To take advantage of the new fetch script, without breaking existing code, create FetchFileURL(), and alter FetchFile to pass acceptable parameters.
Become more useful by adding a couple of parameters: URL=$1 - The URL to fetch from. Useful for local testing. SUFFIX=$6 - The suffix to attach to the URL. Useful to specify the repository.
We're pretty good here now. Hopefully it won't take much to complete this.
Get rid of unused variables and commented out code.
Remove this file as it will not be used.
I was planning on grabbing the historical epochs for the master sites of slave ports, but that proved to be ugly because historical makefiles do not always parse cleanly.
Start updating commit_log_ports Add some code for extracting PORTEPOCH via make -V, but then comment it out because some old revisions of makefiles do not parse cleanly. Ignore PortEpochs that are variables. We can't use them here.
If the port never sets PORTEPOCH, it must be set in the MASTERPORT. Detect such situations and display the master port name.
Whitespace only
This is much better.
First commit of this. I think it's soon to change.
Now we are updating the commit_log_ports_vuxml table.
Now we are invoking pkg_version to test versions. Getting closer now!
We now have all the commits for a given package.
Remove ranges_ from the columes in the vuxml_ranges table. Instead of using version_start, use version1, etc
On a file update, invoke FreshPorts::SpecialProcessingFiles::Eat Start handling $FreshPorts::Messages::PortsFreezeCheck
Start processing all the special files
add $FreshPorts::Messages::PortsFreezeCheck
Stop calling FreshPorts::SpecialProcessingFiles::Eat
add shell script which sets PortsFreezeInEffect file
Add the shell script that corresponds to the perl script
Put the right values into the right fields for ranges
Set commit_log_ports.port_epoch
On the insert, use the right field names with the right values.
Handle new field: quoted_port_epoch
set the newly redefined package_name field
Grab PKGNAMEPREFIX and PKGNAMESUFFIX rename pkgname => package_name
Script to set newly added fields: no_latest_link no_package pkgname portepoch
Add new columns to ports table:
no_latest_link
no_package
pkgname
portepoch
example:
freshports.org=# select no_latest_link, no_package, pkgname, portepoch from ports_active where name = 'dgd-net';
no_latest_link | no_package | pkgname | portepoch
----------------+------------+---------------+-----------
| | dgd-net-1.1.8 | 0
(1 row)
freshports.org=#
Add update_database_vuxml_affected and update_database_vuxml_references This completes the database updates for vuxml data.
There is no date_modified column. Remove usage.
There is no date_modified column. Remove usage. We use vuxml_affected_id, not vuxml_id. Change it.
put the -w back in
Start updating the database
Pass in database handle
Include constants Set status
how to process the vuxml changes
Allow invocation like this: (DBHandle => $dbh, Stream => *STDIN) cater for undefined values
The start of using vuxml
First attempt. untested.
Raname package from vuxml-parsing to vuxml_parsing
Add Matthew Seaman's work into the tree. This will be used to parse the vuxml database.
Set the broken field.
strip out unmentionables, unprintable characters.
Start using "ISO-8859-1" and not "UTF-8". This fixes the umlaut problems.
Move to an Observer/Observable stragegy. This commit requires use of http://search.cpan.org/~cwinters/Class-Observable-1.02/lib/Class/Observable.pm See also this port: http://www.freebsd.org/cgi/query-pr.cgi?pr=ports/70339 For this commit, most of load_xml_into_db.pl was moved to a new file: xml_munge.pm
Add messages for Observer/Observable
whitespace only
Whitespace changes only
add missing ' in debugging message
use the right paths so that reinstalling this port works.
COMMENTify this port
remove @dates, which is no longer used.
Move diagnostics code up into the main loop. Use config.pm for path to ports tree.
Start using AddUpdatingXref
Introducing $FreshPorts::Constants::VERSION_REVISION_JOINER
Update copyright year
Remove unused variable $file. Remove unnecessary push.
Original code from Travis Campbell. Slightly modified by Dan Langille to work with STDIN and write to database.
remove unused variable
Ignore vacuum.sh
add depends_lib, master_port, latest_link
Process slave ports when the master port is updated.
Set the ignore field of the ports table.
Back out the change. The blank line code has been tested in production for some time, but it's not thought to be necessary. The error it is detecting should not occur. It may be better to fail with when this error occurs.
Cater for blank lines. this will be backed out soon.
For a given master port, return all the slave ports.
For each slave port, refresh its values from the master port.
Set the depends_lib field
This script sets the master_porta and latest_link fields of the ports table.
Add stub for refreshing slave ports.
Allow the date in a commit message to be : or / delimited. e.g. jeh 2001/12/04 05:22:26 PST or jeh 2001-12-04 05:22:26 PST
Use cvsup host not xeon host.
remove debugging code which was stopping the reports.
Comment out some debugging information.
Better examples
Remove directories no longer used
No need to email now
A port can be marked as IGNORE. Start processing that value from the makefile. All makes now use: LOCALBASE=/nonexistentlocal X11BASE=/nonexistentx This will allow ports marked as BROKEN to be queried as if they were being loaded into a empty machine (i.e. no ports installed). Idea from: Oliver Eikemeier <eikemeier@fillmore-labs.com> Brought up by: Thierry Thomas <thierry@pompo.net>
add ignore
Better format this output. Group them by Date
remove USERS as it was not used.
Correctly state whether or not committer notifications are enabled.
forced commit to correct previous commit message this script now handles the deprecated field.
Handle hourly stats
Handle the ports.deprecated table
Based up on report-notifications.pl, this script does not need to refer to report_frequency because it is run on demand. We refer to security_notice.date_added not commit_log.date_added The next step is to remove all reference to frequency.
Add OFFLINE example
Add
Start using online
improve reporting, use Online
Improve report
Start using OFFLINE
Start using system_status. delete records more than 7 days old
Only email the committer if they are opted in
If MessageID is not found in the message, say so, and abort.
Move the "This message was generated..." phrase to the bottom of the email.
whitespace and cap changes
Security Report ID should be 5, not 6
Add announcements.pm
Start using FreshPorts::ReportConstants::Footer
whitespace
remove dirname which was unused
remove maxlength and dirname, which were unused
Update copyright. move WatchURL, ReportSubscriptionURL here from various report scripts Create FreshPorts::ReportConstants::Footer
Add entry for daily rendering job
Remove unused code
Script called by cronjob.
Script for creating summary for daily totals.
fix the broken regex for the ports tree
Move comments closed to relevant code
Update samples
Fetch all files. Let the called routine validate the files.
Fetch only files within the ports tree.
Start using special processing
special processing for special files
Add more samples
Whitespace adjustement
cronjob
remove unused code empty table before filling it
use chomp
Insert the stuff into the database
First cut. Needs to start using stored procedure PortsMovedAdd.
Improve the error reporting for corrupted commits.
Forced commit to fix previous commit message. Track duplicate file names in case of corrupted commit messages.
ignore status.pm
improve error collection
Display the Port name and the error beneath it.
white space changes (tab align, convert space to tabs etc) remove commented out code
Add a status check on the queues. If anything turns up in the retry queue, let the admin know.
Verify that WEBSITEURL is defined.
add cache-refresh.sh
When processing a commit, check to see if the Makefile is there. If it isn't, error out and mention that if this is a repocopy, please ignore this error. While here, put the Makefile pathname into $Makefile, and stop repeating the use of MakefileDirectory/$FreshPorts::Constants::FILE_MAKEFILE
Add the hostname and database name into the mail headers
whitespace
Refresh the cached files
Keep the error message with the port name Always CC the system admin on sanity errors
Improve error reporting by including port/category. Only report the error if the error file is > 0 and the result is zero
Add: WEBSITEURL CACHEDIR STAGINGDIR
whitespace
Add details on how to use formail to load an archive.
- Use commit_log_ports_elements instead of commit_log_ports_extra - When creating a new port, be sure to read the details back in after saving. That info is needed later. - fix up the matching of directories and ports so we quote any meta characters in the port name. i.e. \Qpathname\E
Replace commit_log_ports_extra with commit_log_ports_elements. Same concept, but larger scope. This new table cross references a commit to ports and files outside ports.
A little test script for checking if dirA is a subdirectory of dirB.
Any ports tree commit which touches a file not belonging to a port (e.g. ports/INDEX) will result in an entry in this table.
- Because the File structure now contains element_id, be sure to extract it from the where used. - Add _RecordPortsFilesOutsidePorts which will populate the commit_log_ports_extra table.
Include the element_id for the file within the File structure
Include the full path to the port element, without a leading /
Call RecordPortsTreeButNonPortCommits if we have a commit with no ports.
remove #!/usr/bin/perl -w
Remove unused values
Provide a facility for recording commits into the last_commits_ports table which are in the ports tree, but which do not involve a port.
whitespace changes
whitespace and text alignment
Remove incorrect package declaration.
Whitespace only
Now that main page update has gone away, we need the ability to refresh the daily summaries. One day, we'll start using it...
Wrap text at 72 for any messages sent by SendEmailNotice
We no longer use these files.
If we encounter an error, stop. Comment out all prints.
If no files are found during a regular GetFiles procedure, try invoking GetFilesImported instead. This will process any file imports.
Remove notice about multiple watch lists.
Whitespace adjustment. When we cannot open Mail::Sender, log the error using LOG_ERR not LOG_NOTICE.
Use the correct number of parameters when calling SendMail.
Remove "use housekeeping". Remove RefreshMainPage function because we no longer do this.
Lots of whitespace fixes. Record the information which is used during Error Notification. (message subject and message id)
Allow CommitMessageID and CommitMessageSubject to be included in the notification. If Committer Notifications are turned off, don't include the part about why you are getting this message. It'll be going to the system owner, who should know why...
Fix error reporting which failed to correctly report the error.
Add SystemOwnerEmail some minor whitespace changes
If no files found in a commit, report an error. This was prompted by someone who did a cvs import instead of using addport.
Use `hostname` not `$hostname` to get the hostname.
Add a newline at end of line
Each category has a pkg/COMMENT file which describes that category. When a new category is encountered, if we cannot fetch pkg/COMMENT, then go with a fake description.
When creating a new port, ensure the status is set to Active. This doesn't affect the saving of the port, because a new port is always set Active. It affects code modified in the previous comment which checked the status to determine whether or not to refresh the port.
Wrap all committer messages at column 72. Tidy up the email code to make it easier to read.
Make use of the ability to include a CC: in outgoing email.
Improve the error reporting during sanity testing. I found a case where we got an error such as this: "/usr/home/dan/ports/french/homard/Makefile", line 56: Need an operator (caused by spaces instead of tabs in a section such as do-install:). In such cases, no results are returned from the make command. Instead, the errors will be captured in the tmp file we created to capture ERROUT. Add two new functions: SetActive and SetDeleted.
Include a CC field when mailing out messages. This will allow me to CC myself on any outgoing sanity test errors.
Sometimes a port can be deleted in one commit, and a later commit will remove a missed file. If this port is deleted, don't refresh it. If we don't need to refresh it, we don't need to save it.
Add two new functions, IsActive and IsDeleted.
Include the error code in the email
Add the nightly check for unrefreshed ports, including ignored ports. whitespace adjust to keep things pretty.
Remove the temp error collection files when and where we should. Not where we are.
Don't overwrite the outpout files....
- Use ports_active, not ports, so we don't have to check if a port has been deleted. Which means we don't need to refer to the element table at all. So remove all that code. - Use tabs to delimit things instead of :
start using find because we have too many files...
Remove extraneous remove
We now ignore a refresh once it has been reported. But we can't ignore it forever. Add an option to allow inclusion of ignored refreshes.
Update copyright notice
With the move to a flat directory structure, we don't need archive-logs.sh. archive-messages.sh does it all.
Remove control Ms
convert to use a single directory for raw email, xml, xml loading, and errors.
This commit was manufactured by cvs2svn to create tag 'FreshPorts_2003_05_04'.
Start using examples from email.pm
Add defaults for email.pm
Do a better sample
fix typos
Add new defaults
Remove housekeeping calls because we don't need that any more
Supply the dbname and website URL when emailing out.
move to a better directory structure
Move to a user-independent directory structure
Better handling and reporting of non-fatal errors.
Add ReportErrorEmail and ReportErrorEmail
check for config file
move spooling directory one leve down
also ignore config.sh
better use of variables
By default, do not notify committers of problems. Otherwise we'll have each test system telling them.
Indicate that we need a path to the scripts directory and things aren't always in the home directory any more
Adjust things for Postfix address extentions (i.e. foo+bar@example.org) and to allow procmail to fail softly.
Document
Use this file to set configuration parameters such as the location of the msgs tree and the scripts directory location.
create the retry directory
remove an echo
Move to a better method of message handling. This will allow multiple databases per user and for the processing of multiple incoming cvs-all streams.
Use a different approach to pathnames. This should make it easier for one user to process multiple cvs-all streams.
Better handle errors when they occur when mastersites
Better handle the lack of a pkg-descr file
catch and report command line flags we don't know about.
improve debugging and avoid undefined values for special conditions.
First commit
Message format has changed. End of files now indicated by ______...
add the Security report
change the report id to be the correct value add security_notice to FROM list in SQL better debugging messages
whitespace
remove debugging code
remove trailing ^M
remove references to bchosting by request. They are away for a while..
First commit. Untested.
This commit was manufactured by cvs2svn to create tag 'RELEASE-beta- 2003_03_07'.
virtual categories
whitespace
To populate the new table
module for new table
Whitespace changes
add support for commit_log_ports_ignore
Virtual category support whitespace changes
whitespace
Add an optional number of days to go back.
Only fetch files for port tree commits
use FreshPorts not Freshports
Place removal of pkg directory to be after make command has run. Ignore COMMENTFILE. COMMENT should now always work. remove large unused portion of needs_refrseh for new ports
We don't always fetch the comment file because now COMMENTFILE and COMMENT both exist.
print the command as part of debugging
chomp the longdescription and mastersites to remove trailing whitespace. whitespace changes.
Start using COMMENT and COMMENTFILE to cope with recent changes
Check sth whitespace
white space changes to SQL
remove pring which was screwing up processing
remove ^M
Adjust quoting to get hostname
in perl, we use 0, not FALSE
Don't commit prematurely
turn autocommit off do the rollback/commit some whitespace changes
handle the temp file better
how about some instructions, for the next time we do this
Say if the notifications are disabled
include the database name in the message
Add key to housekeeping table.
white space changes only
Add switch for notifying committers
white space changes only
white space changes
add X-header
whitespace changes
Add headers to each mail message.
Use new email function. Put watch list name in subject.
Add a new parameter, Headers.
Replaced by report-notification.pl
white space changes
Fix to work with multiple watch lists per person. Put the frequency and watch list name into the headers.
Tell them about the multiple watch lists
Some whitespace changes Add _UndeleteResurrectedPorts
add update_status whitespace changes
whitespace changes
Fix missing ' include constants.pm
Use the constants provided.
whitespace changes Add FreshPorts::Constants::ReportDeletedPorts
more whitespace changes
Whitespace changes
white space changes
improve the error checking and reporting
add a missing ( in a string change " to ' to avoid \@
Check the return value on that message open
use SendEnc instead of SendLineEnc
add report-notification.pl and report-new-ports.pl
Remove \ from email address
fix debugging
Fix debugging
Start using email.pm
Add mail/p5-Mail-Sender
Start using Mail::Sender
Start using trim_multiple_to_single and trim on depends run and depends build. Perhaps we should do that on other fields as well?
add trim and trim_multiple_to_single
Start fetching all the files for a commit.
Never fetch files before refreshing all ports touched by this commit (RefreshAllPortsTouchedByCommit)
correct debugging statement
Add hostname to error messages
Add an extra blank line between items
try using $revision instead of HEAD
In a comment, rename _GetNeedsRefreshForNewPort to GetNeedsRefreshForNewPort
use the new PORTCOMMENT features if no pkg-comment file is found
move and comment out the body printing. That will greatly reduce the log size.
Uncomment SendWatchNoticePersonal which is a big mistake to comment out.
provide the commit_log_id which might just be useful
wrap text at 82, change whitespace formating, and put URL at end of note
Set result upon error. Perhaps this will stop the duplicate error messages.
try case insensitive
remove 'new' references
Announce the new report subscription service
Notify if embedded makefile is suspected
Add option to not refresh files on disk useful when getting around build problems
Add announcement report
Update to use report-subscriptions table.
display the hostname when reporting
require committer_opt_in
If make -V PORTVERSION fails to return a value, notify the user.
Display the ports which need refreshing
first commit
change final test
Add ReportIDMaintainerNotification for checkaddress.pl
don't hardcode the db name in the error msg
Script for verifying maintainer subcription
Remove debugging code
First commit - this file handles the notification of committers when an error is found with their port
changes for committer opt-in
cater for error catching when telling committers about errors
Catch errors on the fetch so they don't appear in the .errors file
don't fetch files if you aren't supposed to (debugging tool)\nFirst steps towards committer opt-in
start distinguishing from a Port and a non-Port refresh
add the vacuum analyze
final changes...
add then, and fix test
fix `
first commit
better handle processing of the log message
Add debugging info for master_sites PR 174: File::PathConvert does not handle // very well
Add bchosting notice
call it the new ports report
Add suggestions from Piet Delport <pjd@303.za.net>
use SystemTimeAdjust
first commit
Remove debugging
New results
Make sure we pick up the correct report number.
Fix up message and URLs.
uncomment the commit
Remove duplicates by fixing SQL
Check only active elements Send the email notice
First commit
make it work for freshports2
searchlog.txt is now in dynamic
remove unneeded stuff
Move status.html to dynamic
use www.freshports.org not migration
spell Calculated
Put the port and new count where they can be seen for each message. Add links to the website.
Add fortnight, weekly, and monthly
add fortnightly and monthly totals
Add port count and new port count to message.
This commit was manufactured by cvs2svn to create tag 'FreshPorts2_Launch'.
Add daily stats
add scripts/hourly_stats.pl
Change the titles slightly and links better to ports-new.php
add FreshPorts::Config::HourlySummaryDir
first commit
Add these in
start using revision
start fetching revision
start using the revision
fetch using a revision
use the defined HEAD
define HEAD
Start using version, but we'll use HEAD for now.
remember to commit
First commit - a cron job for running daily statistics.
Remove tarball, use files.
Add this tarfile.
actually call SendWatchNoticePersonal
change .php3 to .php
Fix the URL for the watch list
merge to FreshPorts1 from HEAD
Update copyright
send one message per user
Add a trailing slash to the URL
PR142 - after refreshing a port, queue the date into the daily_refreshes
table so that the daily summaries are updated.
Don't show revision if it is zero
Add committer to message
update version
cater for older xml encodings without EncodingLosses
cast to boolean to cater for default values of 0
tag the file as UTF-9
add EncodingLosses
Add EncodingLosses
sort by category and port to ensure consistency
Tidy up the interval.
Cater better for the Revision line...
Remember to use the system time adjustment
merge from branch
Merge to branch
merge to branch
commit to head
Add new caching functions to keep track of updating the cache
move RefreshMainPage and GetMaxCommitLogPortId to cache.pm
if commiting a port, call DailySummaryDateAdd
also check the daily_refreshes file
- update copyright
- remove mistakenly copied routines
- ReadFile
- FetchFile
- InitSyslog
- ReportError
- SendEmailNotice
reflect new location of CreateDailySummary in cache.pm
move CreateDailySummary to new cache.pm module
No longer needed
Upgrade to latest on FreshPorts2
Move freshports_ConvertPortPathToStandardLocation to port.pm
spelling mistake changes, etc.
clean up the file
print the file name on a file action error
Put this on the branch
Be a little more specific about the start of the files section
This is a great port for installing ports needed by FreshPorts
create msgs directory
Let's use fetch, not lynx
scripts for comparing the database with a list of category/port entries.
This commit was manufactured by cvs2svn to create branch 'FreshPorts2'.
remember to update the categories field. pr 114
PR 112 watch_notice_log.frequency_id needs to be implemented changing frequency to frequency_id check scripts/email.pl and AddToLogs
RecordLastestPortCommits now works independently of date.
update copyright
call freshports_ConverPortPathToStandardLocation
There is no need to grab the commit_log id first. It will be obtained by the commit_log class.
Add freshports_ConverPortPathToStandardLocation, which will change path names to the standard /usr/ports pathname
Add Makefile.inc to the list of things we ignore
Let's try distinct, just in case...
Put the committer into the output
Mark those ports found in the INDEX and those not found.
*** empty log message ***
use fetch, not lynx
sleep at the start of the script, not the end. if an error occurs, we don't retry it right away.
update copyright
update copyright change return value of 3 to 0 if all is well we don't move files around. the fp-daemon script does
add retry directory and update copyright
need to create the directories
we no longer need lynx
display the full file name when processing
Check for blank branch name
All make commands must refer to the correct ports tree via PORTSDIR=
IF YOU CHANGE THE MAKE COMMAND, CHANTGE THE SPLIT!!!!!!!!!!!!!!! we'll have to refresh all ports now.
adjust debugging code
let's add a commit-rollback just for fun.
Don't die with an error, just report it. We will clear refresh_now so the SP doesn't have to.
we need the committer in here.
let's use fetch instead of lynx
change LooksLikeAMakefile to be correct more often
remember to install procmail
add .forward
missed this
Add these into the repo
let's make this into a daemon-type script for use with daemontools.
at the end move the input file away to the raw directory
remember to include housekeeping module
New class.
Start using the housekeeping class
Don't commit here when refreshing ports. We'll do that lower down in the code.
After refreshing a port, update housekeeping.
Slight adjustment to error returns
Let's have a look at the Makefiles before we use them. If they are ASCII Text, then they are probably a Makefile. If not, they are probably HTML, and that means the fetch failed.
only refresh non-deleted ports
only do the table update if a new port has been committed.
no longer any need to create daily summaries here.
no longer a need to touch a file after refreshing.
how about only doing the SQL if there is a need to do so
To speed up the home page, we are going to cache the data in a table. The main page will then read from that table. The main page will be updated every minute.
whitespace changes only
Start using "make master-sites-all" instead of "make -V MASTERSITES"
Refresh all ports.
refresh-unrefreshed-ports.pl stays as it was, refreshing unrefreshed ports based on commit_log_ports.needs_refresh.
Add a flag which allows us to refresh all ports. useful during fp1-fp2 migration
script to create ~/msgs
Add flag -R which means do not refresh any ports associated with a given commit. Useful during the fp1-fp2 migration. We'll just refresh each port after the data is imported.
If an invalid file action is found, display it as well as report it.
don't export deleted ports - they won't exist in the ports tree and we won't be able to refresh the port. This does mean we lose the history for about 451 deleted ports. I can live that that. We can always import them later.
allow incoming parameter to set limit If file_action = 'I' (import) used add and change filename to '.../Makefile'
Add incoming limit parameter
remember to clear out MessageTo in case there is more than one recipient.
don't fetch stuff if -r flag is set.
oops, use PST not EST
Here's the file where will allow us to export FP1 data into XML format. Looks OK so far. But will need further testing of output
Create a monthly compression archive. note that the other compress script appears to be unused.
make sure utilities is included where it should be included. and that config is included in utilities.
if the code dies, email me
Use new error routine
Add new commit_log class Start using new ReportError function from utilities.pm instead of calling SysLog and die.
make sure to use " not ' when expanding $variables.
doh! do not hard code path names!
I should test more before committing.
When an error occurs when processing a make file, return the error to the calling function. Then, don't update the port because it's not ready
Put a knob in to turn off creation of a pkg directory. I think I added this to detect problems which arose if this directory exists. noteably: pre-everything having two : after it.
umm, ports-supfile is in ~/scripts not ~/
We need a custom supfile for this. Let's also add a cvsup to the crontab.
PR#21 cater for imported sources. With a recent change implemented by Josef Karthauser, imported source cvs-all message do contain a BRANCH. However, the message do not contain a LOG section. Thus the XML field is empty. Get around the problem with a minor reorganization of the code. Grab the message subject. Grab the log. If the log is empty, use the subject. ALSO: white space changes.
Add copyrights
add copyright
Add copyright
convert to PostgreSQL
Add copyright
Start using ${HOME}
upgrade to postgresql. Now that this is done, the next step is to get some of you on the Develop list to start tracking your ports via fp2.freshports.org. BUT FIRST I'll have to upgrade that site to the latest database and scripts as found in lists-test.freshports.org. Watch this space.
Add in the copyright notice. fix up the paths to refer to HOME
add another simple test
remove debugging code
simple whitespace change
$hash{portname} is not the same as
$hash{$portname}
Fix this annoying bug so more than just the first port in a commit gets refreshed.
daily summary changes - use category/port format - add time-ajustment factor to cater for time zone differences
convert to postgresql
- correct where the script was still using ports.needs_refresh instead of commit_log_ports.needs_refresh. - for now, we will fetch every file touch by a port commit. I still don't have a solution for files included by Makefile.
Use $ENV{HOME} not ~/
Handle deleted ports better. Remove the path-to-ports so it works with symlinks.
Add some real-path calls so we have the real pathname instead of symlinks.
oops. fix a typo
slight whitespace change to make SQL easier to read
after refreshing a port from newly fetched files, let's actually save the results to the database.
in CreateDailySummary, use commit_log_ports.{port_version|port_revision}
handle port_version
move the commit to be before the CreateDailySummary call. If that call falls over, we want to be sure the transaction is closed. otherwise, it will roll back and undo what we did.
update to use commit_log_ports.needs_refresh not ports.needs_refresh
- with master/slave ports, the directory we are fetching to (master port) may not be the directory we are working in (slave port; the one being refreshed. adjust fetching scheme accordingly. - add function to remove port directory prefix (RemovePortsPrefix).
start using $ENV{HOME} so we know the correct home directory without modifying
this config file.
slightly modify the SQL to match similar query in refresh-unrefreshed-ports.pl
Update this script to use commit_log_ports.needs_refresh instead of ports.needs_refresh PR56
use relative paths, not absolute
Add call to script to archive out messages.
change default pathnames to be relative not absolute
It appears we have a working solution for storing port version with each commit.
My first attempt at moving needs_refresh from the port table to the commit_log_ports table. In addition, the commit_log_ports will hold the port_version associated with that commit. Thus, as you look down the page, you should be able to see the port_version change from commit to commit (not that every commit causes a change).
remove comments no longer relevant
No longer needed here
Add the new archive-messages.sh. call this from cron. it will call the improved archive-logs.sh which will move the msgs away from the main directory and archive them.
correctly detect the successful opening of a file for our daily summary output.
test for packages.exists file before we grep from it
Upgrade to FP2
provide a new option: -O (Overwrite) when processing an XML file, if the supplied message id exists, delete it and continue processing. Useful when you need to reprocess a message for some reason.
use the commit_log_ports table, not commit_log_port.
upgrade to FP2
put default values which make sense but can't be used.
Remove some commented out code
First commit
New FP2 version of script
First commit
This commit was manufactured by cvs2svn to create branch 'FreshPorts2'.
Add copyright notices and Id tags to each file.
Add copyright notice expand messages when Makefile errors occur
Add copyright notice start using the new and improved commit_log_ports
add some testing scripts
first commit. includes instructions about installing perl modules for these scripts.
don't save commit_log_id unless it is supplied.
Add some basic code to cater for master/slave ports.
ensure we take the commit date before we clear out all the date values.
add missing ) to an if. actually write HTML to FILE.
If the version isn't set, don't try to display it
Don't do the build of daily summaries until after we have refreshed the ports. Otherwise for new ports, version will be empty.
Don't do any of the port update things if there are no ports. This mainly reduces the size of the log file.
don't quote the date
Remove trailing / from 'use lib' statement.
Add CreateDailySummary to the list of things that happen when a message is processed.
If a port has been deleted, make sure we delete the element which corresponds to that port.
Move things around so they work better.
remove CommitLogElementsInsert replace EnsureCategoryAndPortExist with SaveChangesToPortsTree create _CompileListOfPorts which replaces the fuctionality of EnsureCategoryAndPortExist Instead of saving a port as we go along, we will compile a list of ports based on the files we find. Once all files are processed and saved to the database, we have our list. Then we process the files again, setting the needs_refresh value for the port affected by this file. If we find that the Makefile for a port has been deleted, we set needs_refresh = 0.
use a hash instead of a character string for ignored files
first commit
Make sure we are looking for " Revision" at the start of the line. See 200111231716.fANHGwN21197@freefall.freebsd.org for what broke this.
if the port is new and has not been deleted, then set needs_refresh.
remove unneeded exports
if the port has been deleted, make sure we set port->{deleted} correctly
and process things.
move the refresh ports process to port.pm so it can be used
both with load_xml_into_db.pl and from refresh-unrefreshed-ports.pl
separate out the refreshing of a port from the saving of a commit message.
Always check if the ElementRevisionExists before doing a ElementRevisionInsert.
Spell the path correctly
remove exta my.
use SystemID not SystemBranchID
log it when we create a new branch
fix typos
rename system_version to system_branch rename system_version_element to system_branch_element_revision
check for failed file open
clean up code, check for port and category before deciding this is a port
PR 4 solved. scan the lines following the subject and include them as part of the subject if they start with 9 spaces.
fix typo. should be OBTAINEDFROM not OBTAINED in the dtd.
The previous commit was in error. PR 15 Previously the log message was terminated at the first occurance of: Revision PR: Submitted by: Approved by: Reviewed by: To Unsubscribe Now it's only: Revision To Unsubscribe Also, populate the ObtainedFrom field while we are here.
PR 15 Previously the log message was terminated at the first occurance of:
This commit was manufactured by cvs2svn to create branch 'FreshPorts1'.
spell receive
add the revision field.
Use commit_log_element
Use new class: commit_log_port
use ne instead of eq. condition was wrong.
updates
add missing files
Get those values from the result set.
save the right stuff when saving. it still needs to be read back in.
use the right id
Now we fetch the files needed to refresh the port, we update the port class, and we save it. port.pm needs to be updated to save and fetch more fields.
set the commit id before saving
Move ReadFile to a common location.
remove code we've already converted
correct the sql for updating a port
remove unneeded comment
when a port is created, needs_refresh is set correctly. now we need to set that when a port is updated.
first commit
needs_refresh is now being computed. We have have to do something special for ports which are created first time.
Now processing the files and ports correctly. now we just have to parse the file names and update the port needs_refresh.
We now have a list of ports which needs to be updated. next step: set the needs_refresh field and then save the results back to the database.
Create a hash of ports...
whitespace changes only
fetch by partial name
checkpoint
just a checkpoint
Ummm, let's get the element_id of the port before we create the port.
Remove GetDBHandle and use the one provided by FreshPorts::Database. use $dbh not $dbh_pg
die if "is_primary" is not set.
use the recently created FreshPorts::Category and FreshPorts::Port classes
Move GetDBHandle to database.php Add test_port_save
Just another checkpoint
Make save work.
This commit was manufactured by cvs2svn to create tag 'beta'.
first time
Add the ID to the file
simplify things greatly
backups are handled by another user now
try $HOME instead of /usr/local/etc/freshports
better the grammar
instead of port/category, try category/port
fix path to lastupdate.
provide details on each port to be refreshed
fix typo
update path
fix typo in last commit
fix path
Put the database connect into freshports_database.pm and use freshports_database.pm.sample as the example.
update
get the path right
get the directory correct
updates
tidy up
fix up crontabs
Send out individualized messages for the ports changes.
pick a better password
Add some cache busting code to the fetch.
fix syntax error
Don't create a pkg directory in fetch-cvs-file.sh. Let's do it where werun the make -V. then we'll remove it. this catches the pre-everything bug.
Don't create a pkg directory here. Let's do it where we run the make -V. then we'll remove it. this catches the pre-everything bug.
Don't chown any more
change path. This should really become a local configuration item
fix dir path
change paths
change path
Update locations
change locations
fresh updates from the website
first commit
first commits
update the scripts with the latest from the website
This commit was manufactured by cvs2svn to create tag 'release1_1'.
*** empty log message ***
First commit
use a LIB command.
Added logs of time stamp printing so I could see where things took up time.
CreateDailySummary mods to increase db performance
*** empty log message ***
Add code to strip timezone from timestamp. Might be related to new mysql. Modified Files: updates.pl
Hmmm, it assumed that a port commit started with cvs commit: ports/ now, it doesn't. the ports/ bit can be anywhere on the subject: line. Modified Files: log-catcher.awk
oops! forgot to add the ports changes for pkg-descr etc. Committing in updates Modified Files: updates.pl
changed pkg/DESCR to pkg-descr and other changes associated with new ports layout. Modified Files: ports.pm
extra checks to ensure directories exist. Modified Files: fetch-cvs-file.sh
first commit Added Files: fetch-cvs-file.sh
let the owner know if a category is created. Modified Files: updates.pl
Cater for ports which are deleted, then reimported. We have them in the tree, but they are deleted. Just set them "status = 'A'" and get on with it. Modified Files: updates.pl
add GetPortCategory add category to PortCreate add GetPortID Modified Files: updates.pl
damn, forgot the db login Modified Files: updates.pl
another path which needs changing. Modified Files: updates.pl
change db and password to values which obviously need changing. Modified Files: updates.pl
add fake paths so we don't updates stuff we shouldn't. Committing in . Modified Files: log-catcher.awk
final changes before freshports 1.1 Committing in . Modified Files: log-catcher.awk log-catcher.pl Modified Files: updates.pl
final changes before freshports 1.1 Committing in . Modified Files: log-catcher.awk log-catcher.pl
rename change_log_details.change_port_id to change_log_port_id Modified Files: updates.pl
move the call to MarkPortAsRefreshNeeded to where it is always called for every entry being modified. Failure to do this means pkg/DESCR are not fetched and therefore the data is out of date. Modified Files: updates.pl
add a zero to the mask (to make it octal? or hex?) Modified Files: portschange.pm
now tests for a failed make call. Modified Files: ports.pm
The big change to full automation of commits.
creates a daily summary for all change_logs in system.
initial commits.
now includes code so you can refresh a single port. Modified Files: fetch-refresh-ports.pl
Looks good so far. Just a quick commit to save everything. At this point, I have the fetching of Makefile, pkg/DESCR, and pkg/COMMENTS going. But I have to know when to fetch such things. Committing in . Modified Files: fetch-cvs-file.sh fetch-refresh-ports.pl ports.pm test.pl
fetch-cvs-file.pl is actually fetch-cvs-file.sh Committing in . Modified Files: announce.pl email.pl ports.pm refresh-ports.pl test.pl Removed Files: fetch-cvs-file.pl
These files are used to refresh a port on-the-fly. fetch-cvs-file.sh will fetch the latest version of any cvs file. fetch-refresh-ports.pl uses the above to refresh all ports which need refreshing. Added Files: fetch-refresh-ports.pl fetch-cvs-file.sh
latest and greatest Modified Files: log-catcher.pl log-munger.awk
fixed up setting of refresh_needed and started using index instead of a regex for FilesWhichPromptRefresh. Modified Files: updates.pl
now updates change_log_details properly. obtains needs_refresh and status when checking for existing ports. assigns value to needs_refresh only if necessary. sets needs_refresh to "N" if port is deleted. Modified Files: updates.pl
use index function instead of a regex when searching for existing pacakges. Modified Files: ports.pm
now records the changes in distinct tables as they arrive Modified Files: updates.pl
now handles an undefined $homepage much better. Modified Files: refresh-ports.pl ports.pm
updated the outgoing message Modified Files: ports.pm
Added SendWatchNotice Modified Files: ports.pm
now marks ports as deleted if the Makefile is removed.
no longer sets status to 'N' when a port is updated ignored ports are now tested for individually as using a REGEX was causing too many problems. improved formatting of code.
When a new port is added, the status is now set to 'A' - active.
now works fine.
split the file name into three parts, so we can recognize special files such as pkg/DESCR, etc.
All the scripts for log catching, log munging, and dataabse update.
finally created a perl module for the most common routines.
Standard project directories initialized by cvs2svn.