loncom/build/lpml_parse.pl - diff

Return to lpml_parse.pl CVS log

Up to [LON-CAPA] / loncom / build

Diff for /loncom/build/lpml_parse.pl between versions 1.31 and 1.49

version 1.31, 2001/12/13 23:41:26	version 1.49, 2002/05/23 16:55:20
Line 1	Line 1
#!/usr/bin/perl	#!/usr/bin/perl

	# -------------------------------------------------------- Documentation notice
	# Run "perldoc ./lpml_parse.pl" in order to best view the software
	# documentation internalized in this program.

	# --------------------------------------------------------- Distribution notice
	# This script is distributed with the LPML software project available at
	# http://lpml.sourceforge.net

	# --------------------------------------------------------- License Information
# The LearningOnline Network with CAPA	# The LearningOnline Network with CAPA
# lpml_parse.pl - Linux Packaging Markup Language parser	# lpml_parse.pl - Linux Packaging Markup Language parser
#	#
# $Id$	# $Id$
#	#
# Written by Scott Harrison, harris41@msu.edu	# Written by Scott Harrison, codeharrison@yahoo.com
#	#
# Copyright Michigan State University Board of Trustees	# Copyright Michigan State University Board of Trustees
#	#
Line 35	Line 44
# 9/5/2001,9/6,9/7,9/8 - Scott Harrison	# 9/5/2001,9/6,9/7,9/8 - Scott Harrison
# 9/17,9/18 - Scott Harrison	# 9/17,9/18 - Scott Harrison
# 11/4,11/5,11/6,11/7,11/16,11/17 - Scott Harrison	# 11/4,11/5,11/6,11/7,11/16,11/17 - Scott Harrison
# 12/2,12/3,12/4,12/5,12/6,12/13 - Scott Harrison	# 12/2,12/3,12/4,12/5,12/6,12/13,12/19,12/29 - Scott Harrison
	# YEAR=2002
	# 1/8,1/9,1/29,1/31,2/5,3/21,4/8,4/12 - Scott Harrison
#	#
###	###

Line 66 use HTML::TokeParser;	Line 77 use HTML::TokeParser;
my $usage=<<END;	my $usage=<<END;
** ERROR ERROR ERROR ERROR **	** ERROR ERROR ERROR ERROR **
Usage is for lpml file to come in through standard input.	Usage is for lpml file to come in through standard input.
1st argument is the mode of parsing.	1st argument is the mode of parsing:
2nd argument is the category permissions to use (runtime or development)	install,configinstall,build,rpm,dpkg,htmldoc,textdoc,status
3rd argument is the distribution (default,redhat6.2,debian2.2,redhat7.1,etc).	2nd argument is the category permissions to use:
	typical choices: runtime,development
	3rd argument is the distribution:
	typical choices: default,redhat6.2,debian2.2,redhat7
4th argument is to manually specify a sourceroot.	4th argument is to manually specify a sourceroot.
5th argument is to manually specify a targetroot.	5th argument is to manually specify a targetroot.

Line 78 Example:	Line 92 Example:

cat ../../doc/loncapafiles.lpml \|\\	cat ../../doc/loncapafiles.lpml \|\\
perl lpml_parse.pl html development default /home/sherbert/loncapa /tmp/install	perl lpml_parse.pl html development default /home/sherbert/loncapa /tmp/install

	For more information, type "perldoc lpml_parse.pl".
END	END

# ------------------------------------------------- Grab command line arguments	# ------------------------------------------------- Grab command line arguments

my $mode;	my $mode='';
if (@ARGV==5) {	if (@ARGV==5) {
$mode = shift @ARGV;	$mode = shift @ARGV;
}	}
Line 93 else {	Line 109 else {
exit -1; # exit with error status	exit -1; # exit with error status
}	}

my $categorytype;	my $categorytype='';
if (@ARGV) {	if (@ARGV) {
$categorytype = shift @ARGV;	$categorytype = shift @ARGV;
}	}

my $dist;	my $dist='';
if (@ARGV) {	if (@ARGV) {
$dist = shift @ARGV;	$dist = shift @ARGV;
}	}

my $targetroot;	my $targetroot='';
my $sourceroot;	my $sourceroot='';
my $targetrootarg;	my $targetrootarg='';
my $sourcerootarg;	my $sourcerootarg='';
if (@ARGV) {	if (@ARGV) {
$sourceroot = shift @ARGV;	$sourceroot = shift @ARGV;
}	}
if (@ARGV) {	if (@ARGV) {
$targetroot = shift @ARGV;	$targetroot = shift @ARGV;
}	}
$sourceroot=~s/\/$//;	$sourceroot=~s/\/$//; # remove trailing directory slash
$targetroot=~s/\/$//;	$targetroot=~s/\/$//; # remove trailing directory slash
$sourcerootarg=$sourceroot;	$sourcerootarg=$sourceroot;
$targetrootarg=$targetroot;	$targetrootarg=$targetroot;

my $logcmd='\| tee -a WARNINGS';	my $logcmd='\| tee -a WARNINGS';

my $invocation;	my $invocation; # Record how the program was invoked
# --------------------------------------------------- Record program invocation	# --------------------------------------------------- Record program invocation
if ($mode eq 'install' or $mode eq 'configinstall' or $mode eq 'build') {	if ($mode eq 'install' or $mode eq 'configinstall' or $mode eq 'build') {
$invocation=(<<END);	$invocation=(<<END);
Line 128 if ($mode eq 'install' or $mode eq 'conf	Line 144 if ($mode eq 'install' or $mode eq 'conf
# 1st argument (mode) is: $mode	# 1st argument (mode) is: $mode
# 2nd argument (category type) is: $categorytype	# 2nd argument (category type) is: $categorytype
# 3rd argument (distribution) is: $dist	# 3rd argument (distribution) is: $dist
# 4th argument (targetroot) is: described below	# 4th argument (sourceroot) is: described below
# 5th argument (sourceroot) is: described below	# 5th argument (targetroot) is: described below
END	END
}	}

# ---------------------------------------------------- Start first pass through	# -------------------------- Start first pass through (just gather information)
my @parsecontents = <>;	my @parsecontents=<>;
my $parsestring = join('',@parsecontents);	my $parsestring=join('',@parsecontents);
my $outstring;

# Need to make a pass through and figure out what defaults are	# Need to make a pass through and figure out what defaults are
# overrided. Top-down overriding strategy (leaves don't know	# overrided. Top-down overriding strategy (tree leaves don't know
# about distant leaves).	# about distant tree leaves).

my @hierarchy;	my @hierarchy;
$hierarchy[0]=0;	$hierarchy[0]=0;
Line 149 my $token;	Line 164 my $token;
$parser = HTML::TokeParser->new(\$parsestring) or	$parser = HTML::TokeParser->new(\$parsestring) or
die('can\'t create TokeParser object');	die('can\'t create TokeParser object');
$parser->xml_mode('1');	$parser->xml_mode('1');
my %hash;	my %setting;
my $key;
while ($token = $parser->get_token()) {	# Values for the %setting hash
	my $defaultset=1; # a default setting exists for a key
	my $distset=2; # a distribution setting exists for a key
	# (overrides default setting)

	my $key=''; # this is a unique key identifier (the token name with its
	# coordinates inside the hierarchy)
	while ($token = $parser->get_token()) { # navigate through $parsestring
if ($token->[0] eq 'S') {	if ($token->[0] eq 'S') {
$hloc++;	$hloc++;
$hierarchy[$hloc]++;	$hierarchy[$hloc]++;
$key=$token->[1].join(',',@hierarchy[0..($hloc-1)]);	$key=$token->[1].join(',',@hierarchy[0..($hloc-1)]);
my $thisdist=' '.$token->[2]{'dist'}.' ';	my $thisdist=' '.$token->[2]{'dist'}.' ';
if ($thisdist eq ' default ') {	if ($thisdist eq ' default ') {
$hash{$key}=1; # there is a default setting for this key	$setting{$key}=$defaultset;
}	}
elsif ($dist && $hash{$key}==1 && $thisdist=~/\s$dist\s/) {	elsif (length($dist)>0 &&
$hash{$key}=2; # disregard default setting for this key if	$setting{$key}==$defaultset &&
# there is a directly requested distribution match	$thisdist=~/\s$dist\s/) {
	$setting{$key}=$distset;
	# disregard default setting for this key if
	# there is a directly requested distribution match
	# (in other words, there must first be a default
	# setting for a key in order for it to be overridden)
}	}
}	}
if ($token->[0] eq 'E') {	if ($token->[0] eq 'E') {
Line 170 while ($token = $parser->get_token()) {	Line 197 while ($token = $parser->get_token()) {
}	}
}	}

# --------------------------------------------------- Start second pass through	# - Start second pass through (clean up the string to allow for easy rendering)
undef $hloc;
undef @hierarchy;	# The string is cleaned up so that there is no white-space surrounding any
undef $parser;	# XML tag. White-space inside text 'T' elements is preserved.
$hierarchy[0]=0;
	# Clear up memory
	undef($hloc);
	undef(@hierarchy);
	undef($parser);
	$hierarchy[0]=0; # initialize hierarchy
$parser = HTML::TokeParser->new(\$parsestring) or	$parser = HTML::TokeParser->new(\$parsestring) or
die('can\'t create TokeParser object');	die('can\'t create TokeParser object');
$parser->xml_mode('1');	$parser->xml_mode('1');
my $cleanstring;	my $cleanstring; # contains the output of the second step
while ($token = $parser->get_token()) {	while ($token = $parser->get_token()) { # navigate through $parsestring
if ($token->[0] eq 'S') {	if ($token->[0] eq 'S') { # a start tag
$hloc++;	$hloc++;
$hierarchy[$hloc]++;	$hierarchy[$hloc]++;
$key=$token->[1].join(',',@hierarchy[0..($hloc-1)]);	$key=$token->[1].join(',',@hierarchy[0..($hloc-1)]);
my $thisdist=' '.$token->[2]{'dist'}.' ';
	# Surround tagdist (the dist attribute of an XML tag)
	# with white-space to allow for uniform searching a few
	# lines below here.
	my $tagdist=' '.$token->[2]{'dist'}.' ';

# This conditional clause is set up to ignore two sets	# This conditional clause is set up to ignore two sets
# of invalid conditions before accepting entry into	# of invalid conditions before accepting entry into
# the cleanstring.	# $cleanstring.
if ($hash{$key}==2 and
!($thisdist eq ' ' or $thisdist =~/\s$dist\s/)) {	# Condition #1: Ignore this part of the string if the tag
	# has a superior distribution-specific setting and the tag
	# being evaluated has a dist setting something other than
	# blank or $dist.
	if ($setting{$key}==$distset and
	!($tagdist eq ' ' or $tagdist =~/\s$dist\s/)) {
if ($token->[4]!~/\/>$/) {	if ($token->[4]!~/\/>$/) {
$parser->get_tag('/'.$token->[1]);	$parser->get_tag('/'.$token->[1]);
$hloc--;	$hloc--;
}	}
}	}
elsif ($thisdist ne ' ' and $thisdist!~/\s$dist\s/ and	# Condition #2: Ignore this part of the string if the tag has
!($thisdist eq ' default ' and $hash{$key}!=2)) {	# is not blank and does not equal dist and
	# either does not equal default or it has a prior $dist-specific
	# setting.
	elsif ($tagdist ne ' ' and $tagdist!~/\s$dist\s/ and
	!($tagdist eq ' default ' and $setting{$key}!=$distset)) {
if ($token->[4]!~/\/>$/) {	if ($token->[4]!~/\/>$/) {
$parser->get_tag('/'.$token->[1]);	$parser->get_tag('/'.$token->[1]);
$hloc--;	$hloc--;
}	}
}	}
	# In other words, output to $cleanstring if the tag is dist=default
	# or if the tag is set to dist=$dist for the first time. And, always
	# output when dist='' is not present.
else {	else {
$cleanstring.=$token->[4];	$cleanstring.=$token->[4];
}	}
if ($token->[4]=~/\/>$/) {
$hloc--;
}
}	}
if ($token->[0] eq 'E') {	# Note: this loop DOES work with <tag /> style markup as well as
	# <tag></tag> style markup since I always check for $token->[4] ending
	# with "/>".
	if ($token->[0] eq 'E') { # an end tag
$cleanstring.=$token->[2];	$cleanstring.=$token->[2];
$hloc--;	$hloc--;
}	}
if ($token->[0] eq 'T') {	if ($token->[0] eq 'T') { # text contents inside tags
$cleanstring.=$token->[1];	$cleanstring.=$token->[1];
}	}
}	}
$cleanstring=&trim($cleanstring);	$cleanstring=&trim($cleanstring);
$cleanstring=~s/\>\s\n\s\</\>\</g;	$cleanstring=~s/\>\s\n\s\</\>\</g;

# ---------------------------------------------------- Start final pass through	# -------------------------------------------- Start final (third) pass through

# storage variables	# storage variables
my $lpml;	my $lpml;
Line 279 my $link_count;	Line 328 my $link_count;
my $fileglob_count;	my $fileglob_count;
my $fileglobnames_count;	my $fileglobnames_count;
my %categorycount;	my %categorycount;
# START TEMP WAY
#my %bytecount; # TEMP WAY TO COUNT INFORMATION
#my %linecount; # TEMP WAY TO COUNT INFORMATION
# END TEMP WAY

my @buildall;	my @buildall;
my @buildinfo;	my @buildinfo;
Line 321 $parser->{textify}={	Line 366 $parser->{textify}={
rpmAutoReqProv => \&format_rpmAutoReqProv,	rpmAutoReqProv => \&format_rpmAutoReqProv,
rpmdescription => \&format_rpmdescription,	rpmdescription => \&format_rpmdescription,
rpmpre => \&format_rpmpre,	rpmpre => \&format_rpmpre,
	rpmRequires => \&format_rpmRequires,
directories => \&format_directories,	directories => \&format_directories,
directory => \&format_directory,	directory => \&format_directory,
categoryname => \&format_categoryname,	categoryname => \&format_categoryname,
Line 367 exit;	Line 413 exit;
# ------------------------ Final output at end of markup parsing and formatting	# ------------------------ Final output at end of markup parsing and formatting
sub end {	sub end {
if ($mode eq 'html') {	if ($mode eq 'html') {
# START TEMP WAY
# my $totallinecount;
# my $totalbytecount;
# map {$totallinecount+=$linecount{$_};
# $totalbytecount+=$bytecount{$_}}
# @categorynamelist;
# END TEMP WAY
return "<br /> <br />".	return "<br /> <br />".
"<a name='summary' /><font size='+2'>Summary of Source Repository".	"<a name='summary' /><font size='+2'>Summary of Source Repository".
"</font>".	"</font>".
Line 401 sub end {	Line 440 sub end {
"<table border='1' cellpadding='5'>".	"<table border='1' cellpadding='5'>".
"<caption>File Category Count</caption>".	"<caption>File Category Count</caption>".
"<tr><th>Icon</th><th>Name</th><th>Number of Occurrences</th>".	"<tr><th>Icon</th><th>Name</th><th>Number of Occurrences</th>".
	"<th>Number of Incorrect Counts</th>".
	"</tr>".
join("\n",(map {"<tr><td><img src='$fab{$_}.gif' ".	join("\n",(map {"<tr><td><img src='$fab{$_}.gif' ".
"alt='$_ icon' /></td>".	"alt='$_ icon' /></td>".
"<td>$_</td><td>$categorycount{$_}</td></tr>"}	"<td>$_</td><td>$categorycount{$_}</td>".
	"<td><!-- POSTEVALINLINE $_ --></td></tr>"}
@categorynamelist)).	@categorynamelist)).
"</table>".	"</table>".
"</body></html>\n";	"</body></html>\n";

# START TEMP WAY
# join("\n",(map {"<tr><td><img src='$fab{$_}.gif' ".
# "alt='$_ icon' /></td>".
# "<td>$_</td><td>$categorycount{$_}</td><td>$linecount{$_}</td><td>$bytecount{$_}</td></tr>"}
# @categorynamelist)).
# "<br /> <br />".
# "Total Lines of Code: $totallinecount".
# "<br /> <br />".
# "Total Bytes: $totalbytecount".
# END TEMP WAY
}	}
if ($mode eq 'install') {	if ($mode eq 'install') {
return '';	return '';
Line 661 $text	Line 693 $text
</table>	</table>
END	END
}	}
	elsif ($mode eq 'make_rpm') {
	return $text;
	}
elsif ($mode eq 'text') {	elsif ($mode eq 'text') {
return $rpm=<<END;	return $rpm=<<END;
Software Package Description	Software Package Description
Line 682 sub format_rpmSummary {	Line 717 sub format_rpmSummary {
elsif ($mode eq 'text') {	elsif ($mode eq 'text') {
return $rpmSummary="\nSummary : $text";	return $rpmSummary="\nSummary : $text";
}	}
	elsif ($mode eq 'make_rpm') {
	return <<END;
	<summary>$text</summary>
	END
	}
else {	else {
return '';	return '';
}	}
Line 696 sub format_rpmName {	Line 736 sub format_rpmName {
elsif ($mode eq 'text') {	elsif ($mode eq 'text') {
return $rpmName="\nName : $text";	return $rpmName="\nName : $text";
}	}
	elsif ($mode eq 'make_rpm') {
	return <<END;
	<name>$text</name>
	END
	}
else {	else {
return '';	return '';
}	}
Line 738 sub format_rpmVendor {	Line 783 sub format_rpmVendor {
elsif ($mode eq 'text') {	elsif ($mode eq 'text') {
return $rpmVendor="\nVendor : $text";	return $rpmVendor="\nVendor : $text";
}	}
	elsif ($mode eq 'make_rpm') {
	return <<END;
	<vendor>$text</vendor>
	END
	}
else {	else {
return '';	return '';
}	}
Line 766 sub format_rpmCopyright {	Line 816 sub format_rpmCopyright {
elsif ($mode eq 'text') {	elsif ($mode eq 'text') {
return $rpmCopyright="\nLicense : $text";	return $rpmCopyright="\nLicense : $text";
}	}
	elsif ($mode eq 'make_rpm') {
	return <<END;
	<copyright>$text</copyright>
	END
	}
else {	else {
return '';	return '';
}	}
Line 780 sub format_rpmGroup {	Line 835 sub format_rpmGroup {
elsif ($mode eq 'text') {	elsif ($mode eq 'text') {
return $rpmGroup="\nGroup : $text";	return $rpmGroup="\nGroup : $text";
}	}
	elsif ($mode eq 'make_rpm') {
	return <<END;
	<group>Utilities/System</group>
	END
	}
else {	else {
return '';	return '';
}	}
Line 805 sub format_rpmAutoReqProv {	Line 865 sub format_rpmAutoReqProv {
if ($mode eq 'html') {	if ($mode eq 'html') {
return $rpmAutoReqProv="\nAutoReqProv : $text";	return $rpmAutoReqProv="\nAutoReqProv : $text";
}	}
if ($mode eq 'text') {	elsif ($mode eq 'text') {
return $rpmAutoReqProv="\nAutoReqProv : $text";	return $rpmAutoReqProv="\nAutoReqProv : $text";
}	}
	elsif ($mode eq 'make_rpm') {
	return <<END;
	<AutoReqProv>$text</AutoReqProv>
	END
	}
else {	else {
return '';	return '';
}	}
Line 826 sub format_rpmdescription {	Line 891 sub format_rpmdescription {
$text=~s/\\n/\n/g;	$text=~s/\\n/\n/g;
return $rpmdescription="\nDescription : $text";	return $rpmdescription="\nDescription : $text";
}	}
	elsif ($mode eq 'make_rpm') {
	$text=~s/\n//g;
	$text=~s/\\n/\n/g;
	return <<END;
	<description>$text</description>
	END
	}
else {	else {
return '';	return '';
}	}
Line 838 sub format_rpmpre {	Line 910 sub format_rpmpre {
# return $rpmpre="\n<br />RPMPRE $text";	# return $rpmpre="\n<br />RPMPRE $text";
return '';	return '';
}	}
	elsif ($mode eq 'make_rpm') {
	return <<END;
	<pre>$text</pre>
	END
	}
else {	else {
return '';	return '';
}	}
}	}
	# -------------------------------------------------- Format requires section
	sub format_rpmRequires {
	my @tokeninfo=@_;
	my $aref;
	my $text;
	if ($mode eq 'make_rpm') {
	while ($aref=$parser->get_token()) {
	if ($aref->[0] eq 'E' && $aref->[1] eq 'rpmRequires') {
	last;
	}
	elsif ($aref->[0] eq 'S') {
	$text.=$aref->[4];
	}
	elsif ($aref->[0] eq 'E') {
	$text.=$aref->[2];
	}
	else {
	$text.=$aref->[1];
	}
	}
	}
	else {
	$parser->get_tag('/rpmRequires');
	return '';
	}
	return '<rpmRequires>'.$text.'</rpmRequires>';
	}
# -------------------------------------------------- Format directories section	# -------------------------------------------------- Format directories section
sub format_directories {	sub format_directories {
my $text=$parser->get_text('/directories');	my $text=$parser->get_text('/directories');
Line 866 sub format_directories {	Line 970 sub format_directories {
}	}
elsif ($mode eq 'install') {	elsif ($mode eq 'install') {
return "\n".'directories:'."\n".$text;	return "\n".'directories:'."\n".$text;
}	}
	elsif ($mode eq 'rpm_file_list') {
	return $text;
	}
else {	else {
return '';	return '';
}	}
Line 889 sub format_directory {	Line 996 sub format_directory {
my ($chmod,$chown)=split(/\s/,$categoryhash{$categoryname});	my ($chmod,$chown)=split(/\s/,$categoryhash{$categoryname});
return $directory="\n<tr><td rowspan='2' bgcolor='#ffffff'>".	return $directory="\n<tr><td rowspan='2' bgcolor='#ffffff'>".
"$categoryname</td>".	"$categoryname</td>".
"<td rowspan='2' bgcolor='#ffffff'><!-- POSTEVAL verify.pl directory /$targetdir $categoryhash{$categoryname} --> </td>".	"<td rowspan='2' bgcolor='#ffffff'><!-- POSTEVAL [$categoryname] ".
	"verify.pl directory /$targetdir $categoryhash{$categoryname} -->".
	" </td>".
"<td rowspan='2' bgcolor='#ffffff'>$chmod<br />$chown</td>".	"<td rowspan='2' bgcolor='#ffffff'>$chmod<br />$chown</td>".
"<td bgcolor='#ffffff'>$thtml</td></tr>".	"<td bgcolor='#ffffff'>$thtml</td></tr>".
"<tr><td bgcolor='#ffffff' colspan='[{{{{{DPATHLENGTH}}}}}]'>".	"<tr><td bgcolor='#ffffff' colspan='[{{{{{DPATHLENGTH}}}}}]'>".
Line 903 sub format_directory {	Line 1012 sub format_directory {
return "\t".'install '.$categoryhash{$categoryname}.' -d '.	return "\t".'install '.$categoryhash{$categoryname}.' -d '.
$targetroot.'/'.$targetdir."\n";	$targetroot.'/'.$targetdir."\n";
}	}
	elsif ($mode eq 'rpm_file_list') {
	return $targetroot.'/'.$targetdir."\n";
	}
else {	else {
return '';	return '';
}	}
Line 944 sub format_description {	Line 1056 sub format_description {
sub format_files {	sub format_files {
my $text=$parser->get_text('/files');	my $text=$parser->get_text('/files');
$parser->get_tag('/files');	$parser->get_tag('/files');
if ($mode eq 'html') {	if ($mode eq 'MANIFEST') {
	return $text;
	}
	elsif ($mode eq 'html') {
return $directories="\n<br /> <br />".	return $directories="\n<br /> <br />".
"<a name='files' />".	"<a name='files' />".
"<font size='+2'>Files</font><br /> <br />".	"<font size='+2'>Files</font><br /> <br />".
Line 982 sub format_files {	Line 1097 sub format_files {
foreach my $bi (@buildinfo) {	foreach my $bi (@buildinfo) {
my ($target,$source,$command,$trigger,@deps)=split(/\;/,$bi);	my ($target,$source,$command,$trigger,@deps)=split(/\;/,$bi);
$tword=''; $tword=' alwaysrun' if $trigger eq 'always run';	$tword=''; $tword=' alwaysrun' if $trigger eq 'always run';
$command=~s/\/([^\/]*)$//;	if ($command!~/\s/) {
$command2="cd $command; sh ./$1;\\";	$command=~s/\/([^\/]*)$//;
	$command2="cd $command; sh ./$1;\\";
	}
	else {
	$command=~s/(.?\/)([^\/]+\s+.)$/$1/;
	$command2="cd $command; sh ./$2;\\";
	}
my $depstring;	my $depstring;
my $depstring2="\t\t\@echo '';\\\n";	my $depstring2="\t\t\@echo '';\\\n";
my $olddep;	my $olddep;
Line 1019 sub format_files {	Line 1140 sub format_files {
$binfo."\n".	$binfo."\n".
"alwaysrun:\n\n";	"alwaysrun:\n\n";
}	}
	elsif ($mode eq 'rpm_file_list') {
	return $text;
	}
else {	else {
return '';	return '';
}	}
Line 1051 sub format_file {	Line 1175 sub format_file {
my $buildtest;	my $buildtest;
$file_count++;	$file_count++;
$categorycount{$categoryname}++;	$categorycount{$categoryname}++;
# START TEMP WAY
# if (-T "$sourcerootarg/$source") {
# $linecount{$categoryname}+=`wc -l $sourcerootarg/$source`;
# }
# my $bytesize=(-s "$sourcerootarg/$source");
# $bytecount{$categoryname}+=$bytesize;
# END TEMP WAY
if ($source) {	if ($source) {
$parser->get_tag('/file');	$parser->get_tag('/file');
if ($mode eq 'html') {	if ($mode eq 'MANIFEST') {
	my $command=$build;
	if ($command!~/\s/) {
	$command=~s/\/([^\/]*)$//;
	}
	else {
	$command=~s/(.?\/)([^\/]+\s+.)$/$1/;
	}
	$command=~s/^$sourceroot\///;
	my (@deps)=split(/\;/,$dependencies);
	my $retval=join("\n",($source,
	(map {"$command$_"} @deps)));
	return $retval."\n";
	}
	elsif ($mode eq 'html') {
return ($file="\n<!-- FILESORT:$target -->".	return ($file="\n<!-- FILESORT:$target -->".
"<tr>".	"<tr>".
"<td><!-- POSTEVAL verify.pl file '$sourcerootarg' ".	"<td><!-- POSTEVAL [$categoryname] verify.pl file '$sourcerootarg' ".
"'$targetrootarg' ".	"'$targetrootarg' ".
"'$source' '$target' ".	"'$source' '$target' ".
"$categoryhash{$categoryname} --> </td><td>".	"$categoryhash{$categoryname} --> </td><td>".
Line 1092 sub format_file {	Line 1223 sub format_file {
foreach my $dep (@deps) {	foreach my $dep (@deps) {
$depstring.=<<END;	$depstring.=<<END;
ECODE=0; DEP=''; \\	ECODE=0; DEP=''; \\
test -e $command/$dep \|\| (echo '** WARNING ** cannot evaluate status of dependency $command/$dep (for building ${sourceroot}/${source} with)'$logcmd); DEP="1"; \\	test -e $dep \|\| (echo '** WARNING ** cannot evaluate status of dependency $dep (for building ${sourceroot}/${source} with)'$logcmd); DEP="1"; \\
[ -n DEP ] && { perl filecompare.pl -b2 $command/$dep ${targetroot}/${target} \|\| ECODE=\$\$?; } \|\| DEP="1"; \\	[ -n DEP ] && { perl filecompare.pl -b2 $dep ${targetroot}/${target} \|\| ECODE=\$\$?; } \|\| DEP="1"; \\
case "\$\$ECODE" in \\	case "\$\$ECODE" in \\
2) echo "** WARNING ** dependency $command/$dep is newer than target file ${targetroot}/${target}; you may want to run make build"$logcmd;; \\	2) echo "** WARNING ** dependency $dep is newer than target file ${targetroot}/${target}; you may want to run make build"$logcmd;; \\
esac; \\	esac; \\
END	END
}	}
Line 1135 END	Line 1266 END
elsif ($mode eq 'configinstall' && $categoryname eq 'conf') {	elsif ($mode eq 'configinstall' && $categoryname eq 'conf') {
push @configall,$targetroot.'/'.$target;	push @configall,$targetroot.'/'.$target;
return $targetroot.'/'.$target.': alwaysrun'."\n".	return $targetroot.'/'.$target.': alwaysrun'."\n".
"\t".'@echo -n ""; ECODE=0 && { perl filecompare.pl -b4 '.	"\t".'@# Compare source with target and intelligently respond'.
$sourceroot.'/'.$source.' '.$targetroot.'/'.$target.	"\n\t\n\t\n".
' \|\| ECODE=$$?; } && '.
'{ [ $$ECODE != "2" ] \|\| (install '.
$categoryhash{$categoryname}.' '.	"\t".'@echo -n ""; ECODE=0 && { perl filecompare.pl -b4 \\'.
$sourceroot.'/'.$source.' '.	"\n\t".$sourceroot.'/'.$source." \\\n\t".
$targetroot.'/'.$target.'.lpmlnew'.	$targetroot.'/'.$target." \\\n\t".
	' \|\| ECODE=$$?; } && '."\\\n\t"."\\\n\t"."\\\n\t".


	'{ [ $$ECODE != "2" ] \|\| '." \\\n\t".'(install '.
	$categoryhash{$categoryname}." \\\n\t\t".
	$sourceroot.'/'.$source." \\\n\t\t".
	$targetroot.'/'.$target.'.lpmlnew'." \\\n\t\t".
' && echo "** NOTE: CONFIGURATION FILE CHANGE **"'.	' && echo "** NOTE: CONFIGURATION FILE CHANGE **"'.
$logcmd.' && echo "'.	" \\\n\t\t".$logcmd.' && '." \\\n\t\t"."echo -n \"".
'You likely need to compare contents of '.	'You likely need to compare contents of "'."\\\n\t\t\t".
''.$targetroot.'/'.$target.' with the new '.	'&& echo -n "'.$targetroot.'/'.$target.'"'."\\\n\t\t".
''.$targetroot.'/'.$target.'.lpmlnew"'.	'&& echo -n " with the new "'."\\\n\t\t\t".
"$logcmd); } && ".	'&& echo "'.$targetroot.'/'.$target.'.lpmlnew"'."\\\n\t\t".
'{ [ $$ECODE != "3" ] \|\| (install '.	"$logcmd); } && "." \\\n\t"."\\\n\t"."\\\n\t".
$categoryhash{$categoryname}.' '.
$sourceroot.'/'.$source.' '.
$targetroot.'/'.$target.''.	'{ [ $$ECODE != "3" ] \|\| '."\\\n\t".
	'(install '.
	$categoryhash{$categoryname}."\\\n\t\t".
	$sourceroot.'/'.$source."\\\n\t\t".
	$targetroot.'/'.$target."\\\n\t\t".
' && echo "** WARNING: NEW CONFIGURATION FILE ADDED **"'.	' && echo "** WARNING: NEW CONFIGURATION FILE ADDED **"'.
$logcmd.' && echo "'.	"\\\n\t\t".$logcmd.' && '."\\\n\t\t".
'You likely need to review the contents of '.	'&& echo -n "'.
''.$targetroot.'/'.$target.' to make sure its '.	'You likely need to review the contents of "'."\\\n\t\t\t".
'settings are compatible with your overall system"'.	'&& echo -n "'.
"$logcmd); } && ".	$targetroot.'/'.$target.'"'."\\\n\t\t\t".
'{ [ $$ECODE != "1" ] \|\| ('.	'&& echo -n "'.
'echo "** ERROR **"'.	' to make sure its "'."\\\n\t\t".
$logcmd.' && echo "'.	'&& echo "'.
'Configuration source file does not exist '.	'settings are compatible with your overall system"'."\\\n\t\t".
''.$sourceroot.'/'.$source.'"'.	"$logcmd); } && "."\\\n\t"."\\\n\t"."\\\n\t".
"$logcmd); } && perl verifymodown.pl ${targetroot}/${target} \"$categoryhash{$categoryname}\"$logcmd;\n\n";

	'{ [ $$ECODE != "1" ] \|\| ('."\\\n\t\t".
	'echo "** ERROR **"'.$logcmd.' && '."\\\n\t\t".'echo -n "'.
	'Configuration source file does not exist "'."\\\n\t\t".
	'echo -n "'.$sourceroot.'/'.$source.'"'."\\\n\t\t".
	"$logcmd); } && "."\\\n\t\t".
	"perl verifymodown.pl ${targetroot}/${target} "."\\\n\t\t\t".
	"\"$categoryhash{$categoryname}\""."\\\n\t\t\t".
	"$logcmd;\n\n";
}	}
elsif ($mode eq 'build' && $build) {	elsif ($mode eq 'build' && $build) {
push @buildall,$sourceroot.'/'.$source;	push @buildall,$sourceroot.'/'.$source;
Line 1172 END	Line 1323 END
$dependencies;	$dependencies;
# return '# need to build '.$source.";	# return '# need to build '.$source.";
}	}
	elsif ($mode eq 'rpm_file_list') {
	if ($categoryname eq 'doc') {
	return $targetroot.'/'.$target.' # doc'."\n";
	}
	elsif ($categoryname eq 'conf') {
	return $targetroot.'/'.$target.' # config'."\n";
	}
	else {
	return $targetroot.'/'.$target."\n";
	}
	}
else {	else {
return '';	return '';
}	}
Line 1184 sub format_link {	Line 1346 sub format_link {
$link=''; $linkto=''; $source=''; $target=''; $categoryname='';	$link=''; $linkto=''; $source=''; $target=''; $categoryname='';
$description=''; $note=''; $build=''; $status=''; $dependencies='';	$description=''; $note=''; $build=''; $status=''; $dependencies='';
my $text=&trim($parser->get_text('/link'));	my $text=&trim($parser->get_text('/link'));
my @links;
if ($linkto) {	if ($linkto) {
$parser->get_tag('/link');	$parser->get_tag('/link');
if ($mode eq 'html') {	if ($mode eq 'html') {
Line 1194 sub format_link {	Line 1355 sub format_link {
$categorycount{$categoryname}++;	$categorycount{$categoryname}++;
push @links,("\n<!-- FILESORT:$tgt -->".	push @links,("\n<!-- FILESORT:$tgt -->".
"<tr>".	"<tr>".
"<td><!-- POSTEVAL verify.pl link ".	"<td><!-- POSTEVAL [$categoryname] verify.pl link ".
"'/$targetrootarg$linkto' '/$targetrootarg$tgt' ".	"'/$targetrootarg$linkto' '/$targetrootarg$tgt' ".
"$categoryhash{$categoryname} --> </td><td>".	"$categoryhash{$categoryname} --> </td><td>".
"<img src='$fab{$categoryname}.gif' ".	"<img src='$fab{$categoryname}.gif' ".
Line 1225 sub format_link {	Line 1386 sub format_link {
elsif ($mode eq 'install') {	elsif ($mode eq 'install') {
my @targets=map {s/^\s*//;s/\s$//;$_} split(/\;/,$target);	my @targets=map {s/^\s*//;s/\s$//;$_} split(/\;/,$target);
foreach my $tgt (@targets) {	foreach my $tgt (@targets) {
push @links,"\t".'ln -fs /'.$linkto.' /'.$targetroot.$tgt.	push @links,"\t".'ln -fs /'.$linkto.' '.$targetroot.'/'.$tgt.
"\n";	"\n";
}	}
	# return join('',@links);
return '';	return '';
}	}
	elsif ($mode eq 'rpm_file_list') {
	my @linklocs;
	my @targets=map {s/^\s*//;s/\s$//;$_} split(/\;/,$target);
	foreach my $tgt (@targets) {
	push @linklocs,''.$targetroot.'/'.$tgt."\n";
	}
	return join('',@linklocs);
	}
else {	else {
return '';	return '';
}	}
Line 1249 sub format_fileglob {	Line 1419 sub format_fileglob {
my @semi=($filenames2=~/(\;)/g);	my @semi=($filenames2=~/(\;)/g);
$fileglobnames_count+=scalar(@semi)+1;	$fileglobnames_count+=scalar(@semi)+1;
$categorycount{$categoryname}+=scalar(@semi)+1;	$categorycount{$categoryname}+=scalar(@semi)+1;
# START TEMP WAY
# for my $f (split(/\;/,$filenames2)) {
# if (-T "$sourcerootarg/$sourcedir/$f") {
# $linecount{$categoryname}+=`wc -l $sourcerootarg/$sourcedir/$f`;
# open OUT,">>/tmp/junk123";
# print OUT "$linecount{$categoryname} $categoryname $sourcerootarg/$sourcedir/$f\n";
# close OUT;
# }
# my $bytesize=(-s "$sourcerootarg/$sourcedir/$f");
# $bytecount{$categoryname}+=$bytesize;
# }
# END TEMP WAY
if ($sourcedir) {	if ($sourcedir) {
$parser->get_tag('/fileglob');	$parser->get_tag('/fileglob');
if ($mode eq 'html') {	if ($mode eq 'MANIFEST') {
	return join("\n",(map {"$sourcedir$_"} split(/\;/,$filenames2)))."\n";
	}
	elsif ($mode eq 'html') {
return $fileglob="\n<tr>".	return $fileglob="\n<tr>".
"<td><!-- POSTEVAL verify.pl fileglob '$sourcerootarg' ".	"<td><!-- POSTEVAL [$categoryname] verify.pl fileglob '$sourcerootarg' ".
"'$targetrootarg' ".	"'$targetrootarg' ".
"'$glob' '$sourcedir' '$filenames2' '$targetdir' ".	"'$glob' '$sourcedir' '$filenames2' '$targetdir' ".
"$categoryhash{$categoryname} --> </td>".	"$categoryhash{$categoryname} --> </td>".
Line 1296 sub format_fileglob {	Line 1457 sub format_fileglob {
$sourceroot.'/'.$sourcedir.$eglob.' '.	$sourceroot.'/'.$sourcedir.$eglob.' '.
$targetroot.'/'.$targetdir.'.'."\n";	$targetroot.'/'.$targetdir.'.'."\n";
}	}
	elsif ($mode eq 'rpm_file_list') {
	my $eglob=$glob;
	if ($glob eq '*') {
	$eglob='[^C][^V][^S]'.$glob;
	}
	my $targetdir2=$targetdir;$targetdir2=~s/\/$//;
	my @gfiles=map {s/^.*\///;"$targetroot/$targetdir2/$_\n"}
	glob("$sourceroot/$sourcedir/$eglob");
	return join('',@gfiles);
	}
else {	else {
return '';	return '';
}	}
Line 1371 sub format_build {	Line 1542 sub format_build {
if ($text) {	if ($text) {
$parser->get_tag('/build');	$parser->get_tag('/build');
$build=$sourceroot.'/'.$text.';'.$tokeninfo[2]{'trigger'};	$build=$sourceroot.'/'.$text.';'.$tokeninfo[2]{'trigger'};
	$build=~s/([^\\])\\\s+/$1/g; # allow for lines split onto new lines
}	}
return '';	return '';
}	}
Line 1429 sub format_filenames {	Line 1601 sub format_filenames {
}	}
return '';	return '';
}	}
# ------------------------------------------------ Format specialnotice section	# ----------------------------------------------- Format specialnotices section
sub format_specialnotices {	sub format_specialnotices {
$parser->get_tag('/specialnotices');	$parser->get_tag('/specialnotices');
return '';	return '';
Line 1463 sub trim {	Line 1635 sub trim {

# ----------------------------------- POD (plain old documentation, CPAN style)	# ----------------------------------- POD (plain old documentation, CPAN style)

	=pod

=head1 NAME	=head1 NAME

lpml_parse.pl - This is meant to parse files meeting the lpml document type.	lpml_parse.pl - This is meant to parse files meeting the lpml document type.
See lpml.dtd. LPML=Linux Packaging Markup Language.

=head1 SYNOPSIS	=head1 SYNOPSIS

Usage is for lpml file to come in through standard input.	<STDIN> \| perl lpml_parse.pl <MODE> <CATEGORY> <DIST> <SOURCE> <TARGET>

	Usage is for the lpml file to come in through standard input.

=over 4	=over 4

Line 1502 Only the 1st argument is mandatory for t	Line 1677 Only the 1st argument is mandatory for t
Example:	Example:

cat ../../doc/loncapafiles.lpml \|\\	cat ../../doc/loncapafiles.lpml \|\\
perl lpml_parse.pl html default /home/sherbert/loncapa /tmp/install	perl lpml_parse.pl html runtime default /home/sherbert/loncapa /tmp/install

=head1 DESCRIPTION	=head1 DESCRIPTION

I am using a multiple pass-through approach to parsing	The general flow of the script is to get command line arguments, run through
the lpml file. This saves memory and makes sure the server	the XML document three times, and output according to any desired mode:
will never be overloaded.	install, configinstall, build, rpm, dpkg, htmldoc, textdoc, and status.

	A number of coding decisions are made according to the following principle:
	installation software must be stand-alone. Therefore, for instance, I try
	not to use the GetOpt::Long module or any other perl modules. (I do however
	use HTML::TokeParser.) I also have tried to keep all the MODES of
	parsing inside this file. Therefore, format_TAG subroutines are fairly
	lengthy with their conditional logic. A more "elegant" solution might
	be to dynamically register the parsing mode and subroutines, or maybe even work
	with stylesheets. However, in order to make this the installation back-bone
	of choice, there are advantages for HAVING EVERYTHING IN ONE FILE.
	This way, the LPML installation software does not have to rely on OTHER
	installation software (a chicken versus the egg problem). Besides, I would
	suggest the modes of parsing are fairly constant: install, configinstall,
	build, rpm, dpkg, htmldoc, textdoc, and status.

	Another coding decision is about using a multiple pass-through approach to
	parsing the lpml file. This saves memory and makes sure the server will never
	be overloaded. During the first pass-through, the script gathers information
	specific as to resolving what tags with what 'dist=' attributes are to be used.
	During the second pass-through, the script cleans up white-space surrounding
	the XML tags, and filters through the tags based on information regarding the
	'dist=' attributes (information gathered in the first pass-through).
	The third and final pass-through involves formatting and rendering the XML
	into whatever XML mode is chosen: install, configinstall, build, rpm, dpkg,
	htmldoc, textdoc, and status.

	The hierarchy mandated by the DTD does not always correspond to the hierarchy
	that is sensible for a Makefile. For instance, in a Makefile it is sensible
	that soft-links are installed after files. However, in an LPML document, it
	is sensible that files and links be considered together and the writer of the
	LPML document should be free to place things in whatever order makes best
	sense in terms of LOOKING at the information. The complication that arises
	is that the parser needs to have a memory for passing values from
	leaves on the XML tree to higher-up branches. Currently, this memory is
	hard-coded (like with the @links array), but it may benefit from a more
	formal approach in the future.

=head1 README	=head1 README

I am using a multiple pass-through approach to parsing	This parses an LPML file to generate information useful for
the lpml file. This saves memory and makes sure the server	source to target installation, compilation, filesystem status
will never be overloaded.	checking, RPM and Debian software packaging, and documentation.

	More information on LPML is available at http://lpml.sourceforge.net.

=head1 PREREQUISITES	=head1 PREREQUISITES

Line 1528 linux	Line 1741 linux

=head1 SCRIPT CATEGORIES	=head1 SCRIPT CATEGORIES

Packaging/Administrative	UNIX/System_administration

	=head1 AUTHOR

	Scott Harrison
	codeharrison@yahoo.com

	Please let me know how/if you are finding this script useful and
	any/all suggestions. -Scott

=cut	=cut

FreeBSD-CVSweb <freebsd-cvsweb@FreeBSD.org>

Removed from v.1.31
changed lines
	Added in v.1.49