loncom/interface/lonsearchcat.pm - view

File: [LON-CAPA] / loncom / interface / lonsearchcat.pm
Revision 1.146: download - view: text, annotated - select for diffs
Mon Jul 29 21:53:57 2002 UTC (21 years, 9 months ago) by matthew
Branches: MAIN
CVS tags: HEAD

This code should NOT be considered stable.
However, it seems to work occasionally.
Frames are now used to contact two httpd daemons.  Results are shown in
pages of 20.
&handler was mostly rewritten.  Hopefully the logic is clearer.
Some function names were changed to reflect that they now output html
directly via $r.
Data persistence is a problem.  Rewrites were done of the previous 'persistent'
functions.  Two new functions were added as well.  This still needs work.
&create_results_table is a new function to create the mysql tables.
&write_status is depricated and will be removed once major debugging stops.
Many changes.  Much wailing and gnashing of teeth.

# The LearningOnline Network with CAPA # Search Catalog # # $Id: lonsearchcat.pm,v 1.146 2002/07/29 21:53:57 matthew Exp $ # # Copyright Michigan State University Board of Trustees # # This file is part of the LearningOnline Network with CAPA (LON-CAPA). # # LON-CAPA is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # LON-CAPA is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with LON-CAPA; if not, write to the Free Software # Foundation, Inc., 59 Temple Place, Suite 330, Boston, MA 02111-1307 USA # # /home/httpd/html/adm/gpl.txt # # http://www.lon-capa.org/ # # YEAR=2001 # 3/8, 3/12, 3/13, 3/14, 3/15, 3/19 Scott Harrison # 3/20, 3/21, 3/22, 3/26, 3/27, 4/2, 8/15, 8/24, 8/25 Scott Harrison # 10/12,10/14,10/15,10/16,11/28,11/29,12/10,12/12,12/16 Scott Harrison # YEAR=2002 # 1/17 Scott Harrison # 6/17 Matthew Hall # ############################################################################### ############################################################################### =pod =head1 NAME lonsearchcat - LONCAPA Search Interface =head1 SYNOPSIS Search interface to LON-CAPAs digital library =head1 DESCRIPTION This module enables searching for a distributed browseable catalog. This is part of the LearningOnline Network with CAPA project described at http://www.lon-capa.org. lonsearchcat presents the user with an interface to search the LON-CAPA digital library. lonsearchcat also initiates the execution of a search by sending the search parameters to LON-CAPA servers. The progress of search (on a server basis) is displayed to the user in a seperate window. =head1 Internals =over 4 =cut ############################################################################### ############################################################################### ############################################################################### ## ## ## ORGANIZATION OF THIS PERL MODULE ## ## ## ## 1. Modules used by this module ## ## 2. Variables used throughout the module ## ## 3. handler subroutine called via Apache and mod_perl ## ## 4. Other subroutines ## ## ## ############################################################################### package Apache::lonsearchcat; # ------------------------------------------------- modules used by this module use strict; use Apache::Constants qw(:common); use Apache::lonnet(); use Apache::File(); use CGI qw(:standard); use Text::Query; use DBI; use GDBM_File; use Apache::loncommon(); use Apache::lonmysql(); # ---------------------------------------- variables used throughout the module ###################################################################### ###################################################################### =pod =item Global variables =over 4 =item $importbutton button to take the select results and go to group sorting =item %groupsearch_db Database hash used to save values for the groupsearch RAT interface. =item $diropendb The full path to the (temporary) search database file. This is set and used in &handler() and is also used in &output_results(). =item %Views Hash which associates an output view description with the function that produces it. Adding a new view type should be as easy as adding a line to the definition of this hash and making sure the function takes the proper parameters. =back =cut ###################################################################### ###################################################################### # -- dynamically rendered interface components my $importbutton; # button to take the selected results and go to group sorting # -- miscellaneous variables my %groupsearch_db; # database hash my $diropendb = ""; # db file # View Description Function Pointer my %Views = ("Detailed Citation View" => \&detailed_citation_view, "Summary View" => \&summary_view, "Fielded Format" => \&fielded_format_view, "XML/SGML" => \&xml_sgml_view ); my %persistent_db; my $hidden_fields; ###################################################################### ###################################################################### =pod =item &handler() - main handler invoked by httpd child =item Variables =over 4 =item $hidden holds 'hidden' html forms =item $scrout string that holds portions of the screen output =back =cut ###################################################################### ###################################################################### sub handler { my $r = shift; # my $closebutton; # button that closes the search window # This button is different for the RAT compared to # normal invocation. # $r->content_type('text/html'); $r->send_http_header; return OK if $r->header_only; ## ## Pick up form fields passed in the links. ## &Apache::loncommon::get_unprocessed_cgi($ENV{'QUERY_STRING'}, ['catalogmode','launch','acts','mode','form','element','pause', 'phase','persistent_db_id','table','start','show']); ## ## The following is a trick - we wait a few seconds if asked to so ## the daemon running the search can get ahead of the daemon ## printing the results. We only need (theoretically) to do ## this once, so the pause indicator is deleted ## if (exists($ENV{'form.pause'})) { sleep(5); delete($ENV{'form.pause'}); } ## ## Initialize global variables ## my $domain = $r->dir_config('lonDefDomain'); $diropendb= "/home/httpd/perl/tmp/".&Apache::lonnet::escape($domain). "\_".&Apache::lonnet::escape($ENV{'user.name'})."_searchcat.db"; # # set the name of the persistent database # $ENV{'form.persistent_db_id'} can only have digits in it. if (! exists($ENV{'form.persistent_db_id'}) || $ENV{'form.persistent_db_id'} =~ /\D/ ) { $ENV{'form.persistent_db_id'} = time; } my $persistent_db_file = "/home/httpd/perl/tmp/". &Apache::lonnet::escape($domain). '_'.&Apache::lonnet::escape($ENV{'user.name'}). '_'.$ENV{'form.persistent_db_id'}.'_persistent_search.db'; ## &get_persistent_form_data($r,$persistent_db_file); ## ## Clear out old values from groupsearch database ## untie %groupsearch_db if (tied(%groupsearch_db)); if ($ENV{'form.launch'} eq '1') { if (tie(%groupsearch_db,'GDBM_File',$diropendb,&GDBM_WRCREAT,0640)) { &start_fresh_session(); untie %groupsearch_db; } else { $r->print('<html><head></head><body>Unable to tie hash to db '. 'file</body></html>'); return OK; } } ## ## Configure dynamic components of interface ## $hidden_fields = '<input type="hidden" name="persistent_db_id" value="'. $ENV{'form.persistent_db_id'}.'" />'; ## if ($ENV{'form.catalogmode'} eq 'interactive') { $closebutton="<input type='button' name='close' value='CLOSE' ". "onClick='self.close()'>"."\n"; } elsif ($ENV{'form.catalogmode'} eq 'groupsearch') { $closebutton=<<END; <input type='button' name='close' value='CLOSE' onClick='self.close()'> END $importbutton=<<END; <input type='button' name='import' value='IMPORT' onClick='javascript:select_group()'> END } else { $closebutton = ''; $importbutton = ''; } ## ## Sanity checks on form elements ## if (!defined($ENV{'form.viewselect'})) { $ENV{'form.viewselect'} ="Detailed Citation View"; } $ENV{'form.phase'} = 'displaybasic' if (! exists($ENV{'form.phase'})); ## ## Switch on the phase ## if ($ENV{'form.phase'} eq 'disp_basic') { &print_basic_search_form($r,$closebutton); } elsif ($ENV{'form.phase'} eq 'disp_adv') { &print_advanced_search_form($r,$closebutton); } elsif ($ENV{'form.phase'} eq 'results') { &display_results($r,$importbutton,$closebutton); } elsif($ENV{'form.phase'} eq 'run_search') { my ($query,$customquery,$customshow,$libraries,$pretty_string) = &get_persistent_data($persistent_db_file, ['query','customquery','customshow', 'libraries','pretty_string']); &write_status($r,"query = $query"); &write_status($r,"customquery = $customquery"); &write_status($r,"customshow = $customshow"); &write_status($r,"libraries = $libraries"); &write_status($r,"pretty_string = $pretty_string"); &run_search($r,$query,$customquery,$customshow, $libraries,$pretty_string); } elsif(($ENV{'form.phase'} eq 'basic_search') || ($ENV{'form.phase'} eq 'adv_search')) { # Set up table if (! defined(&create_results_table())) { # Unable to make table to store results in. # Definately abort search. } if (! &make_form_data_persistent($r,$persistent_db_file)) { # Unable to store persistent data. # Probably should bail out. } # # We are running a search my ($query,$customquery,$customshow,$libraries) = (undef,undef,undef,undef); my $pretty_string; if ($ENV{'form.phase'} eq 'basic_search') { ($query,$pretty_string) = &parse_basic_search($r,$closebutton); } else { # Advanced search ($query,$customquery,$customshow,$libraries,$pretty_string) = &parse_advanced_search($r,$closebutton); return OK if (! defined($query)); } &write_status($r,"query = $query"); &write_status($r,"customquery = $customquery"); &write_status($r,"customshow = $customshow"); &write_status($r,"libraries = $libraries"); &write_status($r,"pretty_string = $pretty_string"); &make_persistent($r, { query => $query, customquery => $customquery, customshow => $customshow, libraries => $libraries, pretty_string => $pretty_string }, $persistent_db_file); ## ## Print out the frames interface ## &print_frames_interface($r); } return OK; } ###################################################################### ###################################################################### =pod =item &print_basic_search_form() Returns a scalar which holds html for the basic search form. =cut ###################################################################### ###################################################################### sub print_basic_search_form{ my ($r,$closebutton) = @_; my $scrout=<<"ENDDOCUMENT"; <html> <head> <title>The LearningOnline Network with CAPA</title> <script type="text/javascript"> function openhelp(val) { openhelpwin=open('/adm/help/searchcat.html','helpscreen', 'scrollbars=1,width=600,height=300'); openhelpwin.focus(); } </script> </head> <body bgcolor="#FFFFFF"> <img align='right' src='/adm/lonIcons/lonlogos.gif' /> <h1>Search Catalog</h1> <form method="post" action="/adm/searchcat"> <input type="hidden" name="phase" value="basic_search" /> $hidden_fields <h3>Basic Search</h3> <p> Enter terms or phrases separated by AND, OR, or NOT then press SEARCH below. </p> <p> <table> <tr><td> ENDDOCUMENT $scrout.=' '.&simpletextfield('basicexp',$ENV{'form.basicexp'},40). ' '; # $scrout.=&simplecheckbox('allversions',$ENV{'form.allversions'}); # $scrout.='<font color="#800000">Search historic archives</font>'; my $checkbox = &simplecheckbox('related',$ENV{'form.related'}); $scrout.=<<END; </td><td><a href="/adm/searchcat?phase=disp_adv">Advanced Search</a></td></tr> <tr><td>$checkbox use related words</td><td></td></tr> </table> </p> <p>  <input type="submit" name="basicsubmit" value='SEARCH' />  $closebutton END $scrout.=&selectbox(undef,'viewselect', $ENV{'form.viewselect'}, undef,undef,undef, sort(keys(%Views))); $scrout.=<<ENDDOCUMENT; <input type="button" value="HELP" onClick="openhelp()" /> </p> </form> </body> </html> ENDDOCUMENT $r->print($scrout); return; } ###################################################################### ###################################################################### =pod =item &advanced_search_form() Returns a scalar which holds html for the advanced search form. =cut ###################################################################### ###################################################################### sub print_advanced_search_form{ my ($r,$closebutton) = @_; my $advanced_buttons = <<"END"; <p> <input type="submit" name="advancedsubmit" value='SEARCH' /> <input type="reset" name="reset" value='RESET' /> $closebutton <input type="button" value="HELP" onClick="openhelp()" /> </p> END if (!defined($ENV{'form.viewselect'})) { $ENV{'form.viewselect'} ="Detailed Citation View"; } my $scrout=<<"ENDHEADER"; <html> <head> <title>The LearningOnline Network with CAPA</title> <script type="text/javascript"> function openhelp(val) { openhelpwin=open('/adm/help/searchcat.html','helpscreen', 'scrollbars=1,width=600,height=300'); openhelpwin.focus(); } </script> </head> <body bgcolor="#FFFFFF"> <img align='right' src='/adm/lonIcons/lonlogos.gif' /> <h1>Advanced Catalog Search</h1> <hr /> Enter terms or phrases separated by search operators such as AND, OR, or NOT.<br /> <form method="post" action="/adm/searchcat"> $advanced_buttons $hidden_fields <input type="hidden" name="phase" value="adv_search" /> <table> <tr><td><font color="#800000" face="helvetica"><b>VIEW:</b></font></td> <td> ENDHEADER $scrout.=&selectbox(undef,'viewselect', $ENV{'form.viewselect'}, undef,undef,undef, sort(keys(%Views))); $scrout.="</td><td>Related<br />Words</td></tr>\n"; $scrout.=&searchphrasefield_with_related('title', 'title' , $ENV{'form.title'}); $scrout.=&searchphrasefield('author', 'author' ,$ENV{'form.author'}); $scrout.=&searchphrasefield_with_related('subject', 'subject' , $ENV{'form.subject'}); $scrout.=&searchphrasefield_with_related('keywords','keywords', $ENV{'form.keywords'}); $scrout.=&searchphrasefield('URL', 'url' ,$ENV{'form.url'}); $scrout.=&searchphrasefield_with_related('notes', 'notes' , $ENV{'form.notes'}); $scrout.=&searchphrasefield_with_related('abstract','abstract', $ENV{'form.abstract'}); # Hack - an empty table row. $scrout.="<tr><td> </td><td> </td><td> </td></tr>\n"; $scrout.=&searchphrasefield('file<br />extension','mime', $ENV{'form.mime'}); $scrout.="<tr><td> </td><td> </td><td> </td></tr>\n"; $scrout.=&searchphrasefield('publisher<br />owner','owner', $ENV{'form.owner'}); $scrout.="</table>\n"; $ENV{'form.category'}='any' unless length($ENV{'form.category'}); $scrout.=&selectbox('File Category','category', $ENV{'form.category'}, 'any','Any category', undef, (&Apache::loncommon::filecategories())); $ENV{'form.language'}='any' unless length($ENV{'form.language'}); #---------------------------------------------------------------- # Allow restriction to multiple domains. # I make the crazy assumption that there will never be a domain 'any'. # $ENV{'form.domains'} = 'any' if (! exists($ENV{'form.domains'})); my @allowed_domains = (ref($ENV{'form.domains'}) ? @{$ENV{'form.domains'}} : ($ENV{'form.domains'}) ); my %domain_hash = (); foreach (@allowed_domains) { $domain_hash{$_}++; } my @domains =&Apache::loncommon::get_domains(); # adjust the size of the select box my $size = 4; my $size = (scalar @domains < ($size - 1) ? scalar @domains + 1 : $size); $scrout.="\n".'<font color="#800000" face="helvetica"><b>'. 'DOMAINS</b></font><br />'. '<select name="domains" size="'.$size.'" multiple>'."\n". '<option name="any" value="any" '. ($domain_hash{'any'}? 'selected ' :''). '>all domains</option>'."\n"; foreach my $dom (sort @domains) { $scrout.="<option name=\"$dom\" ". ($domain_hash{$dom} ? 'selected ' :'').">$dom</option>\n"; } $scrout.="</select>\n"; #---------------------------------------------------------------- $scrout.=&selectbox('Limit by language','language', $ENV{'form.language'},'any','Any Language', \&{Apache::loncommon::languagedescription}, (&Apache::loncommon::languageids), ); # ------------------------------------------------ Compute date selection boxes $scrout.=<<CREATIONDATESTART; <p> <font color="#800000" face="helvetica"><b>LIMIT BY CREATION DATE RANGE:</b> </font> <br /> between: CREATIONDATESTART $scrout.=&dateboxes('creationdatestart',1,1,1976, $ENV{'form.creationdatestart_month'}, $ENV{'form.creationdatestart_day'}, $ENV{'form.creationdatestart_year'}, ); $scrout.="and:\n"; $scrout.=&dateboxes('creationdateend',12,31,2051, $ENV{'form.creationdateend_month'}, $ENV{'form.creationdateend_day'}, $ENV{'form.creationdateend_year'}, ); $scrout.="</p>"; $scrout.=<<LASTREVISIONDATESTART; <p> <font color="#800000" face="helvetica"><b>LIMIT BY LAST REVISION DATE RANGE: </b></font> <br />between: LASTREVISIONDATESTART $scrout.=&dateboxes('lastrevisiondatestart',1,1,1976, $ENV{'form.lastrevisiondatestart_month'}, $ENV{'form.lastrevisiondatestart_day'}, $ENV{'form.lastrevisiondatestart_year'}, ); $scrout.=<<LASTREVISIONDATEEND; and: LASTREVISIONDATEEND $scrout.=&dateboxes('lastrevisiondateend',12,31,2051, $ENV{'form.lastrevisiondateend_month'}, $ENV{'form.lastrevisiondateend_day'}, $ENV{'form.lastrevisiondateend_year'}, ); $scrout.='</p>'; $ENV{'form.copyright'}='any' unless length($ENV{'form.copyright'}); $scrout.=&selectbox('Limit by copyright/distribution','copyright', $ENV{'form.copyright'}, 'any','Any copyright/distribution', \&{Apache::loncommon::copyrightdescription}, (&Apache::loncommon::copyrightids), ); # ------------------------------------------- Compute customized metadata field $scrout.=<<CUSTOMMETADATA; <p> <font color="#800000" face="helvetica"><b>LIMIT BY SPECIAL METADATA FIELDS:</b> </font> For resource-specific metadata, enter in an expression in the form of <i>key</i>=<i>value</i> separated by operators such as AND, OR or NOT.<br /> <b>Example:</b> grandmother=75 OR grandfather=85 <br /> CUSTOMMETADATA $scrout.=&simpletextfield('custommetadata',$ENV{'form.custommetadata'}); $scrout.=<<CUSTOMSHOW; <p> <font color="#800000" face="helvetica"><b>SHOW SPECIAL METADATA FIELDS:</b> </font> Enter in a space-separated list of special metadata fields to show in a fielded listing for each record result. <br /> CUSTOMSHOW $scrout.=&simpletextfield('customshow',$ENV{'form.customshow'}); $scrout.=<<ENDDOCUMENT; $advanced_buttons </form> </body> </html> ENDDOCUMENT $r->print($scrout); return; } ###################################################################### ###################################################################### =pod =item &get_persistent_form_data Inputs: filename of database Outputs: returns undef on database errors. This function is the reverse of &make_persistent() for form data. Retrieve persistent data from %persistent_db. Retrieved items will have their values unescaped. If a form value already exists in $ENV, it will not be overwritten. Form values that are array references may have values appended to them. =cut ###################################################################### ###################################################################### sub get_persistent_form_data { my $r = shift; my $filename = shift; return undef if (! -e $filename); return undef if (! tie(%persistent_db,'GDBM_File',$filename, &GDBM_READER,0640)); # # These make sure we do not get array references printed out as 'values'. my %arrays_allowed = ('form.category'=>1,'form.domains'=>1); # # Loop through the keys, looking for 'form.' foreach my $name (keys(%persistent_db)) { next if ($name !~ /^form./); my @values = map { &Apache::lonnet::unescape($_); } split(',',$persistent_db{$name}); next if (@values <1); if (exists($ENV{$name})) { if (ref($ENV{$name}) eq 'ARRAY') { # If it is an array, tack @values on the end of it. $ENV{$name} = [@$ENV{$name},@values]; } elsif (! ref($ENV{$name}) && $arrays_allowed{$name}) { # if arrays are allowed, turn it into one and add @values $ENV{$name} = [$ENV{$name},@values]; } # otherwise, assume the value in $ENV{$name} is better than ours. } else { if ($arrays_allowed{$name}) { $ENV{$name} = [@values]; } else { $ENV{$name} = $values[0] if ($values[0]); } } &write_status($r,"Reconstructed $name = $ENV{$name}"); } untie (%persistent_db); return 1; } ###################################################################### ###################################################################### =pod =item &get_persistent_data Inputs: filename of database, ref to array of values to recover. Outputs: array of values. Returns undef on error. This function is the reverse of &make_persistent(); Retrieve persistent data from %persistent_db. Retrieved items will have their values unescaped. If the item contains commas (before unescaping), the returned value will be an array pointer. =cut ###################################################################### ###################################################################### sub get_persistent_data { my $filename = shift; my @Vars = @{shift()}; my @Values; # Return array return undef if (! -e $filename); return undef if (! tie(%persistent_db,'GDBM_File',$filename, &GDBM_READER,0640)); foreach my $name (@Vars) { if (! exists($persistent_db{$name})) { push @Values, undef; next; } my @values = map { &Apache::lonnet::unescape($_); } split(',',$persistent_db{$name}); if (@values == 1) { push @Values,$values[0]; } else { push @Values,\@values; } } untie (%persistent_db); return @Values; } ###################################################################### ###################################################################### =pod =item &make_persistent() Inputs: Hash of values to save, filename of persistent database. Store variables away to the %persistent_db. Values will be escaped. Values that are array pointers will have their elements escaped and concatenated in a comma seperated string. =cut ###################################################################### ###################################################################### sub make_persistent { my $r = shift; my %save = %{shift()}; my $filename = shift; return undef if (! tie(%persistent_db,'GDBM_File', $filename,&GDBM_WRCREAT,0640)); foreach my $name (keys(%save)) { next if (! exists($save{$name})); next if (! defined($save{$name}) || $save{$name} eq ''); my @values = (ref($save{$name}) ? @{$save{$name}} : ($save{$name})); # We handle array references, but not recursively. my $store = join(',', map { &Apache::lonnet::escape($_); } @values ); $persistent_db{$name} = $store; &write_status($r,"Stored $name = $store"); } untie(%persistent_db); return 1; } ###################################################################### ###################################################################### =pod =item &make_form_data_persistent() Inputs: filename of persistent database. Store most form variables away to the %persistent_db. Values will be escaped. Values that are array pointers will have their elements escaped and concatenated in a comma seperated string. =cut ###################################################################### ###################################################################### sub make_form_data_persistent { my $r = shift; my $filename = shift; my %save; foreach (keys(%ENV)) { next if (! /^form/ || /submit/); $save{$_} = $ENV{$_}; } return &make_persistent($r,\%save,$filename); } ###################################################################### # HTML form building functions # ###################################################################### =pod =item HTML form building functions =over 4 =cut ############################################### ############################################### =pod =item &simpletextfield() Inputs: $name,$value,$size Returns a text input field with the given name, value, and size. If size is not specified, a value of 20 is used. =cut ############################################### ############################################### sub simpletextfield { my ($name,$value,$size)=@_; $size = 20 if (! defined($size)); return '<input type="text" name="'.$name. '" size="'.$size.'" value="'.$value.'" />'; } ############################################### ############################################### =pod =item &simplecheckbox() Inputs: $name,$value Returns a simple check box with the given $name. If $value eq 'on' the box is checked. =cut ############################################### ############################################### sub simplecheckbox { my ($name,$value)=@_; my $checked=''; $checked="checked" if $value eq 'on'; return '<input type="checkbox" name="'.$name.'" '. $checked . ' />'; } ############################################### ############################################### =pod =item &fieldtitle() Input: $title Returns a scalar with html which will display $title as a search field heading. =cut ############################################### ############################################### sub fieldtitle { my $title = uc(shift()); return '<font color="#800000" face="helvetica"><b>'.$title. ': </b></font>'; } ############################################### ############################################### =pod =item &searchphrasefield() Inputs: $title,$name,$value Returns html for a title line and an input field for entering search terms. The entry field (which is where the $name and $value are used) is a 50 column simpletextfield. The html returned is for a row in a three column table. =cut ############################################### ############################################### sub searchphrasefield { my ($title,$name,$value)=@_; return '<tr><td>'.&fieldtitle($title).'</td><td>'. &simpletextfield($name,$value,50)."</td><td> </td></tr>\n"; } ############################################### ############################################### =pod =item &searchphrasefield_with_related() Inputs: $title,$name,$value Returns html for a title line and an input field for entering search terms and a check box for 'related words'. The entry field (which is where the $name and $value are used) is a 50 column simpletextfield. The name of the related words checkbox is "$name_related". =cut ############################################### ############################################### sub searchphrasefield_with_related { my ($title,$name,$value)=@_; return '<tr><td>'.&fieldtitle($title).'</td><td>'. &simpletextfield($name,$value,50).'</td><td align="center"> '. &simplecheckbox($name.'_related',$ENV{'form.'.$name.'_related'}). " </td></tr>\n"; } ############################################### ############################################### =pod =item &dateboxes() Returns html selection form elements for the specification of the day, month, and year. =cut ############################################### ############################################### sub dateboxes { my ($name,$defaultmonth,$defaultday,$defaultyear, $currentmonth,$currentday,$currentyear)=@_; ($defaultmonth,$defaultday,$defaultyear)=('','',''); # # Day my $day=<<END; <select name="${name}_day"> <option value='$defaultday'> </option> END for (my $i = 1; $i<=31; $i++) { $day.="<option value=\"$i\">$i</option>\n"; } $day.="</select>\n"; $day=~s/(\"$currentday\")/$1 SELECTED/ if length($currentday); # # Month my $month=<<END; <select name="${name}_month"> <option value='$defaultmonth'> </option> END my $i = 1; foreach (qw/January February March April May June July August September October November December /){ $month .="<option value=\"$i\">$_</option>\n"; $i++; } $month.="</select>\n"; $month=~s/(\"$currentmonth\")/$1 SELECTED/ if length($currentmonth); # # Year (obviously) my $year=<<END; <select name="${name}_year"> <option value='$defaultyear'> </option> END my $maxyear = 2051; for (my $i = 1976; $i<=$maxyear; $i++) { $year.="<option value=\"$i\">$i</option>\n"; } $year.="</select>\n"; $year=~s/(\"$currentyear\")/$1 SELECTED/ if length($currentyear); return "$month$day$year"; } ############################################### ############################################### =pod =item &selectbox() Returns a scalar containing an html <select> form. Inputs: =over 4 =item $title Printed above the select box, in uppercase. If undefined, only a select box will be returned, with no additional html. =item $name The name element of the <select> tag. =item $default The default value of the form. Can be $anyvalue, or in @idlist. =item $anyvalue The <option value="..."> used to indicate a default of none of the values. Can be undef. =item $anytag The text associate with $anyvalue above. =item $functionref Each element in @idlist will be passed as a parameter to the function referenced here. The return value of the function should be a scalar description of the items. If this value is undefined the description of each item in @idlist will be the item name. =item @idlist The items to be selected from. One of these or $anyvalue will be the value returned by the form element, $ENV{form.$name}. =back =cut ############################################### sub selectbox { my ($title,$name,$default,$anyvalue,$anytag,$functionref,@idlist)=@_; if (! defined($functionref)) { $functionref = sub { $_[0]}; } my $selout=''; if (defined($title)) { my $uctitle=uc($title); $selout="\n".'<p><font color="#800000" face="helvetica">'. '<b>'.$uctitle.': </b></font>'; } $selout .= '<select name="'.$name.'">'; unshift @idlist,$anyvalue if (defined($anyvalue)); foreach (@idlist) { $selout.='<option value="'.$_.'"'; if ($_ eq $default and !/^any$/) { $selout.=' selected >'.&{$functionref}($_).'</option>'; } elsif ($_ eq $default and /^$anyvalue$/) { $selout.=' selected >'.$anytag.'</option>'; } else {$selout.='>'.&{$functionref}($_).'</option>';} } return $selout.'</select>'.(defined($title)?'</p>':' '); } ###################################################################### # End of HTML form building functions # ###################################################################### =pod =back =cut ###################################################################### ###################################################################### =pod =item &parse_advanced_search() Parse advanced search form and return the following: =over 4 =item $query Scalar containing an SQL query. =item $customquery Scalar containing a custom query. =item $customshow Scalar containing commands to show custom metadata. =item $libraries_to_query Reference to array of domains to search. =back =cut ###################################################################### ###################################################################### sub parse_advanced_search { my ($r,$closebutton)=@_; my $fillflag=0; my $pretty_search_string = "<br />\n"; # Clean up fields for safety for my $field ('title','author','subject','keywords','url','version', 'creationdatestart_month','creationdatestart_day', 'creationdatestart_year','creationdateend_month', 'creationdateend_day','creationdateend_year', 'lastrevisiondatestart_month','lastrevisiondatestart_day', 'lastrevisiondatestart_year','lastrevisiondateend_month', 'lastrevisiondateend_day','lastrevisiondateend_year', 'notes','abstract','mime','language','owner', 'custommetadata','customshow','category') { $ENV{"form.$field"}=~s/[^\w\/\s\=\-\"\']//g; } foreach ('mode','form','element') { # is this required? Hmmm. next unless (exists($ENV{"form.$_"})); $ENV{"form.$_"}=&Apache::lonnet::unescape($ENV{"form.$_"}); $ENV{"form.$_"}=~s/[^\w\/\s\=\-\"\']//g; } # Preprocess the category form element. if ($ENV{'form.category'} ne 'any') { my @extensions = &Apache::loncommon::filecategorytypes ($ENV{'form.category'}); $ENV{'form.mime'} = join ' OR ',@extensions; } # Check to see if enough information was filled in for my $field ('title','author','subject','keywords','url','version', 'notes','abstract','mime','language','owner', 'custommetadata') { if (&filled($ENV{"form.$field"})) { $fillflag++; } } unless ($fillflag) { &output_blank_field_error($r,$closebutton); return ; } # Turn the form input into a SQL-based query my $query=''; my @queries; my $font = '<font color="#800000" face="helvetica">'; # Evaluate logical expression AND/OR/NOT phrase fields. foreach my $field ('title','author','subject','notes','abstract','url', 'keywords','version','owner','mime') { if ($ENV{'form.'.$field}) { my $searchphrase = $ENV{'form.'.$field}; $pretty_search_string .= $font."$field</font> contains <b>". $searchphrase."</b>"; if ($ENV{'form.'.$field.'_related'}) { my @New_Words; ($searchphrase,@New_Words) = &related_version($searchphrase); if (@New_Words) { $pretty_search_string .= " with related words: ". "<b>@New_Words</b>."; } else { $pretty_search_string .= " with no related words."; } } $pretty_search_string .= "<br />\n"; push @queries,&build_SQL_query($field,$searchphrase); } } # I dislike the hack below. if ($ENV{'form.category'}) { $ENV{'form.mime'}=''; } # Evaluate option lists if ($ENV{'form.language'} and $ENV{'form.language'} ne 'any') { push @queries,"(language like \"$ENV{'form.language'}\")"; $pretty_search_string.=$font."language</font>= ". &Apache::loncommon::languagedescription($ENV{'form.language'}). "<br />\n"; } if ($ENV{'form.copyright'} and $ENV{'form.copyright'} ne 'any') { push @queries,"(copyright like \"$ENV{'form.copyright'}\")"; $pretty_search_string.=$font."copyright</font> = ". &Apache::loncommon::copyrightdescription($ENV{'form.copyright'}). "<br \>\n"; } # # Evaluate date windows my $datequery=&build_date_queries( $ENV{'form.creationdatestart_month'}, $ENV{'form.creationdatestart_day'}, $ENV{'form.creationdatestart_year'}, $ENV{'form.creationdateend_month'}, $ENV{'form.creationdateend_day'}, $ENV{'form.creationdateend_year'}, $ENV{'form.lastrevisiondatestart_month'}, $ENV{'form.lastrevisiondatestart_day'}, $ENV{'form.lastrevisiondatestart_year'}, $ENV{'form.lastrevisiondateend_month'}, $ENV{'form.lastrevisiondateend_day'}, $ENV{'form.lastrevisiondateend_year'}, ); # Test to see if date windows are legitimate if ($datequery=~/^Incorrect/) { &output_date_error($r,$datequery,$closebutton); return ; } elsif ($datequery) { # Here is where you would set up pretty_search_string to output # date query information. push @queries,$datequery; } # Process form information for custom metadata querying my $customquery=undef; if ($ENV{'form.custommetadata'}) { $pretty_search_string .=$font."Custom Metadata Search</font>: <b>". $ENV{'form.custommetadata'}."</b><br />\n"; $customquery=&build_custommetadata_query('custommetadata', $ENV{'form.custommetadata'}); } my $customshow=undef; if ($ENV{'form.customshow'}) { $pretty_search_string .=$font."Custom Metadata Display</font>: <b>". $ENV{'form.customshow'}."</b><br />\n"; $customshow=$ENV{'form.customshow'}; $customshow=~s/[^\w\s]//g; my @fields=split(/\s+/,$customshow); $customshow=join(" ",@fields); } ## --------------------------------------------------------------- ## Deal with restrictions to given domains ## my $libraries_to_query = undef; # $ENV{'form.domains'} can be either a scalar or an array reference. # We need an array. my @allowed_domains = (ref($ENV{'form.domains'}) ? @{$ENV{'form.domains'}} : ($ENV{'form.domains'}) ); my %domain_hash = (); my $pretty_domains_string; foreach (@allowed_domains) { $domain_hash{$_}++; } if ($domain_hash{'any'}) { $pretty_domains_string = "Searching all domains."; } else { if (@allowed_domains > 1) { $pretty_domains_string = "Searching domains:"; } else { $pretty_domains_string = "Searching domain "; } foreach (sort @allowed_domains) { $pretty_domains_string .= "<b>$_</b> "; } foreach (keys(%Apache::lonnet::libserv)) { if (exists($domain_hash{$Apache::lonnet::hostdom{$_}})) { push @$libraries_to_query,$_; } } } $pretty_search_string .= $pretty_domains_string."<br />\n"; # if (@queries) { $query=join(" AND ",@queries); $query="select * from metadata where $query"; } elsif ($customquery) { $query = ''; } return ($query,$customquery,$customshow,$libraries_to_query, $pretty_search_string); } ###################################################################### ###################################################################### =pod =item &parse_basic_search() Parse the basic search form and return a scalar containing an sql query. =cut ###################################################################### ###################################################################### sub parse_basic_search { my ($r,$closebutton)=@_; # Clean up fields for safety for my $field ('basicexp') { $ENV{"form.$field"}=~s/[^\w\s\-]//g; } foreach ('mode','form','element') { # is this required? Hmmm. next unless (exists($ENV{"form.$_"})); $ENV{"form.$_"}=&Apache::lonnet::unescape($ENV{"form.$_"}); $ENV{"form.$_"}=~s/[^\w\/\s\=\-\"\']//g; } # Check to see if enough is filled in unless (&filled($ENV{'form.basicexp'})) { &output_blank_field_error($r,$closebutton); return OK; } my $pretty_search_string = '<b>'.$ENV{'form.basicexp'}.'</b>'; my $search_string = $ENV{'form.basicexp'}; if ($ENV{'form.related'}) { my @New_Words; ($search_string,@New_Words) = &related_version($ENV{'form.basicexp'}); if (@New_Words) { $pretty_search_string .= " with related words: <b>@New_Words</b>."; } else { $pretty_search_string .= " with no related words."; } } # Build SQL query string based on form page my $query=''; my $concatarg=join('," ",', ('title', 'author', 'subject', 'notes', 'abstract', 'keywords')); $concatarg='title' if $ENV{'form.titleonly'}; $query=&build_SQL_query('concat('.$concatarg.')',$search_string); $pretty_search_string .= "<br />\n"; return 'select * from metadata where '.$query,$pretty_search_string; } ###################################################################### ###################################################################### =pod =item &related_version Modifies an input string to include related words. Words in the string are replaced with parenthesized lists of 'OR'd words. For example "torque" is replaced with "(torque OR word1 OR word2 OR ...)". Note: Using this twice on a string is probably silly. =cut ###################################################################### ###################################################################### sub related_version { my $search_string = shift; my $result = $search_string; my %New_Words = (); while ($search_string =~ /(\w+)/cg) { my $word = $1; next if (lc($word) =~ /\b(or|and|not)\b/); my @Words = &Apache::loncommon::get_related_words($word); @Words = ($#Words>4? @Words[0..4] : @Words); foreach (@Words) { $New_Words{$_}++;} my $replacement = join " OR ", ($word,@Words); $result =~ s/(\b)$word(\b)/$1($replacement)$2/g; } return $result,sort(keys(%New_Words)); } ###################################################################### ###################################################################### =pod =item &build_SQL_query() Builds a SQL query string from a logical expression with AND/OR keywords using Text::Query and &recursive_SQL_query_builder() =cut ###################################################################### ###################################################################### sub build_SQL_query { my ($field_name,$logic_statement)=@_; my $q=new Text::Query('abc', -parse => 'Text::Query::ParseAdvanced', -build => 'Text::Query::Build'); $q->prepare($logic_statement); my $matchexp=${$q}{'matchexp'}; chomp $matchexp; my $sql_query=&recursive_SQL_query_build($field_name,$matchexp); return $sql_query; } ###################################################################### ###################################################################### =pod =item &build_custommetadata_query() Constructs a custom metadata query using a rather heinous regular expression. =cut ###################################################################### ###################################################################### sub build_custommetadata_query { my ($field_name,$logic_statement)=@_; my $q=new Text::Query('abc', -parse => 'Text::Query::ParseAdvanced', -build => 'Text::Query::BuildAdvancedString'); $q->prepare($logic_statement); my $matchexp=${$q}{'-parse'}{'-build'}{'matchstring'}; # quick fix to change literal into xml tag-matching # will eventually have to write a separate builder module # wordone=wordtwo becomes\<wordone\>[^\<] *wordtwo[^\<]*\<\/wordone\> $matchexp =~ s/(\w+)\\=([\w\\\+]+)?# wordone=wordtwo is changed to /\\<$1\\>?# \<wordone\> \[\^\\<\]?# [^\<] \*$2\[\^\\<\]?# *wordtwo[^\<] \*\\<\\\/$1\\>?# *\<\/wordone\> /g; return $matchexp; } ###################################################################### ###################################################################### =pod =item &recursive_SQL_query_build() Recursively constructs an SQL query. Takes as input $dkey and $pattern. =cut ###################################################################### ###################################################################### sub recursive_SQL_query_build { my ($dkey,$pattern)=@_; my @matches=($pattern=~/(\[[^\]|\[]*\])/g); return $pattern unless @matches; foreach my $match (@matches) { $match=~/\[ (\w+)\s(.*) \]/; my ($key,$value)=($1,$2); my $replacement=''; if ($key eq 'literal') { $replacement="($dkey like \"\%$value\%\")"; } elsif ($key eq 'not') { $value=~s/like/not like/; # $replacement="($dkey not like $value)"; $replacement="$value"; } elsif ($key eq 'and') { $value=~/(.*[\"|\)]) ([|$|\^].*)/; $replacement="($1 AND $2)"; } elsif ($key eq 'or') { $value=~/(.*[\"|$]) ([|\(|\^].*)/; $replacement="($1 OR $2)"; } substr($pattern, index($pattern,$match), length($match), $replacement ); } &recursive_SQL_query_build($dkey,$pattern); } ###################################################################### ###################################################################### =pod =item &build_date_queries() Builds a SQL logic query to check time/date entries. Also reports errors (check for /^Incorrect/). =cut ###################################################################### ###################################################################### sub build_date_queries { my ($cmonth1,$cday1,$cyear1,$cmonth2,$cday2,$cyear2, $lmonth1,$lday1,$lyear1,$lmonth2,$lday2,$lyear2)=@_; my @queries; if ($cmonth1 or $cday1 or $cyear1 or $cmonth2 or $cday2 or $cyear2) { unless ($cmonth1 and $cday1 and $cyear1 and $cmonth2 and $cday2 and $cyear2) { return "Incorrect entry for the creation date. You must specify ". "a starting month, day, and year and an ending month, ". "day, and year."; } my $cnumeric1=sprintf("%d%2d%2d",$cyear1,$cmonth1,$cday1); $cnumeric1+=0; my $cnumeric2=sprintf("%d%2d%2d",$cyear2,$cmonth2,$cday2); $cnumeric2+=0; if ($cnumeric1>$cnumeric2) { return "Incorrect entry for the creation date. The starting ". "date must occur before the ending date."; } my $cquery="(creationdate BETWEEN '$cyear1-$cmonth1-$cday1' AND '". "$cyear2-$cmonth2-$cday2 23:59:59')"; push @queries,$cquery; } if ($lmonth1 or $lday1 or $lyear1 or $lmonth2 or $lday2 or $lyear2) { unless ($lmonth1 and $lday1 and $lyear1 and $lmonth2 and $lday2 and $lyear2) { return "Incorrect entry for the last revision date. You must ". "specify a starting month, day, and year and an ending ". "month, day, and year."; } my $lnumeric1=sprintf("%d%2d%2d",$lyear1,$lmonth1,$lday1); $lnumeric1+=0; my $lnumeric2=sprintf("%d%2d%2d",$lyear2,$lmonth2,$lday2); $lnumeric2+=0; if ($lnumeric1>$lnumeric2) { return "Incorrect entry for the last revision date. The ". "starting date must occur before the ending date."; } my $lquery="(lastrevisiondate BETWEEN '$lyear1-$lmonth1-$lday1' AND '". "$lyear2-$lmonth2-$lday2 23:59:59')"; push @queries,$lquery; } if (@queries) { return join(" AND ",@queries); } return ''; } ###################################################################### ###################################################################### =pod =item &copyright_check() =cut ###################################################################### ###################################################################### sub copyright_check { my $Metadata = shift; # Check copyright tags and skip results the user cannot use my (undef,undef,$resdom,$resname) = split('/', $Metadata->{'url'}); # Check for priv if (($Metadata->{'copyright'} eq 'priv') && (($ENV{'user.name'} ne $resname) && ($ENV{'user.domain'} ne $resdom))) { return 0; } # Check for domain if (($Metadata->{'copyright'} eq 'domain') && ($ENV{'user.domain'} ne $resdom)) { return 0; } return 1; } ##################################################################### ##################################################################### =pod =item MySQL Table Description MySQL table creation requires a precise description of the data to be stored. The use of the correct types to hold data is vital to efficient storage and quick retrieval of records. The columns must be described in the following format: =cut ## ## Restrictions: ## columns of type 'text' and 'blob' cannot have defaults. ## columns of type 'enum' cannot be used for FULLTEXT. ## my @DataOrder = qw/id title author subject url keywords version notes abstract mime lang owner copyright creationdate lastrevisiondate hostname idx_title idx_author idx_subject idx_abstract idx_mime idx_language idx_owner idx_copyright/; my %Datatypes = ( id =>{ type => 'INT', restrictions => 'NOT NULL', primary_key => 'yes', auto_inc => 'yes' }, title =>{ type=>'TEXT'}, author =>{ type=>'TEXT'}, subject =>{ type=>'TEXT'}, url =>{ type=>'TEXT', restrictions => 'NOT NULL' }, keywords =>{ type=>'TEXT'}, version =>{ type=>'TEXT'}, notes =>{ type=>'TEXT'}, abstract =>{ type=>'TEXT'}, mime =>{ type=>'TEXT'}, lang =>{ type=>'TEXT'}, owner =>{ type=>'TEXT'}, copyright =>{ type=>'TEXT'}, hostname =>{ type=>'TEXT'}, #-------------------------------------------------- creationdate =>{ type=>'DATETIME'}, lastrevisiondate =>{ type=>'DATETIME'}, #-------------------------------------------------- idx_title =>{ type=>'FULLTEXT', target=>'title'}, idx_author =>{ type=>'FULLTEXT', target=>'author'}, idx_subject =>{ type=>'FULLTEXT', target=>'subject'}, idx_abstract =>{ type=>'FULLTEXT', target=>'abstract'}, idx_mime =>{ type=>'FULLTEXT', target=>'mime'}, idx_language =>{ type=>'FULLTEXT', target=>'lang'}, idx_owner =>{ type=>'FULLTEXT', target=>'owner'}, idx_copyright =>{ type=>'FULLTEXT', target=>'copyright'}, ); ###################################################################### ###################################################################### =pod =item &create_results_table() Creates the table of search results by calling lonmysql. Stores the table id in $ENV{'form.table'} Inputs: none. Returns: the identifier of the table on success, undef on error. =cut ###################################################################### ###################################################################### sub create_results_table { my $table = &Apache::lonmysql::create_table ( { columns => \%Datatypes, column_order => \@DataOrder, } ); if (defined($table)) { $ENV{'form.table'} = $table; return $table; } return undef; # Error... } ###################################################################### ###################################################################### =pod =item &write_status() =cut ###################################################################### ###################################################################### sub write_status { my ($r,$string) = @_; $string =~ s/(\')/\$1/g; $string =~ s/\n//sg; # $r->print("<script>alert('$string');</script>\n"); # $r->rflush(); return; } ###################################################################### ###################################################################### =pod =item &run_search =cut ###################################################################### ###################################################################### sub run_search { my ($r,$query,$customquery,$customshow,$serverlist,$pretty_string) = @_; # # Timing variables # my $starttime = time; my $max_time = 120; # seconds for the search to complete # # Print run_search header # $r->print("<html><head><title>Search Status</title></head><body>"); $r->print("Search: ".$pretty_string."<br />\n"); $r->rflush(); # # Determine the servers we need to contact. # my @Servers_to_contact; if (defined($serverlist)) { @Servers_to_contact = @$serverlist; } else { @Servers_to_contact = sort(keys(%Apache::lonnet::libserv)); } my %Server_status; my $table =$ENV{'form.table'}; if (! defined($table)) { # What do I do now? Print out an error page. &Apache::lonnet::logthis("lonmysql attempted to create a table ". "and this was the result:". &Apache::lonmysql::get_error()); $r->print("An internal error occured with the database.<br />". "The error has been logged, but you should probably alert". " your system administrator."); return; } ## ## Prepare for the big loop. ## my $hitcountsum; my $server; my $status; while ((time - $starttime < $max_time) && ((@Servers_to_contact) || keys(%Server_status))) { # Send out a search request if it needs to be done. if (@Servers_to_contact) { # Contact one server my $server = shift(@Servers_to_contact); my $reply=&Apache::lonnet::metadata_query($query,$customquery, $customshow,[$server]); ($server) = keys(%$reply); $Server_status{$server} = $reply->{$server}; # $r->print("Contacted:$server:reply:$Server_status{$server}"); if ($max_time - (time - $starttime) < 20) { # If there are less than 20 seconds to go in the search, # give the newly contacted servers 20 more seconds to # respond.... $max_time += 20; } } else { sleep(1); # wait a sec. to give time for files to be written } while (my ($server,$status) = each(%Server_status)) { if ($status eq 'con_lost') { delete ($Server_status{$server}); # $r->print("server $server is not responding."); next; } $status=~/^([\.\w]+)$/; my $datafile=$r->dir_config('lonDaemons').'/tmp/'.$1; if (-e $datafile && ! -e "$datafile.end") { # Let the user know we are receiving data from the server # $r->print("$server:Receiving file"); next; } if (-e "$datafile.end") { if (-z "$datafile") { delete($Server_status{$server}); next; } my $fh; if (!($fh=Apache::File->new($datafile))) { # Error opening file... # Tell the user and exit...? # Should I give up on opening it? $r->print("Unable to open search results file for ". "server $server. Omitting from search"); next; } # Read in the whole file. while (my $result = <$fh>) { # handle custom fields? Someday we will! chomp($result); next unless $result; # Parse the result. my %Fields = &parse_raw_result($result,$server); $Fields{'hostname'} = $server; next if (! &copyright_check(\%Fields)); # Store the result in the mysql database my $result = &Apache::lonmysql::store_row($table,\%Fields); if (! defined($result)) { $r->print(&Apache::lonmysql::get_error()); } # $r->print(&Apache::lonmysql::get_debug()); $hitcountsum ++; } # End of foreach (@results) $fh->close(); # $server is only deleted if the results file has been # found and (successfully) opened. This may be a bad idea. delete($Server_status{$server}); # $r->print("Received $new_count more results from ". # $server."."); } } # Finished looping through the servers } &Apache::lonmysql::disconnect_from_db(); # Let the user know # # We have run out of time or run out of servers to talk to and # results to get. $r->print("<h1>Search completed.</h1>"); if ($hitcountsum) { $r->print($hitcountsum." successful matches to your query.<br />"); } else { $r->print("There were no successful matches to your query.<br />"); } $r->print("</body></html>"); return; } ###################################################################### ###################################################################### =pod =item &prev_next_buttons =cut ###################################################################### ###################################################################### sub prev_next_buttons { my ($current_min,$show,$total,$parms) = @_; return '' if ($show eq 'all'); # No links if you get them all at once. my $links; ## ## Prev my $prev_min = $current_min - $show; $prev_min = 0 if $prev_min < 0; if ($prev_min < $current_min) { $links .= qq{ <a href="/adm/searchcat?$parms&start=$prev_min&show=$show">prev</a> }; } else { $links .= 'prev'; } ## ## Pages.... Someday. ## $links .= qq{   <a href="/adm/searchcat?$parms&start=$current_min&$show=$show">reload</a> }; ## ## Next my $next_min = $current_min + $show; $next_min = $current_min if ($next_min > $total); if ($next_min != $current_min) { $links .= qq{   <a href="/adm/searchcat?$parms&start=$next_min&show=$show">next</a> }; } else { $links .= ' next'; } return $links; } ###################################################################### ###################################################################### =pod =item &display_results =cut ###################################################################### ###################################################################### sub display_results { my ($r,$mode,$importbutton,$closebutton) = @_; $r->print(&search_results_header()); ## ## Set viewing function ## my $viewfunction = $Views{$ENV{'form.viewselect'}}; if (!defined($viewfunction)) { $r->print("Internal Error - Bad view selected.\n"); $r->rflush(); return; } ## ## Get the catalog controls setup ## my $action = "/adm/searchcat?phase=results"; ## ## ## if ($ENV{'form.catalogmode'} eq 'groupsearch') { if (! tie(%groupsearch_db,'GDBM_File',$diropendb, &GDBM_WRCREAT,0640)) { $r->print('Unable to tie hash to db file</body></html>'); $r->rflush(); return; } } ## ## Prepare the table for querying ## my $table = $ENV{'form.table'}; my $connection_result = &Apache::lonmysql::connect_to_db(); if (!defined($connection_result)) { $r->print(&Apache::lonmysql::get_error()); } my $table_check = &Apache::lonmysql::check_table($table); if (! defined($table_check)) { $r->print("A MySQL error has occurred.</body></html>"); &Apache::lonnet::logthis("lonmysql was unable to determine the status". " of table ".$table); return; } elsif (! $table_check) { $r->print("The table of results could not be found."); &Apache::lonnet::logthis("The user requested a table, ".$table. ", that could not be found."); return; } ## ## Get the number of results ## my $total_results = &Apache::lonmysql::number_of_rows($table); if (! defined($total_results)) { $r->print("A MySQL error has occurred.</body></html>"); &Apache::lonnet::logthis("lonmysql was unable to determine the number". " of rows in table ".$table); &Apache::lonnet::logthis(&Apache::lonmysql::get_error()); &Apache::lonnet::logthis(&Apache::lonmysql::get_debug()); return; } if ($total_results == 0) { $r->print("There were no results matching your query.\n". "</form></body></html>"); return; } ## ## Determine how many results we need to get ## $ENV{'form.show'} = 20; $ENV{'form.start'} = 0 if (! exists($ENV{'form.start'})); $ENV{'form.show'} = 'all' if (! exists($ENV{'form.show'})); my $min = $ENV{'form.start'}; my $max; if ($ENV{'form.show'} eq 'all') { $max = $total_results ; } else { $max = $min + $ENV{'form.show'}; $max = $total_results if ($max > $total_results); } ## ## Output links (if necessary) for 'prev' and 'next' pages. ## $r->print("<center>Results $min to $max out of $total_results</center>\n"); $r->print ('<br /><center>'. &prev_next_buttons($min,$ENV{'form.show'},$total_results, "table=".$ENV{'form.table'}. "&phase=results". "&persistent_db_id=".$ENV{'form.persistent_db_id'}) ."</center><br />\n" ); ## ## Get results from MySQL table ## my @Results = &Apache::lonmysql::get_rows($table, 'id>'.$min.' AND id<='.$max); ## ## Loop through the results and output them. ## foreach my $row (@Results) { my %Fields = %{&parse_row(@$row)}; my $output="<p>\n"; $output.=&catalogmode_output($Fields{'title'},$Fields{'url'}); # Render the result into html $output.= &$viewfunction(%Fields); $output.="</p>\n<hr align='left' width='200' noshade />"; # Print them out as they come in. $r->print($output); $r->rflush(); } if (@Results < 1) { $r->print("There were no results matching your query"); } $r->print("</body></html>"); $r->rflush(); untie %groupsearch_db; return; } ###################################################################### ###################################################################### =pod =item &catalogmode_output($title,$url) Returns html needed for the various catalog modes. Gets inputs from $ENV{'form.catalogmode'}. Stores data in %groupsearch_db and $fnum (local variable). =cut ###################################################################### ###################################################################### { my $fnum; sub catalogmode_output { my $output = ''; my ($title,$url) = @_; if ($ENV{'form.catalogmode'} eq 'interactive') { $title=~ s/\'/\\'/g; # ' Escape single quotes. if ($ENV{'form.catalogmode'} eq 'interactive') { $output.=<<END <font size='-1'><INPUT TYPE="button" NAME="returnvalues" VALUE="SELECT" onClick="javascript:select_data('$title','$url')"> </font> END } } if ($ENV{'form.catalogmode'} eq 'groupsearch') { $fnum+=0; $groupsearch_db{"pre_${fnum}_link"}=$url; $groupsearch_db{"pre_${fnum}_title"}=$title; $output.=<<END; <font size='-1'> <input type="checkbox" name="returnvalues" value="SELECT" onClick="javascript:queue($fnum)" /> </font> END $fnum++; } return $output; } } ###################################################################### ###################################################################### =pod =item &parse_row Parse a row returned from the database. =cut ###################################################################### ###################################################################### sub parse_row { my @Row = @_; my %Fields; for (my $i=0;$i<=$#Row;$i++) { $Fields{$DataOrder[$i]}=&Apache::lonnet::unescape($Row[$i]); } $Fields{'language'} = &Apache::loncommon::languagedescription($Fields{'lang'}); $Fields{'copyrighttag'} = &Apache::loncommon::copyrightdescription($Fields{'copyright'}); $Fields{'mimetag'} = &Apache::loncommon::filedescription($Fields{'mime'}); return \%Fields; } ########################################################### ########################################################### =pod =item &parse_raw_result() Takes a line from the file of results and parse it. Returns a hash with keys for the following fields: 'title', 'author', 'subject', 'url', 'keywords', 'version', 'notes', 'abstract', 'mime', 'lang', 'owner', 'copyright', 'creationdate', 'lastrevisiondate'. In addition, the following tags are set by calling the appropriate lonnet function: 'language', 'cprtag', 'mimetag'. The 'title' field is set to "Untitled" if the title field is blank. 'abstract' and 'keywords' are truncated to 200 characters. =cut ########################################################### ########################################################### sub parse_raw_result { my ($result,$hostname) = @_; # Check for a comma - if it is there then we do not need to unescape the # string. There seems to be some kind of problem with some items in # the database - the entire string gets sent out unescaped...? unless ($result =~ /,/) { $result = &Apache::lonnet::unescape($result); } my @fields=map { &Apache::lonnet::unescape($_); } (split(/\,/,$result)); my ($title,$author,$subject,$url,$keywords,$version, $notes,$abstract,$mime,$lang, $creationdate,$lastrevisiondate,$owner,$copyright)=@fields; my %Fields = ( title => &Apache::lonnet::unescape($title), author => &Apache::lonnet::unescape($author), subject => &Apache::lonnet::unescape($subject), url => &Apache::lonnet::unescape($url), keywords => &Apache::lonnet::unescape($keywords), version => &Apache::lonnet::unescape($version), notes => &Apache::lonnet::unescape($notes), abstract => &Apache::lonnet::unescape($abstract), mime => &Apache::lonnet::unescape($mime), lang => &Apache::lonnet::unescape($lang), owner => &Apache::lonnet::unescape($owner), copyright => &Apache::lonnet::unescape($copyright), creationdate => &Apache::lonnet::unescape($creationdate), lastrevisiondate => &Apache::lonnet::unescape($lastrevisiondate) ); $Fields{'language'} = &Apache::loncommon::languagedescription($Fields{'lang'}); $Fields{'copyrighttag'} = &Apache::loncommon::copyrightdescription($Fields{'copyright'}); $Fields{'mimetag'} = &Apache::loncommon::filedescription($Fields{'mime'}); if ($Fields{'author'}=~/^(\s*|error)$/) { $Fields{'author'}="Unknown Author"; } # Put spaces in the keyword list, if needed. $Fields{'keywords'}=~ s/,([A-z])/, $1/g; if ($Fields{'title'}=~ /^\s*$/ ) { $Fields{'title'}='Untitled'; } unless ($ENV{'user.adv'}) { # What is this anyway? $Fields{'keywords'} = '- not displayed -'; $Fields{'notes'} = '- not displayed -'; $Fields{'abstract'} = '- not displayed -'; $Fields{'subject'} = '- not displayed -'; } if (length($Fields{'abstract'})>200) { $Fields{'abstract'} = substr($Fields{'abstract'},0,200).'...'; } if (length($Fields{'keywords'})>200) { $Fields{'keywords'} = substr($Fields{'keywords'},0,200).'...'; } return %Fields; } ########################################################### ########################################################### =pod =item &handle_custom_fields() =cut ########################################################### ########################################################### sub handle_custom_fields { my @results = @{shift()}; my $customshow=''; my $extrashow=''; my @customfields; if ($ENV{'form.customshow'}) { $customshow=$ENV{'form.customshow'}; $customshow=~s/[^\w\s]//g; my @fields=map { "<font color=\"#008000\">$_:</font>"; } split(/\s+/,$customshow); @customfields=split(/\s+/,$customshow); if ($customshow) { $extrashow="<ul><li>".join("</li><li>",@fields)."</li></ul>\n"; } } my $customdata=''; my %customhash; foreach my $result (@results) { if ($result=~/^(custom\=.*)$/) { # grab all custom metadata my $tmp=$result; $tmp=~s/^custom\=//; my ($k,$v)=map {&Apache::lonnet::unescape($_); } split(/\,/,$tmp); $customhash{$k}=$v; } } return ($extrashow,\@customfields,\%customhash); } ###################################################################### ###################################################################### =pod =item &search_results_header Output the proper html headers and javascript code to deal with different calling modes. Takes most inputs directly from %ENV, except $mode. =over 4 =item $mode is either (at this writing) 'Basic' or 'Advanced' =back The following environment variables are checked: =over 4 =item 'form.catalogmode' Checked for 'interactive' and 'groupsearch'. =item 'form.mode' Checked for existance & 'edit' mode. =item 'form.form' =item 'form.element' =back =cut ###################################################################### ###################################################################### sub search_results_header { my $result = ''; # output beginning of search page # conditional output of script functions dependent on the mode in # which the search was invoked if ($ENV{'form.catalogmode'} eq 'interactive'){ if (! exists($ENV{'form.mode'}) || $ENV{'form.mode'} ne 'edit') { $result.=<<SCRIPT; <script type="text/javascript"> function select_data(title,url) { changeTitle(title); changeURL(url); self.close(); } function changeTitle(val) { if (opener.inf.document.forms.resinfo.elements.t) { opener.inf.document.forms.resinfo.elements.t.value=val; } } function changeURL(val) { if (opener.inf.document.forms.resinfo.elements.u) { opener.inf.document.forms.resinfo.elements.u.value=val; } } </script> SCRIPT } elsif ($ENV{'form.mode'} eq 'edit') { my $form = $ENV{'form.form'}; my $element = $ENV{'form.element'}; $result.=<<SCRIPT; <script type="text/javascript"> function select_data(title,url) { changeURL(url); self.close(); } function changeTitle(val) { } function changeURL(val) { if (window.opener.document) { window.opener.document.forms["$form"].elements["$element"].value=val; } else { var url = 'forms[\"$form\"].elements[\"$element\"].value'; alert("Unable to transfer data to "+url); } } </script> SCRIPT } } $result.=<<SCRIPT if $ENV{'form.catalogmode'} eq 'groupsearch'; <script type="text/javascript"> function select_data(title,url) { // alert('DEBUG: Should be storing '+title+' and '+url); } function queue(val) { if (eval("document.forms.results.returnvalues["+val+"].checked")) { document.forms.results.acts.value+='1a'+val+'b'; } else { document.forms.results.acts.value+='0a'+val+'b'; } } function select_group() { window.location= "/adm/groupsort?mode=$ENV{'form.mode'}&catalogmode=groupsearch&acts="+ document.forms.results.acts.value; } </script> SCRIPT $result.=<<END; </head> END return $result; } ###################################################################### ###################################################################### sub search_status_header { return <<ENDSTATUS; <html><head><title>Search Status</title></head> <body> <h3>Search Status</h3> Sending search request to LON-CAPA servers.<br /> ENDSTATUS } ###################################################################### ###################################################################### sub print_frames_interface { my $r = shift; my $basic_link = "/adm/searchcat?"."&table=".$ENV{'form.table'}. "&persistent_db_id=".$ENV{'form.persistent_db_id'}; my $run_search_link = $basic_link."&phase=run_search"; my $results_link = $basic_link."&phase=results". "&pause=10"."&start=0"."&show=20"; my $result = <<"ENDFRAMES"; <html> <head> <title>LON-CAPA Digital Library Search Results</title> </head> <frameset rows="150,*"> <frame name="statusframe" src="$run_search_link"> <frame name="resultsframe" src="$results_link"> </frameset> </html> ENDFRAMES $r->print($result); return; } ###################################################################### ###################################################################### =pod =item Metadata Viewing Functions Output is a HTML-ified string. Input arguments are title, author, subject, url, keywords, version, notes, short abstract, mime, language, creation date, last revision date, owner, copyright, hostname, and extra custom metadata to show. =over 4 =item &detailed_citation_view() =cut ###################################################################### ###################################################################### sub detailed_citation_view { my %values = @_; my $result=<<END; <h3><a href="http://$ENV{'HTTP_HOST'}$values{'url'}" target='search_preview'>$values{'title'}</a></h3> <p> <b>$values{'author'}</b>, <i>$values{'owner'}</i><br /> <b>Subject: </b> $values{'subject'}<br /> <b>Keyword(s): </b> $values{'keywords'}<br /> <b>Notes: </b> $values{'notes'}<br /> <b>MIME Type: </b> $values{'mimetag'}<br /> <b>Language: </b> $values{'language'}<br /> <b>Copyright/Distribution:</b> $values{'cprtag'}<br /> </p> $values{'extrashow'} <p> $values{'shortabstract'} </p> END return $result; } ###################################################################### ###################################################################### =pod =item &summary_view() =cut ###################################################################### ###################################################################### sub summary_view { my %values = @_; my $result=<<END; <a href="http://$ENV{'HTTP_HOST'}$values{'url'}" target='search_preview'>$values{'author'}</a><br /> $values{'title'}<br /> $values{'owner'} -- $values{'lastrevisiondate'}<br /> $values{'copyrighttag'}<br /> $values{'extrashow'} </p> END return $result; } ###################################################################### ###################################################################### =pod =item &fielded_format_view() =cut ###################################################################### ###################################################################### sub fielded_format_view { my %values = @_; my $result=<<END; <b>URL: </b> <a href="http://$ENV{'HTTP_HOST'}$values{'url'}" target='search_preview'>$values{'url'}</a> <br /> <b>Title:</b> $values{'title'}<br /> <b>Author(s):</b> $values{'author'}<br /> <b>Subject:</b> $values{'subject'}<br /> <b>Keyword(s):</b> $values{'keywords'}<br /> <b>Notes:</b> $values{'notes'}<br /> <b>MIME Type:</b> $values{'mimetag'}<br /> <b>Language:</b> $values{'language'}<br /> <b>Creation Date:</b> $values{'creationdate'}<br /> <b>Last Revision Date:</b> $values{'lastrevisiondate'}<br /> <b>Publisher/Owner:</b> $values{'owner'}<br /> <b>Copyright/Distribution:</b> $values{'copyrighttag'}<br /> <b>Repository Location:</b> $values{'hostname'}<br /> <b>Abstract:</b> $values{'shortabstract'}<br /> $values{'extrashow'} </p> END return $result; } ###################################################################### ###################################################################### =pod =item &xml_sgml_view() =back =cut ###################################################################### ###################################################################### sub xml_sgml_view { my %values = @_; my $result=<<END; <pre> <LonCapaResource> <url>$values{'url'}</url> <title>$values{'title'}</title> <author>$values{'author'}</author> <subject>$values{'subject'}</subject> <keywords>$values{'keywords'}</keywords> <notes>$values{'notes'}</notes> <mimeInfo> <mime>$values{'mime'}</mime> <mimetag>$values{'mimetag'}</mimetag> </mimeInfo> <languageInfo> <language>$values{'lang'}</language> <languagetag>$values{'language'}</languagetag> </languageInfo> <creationdate>$values{'creationdate'}</creationdate> <lastrevisiondate>$values{'lastrevisiondate'}</lastrevisiondate> <owner>$values{'owner'}</owner> <copyrightInfo> <copyright>$values{'copyright'}</copyright> <copyrighttag>$values{'copyrighttag'}</copyrighttag> </copyrightInfo> <repositoryLocation>$values{'hostname'}</repositoryLocation> <shortabstract>$values{'shortabstract'}</shortabstract> </LonCapaResource> </pre> $values{'extrashow'} END return $result; } ###################################################################### ###################################################################### =pod =item &filled() see if field is filled. =cut ###################################################################### ###################################################################### sub filled { my ($field)=@_; if ($field=~/\S/ && $field ne 'any') { return 1; } else { return 0; } } ###################################################################### ###################################################################### =pod =item &output_blank_field_error() =cut ###################################################################### ###################################################################### sub output_blank_field_error { my ($r,$closebutton)=@_; # make query information persistent to allow for subsequent revision $r->print(<<BEGINNING); <html> <head> <title>The LearningOnline Network with CAPA</title> BEGINNING $r->print(<<RESULTS); </head> <body bgcolor="#ffffff"> <img align='right' src='/adm/lonIcons/lonlogos.gif' /> <h1>Search Catalog</h1> <form method="post" action="/adm/searchcat"> $hidden_fields <a href="/adm/searchcat?persistent_db_id=$ENV{'form.persistent_db_id'}" >Revise search request</a>  $closebutton <hr /> <h3>Helpful Message</h3> <p> Incorrect search query due to blank entry fields. You need to fill in the relevant fields on the search page in order for a query to be processed. </p> </body> </html> RESULTS } ###################################################################### ###################################################################### =pod =item &output_date_error() Output a full html page with an error message. Inputs: $r, the request pointer. $message, the error message for the user. $closebutton, the specialized close button needed for groupsearch. =cut ###################################################################### ###################################################################### sub output_date_error { my ($r,$message,$closebutton)=@_; # make query information persistent to allow for subsequent revision $r->print(<<RESULTS); <html> <head> <title>The LearningOnline Network with CAPA</title> </head> <body bgcolor="#ffffff"> <img align='right' src='/adm/lonIcons/lonlogos.gif' /> <h1>Search Catalog</h1> <form method="post" action="/adm/searchcat"> $hidden_fields <input type='button' value='Revise search request' onClick='this.form.submit();' /> $closebutton <hr /> <h3>Helpful Message</h3> <p> $message </p> </body> </html> RESULTS } ###################################################################### ###################################################################### =pod =item &start_fresh_session() Cleans the global %groupsearch_db by removing all fields which begin with 'pre_' or 'store'. =cut ###################################################################### ###################################################################### sub start_fresh_session { delete $groupsearch_db{'mode_catalog'}; foreach (keys %groupsearch_db) { if ($_ =~ /^pre_/) { delete $groupsearch_db{$_}; } if ($_ =~ /^store/) { delete $groupsearch_db{$_}; } } } 1; __END__ =pod =back =cut