[BACK]Return to entities.pm CVS log [TXT] [DIR] Up to [LON-CAPA] / loncom / interface

Diff for /loncom/interface/entities.pm between versions 1.14 and 1.23

version 1.14, 2008/11/17 20:22:42 version 1.23, 2019/02/23 20:05:50
Line 1 Line 1
 # The LearningOnline Network  # The LearningOnline Network
 # entity -> tex.  # entity -> tex.
 #  #
 #   # $Id$
 #  #
 # Copyright Michigan State University Board of Trustees  # Copyright Michigan State University Board of Trustees
 #  #
Line 26 Line 26
 #  #
 #  #
   
   package Apache::entities;
   use strict;
   
 =pod  =pod
   
 =head1 NAME  =head1 TABLES ASCII code page
   
 Apache::entities.pm  =over
   
 =head1 SYNOPSIS  =item (7-13)
   
 This file contains a table driven entity-->latex converter.      Translation to empty strings
   
 This is part of the LearningOnline Network with CAPA project  =item (32-126)
 described at http://www.lon-capa.org.  
   
 =head1 OVERVIEW      Translations to simple characters
   
   =item (130-140)
   
 Assumptions:      Controls and Latin-1 supplement.  Note that some entities that have
  The number of entities in a resource is small compared with the      visible effect are not printing unicode characters.  Specifically
  number of possible entities that might be translated.      ‚- 
  Therefore the strategy is to match a general entity pattern  
  &.+; over and over, pull out the match look it up in an entity -> tex hash  
  and do the replacement.  
   
 In order to simplify the hash, the following reductions are done:  =item (145-156)
  &#d+; have the &# and ; stripped and is converted to an int.  
  &#.+; have the &#x and ; stripped and is converted to an int as a hex  
                            value.  
  All others have the & and ; stripped.  
   
       There's a gap here in my entity table
   
 The hash:  Add new conversions here; leave off the leading & and the trailing ;  =item (159-255)
 all numeric entities need only appear as their decimal versions  
 (e.g. no need for 1234 is sufficient, no need for 0x4d2 as well.  
   
 This entity table is mercilessly cribbed from the  HTML pocket reference       Another short gap
 table starting at pg 82.  In most cases the LaTeX equivalent codes come from  
 the original massive regular expression replacements originally by   
 A. Sakharuk in lonprintout.pm  
   
 I also want to acknowledge  
  ISO Character entities and their LaTeX equivalents by   
     Vidar Bronken Gundersen, and Rune Mathisen  
   http://www.bitjungle.com/isoent-ref.pdf  
   
   =item (295)
   
 Note numerical entities are essentially unicode character codes.       hbar entity number comes from the unicode character:
        see e.g. http://www.unicode.org/charts/PDF/U0100.pdf
        ISO also documents a 'planck' entity.
   
   =item (338-376)
   
 =head1 SUBROUTINES      Latin extended-A HTML 4.01 entities
   
 =item entity_to_utf8()  =item (402)
   
       Latin extended B HTML 4.01 entities
   
 Convert a numerical entity (that does not exist in our hash)  =item (710 & 732)
  to its UTF-8 equivalent representation.  
  This allows us to support, to some extent, any entity for which  
  dvipdf can find a gylph (given that LaTeX is now UTF-8 clean).  
   
 Parameters:      Spacing modifier letters
   unicode  - The unicode for the character.  This is assumed to  
              be a decimal value  
 Returns:  
   The UTF-8 equiavalent of the value.  
   
 =item entity_to_latex()  =item (913-937)
   
  Convert an entity to the corresponding LateX if possible.      Greek uppercase (skipss 930)
  If not possible, and the entity is numeric,  
  the entity is treated like a Unicode character and converted  
  to UTF-8 which should display as long as dvipdf can find the  
  appropriate glyph.  
   
  The entity is assumed to have already had the   =item (945-982)
  &;  or & ; removed  
   
 Parameters:      Greek lowercase
   entity    - Name of entity to convert.  
 Returns:  
  One of the following:  
   - Latex string that produces the entity.  
   - UTF-8 equivalent of a numeric entity for which we don't have a latex string.  
   - ' ' for text entities for which there's no latex equivalent.  
   
   =item (8194-8364)
   
 =item replace_entities()      The general punctuation set
   
  Convert all the entities in a string.  =item (8462-8501)
  We locate all the entities, pass them into entity_to_latex and   
  and replace occurences in the input string.  
  The assumption is that there are few entities in any string/document  
  so this looping is not too bad.  The advantage of looping vs. regexping is  
  that we now can use lookup tables for the translation in entity_to_latex above.  
   
 Parameters:      Letter like symbols
   input   - Input string/document  
 Returns  
   input with entities replaced by latexable stuff (UTF-8 encodings or  
   latex control strings to produce the entity.  
   
 =head1 TABLES ASCII code page  =item (8592-8669)
   
 =cut      Arrows and then some (harpoons from Hon Kie).
   
   =item (8704-8734)
   
 package Apache::entities;      Mathematical operators.
 use strict;  
   
 package Apache::entities;  =item (8735-9830)
   
 my %entities = (      The items below require the isoent latex package which I can't find at least for FC5.
       Temporarily commented out.
   
 =pod  =back
   
 =out  =cut
   
 =item (7-13)  my %entities = (
   
     # Translation to empty strings:      # Translation to empty strings:
 =cut  
   
     7        => "",      7        => "",
     9        => "",      9        => "",
     10       => "",      10       => "",
     13       => "",      13       => "",
           
 =pod  
   
 =item (32-126)  
   
     # Translations to simple characters:      # Translations to simple characters:
   
 =cut  
   
     32       => " ",      32       => " ",
     33       => "!",      33       => "!",
     34       => '"',      34       => '"',
Line 259  my %entities = ( Line 219  my %entities = (
     125      => '\}',      125      => '\}',
     126      => '\~',      126      => '\~',
   
 =pod      # Controls and Latin-1 supplement.
   
 =item (130-140)  
   
     Controls and Latin-1 supplement.  Note that some entities that have  
     visible effect are not printing unicode characters.  Specifically  
     ‚-   
   
 =cut  
   
     130     => ',',      130     => ',',
     131     => '\ensuremath{f}',      131     => '\ensuremath{f}',
Line 281  my %entities = ( Line 233  my %entities = (
     139     => '\ensuremath{<}',      139     => '\ensuremath{<}',
     140     => '{\OE}',      140     => '{\OE}',
           
 =pod      # There's a gap here in my entity table
   
 =item (145-156)  
   
     There's a gap here in my entity table  
   
 =cut  
   
     145     => '`',      145     => '`',
     146     => '\'',      146     => '\'',
Line 302  my %entities = ( Line 248  my %entities = (
     155     => '\ensuremath{>}',      155     => '\ensuremath{>}',
     156     => '\oe ',      156     => '\oe ',
   
 =pod       # Another short gap:
   
 =item (159-255)  
   
      Another short gap:  
   
 =cut  
   
     159     => '\"Y',      159     => '\"Y',
     160     => '~',      160     => '~',
Line 499  my %entities = ( Line 439  my %entities = (
     'yuml'  => '\\"{y}',      'yuml'  => '\\"{y}',
   
   
 =pod       # hbar entity number comes from the unicode character:
   
 =item (295)  
   
      hbar entity number comes from the unicode charater:  
      see e.g. http://www.unicode.org/charts/PDF/U0100.pdf  
      ISO also documents a 'planck' entity.  
   
 =cut  
   
     295     => '\ensuremath{\hbar}',      295     => '\ensuremath{\hbar}',
     'planck' => '\ensuremath{\hbar}',      'planck' => '\ensuremath{\hbar}',
   
 =pod      # Latin extended-A HTML 4.01 entities:
   
 =item (338-376)  
   
     Latin extended-A HTML 4.01 entities:  
   
 =cut  
   
     338      => '\OE',      338      => '\OE',
     'OElig'  => '\OE',      'OElig'  => '\OE',
Line 531  my %entities = ( Line 457  my %entities = (
     376      => '\\"{Y}',      376      => '\\"{Y}',
     'Yuml'   => '\\"{Y}',       'Yuml'   => '\\"{Y}', 
   
 =pod      # Latin extended B HTML 4.01 entities
   
 =item (402)  
   
     Latin extended B HTML 4.01 entities  
   
 =cut  
   
     402      => '\ensuremath{f}',      402      => '\ensuremath{f}',
     'fnof'   => '\ensuremath{f}',      'fnof'   => '\ensuremath{f}',
   
 =pod      # Spacing modifier letters:
   
 =item (710 & 732)  
   
     Spacing modifier letters:  
   
 =cut  
           
     710      => '\^{}',      710      => '\^{}',
     'circ'   => '\^{}',      'circ'   => '\^{}',
     732      => '\~{}',      732      => '\~{}',
     'tilde'  => '\~{}',      'tilde'  => '\~{}',
   
 =pod      # Greek uppercase:
   
 =item (913-929)  
   
     Greek uppercase:  
   
 =cut  
   
     913      => '\ensuremath{\mathrm{A}}',      913      => '\ensuremath{\mathrm{A}}',
     'Alpha'  => '\ensuremath{\mathrm{A}}',      'Alpha'  => '\ensuremath{\mathrm{A}}',
Line 597  my %entities = ( Line 505  my %entities = (
     'Pi'     => '\ensuremath{\Pi}',      'Pi'     => '\ensuremath{\Pi}',
     929      => '\ensuremath{\mathrm{P}}',      929      => '\ensuremath{\mathrm{P}}',
     'Rho'    => '\ensuremath{\mathrm{P}}',      'Rho'    => '\ensuremath{\mathrm{P}}',
      
   
 =pod  
   
 =item (931-937)  
   
     Skips 930  
   
 =cut  
   
     931      => '\ensuremath{\Sigma}',      931      => '\ensuremath{\Sigma}',
     'Sigma'  => '\ensuremath{\Sigma}',      'Sigma'  => '\ensuremath{\Sigma}',
     932      => '\ensuremath{\mathrm{T}}',      932      => '\ensuremath{\mathrm{T}}',
Line 622  my %entities = ( Line 520  my %entities = (
     937      => '\ensuremath{\Omega}',      937      => '\ensuremath{\Omega}',
     'Omega'  => '\ensuremath{\Omega}',      'Omega'  => '\ensuremath{\Omega}',
   
 =pod      # Greek lowercase:
   
 =item (945-982)  
   
     Greek lowercase:  
   
 =cut  
   
     945      => '\ensuremath{\alpha}',      945      => '\ensuremath{\alpha}',
     'alpha'  => '\ensuremath{\alpha}',      'alpha'  => '\ensuremath{\alpha}',
Line 687  my %entities = ( Line 579  my %entities = (
     982      => '\ensuremath{\varpi}',      982      => '\ensuremath{\varpi}',
     'piv'    => '\ensuremath{\varpi}',      'piv'    => '\ensuremath{\varpi}',
   
 =pod      # The general punctuation set:
   
 =item (8194-8364)  
       
     The general punctuation set:  
   
 =cut  
   
     8194,    => '\hspace{.5em}',      8194,    => '\hspace{.5em}',
     'enspc'  => '\hspace{.5em}',      'enspc'  => '\hspace{.5em}',
Line 750  my %entities = ( Line 636  my %entities = (
     8364     => '\texteuro',      8364     => '\texteuro',
     'euro'   => '\texteuro',      'euro'   => '\texteuro',
   
 =pod      # Letter like symbols
    
 =item (8472-8501)      8462     => '\ensuremath{h}',
       'planckh' => '\ensuremath{h}',
     Letter like symbols      8463     => '\ensuremath{\hbar}',
       'hbar'   => '\ensuremath{\hbar}',   
 =cut  
   
       
     8472     => '\ensuremath{\wp}',      8472     => '\ensuremath{\wp}',
     'weierp' => '\ensuremath{\wp}',      'weierp' => '\ensuremath{\wp}',
     8465     => '\ensuremath{\Im}',      8465     => '\ensuremath{\Im}',
Line 767  my %entities = ( Line 650  my %entities = (
     'real'   => '\ensuremath{\Re}',      'real'   => '\ensuremath{\Re}',
     8482     => '\texttrademark',      8482     => '\texttrademark',
     'trade'  => '\texttrademark',      'trade'  => '\texttrademark',
       8496     => '\ensuremath{\mathcal{E}}',
       'expectation' => '\ensuremath{\mathcal{E}}',
     8501     => '\ensuremath{\aleph}',      8501     => '\ensuremath{\aleph}',
     'alefsym'=> '\ensuremath{\aleph}',      'alefsym'=> '\ensuremath{\aleph}',
   
 =pod      # Arrows and then some (harpoons from Hon Kie).
   
 =item (8592-8669)  
       
     Arrows and then some (harpoons from Hon Kie).  
   
 =cut      8592     => '\ensuremath{\leftarrow}',
       'larr'   => '\ensuremath{\leftarrow}',
     8592     => '\textleftarrow',      8593     => '\ensuremath{\uparrow}',
     'larr'   => '\textleftarrow',      'uarr'   => '\ensuremath{\uparrow}',
     8593     => '\textuparrow',      8594     => '\ensuremath{\rightarrow}',
     'uarr'   => '\textuparrow',      'rarr'   => '\ensuremath{\rightarrow}',
     8594     => '\textrightarrow',      'rightarrow' => '\ensuremath{\rightarrow}',
     'rarr'   => '\textrightarrow',      8595     => '\ensuremath{\downarrow}',
     8595     => '\textdownarrow',      'darr'   => '\ensuremath{\downarrow}',
     'darr'   => '\textdownarrow',  
     8596     => '\ensuremath{\leftrightarrow}',      8596     => '\ensuremath{\leftrightarrow}',
     'harr'   => '\ensuremath{\leftrightarrow}',      'harr'   => '\ensuremath{\leftrightarrow}',
     8598     => '\ensuremath{\nwarrow}',      8598     => '\ensuremath{\nwarrow}',
Line 822  my %entities = ( Line 702  my %entities = (
     8669     => '\ensuremath{\rightsquigarrow}',      8669     => '\ensuremath{\rightsquigarrow}',
     'rarrw'  => '\ensuremath{\rightsquigarrow}',      'rarrw'  => '\ensuremath{\rightsquigarrow}',
           
 =pod      # Mathematical operators.
   
 =item (8704-8734)  
   
     Mathematical operators.  
   
 =cut  
   
           
     'forall' => '\ensuremath{\forall}',      'forall' => '\ensuremath{\forall}',
     8704     => '\ensuremath{\forall}',      8704     => '\ensuremath{\forall}',
Line 877  my %entities = ( Line 750  my %entities = (
     'infin'  => '\ensuremath{\infty}',      'infin'  => '\ensuremath{\infty}',
     8734     => '\ensuremath{\infty}',      8734     => '\ensuremath{\infty}',
   
       # The items below require the isoent latex package which I can't find at least for FC5.
 =pod      # Temporarily commented out.
   
 =item (8735-9830)  
   
   
     The items below require the isoent latex package which I can't find at least for FC5.  
     Temporarily commented out.  
           
     'ang90'  => '\ensuremath{\sqangle}',      'ang90'  => '\ensuremath{\sqangle}',
     8735     => '\ensuremath{\sqangle}',      8735     => '\ensuremath{\sqangle}',
   
 =cut  
   
     'ang'    => '\ensuremath{\angle}',      'ang'    => '\ensuremath{\angle}',
     8736     => '\ensuremath{\angle}',      8736     => '\ensuremath{\angle}',
     'angmsd' => '\ensuremath{\measuredangle}',      'angmsd' => '\ensuremath{\measuredangle}',
Line 930  my %entities = ( Line 795  my %entities = (
     'cong'   => '\ensuremath{\cong}',      'cong'   => '\ensuremath{\cong}',
     8773     => '\ensuremath{\cong}',      8773     => '\ensuremath{\cong}',
     8775     => '\ensuremath{\ncong}',      8775     => '\ensuremath{\ncong}',
       8776     => '\ensuremath{\approx}',
       'approx' => '\ensuremath{\approx}', 
     8778     => '\ensuremath{\approxeq}',      8778     => '\ensuremath{\approxeq}',
       'approxeq' => '\ensuremath{\approxeq}',
     8784     => '\ensuremath{\doteq}',      8784     => '\ensuremath{\doteq}',
     8785     => '\ensuremath{\doteqdot}',      8785     => '\ensuremath{\doteqdot}',
     8786     => '\ensuremath{\fallingdotseq}',      8786     => '\ensuremath{\fallingdotseq}',
Line 1101  my %entities = ( Line 969  my %entities = (
   
 =pod  =pod
   
 =item *  =head1 UNICODE TABLE
   
   =over
   
     There are some named entities that don't have a good      There are some named entities that don't have a good
     latex equivalent, these are converted to utf-8 via this table      latex equivalent, these are converted to utf-8 via this table
     of entity name -> unicode number.      of entity name -> unicode number.
   
   =back
   
 =cut  =cut
   
 my  %utf_table = (  my  %utf_table = (
Line 1200  __END__ Line 1072  __END__
   
 =pod  =pod
   
   =head1 NAME
   
   Apache::entities.pm
   
   =head1 SYNOPSIS
   
   This file contains a table driven entity-->latex converter.
   
   This is part of the LearningOnline Network with CAPA project
   described at http://www.lon-capa.org.
   
   =head1 OVERVIEW
   
   
   Assumptions:
    The number of entities in a resource is small compared with the
    number of possible entities that might be translated.
    Therefore the strategy is to match a general entity pattern
    &.+; over and over, pull out the match look it up in an entity -> tex hash
    and do the replacement.
   
   In order to simplify the hash, the following reductions are done:
    &#d+; have the &# and ; stripped and is converted to an int.
    &#.+; have the &#x and ; stripped and is converted to an int as a hex
                              value.
    All others have the & and ; stripped.
   
   
   The hash:  Add new conversions here; leave off the leading & and the trailing ;
   all numeric entities need only appear as their decimal versions
   (e.g. no need for 1234 is sufficient, no need for 0x4d2 as well.
   
   This entity table is mercilessly cribbed from the  HTML pocket reference
   table starting at pg 82.  In most cases the LaTeX equivalent codes come from
   the original massive regular expression replacements originally by 
   A. Sakharuk in lonprintout.pm
   
   I also want to acknowledge
    ISO Character entities and their LaTeX equivalents by 
       Vidar Bronken Gundersen, and Rune Mathisen
     http://www.bitjungle.com/isoent-ref.pdf
   
   
   Note numerical entities are essentially unicode character codes.
   
   
   =head1 SUBROUTINES
   
   =over
   
   =item entity_to_utf8()
   
   
   Convert a numerical entity (that does not exist in our hash)
    to its UTF-8 equivalent representation.
    This allows us to support, to some extent, any entity for which
    dvipdf can find a gylph (given that LaTeX is now UTF-8 clean).
   
   Parameters:
     unicode  - The unicode for the character.  This is assumed to
                be a decimal value
   Returns:
     The UTF-8 equiavalent of the value.
   
   =item entity_to_latex()
   
    Convert an entity to the corresponding LateX if possible.
    If not possible, and the entity is numeric,
    the entity is treated like a Unicode character and converted
    to UTF-8 which should display as long as dvipdf can find the
    appropriate glyph.
   
    The entity is assumed to have already had the 
    &;  or & ; removed
   
   Parameters:
     entity    - Name of entity to convert.
   Returns:
    One of the following:
     - Latex string that produces the entity.
     - UTF-8 equivalent of a numeric entity for which we don't have a latex string.
     - ' ' for text entities for which there's no latex equivalent.
   
   
   =item replace_entities()
   
    Convert all the entities in a string.
    We locate all the entities, pass them into entity_to_latex and 
    and replace occurences in the input string.
    The assumption is that there are few entities in any string/document
    so this looping is not too bad.  The advantage of looping vs. regexping is
    that we now can use lookup tables for the translation in entity_to_latex above.
   
   Parameters:
     input   - Input string/document
   Returns
     input with entities replaced by latexable stuff (UTF-8 encodings or
     latex control strings to produce the entity.
   
 =back  =back
   
 =cut  =cut
Removed from v.1.14  
changed lines
  Added in v.1.23

FreeBSD-CVSweb <freebsd-cvsweb@FreeBSD.org>