Return to lonchart.test_procedure CVS log

Up to [LON-CAPA] / doc / homework

This the first attempt at a document that outlines a testing procedure for
lonchart.

    1: lonchart Test Procedure
    2: 
    3:         The procedure will show the validity of the lonchart code.  A course 
    4: called Chart Test was created to test the possible scenarios due to course 
    5: creation.  Next a series of false students will take the course.  Each student 
    6: will perform differently.  The number of students will be directly correlated 
    7: the number of grade related tests required.  The combination of these two sets 
    8: of tests will ensure the proper output of lonchart.
    9:         The course was designed to test the following: problems in the top 
   10: level sequence, problems in a sequece separated by a subsequence, problems with
   11: parts, and the correctness of a single problem resource in general.  The course
   12: is laid out beginning with a top sequence containing in order, start, problem, 
   13: sequence, problem, and finish resources.  The subsequence contains two 
   14: problems.  The first problem is a general problem containing a simple numeric 
   15: response.  The second problem contains two parts.  
   16:         The chart output should contain two columns.  The first should have two
   17: problems in it and the second should have three.  The headings for these 
   18: columns should be the title of the sequences in which they lie.
   19:         The following table outlines a series of students and their performance
   20: on homework1 sequence.  Each row in the table represents a student in the 
   21: course.  The combinations of results will test the possible outcomes lonchart 
   22: will handle.  When the table specifies just correct, it means on the first try.
   23: For the problems in the top sequence, they will all be correct on first try 
   24: except for student number two, who didn't  didn't log in.
   25: 
   26:         problem 1       problem 2 part1         part2
   27: 1.      correct(1 try)          correct         correct
   28: 2.      skip                    skip            skip
   29: 3.      12 tries                correct         skip
   30: 4.      correct(2 tries)        skip            correct
   31: 5.      +                       correct after   correct first time
   32:                                   skip first
   33: 6.      -                       correct first   correct after skip first
   34:                                   time
   35: 7.      .                       .               correct
   36: 8.      x                       correct         .
   37: 9.      correct second try      .               .
   38:           after correct by
   39:           override on first
   40:           try
   41: 
   42: 
   43: 
   44: Expected output:
   45: 
   46: student         top             homework 1      totals
   47: 1               11      2       111     3       5/5
   48: 2
   49: 3               11      2       *1      2       4/5
   50: 4               11      2       2 1     2       4/5
   51: 5               11      2       +?1     ?       ?/5
   52: 6               11      2       -1?     ?       ?/5
   53: 7               11      2       ..1     1       3/5
   54: 8               11      2       x1.     1       3/4
   55: 9               11      2       ?..     ?       ?/5