Annotation of doc/help/build_exam_guide.tex, revision 1.16

1.2       vandui11    1: \documentclass[twocolumn,english]{article}
1.11      albertel    2: %\usepackage[T1]{fontenc}
1.1       vandui11    3: \usepackage[latin1]{inputenc}
1.9       felicia     4: \usepackage{epsf}
                      5: \usepackage{ulem}
                      6: \usepackage[verbose,letterpaper,tmargin=1.0in,bmargin=-0.125in,lmargin=.25in,rmargin=.25in]{geometry}
                      7: \usepackage[tiny]{titlesec}
1.1       vandui11    8: \makeatletter
                      9: \usepackage{babel}
                     10: \makeatother
1.9       felicia    11:  
1.1       vandui11   12: \begin{document}
1.9       felicia    13: \pagestyle{empty}
                     14:  
                     15: \begin{flushleft}
                     16: \textbf{\LARGE{A Guide to Building Your Exam}}
                     17: %\vspace{-.125in}
                     18: \textbf{http://www.lon-capa.org}
                     19: \end{flushleft}
                     20: \vspace{.05in} \hrule height0.6pt \hfill \vspace{ .02in} \\
                     21: \vspace{-.25in}
                     22:                                                                                 
1.7       vandui11   23: 
                     24: 
1.15      raeburn    25: \part*{Bubblesheet Exams}
1.1       vandui11   26: 
1.3       vandui11   27: \section*{Creating a Folder}
1.1       vandui11   28: 
                     29: \begin{itemize}
                     30: \item Select {[}DOCS{]} from the Remote Control or Main Menu. This will
                     31: take you to the Course Documents screen, where you can import or upload
                     32: new documents to use in your course.
1.8       vandui11   33: \item Click the {[}New Folder{]} button and name accordingly. Ex: Exam 1 
1.1       vandui11   34: \end{itemize}
1.4       vandui11   35: NOTE: You may wish to hide the folder so that students do not have
1.7       vandui11   36: access. Check the Hidden option next to your folder on the {[}DOCS{]}
1.4       vandui11   37: screen. Click the {[}Store Parameters{]} button to save.
                     38: 
1.1       vandui11   39: 
1.3       vandui11   40: \section*{Choosing Exam Questions}
1.1       vandui11   41: 
                     42: \begin{itemize}
1.10      felicia    43: \item Add questions to your folder with {[}Import{]}, {[}Search{]}, {[}Load
                     44: Map{]}, or {[}Simple Problem{]}. At this point, your exam will look like homework. 
1.1       vandui11   45: \end{itemize}
1.3       vandui11   46: 
1.12      felicia    47: \section*{How Questions will be Scored}
                     48: 
                     49: \begin{itemize}
                     50: \item For all response types except for option and match response, each part in
                     51: a multi-part question is graded as if it were a separate problem. In other words
                     52: , a problem with weight of three and two parts will be printed as two separate 
                     53: problems each with a weight of three.  Multi-response questions require the 
                     54: student to get all numbered responses correct to get the problem correct. You 
                     55: can tell the difference between a multi-part and multi-response question online.
                     56: For multi-part questions, each part will have its own submit answer button. 
                     57: \item Option response and match response submissions are scored leniently.  This means if an option response question gives four foil statements to the student and is worth a weight of 4, each foil will be scored for one point. If there are multiple option or match responses in one part, then the entire problem is scored leniently regardless if each response is in its own part.  This is different behavior from all other response types.
1.16    ! raeburn    58: \item Essay, formula, and string response questions must be hand-graded.  The instructor can hand-grade online or indicate the grade on the bubblesheet.  If the hand-graded question should receive 5 points then the letter E is bubbled in. If the hand-graded question should receive 15 points then J is bubbled in on the first line (10 points) and E is bubbled in on the second line (5 points) for a total of 15 points.  If the question should receive no credit, then nothing is bubbled in.
1.12      felicia    59: \end{itemize}
                     60:  
1.3       vandui11   61: \section*{Setting the Question Type }
1.1       vandui11   62: 
                     63: \begin{itemize}
                     64: \item Select {[}PARM{]} on the Remote Control or Main Menu. This will take
                     65: you to the Set/Modify Course Parameters screen.
1.5       vandui11   66: \item Scroll down to the \textsf{Course Assessment Parameter - Table Mode}
1.1       vandui11   67: section.
1.7       vandui11   68: \item Choose your exam folder from the drop-down menu under {[}Select Enclosing
                     69: Map or Folder{]}.
1.1       vandui11   70: \item Click the {[}Set/Modify Course Parameters{]} button. This will load
1.3       vandui11   71: a new page with your Parameter Table at the bottom.
1.7       vandui11   72: \item Click the {[}--{]} in the {[}Default Value{]} column next to {[}Question
                     73: Type (type){]}. This will give you a pop-up menu of question type
1.1       vandui11   74: options.
1.9       felicia    75: \item Select the {[}Exam{]} option and then click \uline{Store} to save
1.1       vandui11   76: your choice.
1.9       felicia    77: \item Your Parameter Table will now show 'exam' in both the {[}Default Value{]}
1.1       vandui11   78: column and the {[}Parameter in Effect{]} column. 
1.4       vandui11   79: \item You also need to set the number of bubbles for numerical questions.
1.7       vandui11   80: Click the {[}---{]} in the {[}Default Value{]} column next to {[}Number
                     81: of bubbles in exam mode (numbubbles){]}. This will give you a pop-up
                     82: menu of bubble number options. After specifying a number, click the
                     83: Store link to save your choice. 
1.4       vandui11   84: \end{itemize}
                     85: NOTE: The default number of bubbles is 8. LON-CAPA will generate random
                     86: wrong answers if wrong answers are not coded in the problem. Ex: If
                     87: you specify 5 bubbles in exam mode and 4 bubbles for your exam folder,
                     88: 5 bubbles will still appear. 
                     89: 
1.3       vandui11   90: \section*{Printing Your Exam}
1.1       vandui11   91: 
                     92: \begin{itemize}
1.3       vandui11   93: \item Use the {[}NAV{]} button to return to your exam folder.
                     94: \item Select one problem from the exam folder you created.
1.1       vandui11   95: \item Select {[}PRT{]} from the Remote Control or Main Menu. This will take
                     96: you to the Printing Helper screen.
1.7       vandui11   97: \item Choose the {[}Problems from (name of folder) for anonymous students{]}
                     98: printing option if you are using coded exams (exams without student
                     99: names printed on them). Choose the {[}Problems from (name of folder)
                    100: for selected students{]} printing option if you are using named exams
1.3       vandui11  101: (exams with student names printed on them). Click the {[}Next{]} button
                    102: to continue.
1.1       vandui11  103: \item At the Select Students and Resources screen, you can choose the number
                    104: of exams you want to print. 
                    105: \end{itemize}
                    106: NOTE: It is recommended that you store (save) the CODEs to a file
                    107: for later, though it is not necessary.
                    108: 
                    109: \begin{itemize}
                    110: \item Click the {[}Next{]} button to continue.
1.9       felicia   111: \item You will be directed to the Creating PDF screen. Click \uline{Click here
1.7       vandui11  112: to download pdf}
1.1       vandui11  113: \item After the PDFs are downloaded, you can print your exams. 
                    114: \end{itemize}
                    115: NOTE: You will need to do some testing to add blank pages/columns
1.9       felicia   116: to make sure the different student exams don't run together. 
1.1       vandui11  117: 
                    118: 
1.3       vandui11  119: \section*{Scoring Your Exam}
                    120: 
                    121: \begin{itemize}
                    122: \item Select {[}NAV{]} on the Remote Control or Main Menu. This will take
                    123: you to the Navigate Course Contents page.
                    124: \item Select the first problem in your exam set.
                    125: \item Select {[}PGRD{]} from the Remote Control or Main Menu. This will
                    126: take you to the Manual Grading/View Submission screen.
1.16    ! raeburn   127: \item Click the {}``Grade/Manage/Review Bubblesheets'' link. This will take you to
1.3       vandui11  128: the next Grading screen, where you will fill out the top section depending
1.7       vandui11  129: on if you use coded or named exams.
1.5       vandui11  130: \item In the \textsf{Sequence to grade} section, the system will automatically
1.4       vandui11  131: select the sequence you are in. If you should be in another sequence,
1.3       vandui11  132: you can choose this sequence from the drop down menu.
1.5       vandui11  133: \item In the \textsf{Filename of scoring office file} section, the scoring
1.3       vandui11  134: office generally uploads the filename. You also have the option to
1.15      raeburn   135: specify a bubblesheet data file to upload by browsing for the data file
                    136: and clicking the {[}Upload Bubblesheet Data{]} button.
1.5       vandui11  137: \item In the \textsf{Format of data file} section, use MSU with CODE in separate
1.7       vandui11  138: location for coded exams and MSU without any CODE for named exams.
                    139: \item In the \textsf{Saved CODES to validate against} section: leave blank
1.3       vandui11  140: unless you saved the CODEs file earlier.
1.5       vandui11  141: \item In the \textsf{Each CODE is only to be used once} section, choose No
1.9       felicia   142: if you don't use separately coded exams for each student. Ex: You
1.3       vandui11  143: use 10 variations for a class of 200. If you do use separately coded
                    144: exams, leave the default Yes.
1.7       vandui11  145: \item In the \textsf{Options} section, check the Do only previously skipped
                    146: records option only if you wish to go through skipped records. If
1.3       vandui11  147: you select this option, you have to complete all of the skipped records.
                    148: The file will erase if you exit without completing.
1.15      raeburn   149: \item Click the {[}Validate Bubblesheet Records{]} button. This will take you
1.3       vandui11  150: to the next grading page where you need to double-check your information.
                    151: \item If the information is incorrect, click the {[}Grading Menu{]} button.
                    152: This will take you back to the Manual Grading/View Submission screen.
                    153: \item If the information is correct, click the {[}Validate Records{]} button.
                    154: This will process the information and let you know about any errors.
1.16    ! raeburn   155: \item You will then be shown errors that need to be compared to the bubblesheets. 
1.3       vandui11  156: \end{itemize}
                    157: NOTE: The errors are (double bubble), (missing bubble), (incorrect
1.16    ! raeburn   158: id), (incorrect name), or (incorrect code). You will need the
        !           159: bubblesheets for (double bubble) or (missing bubble) errors.
1.3       vandui11  160: 
                    161: \begin{itemize}
1.4       vandui11  162: \item You have the option to skip an error or continue. If you choose to
                    163: fix the error, click continue. If you choose to skip the error, the
                    164: information about your student will save to a skipped records file
                    165: for later grading. If you continue, you will have several options. 
1.16    ! raeburn   166: \item LON-CAPA will help you fix the error by providing the bubblesheet paper
        !           167: sequence number of the student so you can compare it to the physical
        !           168: bubblesheet. Many students who forget to bubble in their name or
        !           169: ID usually write this information on the bubblesheet 
1.4       vandui11  170: \item In the cases of incorrect student ID, misspelled name, and incorrect
                    171: code with specified code file, LON-CAPA will provide you with the
                    172: closest matches to choose from. In the case of a missing code or incorrect
                    173: code with no code file, you will need to track down which code the
                    174: student used. 
1.3       vandui11  175: \item After you correct the errors, click the {[}Start Grading{]} button.
                    176: This will take you to the next screen where you will see how much
1.15      raeburn   177: time remains in the Bubblesheet grading process.
1.8       vandui11  178: \item Once this process is completed, select {[}CHRT{]} from the Remote Control or Main Menu. This will take you to the Course Statistics
1.3       vandui11  179: and Charts screen.
                    180: \item Select your exam name, HTML with links, and Score summary to view
                    181: the exam results. 
                    182: \end{itemize}
1.1       vandui11  183: 
1.3       vandui11  184: \section*{Providing Answers}
1.1       vandui11  185: 
                    186: \begin{itemize}
                    187: \item After scoring the exam, unhide the folder if it is hidden. However,
1.9       felicia   188: make sure your students can't access and retake the exam. 
1.7       vandui11  189: \item If coded exams were given, students will be able to view the randomized
1.4       vandui11  190: version of the paper exam they took, after scoring is completed.
1.9       felicia   191: 
1.1       vandui11  192: \item You can make the answers visible to your students by setting the answer
1.9       felicia   193: date parameter.  The answer date parameter will not work unless an open date and due date have been set.
1.1       vandui11  194: \item Select {[}PARM{]} on the Remote Control or Main Menu. This will take
                    195: you to the Set/Modify Course Parameters screen.
1.6       felicia   196: \item Scroll down to the \textsf{Course Assessment Parameter - Table Mode}
1.1       vandui11  197: section.
1.7       vandui11  198: \item Choose your exam folder from the drop-down menu under {[}Select Enclosing
                    199: Map or Folder{]}.
1.1       vandui11  200: \item Click the {[}Set/Modify Course Parameters{]} button. This will load
                    201: a new page, with your Parameter Table at the bottom.
1.7       vandui11  202: \item Click the {[}--{]} in the {[}Default Value{]} column next to {[}Problem
                    203: Answer Date (answerdate){]}. This will give you a pop-up menu of open
                    204: answer date options.
1.9       felicia   205: \item Set the open answer date and then click \uline{Store} to save your
1.1       vandui11  206: choice.
1.9       felicia   207: \item Your Parameter Table will now show the open answer date in the {[}Default
                    208: Value{]} column. 
                    209: \item Set the due date parameter next.  Make sure that the due date is dated before the answer date.  The due date should be set to some date that has passed. This way, it will be impossible for students to submit answers online.
                    210: \item Set the open date for a date before the due date.
                    211: \end{itemize}
                    212: 
                    213: \part*{Online Exams}
                    214: 
                    215: \section*{Creating a Folder}
                    216: 
                    217: \begin{itemize}
                    218: \item Select {[}DOCS{]} from the Remote Control or Main Menu. This will
                    219: take you to the Course Documents screen, where you can import or upload
                    220: new documents to use in your course.
                    221: \item Click the {[}New Folder{]} button and name accordingly. Ex: Exam 1 
                    222: \end{itemize}
                    223: NOTE: You may wish to hide the folder so that students do not have
                    224: access while you are building your exam. Check the Hidden option next to your 
                    225: folder on the {[}DOCS{]} screen. Click the {[}Store Parameters{]} button to save.
                    226: 
                    227: \section*{Choosing Exam Questions}
                    228:                                                                                 
                    229: \begin{itemize}
                    230: \item Add questions to your folder with {[}Import{]}, {[}Search{]}, or {[}Load
                    231: Map{]}. At this point, your exam will look like homework.
                    232: \end{itemize}
                    233: 
                    234: \section*{Setting Online Exam Parameters}
                    235: \begin{itemize}
                    236: \item Select {[}PARM{]} from the Remote Control or Main Menu. This will
                    237: take you to the Course Parameters screen, where you can set the open date, due
                    238: date, and answer open date just like you do for homework.  
                    239: \item You may wish to give your students a time-limit to complete their exam. Use the table mode and click the {[}--{]} in the {[}Default Value{]} column next to {[}Time-Limit (interval){]}. This will give you a pop-up window where you can set how long a student has to complete the exam once it is accessed between the open date and due date.
                    240: \item To inhibit students from seeing if they got a problem correct, click the {[}--{]} in the {[}Default Value{]} column next to {[}Show Problem Status (problemstatus){]} and choose No.  Multiple tries behave like a virtual eraser and the last submission recorded by the student is the one that is graded.
                    241: \item To only allow students to access the exam from specific comptuters, click the {[}--{]} in the {[}Default Value{]} column next to {[}Client IP/Name Access Control (acc){]}. In the window that pops up, you can type in the specific IP address or hostname, ex. \texttt{s1.lite.msu.edu} or \texttt{35.9.119.101}.  You can also specify a range such as \texttt{35.8.*}, \texttt{*.msu.edu}, \texttt{35.8.[35-49]}.  You can enter a comma-separated list of multiple values as well.
                    242: \end{itemize}
                    243: 
                    244: 
                    245: 
                    246: \section*{Disabling Communication During Exams}
                    247: 
                    248: \begin{itemize}
                    249: \item There are three kinds of communication functions available in LON-CAPA:
1.14      hauer     250: chat room, discussion board, and internal e-mail. Students also can store information in their portfolio.
1.9       felicia   251: 
                    252: \end{itemize}
                    253: 
1.14      hauer     254: \subsection*{Chat Room}
1.9       felicia   255: 
                    256: \begin{itemize}
1.14      hauer     257: \item To set the chat room, select {[}PARM{]} on the Remote Control
1.9       felicia   258: or Main Menu. This will take you to the Set/Modify Course Parameters
                    259: screen.
                    260: \item Click the {[}Set Course Environment Parameters{]} button. This will
                    261: take you to a new page. 
1.13      hauer     262: \item Scroll down to {[}Disallow chat room use for Roles{]} or {[}Disallow
                    263: chat room use for User{]}.
1.9       felicia   264: \item To deactivate chat for specific roles, enter a comma-separated list
1.14      hauer     265: of roles. Ex: {}``st'' for student. To deactivate the chat room for a specific
1.9       felicia   266: user, enter username:domain.
                    267: \item Check the {[}Set{]} option if it isn't checked by default already.
                    268: \item Scroll down and click the {[}Set Course Environment{]} button. Changes
                    269: will take effect the next time the user(s) enter the course.
                    270: \end{itemize}
                    271: 
                    272: \subsection*{Discussion}
                    273: 
                    274: \begin{itemize}
                    275: \item To set the discussion function, select {[}PARM{]} on the Remote Control
                    276: or Main Menu. This will take you to the Set/Modify Course Parameters
                    277: screen.
                    278: \item Scroll down to the \textsf{Course Assessment Parameter - Table Mode}
                    279: section.
                    280: \item Choose your exam folder from the drop-down menu under {[}Select Enclosing
                    281: Map or Folder{]}.
                    282: \item Click the {[}Set/Modify Course Parameters{]} button. This will load
                    283: a new page with your Parameter Table at the bottom.
                    284: \item Click the {[}---{]} in the {[}Default Value{]} column next to {[}Discussion
                    285: End Time{]}. This will give you a pop-up menu of date and time options.
                    286: The drop-down menu will automatically direct you to specify the ending
                    287: date. You can also specify the starting date or the time interval.
                    288: After setting the date and time, click \uline{Store} to save your
                    289: choice. 
                    290: \end{itemize}
                    291: 
                    292: \subsection*{Internal Email}
                    293: 
                    294: \begin{itemize}
                    295: \item Select {[}COM{]} from the Remote Control or Main Menu. This will take
                    296: you to the Communication and Messages screen.
                    297: \item Click \uline{Configure blocking of student communication during exams} 
                    298: \end{itemize}
                    299: NOTE: Students will still be able to access previous emails. They
                    300: will be able to send emails, but cannot receive emails during the
                    301: set time.
                    302: 
                    303: \begin{itemize}
                    304: \item Select the start and end dates and times for the exam and click the
                    305: {[}Save Changes{]} button.
                    306: \end{itemize}
                    307: NOTE: You MUST set an end date or communication will be blocked for
                    308: all of the student's LON-CAPA courses.
                    309: 
                    310: 
                    311: \subsection*{Portfolio}
                    312: 
                    313: \begin{itemize}
                    314: \item The portfolio function is available and viewable by students only.
                    315: You will not be able to deactivate the portfolio during exams. 
1.1       vandui11  316: \end{itemize}
                    317: 
1.9       felicia   318: 
1.1       vandui11  319: \end{document}

FreeBSD-CVSweb <freebsd-cvsweb@FreeBSD.org>