File:  [LON-CAPA] / doc / help / build_exam_guide.tex
Revision 1.15: download - view: text, annotated - select for diffs
Thu Apr 1 15:26:32 2010 UTC (13 years, 11 months ago) by raeburn
Branches: MAIN
CVS tags: HEAD
- Bug 5853.
  Scantron -> Bubblesheets

    1: \documentclass[twocolumn,english]{article}
    2: %\usepackage[T1]{fontenc}
    3: \usepackage[latin1]{inputenc}
    4: \usepackage{epsf}
    5: \usepackage{ulem}
    6: \usepackage[verbose,letterpaper,tmargin=1.0in,bmargin=-0.125in,lmargin=.25in,rmargin=.25in]{geometry}
    7: \usepackage[tiny]{titlesec}
    8: \makeatletter
    9: \usepackage{babel}
   10: \makeatother
   11:  
   12: \begin{document}
   13: \pagestyle{empty}
   14:  
   15: \begin{flushleft}
   16: \textbf{\LARGE{A Guide to Building Your Exam}}
   17: %\vspace{-.125in}
   18: \textbf{http://www.lon-capa.org}
   19: \end{flushleft}
   20: \vspace{.05in} \hrule height0.6pt \hfill \vspace{ .02in} \\
   21: \vspace{-.25in}
   22:                                                                                 
   23: 
   24: 
   25: \part*{Bubblesheet Exams}
   26: 
   27: \section*{Creating a Folder}
   28: 
   29: \begin{itemize}
   30: \item Select {[}DOCS{]} from the Remote Control or Main Menu. This will
   31: take you to the Course Documents screen, where you can import or upload
   32: new documents to use in your course.
   33: \item Click the {[}New Folder{]} button and name accordingly. Ex: Exam 1 
   34: \end{itemize}
   35: NOTE: You may wish to hide the folder so that students do not have
   36: access. Check the Hidden option next to your folder on the {[}DOCS{]}
   37: screen. Click the {[}Store Parameters{]} button to save.
   38: 
   39: 
   40: \section*{Choosing Exam Questions}
   41: 
   42: \begin{itemize}
   43: \item Add questions to your folder with {[}Import{]}, {[}Search{]}, {[}Load
   44: Map{]}, or {[}Simple Problem{]}. At this point, your exam will look like homework. 
   45: \end{itemize}
   46: 
   47: \section*{How Questions will be Scored}
   48: 
   49: \begin{itemize}
   50: \item For all response types except for option and match response, each part in
   51: a multi-part question is graded as if it were a separate problem. In other words
   52: , a problem with weight of three and two parts will be printed as two separate 
   53: problems each with a weight of three.  Multi-response questions require the 
   54: student to get all numbered responses correct to get the problem correct. You 
   55: can tell the difference between a multi-part and multi-response question online.
   56: For multi-part questions, each part will have its own submit answer button. 
   57: \item Option response and match response submissions are scored leniently.  This means if an option response question gives four foil statements to the student and is worth a weight of 4, each foil will be scored for one point. If there are multiple option or match responses in one part, then the entire problem is scored leniently regardless if each response is in its own part.  This is different behavior from all other response types.
   58: \item Essay, formula, and string response questions must be hand-graded.  The instructor can hand-grade online or indicate the grade on the scantron sheet.  If the hand-graded question should receive 5 points then the letter E is bubbled in. If the hand-graded question should receive 15 points then J is bubbled in on the first line (10 points) and E is bubbled in on the second line (5 points) for a total of 15 points.  If the question should receive no credit, then nothing is bubbled in.
   59: \end{itemize}
   60:  
   61: \section*{Setting the Question Type }
   62: 
   63: \begin{itemize}
   64: \item Select {[}PARM{]} on the Remote Control or Main Menu. This will take
   65: you to the Set/Modify Course Parameters screen.
   66: \item Scroll down to the \textsf{Course Assessment Parameter - Table Mode}
   67: section.
   68: \item Choose your exam folder from the drop-down menu under {[}Select Enclosing
   69: Map or Folder{]}.
   70: \item Click the {[}Set/Modify Course Parameters{]} button. This will load
   71: a new page with your Parameter Table at the bottom.
   72: \item Click the {[}--{]} in the {[}Default Value{]} column next to {[}Question
   73: Type (type){]}. This will give you a pop-up menu of question type
   74: options.
   75: \item Select the {[}Exam{]} option and then click \uline{Store} to save
   76: your choice.
   77: \item Your Parameter Table will now show 'exam' in both the {[}Default Value{]}
   78: column and the {[}Parameter in Effect{]} column. 
   79: \item You also need to set the number of bubbles for numerical questions.
   80: Click the {[}---{]} in the {[}Default Value{]} column next to {[}Number
   81: of bubbles in exam mode (numbubbles){]}. This will give you a pop-up
   82: menu of bubble number options. After specifying a number, click the
   83: Store link to save your choice. 
   84: \end{itemize}
   85: NOTE: The default number of bubbles is 8. LON-CAPA will generate random
   86: wrong answers if wrong answers are not coded in the problem. Ex: If
   87: you specify 5 bubbles in exam mode and 4 bubbles for your exam folder,
   88: 5 bubbles will still appear. 
   89: 
   90: \section*{Printing Your Exam}
   91: 
   92: \begin{itemize}
   93: \item Use the {[}NAV{]} button to return to your exam folder.
   94: \item Select one problem from the exam folder you created.
   95: \item Select {[}PRT{]} from the Remote Control or Main Menu. This will take
   96: you to the Printing Helper screen.
   97: \item Choose the {[}Problems from (name of folder) for anonymous students{]}
   98: printing option if you are using coded exams (exams without student
   99: names printed on them). Choose the {[}Problems from (name of folder)
  100: for selected students{]} printing option if you are using named exams
  101: (exams with student names printed on them). Click the {[}Next{]} button
  102: to continue.
  103: \item At the Select Students and Resources screen, you can choose the number
  104: of exams you want to print. 
  105: \end{itemize}
  106: NOTE: It is recommended that you store (save) the CODEs to a file
  107: for later, though it is not necessary.
  108: 
  109: \begin{itemize}
  110: \item Click the {[}Next{]} button to continue.
  111: \item You will be directed to the Creating PDF screen. Click \uline{Click here
  112: to download pdf}
  113: \item After the PDFs are downloaded, you can print your exams. 
  114: \end{itemize}
  115: NOTE: You will need to do some testing to add blank pages/columns
  116: to make sure the different student exams don't run together. 
  117: 
  118: 
  119: \section*{Scoring Your Exam}
  120: 
  121: \begin{itemize}
  122: \item Select {[}NAV{]} on the Remote Control or Main Menu. This will take
  123: you to the Navigate Course Contents page.
  124: \item Select the first problem in your exam set.
  125: \item Select {[}PGRD{]} from the Remote Control or Main Menu. This will
  126: take you to the Manual Grading/View Submission screen.
  127: \item Click the {[}Grade{]} scantron forms button. This will take you to
  128: the next Grading screen, where you will fill out the top section depending
  129: on if you use coded or named exams.
  130: \item In the \textsf{Sequence to grade} section, the system will automatically
  131: select the sequence you are in. If you should be in another sequence,
  132: you can choose this sequence from the drop down menu.
  133: \item In the \textsf{Filename of scoring office file} section, the scoring
  134: office generally uploads the filename. You also have the option to
  135: specify a bubblesheet data file to upload by browsing for the data file
  136: and clicking the {[}Upload Bubblesheet Data{]} button.
  137: \item In the \textsf{Format of data file} section, use MSU with CODE in separate
  138: location for coded exams and MSU without any CODE for named exams.
  139: \item In the \textsf{Saved CODES to validate against} section: leave blank
  140: unless you saved the CODEs file earlier.
  141: \item In the \textsf{Each CODE is only to be used once} section, choose No
  142: if you don't use separately coded exams for each student. Ex: You
  143: use 10 variations for a class of 200. If you do use separately coded
  144: exams, leave the default Yes.
  145: \item In the \textsf{Options} section, check the Do only previously skipped
  146: records option only if you wish to go through skipped records. If
  147: you select this option, you have to complete all of the skipped records.
  148: The file will erase if you exit without completing.
  149: \item Click the {[}Validate Bubblesheet Records{]} button. This will take you
  150: to the next grading page where you need to double-check your information.
  151: \item If the information is incorrect, click the {[}Grading Menu{]} button.
  152: This will take you back to the Manual Grading/View Submission screen.
  153: \item If the information is correct, click the {[}Validate Records{]} button.
  154: This will process the information and let you know about any errors.
  155: \item You will then be shown errors that need to be compared to the scantrons. 
  156: \end{itemize}
  157: NOTE: The errors are (double bubble), (missing bubble), (incorrect
  158: id), (incorrect name), or (incorrect code). You will need the scantron
  159: bubble sheets for (double bubble) or (missing bubble) errors.
  160: 
  161: \begin{itemize}
  162: \item You have the option to skip an error or continue. If you choose to
  163: fix the error, click continue. If you choose to skip the error, the
  164: information about your student will save to a skipped records file
  165: for later grading. If you continue, you will have several options. 
  166: \item LON-CAPA will help you fix the error by providing the scantron paper
  167: sequence number of the student so you can compare it to the scantron
  168: bubble sheet. Many students who forget to bubble in their name or
  169: ID usually write this information on the scantron form. 
  170: \item In the cases of incorrect student ID, misspelled name, and incorrect
  171: code with specified code file, LON-CAPA will provide you with the
  172: closest matches to choose from. In the case of a missing code or incorrect
  173: code with no code file, you will need to track down which code the
  174: student used. 
  175: \item After you correct the errors, click the {[}Start Grading{]} button.
  176: This will take you to the next screen where you will see how much
  177: time remains in the Bubblesheet grading process.
  178: \item Once this process is completed, select {[}CHRT{]} from the Remote Control or Main Menu. This will take you to the Course Statistics
  179: and Charts screen.
  180: \item Select your exam name, HTML with links, and Score summary to view
  181: the exam results. 
  182: \end{itemize}
  183: 
  184: \section*{Providing Answers}
  185: 
  186: \begin{itemize}
  187: \item After scoring the exam, unhide the folder if it is hidden. However,
  188: make sure your students can't access and retake the exam. 
  189: \item If coded exams were given, students will be able to view the randomized
  190: version of the paper exam they took, after scoring is completed.
  191: 
  192: \item You can make the answers visible to your students by setting the answer
  193: date parameter.  The answer date parameter will not work unless an open date and due date have been set.
  194: \item Select {[}PARM{]} on the Remote Control or Main Menu. This will take
  195: you to the Set/Modify Course Parameters screen.
  196: \item Scroll down to the \textsf{Course Assessment Parameter - Table Mode}
  197: section.
  198: \item Choose your exam folder from the drop-down menu under {[}Select Enclosing
  199: Map or Folder{]}.
  200: \item Click the {[}Set/Modify Course Parameters{]} button. This will load
  201: a new page, with your Parameter Table at the bottom.
  202: \item Click the {[}--{]} in the {[}Default Value{]} column next to {[}Problem
  203: Answer Date (answerdate){]}. This will give you a pop-up menu of open
  204: answer date options.
  205: \item Set the open answer date and then click \uline{Store} to save your
  206: choice.
  207: \item Your Parameter Table will now show the open answer date in the {[}Default
  208: Value{]} column. 
  209: \item Set the due date parameter next.  Make sure that the due date is dated before the answer date.  The due date should be set to some date that has passed. This way, it will be impossible for students to submit answers online.
  210: \item Set the open date for a date before the due date.
  211: \end{itemize}
  212: 
  213: \part*{Online Exams}
  214: 
  215: \section*{Creating a Folder}
  216: 
  217: \begin{itemize}
  218: \item Select {[}DOCS{]} from the Remote Control or Main Menu. This will
  219: take you to the Course Documents screen, where you can import or upload
  220: new documents to use in your course.
  221: \item Click the {[}New Folder{]} button and name accordingly. Ex: Exam 1 
  222: \end{itemize}
  223: NOTE: You may wish to hide the folder so that students do not have
  224: access while you are building your exam. Check the Hidden option next to your 
  225: folder on the {[}DOCS{]} screen. Click the {[}Store Parameters{]} button to save.
  226: 
  227: \section*{Choosing Exam Questions}
  228:                                                                                 
  229: \begin{itemize}
  230: \item Add questions to your folder with {[}Import{]}, {[}Search{]}, or {[}Load
  231: Map{]}. At this point, your exam will look like homework.
  232: \end{itemize}
  233: 
  234: \section*{Setting Online Exam Parameters}
  235: \begin{itemize}
  236: \item Select {[}PARM{]} from the Remote Control or Main Menu. This will
  237: take you to the Course Parameters screen, where you can set the open date, due
  238: date, and answer open date just like you do for homework.  
  239: \item You may wish to give your students a time-limit to complete their exam. Use the table mode and click the {[}--{]} in the {[}Default Value{]} column next to {[}Time-Limit (interval){]}. This will give you a pop-up window where you can set how long a student has to complete the exam once it is accessed between the open date and due date.
  240: \item To inhibit students from seeing if they got a problem correct, click the {[}--{]} in the {[}Default Value{]} column next to {[}Show Problem Status (problemstatus){]} and choose No.  Multiple tries behave like a virtual eraser and the last submission recorded by the student is the one that is graded.
  241: \item To only allow students to access the exam from specific comptuters, click the {[}--{]} in the {[}Default Value{]} column next to {[}Client IP/Name Access Control (acc){]}. In the window that pops up, you can type in the specific IP address or hostname, ex. \texttt{s1.lite.msu.edu} or \texttt{35.9.119.101}.  You can also specify a range such as \texttt{35.8.*}, \texttt{*.msu.edu}, \texttt{35.8.[35-49]}.  You can enter a comma-separated list of multiple values as well.
  242: \end{itemize}
  243: 
  244: 
  245: 
  246: \section*{Disabling Communication During Exams}
  247: 
  248: \begin{itemize}
  249: \item There are three kinds of communication functions available in LON-CAPA:
  250: chat room, discussion board, and internal e-mail. Students also can store information in their portfolio.
  251: 
  252: \end{itemize}
  253: 
  254: \subsection*{Chat Room}
  255: 
  256: \begin{itemize}
  257: \item To set the chat room, select {[}PARM{]} on the Remote Control
  258: or Main Menu. This will take you to the Set/Modify Course Parameters
  259: screen.
  260: \item Click the {[}Set Course Environment Parameters{]} button. This will
  261: take you to a new page. 
  262: \item Scroll down to {[}Disallow chat room use for Roles{]} or {[}Disallow
  263: chat room use for User{]}.
  264: \item To deactivate chat for specific roles, enter a comma-separated list
  265: of roles. Ex: {}``st'' for student. To deactivate the chat room for a specific
  266: user, enter username:domain.
  267: \item Check the {[}Set{]} option if it isn't checked by default already.
  268: \item Scroll down and click the {[}Set Course Environment{]} button. Changes
  269: will take effect the next time the user(s) enter the course.
  270: \end{itemize}
  271: 
  272: \subsection*{Discussion}
  273: 
  274: \begin{itemize}
  275: \item To set the discussion function, select {[}PARM{]} on the Remote Control
  276: or Main Menu. This will take you to the Set/Modify Course Parameters
  277: screen.
  278: \item Scroll down to the \textsf{Course Assessment Parameter - Table Mode}
  279: section.
  280: \item Choose your exam folder from the drop-down menu under {[}Select Enclosing
  281: Map or Folder{]}.
  282: \item Click the {[}Set/Modify Course Parameters{]} button. This will load
  283: a new page with your Parameter Table at the bottom.
  284: \item Click the {[}---{]} in the {[}Default Value{]} column next to {[}Discussion
  285: End Time{]}. This will give you a pop-up menu of date and time options.
  286: The drop-down menu will automatically direct you to specify the ending
  287: date. You can also specify the starting date or the time interval.
  288: After setting the date and time, click \uline{Store} to save your
  289: choice. 
  290: \end{itemize}
  291: 
  292: \subsection*{Internal Email}
  293: 
  294: \begin{itemize}
  295: \item Select {[}COM{]} from the Remote Control or Main Menu. This will take
  296: you to the Communication and Messages screen.
  297: \item Click \uline{Configure blocking of student communication during exams} 
  298: \end{itemize}
  299: NOTE: Students will still be able to access previous emails. They
  300: will be able to send emails, but cannot receive emails during the
  301: set time.
  302: 
  303: \begin{itemize}
  304: \item Select the start and end dates and times for the exam and click the
  305: {[}Save Changes{]} button.
  306: \end{itemize}
  307: NOTE: You MUST set an end date or communication will be blocked for
  308: all of the student's LON-CAPA courses.
  309: 
  310: 
  311: \subsection*{Portfolio}
  312: 
  313: \begin{itemize}
  314: \item The portfolio function is available and viewable by students only.
  315: You will not be able to deactivate the portfolio during exams. 
  316: \end{itemize}
  317: 
  318: 
  319: \end{document}

FreeBSD-CVSweb <freebsd-cvsweb@FreeBSD.org>