--- doc/help/build_exam_guide.tex 2004/12/10 14:17:46 1.1 +++ doc/help/build_exam_guide.tex 2006/02/10 19:42:00 1.12 @@ -1,91 +1,105 @@ -%% LyX 1.3 created this file. For more info, see http://www.lyx.org/. -%% Do not edit unless you really know what you are doing. -\documentclass[english]{article} -\usepackage[T1]{fontenc} +\documentclass[twocolumn,english]{article} +%\usepackage[T1]{fontenc} \usepackage[latin1]{inputenc} - +\usepackage{epsf} +\usepackage{ulem} +\usepackage[verbose,letterpaper,tmargin=1.0in,bmargin=-0.125in,lmargin=.25in,rmargin=.25in]{geometry} +\usepackage[tiny]{titlesec} \makeatletter \usepackage{babel} \makeatother + \begin{document} +\pagestyle{empty} + +\begin{flushleft} +\textbf{\LARGE{A Guide to Building Your Exam}} +%\vspace{-.125in} +\textbf{http://www.lon-capa.org} +\end{flushleft} +\vspace{.05in} \hrule height0.6pt \hfill \vspace{ .02in} \\ +\vspace{-.25in} + -\part*{A Guide to Building Your Exam} - -http://www.lon-capa.org +\part*{Scantron Exams} -\section*{CREATING A FOLDER} +\section*{Creating a Folder} \begin{itemize} \item Select {[}DOCS{]} from the Remote Control or Main Menu. This will take you to the Course Documents screen, where you can import or upload new documents to use in your course. -\item Click the {[}New Folder{]} button and name accordingly. -\item You can choose to hide the folder by using the {[}Parameters{]} button. -If you donât hide the folder, you will need to set the open and due -dates so that students will not be able to access the problems. +\item Click the {[}New Folder{]} button and name accordingly. Ex: Exam 1 \end{itemize} +NOTE: You may wish to hide the folder so that students do not have +access. Check the Hidden option next to your folder on the {[}DOCS{]} +screen. Click the {[}Store Parameters{]} button to save. + -\section*{CHOOSING QUIZ QUESTIONS} +\section*{Choosing Exam Questions} \begin{itemize} -\item Click the {[}Import{]} button on the DOCS screen. -\item Browse published quiz problems from the LON-CAPA resource pool. -\item Select the quiz questions you wish to use. -\item Click the {[}Import{]} button to add questions to your course folder. -\item Make changes and click the {[}re-initializing course{]} button to -load your quiz questions into the selected folder. +\item Add questions to your folder with {[}Import{]}, {[}Search{]}, {[}Load +Map{]}, or {[}Simple Problem{]}. At this point, your exam will look like homework. \end{itemize} -\section*{SETTING THE QUESTION TYPE } +\section*{How Questions will be Scored} + +\begin{itemize} +\item For all response types except for option and match response, each part in +a multi-part question is graded as if it were a separate problem. In other words +, a problem with weight of three and two parts will be printed as two separate +problems each with a weight of three. Multi-response questions require the +student to get all numbered responses correct to get the problem correct. You +can tell the difference between a multi-part and multi-response question online. +For multi-part questions, each part will have its own submit answer button. +\item Option response and match response submissions are scored leniently. This means if an option response question gives four foil statements to the student and is worth a weight of 4, each foil will be scored for one point. If there are multiple option or match responses in one part, then the entire problem is scored leniently regardless if each response is in its own part. This is different behavior from all other response types. +\item Essay, formula, and string response questions must be hand-graded. The instructor can hand-grade online or indicate the grade on the scantron sheet. If the hand-graded question should receive 5 points then the letter E is bubbled in. If the hand-graded question should receive 15 points then J is bubbled in on the first line (10 points) and E is bubbled in on the second line (5 points) for a total of 15 points. If the question should receive no credit, then nothing is bubbled in. +\end{itemize} + +\section*{Setting the Question Type } \begin{itemize} \item Select {[}PARM{]} on the Remote Control or Main Menu. This will take you to the Set/Modify Course Parameters screen. -\item Scroll down to the {[}Course Assessment Parameter - Table Mode{]} +\item Scroll down to the \textsf{Course Assessment Parameter - Table Mode} section. -\item Choose your quiz folder from the drop-down menu under {[}Select Enclosing +\item Choose your exam folder from the drop-down menu under {[}Select Enclosing Map or Folder{]}. \item Click the {[}Set/Modify Course Parameters{]} button. This will load -a new page, with your Parameter Table at the bottom. +a new page with your Parameter Table at the bottom. \item Click the {[}--{]} in the {[}Default Value{]} column next to {[}Question Type (type){]}. This will give you a pop-up menu of question type options. -\item Select the {[}Exam{]} option and then click the Store link to save +\item Select the {[}Exam{]} option and then click \uline{Store} to save your choice. -\item Your Parameter Table will now show âexamâ in both the {[}Default Value{]} +\item Your Parameter Table will now show 'exam' in both the {[}Default Value{]} column and the {[}Parameter in Effect{]} column. +\item You also need to set the number of bubbles for numerical questions. +Click the {[}---{]} in the {[}Default Value{]} column next to {[}Number +of bubbles in exam mode (numbubbles){]}. This will give you a pop-up +menu of bubble number options. After specifying a number, click the +Store link to save your choice. \end{itemize} +NOTE: The default number of bubbles is 8. LON-CAPA will generate random +wrong answers if wrong answers are not coded in the problem. Ex: If +you specify 5 bubbles in exam mode and 4 bubbles for your exam folder, +5 bubbles will still appear. -\section*{PRINTING YOUR EXAM} - - -\subsection*{Run a Test Print} +\section*{Printing Your Exam} \begin{itemize} -\item You will first want to run a test print of one of your quiz questions. -\item Select {[}NAV{]} from the Remote Control or Main Menu to return to -the Navigate Course Contents page. -\item Select one problem from the quiz folder you created. +\item Use the {[}NAV{]} button to return to your exam folder. +\item Select one problem from the exam folder you created. \item Select {[}PRT{]} from the Remote Control or Main Menu. This will take you to the Printing Helper screen. -\item The problem you selected will be your first printing option. Click -the {[}Next{]} button to continue. -\item You will be directed to the Creating PDF screen. Click the Click here -to download pdf link. -\item After the PDF is downloaded, print a copy of the question to complete -your test print. -\end{itemize} - -\subsection*{Print Your Exams} - -\begin{itemize} -\item Use the {[}NAV{]} button to return to your quiz folder. -\item Select one problem from the quiz folder you created. -\item Select {[}PRT{]} from the Remote Control or Main Menu. This will take -you to the Printing Helper screen. -\item This time, choose the {[}Problems from Quiz 1 for anonymous students{]} -printing option. Click the {[}Next{]} button to continue. +\item Choose the {[}Problems from (name of folder) for anonymous students{]} +printing option if you are using coded exams (exams without student +names printed on them). Choose the {[}Problems from (name of folder) +for selected students{]} printing option if you are using named exams +(exams with student names printed on them). Click the {[}Next{]} button +to continue. \item At the Select Students and Resources screen, you can choose the number of exams you want to print. \end{itemize} @@ -94,39 +108,212 @@ for later, though it is not necessary. \begin{itemize} \item Click the {[}Next{]} button to continue. -\item You will be directed to the Creating PDF screen. Click the Click here -to download pdf link. +\item You will be directed to the Creating PDF screen. Click \uline{Click here +to download pdf} \item After the PDFs are downloaded, you can print your exams. \end{itemize} NOTE: You will need to do some testing to add blank pages/columns -to make sure the different student exams donât run together. +to make sure the different student exams don't run together. -\section*{SCORING YOUR EXAM } +\section*{Scoring Your Exam} +\begin{itemize} +\item Select {[}NAV{]} on the Remote Control or Main Menu. This will take +you to the Navigate Course Contents page. +\item Select the first problem in your exam set. +\item Select {[}PGRD{]} from the Remote Control or Main Menu. This will +take you to the Manual Grading/View Submission screen. +\item Click the {[}Grade{]} scantron forms button. This will take you to +the next Grading screen, where you will fill out the top section depending +on if you use coded or named exams. +\item In the \textsf{Sequence to grade} section, the system will automatically +select the sequence you are in. If you should be in another sequence, +you can choose this sequence from the drop down menu. +\item In the \textsf{Filename of scoring office file} section, the scoring +office generally uploads the filename. You also have the option to +specify a scantron data file to upload by browsing for the data file +and clicking the {[}Upload Scantron Data{]} button. +\item In the \textsf{Format of data file} section, use MSU with CODE in separate +location for coded exams and MSU without any CODE for named exams. +\item In the \textsf{Saved CODES to validate against} section: leave blank +unless you saved the CODEs file earlier. +\item In the \textsf{Each CODE is only to be used once} section, choose No +if you don't use separately coded exams for each student. Ex: You +use 10 variations for a class of 200. If you do use separately coded +exams, leave the default Yes. +\item In the \textsf{Options} section, check the Do only previously skipped +records option only if you wish to go through skipped records. If +you select this option, you have to complete all of the skipped records. +The file will erase if you exit without completing. +\item Click the {[}Validate Scantron Records{]} button. This will take you +to the next grading page where you need to double-check your information. +\item If the information is incorrect, click the {[}Grading Menu{]} button. +This will take you back to the Manual Grading/View Submission screen. +\item If the information is correct, click the {[}Validate Records{]} button. +This will process the information and let you know about any errors. +\item You will then be shown errors that need to be compared to the scantrons. +\end{itemize} +NOTE: The errors are (double bubble), (missing bubble), (incorrect +id), (incorrect name), or (incorrect code). You will need the scantron +bubble sheets for (double bubble) or (missing bubble) errors. -\section*{PROVIDING ANSWERS} +\begin{itemize} +\item You have the option to skip an error or continue. If you choose to +fix the error, click continue. If you choose to skip the error, the +information about your student will save to a skipped records file +for later grading. If you continue, you will have several options. +\item LON-CAPA will help you fix the error by providing the scantron paper +sequence number of the student so you can compare it to the scantron +bubble sheet. Many students who forget to bubble in their name or +ID usually write this information on the scantron form. +\item In the cases of incorrect student ID, misspelled name, and incorrect +code with specified code file, LON-CAPA will provide you with the +closest matches to choose from. In the case of a missing code or incorrect +code with no code file, you will need to track down which code the +student used. +\item After you correct the errors, click the {[}Start Grading{]} button. +This will take you to the next screen where you will see how much +time remains in the Scantron process. +\item Once this process is completed, select {[}CHRT{]} from the Remote Control or Main Menu. This will take you to the Course Statistics +and Charts screen. +\item Select your exam name, HTML with links, and Score summary to view +the exam results. +\end{itemize} + +\section*{Providing Answers} \begin{itemize} \item After scoring the exam, unhide the folder if it is hidden. However, -make sure your students canât access and retake the exam. +make sure your students can't access and retake the exam. +\item If coded exams were given, students will be able to view the randomized +version of the paper exam they took, after scoring is completed. + \item You can make the answers visible to your students by setting the answer -date parameter. +date parameter. The answer date parameter will not work unless an open date and due date have been set. \item Select {[}PARM{]} on the Remote Control or Main Menu. This will take you to the Set/Modify Course Parameters screen. -\item Scroll down to the {[}Course Assessment Parameter - Table Mode{]} +\item Scroll down to the \textsf{Course Assessment Parameter - Table Mode} section. -\item Choose your quiz folder from the drop-down menu under {[}Select Enclosing +\item Choose your exam folder from the drop-down menu under {[}Select Enclosing Map or Folder{]}. \item Click the {[}Set/Modify Course Parameters{]} button. This will load a new page, with your Parameter Table at the bottom. \item Click the {[}--{]} in the {[}Default Value{]} column next to {[}Problem Answer Date (answerdate){]}. This will give you a pop-up menu of open answer date options. -\item Set the open answer date and then click the Store link to save your +\item Set the open answer date and then click \uline{Store} to save your choice. -\item Your Parameter Table will now show the open date in both the {[}Default -Value{]} column and the {[}Parameter in Effect{]} column. +\item Your Parameter Table will now show the open answer date in the {[}Default +Value{]} column. +\item Set the due date parameter next. Make sure that the due date is dated before the answer date. The due date should be set to some date that has passed. This way, it will be impossible for students to submit answers online. +\item Set the open date for a date before the due date. +\end{itemize} + +\part*{Online Exams} + +\section*{Creating a Folder} + +\begin{itemize} +\item Select {[}DOCS{]} from the Remote Control or Main Menu. This will +take you to the Course Documents screen, where you can import or upload +new documents to use in your course. +\item Click the {[}New Folder{]} button and name accordingly. Ex: Exam 1 +\end{itemize} +NOTE: You may wish to hide the folder so that students do not have +access while you are building your exam. Check the Hidden option next to your +folder on the {[}DOCS{]} screen. Click the {[}Store Parameters{]} button to save. + +\section*{Choosing Exam Questions} + +\begin{itemize} +\item Add questions to your folder with {[}Import{]}, {[}Search{]}, or {[}Load +Map{]}. At this point, your exam will look like homework. +\end{itemize} + +\section*{Setting Online Exam Parameters} +\begin{itemize} +\item Select {[}PARM{]} from the Remote Control or Main Menu. This will +take you to the Course Parameters screen, where you can set the open date, due +date, and answer open date just like you do for homework. +\item You may wish to give your students a time-limit to complete their exam. Use the table mode and click the {[}--{]} in the {[}Default Value{]} column next to {[}Time-Limit (interval){]}. This will give you a pop-up window where you can set how long a student has to complete the exam once it is accessed between the open date and due date. +\item To inhibit students from seeing if they got a problem correct, click the {[}--{]} in the {[}Default Value{]} column next to {[}Show Problem Status (problemstatus){]} and choose No. Multiple tries behave like a virtual eraser and the last submission recorded by the student is the one that is graded. +\item To only allow students to access the exam from specific comptuters, click the {[}--{]} in the {[}Default Value{]} column next to {[}Client IP/Name Access Control (acc){]}. In the window that pops up, you can type in the specific IP address or hostname, ex. \texttt{s1.lite.msu.edu} or \texttt{35.9.119.101}. You can also specify a range such as \texttt{35.8.*}, \texttt{*.msu.edu}, \texttt{35.8.[35-49]}. You can enter a comma-separated list of multiple values as well. +\end{itemize} + + + +\section*{Disabling Communication During Exams} + +\begin{itemize} +\item There are three kinds of communication functions available in LON-CAPA: +chat, discussion, and internal email. Students also can store information in their portfolio. + \end{itemize} +\subsection*{Chat} + +\begin{itemize} +\item To set the chat function, select {[}PARM{]} on the Remote Control +or Main Menu. This will take you to the Set/Modify Course Parameters +screen. +\item Click the {[}Set Course Environment Parameters{]} button. This will +take you to a new page. +\item Scroll down to {[}Disallow live chatroom use for Roles{]} or {[}Disallow +live chatroom use for User{]}. +\item To deactivate chat for specific roles, enter a comma-separated list +of roles. Ex: {}``st'' for student. To deactivate chat for a specific +user, enter username:domain. +\item Check the {[}Set{]} option if it isn't checked by default already. +\item Scroll down and click the {[}Set Course Environment{]} button. Changes +will take effect the next time the user(s) enter the course. +\end{itemize} + +\subsection*{Discussion} + +\begin{itemize} +\item To set the discussion function, select {[}PARM{]} on the Remote Control +or Main Menu. This will take you to the Set/Modify Course Parameters +screen. +\item Scroll down to the \textsf{Course Assessment Parameter - Table Mode} +section. +\item Choose your exam folder from the drop-down menu under {[}Select Enclosing +Map or Folder{]}. +\item Click the {[}Set/Modify Course Parameters{]} button. This will load +a new page with your Parameter Table at the bottom. +\item Click the {[}---{]} in the {[}Default Value{]} column next to {[}Discussion +End Time{]}. This will give you a pop-up menu of date and time options. +The drop-down menu will automatically direct you to specify the ending +date. You can also specify the starting date or the time interval. +After setting the date and time, click \uline{Store} to save your +choice. +\end{itemize} + +\subsection*{Internal Email} + +\begin{itemize} +\item Select {[}COM{]} from the Remote Control or Main Menu. This will take +you to the Communication and Messages screen. +\item Click \uline{Configure blocking of student communication during exams} +\end{itemize} +NOTE: Students will still be able to access previous emails. They +will be able to send emails, but cannot receive emails during the +set time. + +\begin{itemize} +\item Select the start and end dates and times for the exam and click the +{[}Save Changes{]} button. +\end{itemize} +NOTE: You MUST set an end date or communication will be blocked for +all of the student's LON-CAPA courses. + + +\subsection*{Portfolio} + +\begin{itemize} +\item The portfolio function is available and viewable by students only. +You will not be able to deactivate the portfolio during exams. +\end{itemize} + + \end{document}