Getting Started with Graderworks

by: Anthony Garland
Follow @AnthonyPGarland

(This tutorial is for version 2.XX of Graderworks. Future versions of Graderworks are slightly different. )

If you are new to Graderworks, this guide is meant to help you get started with downloading, installing, and running Graderworks. 

Download and Installation

1. Go to the download page and select the version of Graderworks that is correct for you. Click the download button. 
   1. Make sure you download the version that is compatible with your version year of SOLIDWORKS.  
   2. Graderworks requires Windows 7 or higher.
   3. It is recommended that your computer is relatively fast since opening 1000s of files systematically will take a significant amount of computer resources. 
2. Browse to your downloads folder and click on the Graderworks installer .exe. The installer guides you through installing Graderworks. 

Starting Graderworks

3. Once installed, go to your start menu->applications->Graderworks, or, you can access Graderworks by clicking on the desktop icon. 

4. Once the application starts, it shows the main window. The main window shows you the progress of the program as it analyzes files.

Get Files and Standardize Format

5. In this 'Getting Started' page we will use the example in the 'Examples' page. You can download the zip folder containing the SOLIDWORKS files here. Unzip the files into a folder on your computer. In this example, the absolute path to the unzipped folder is 'C:\Users\garla\Downloads\sldworksparts\sldworksparts'. The file name of each file has already been standardized. 

Configure Graderworks

6. Next, you need to specify the absolute path to the root directory containing the file or folders that you need to be graded.To do this, paste into the 'Root Folder' text box the path to the folder containing the SOLIDWORKS files. Alternatively, you can click File->'Select Root Dir' to select the root folder. 
7. To configure Graderworks so that it knows what types of files to analyze, how to extract the username, and which files represent the correct answer, click on the Configure menu option. This click brings up the configuration window. The configuration window has four tabs. 

8. Now you need to configure Graderworks.
   1. If you look at the files in the root folder, you will see the username of each file has an underscore before and after the username. In the configuration window, using an underscore to identify the username is the default option. 
   2. Next, you need to select the type of assignment. The files to grade are all in the same folder, so in the 'Type of Assignment' drop-down box, you will select 'SOLIDWORKS files' which is the default option. 
   3. In addition to selecting the kind of assignment, you can tell Graderworks to analyze parts, assemblies, drawings, or any combination of the three by selecting the checkboxes in the 'SW File Types to Analyze' area. In this example, you will uncheck assemblies and drawings since you are only working with part files. 
   4. When extracting information from the files, it is usually best to use the default system units (MKS) so that the extracted properties are all in the same unit system. If you selected 'Use Document Units', then if students submit parts in IPS, MMGS, or CGS the extracted properties will be in the corresponding unit system. Then the grading algorithm will need a method to detect the different unit systems which will add a new layer of complexity. 
9. Next, you can configure Graderworks to analyze the part's geometry with respect to the correct answer.
   1. In the configuration window click on the 'Comparison' tab. 
   2. Check the box to enable geometric comparisons.
   3. Using Windows Explore, locate a file that is the 'correct' answer and then paste the absolute path into the configuration tab's text box. In Windows 10, if you select the file, then click on the 'copy path' button then the absolute path is conveniently copied to the clipboard automatically. In this example, use the a10_apg_part.SLDPRT file. 
   4. Next, click 'ok' on the configuration window. 

Run the Analysis

10. Now you are ready to start the actual analysis. Click on Analysis->Start. Graderworks starts by first opening the 'correct' answer file. Then it loops through the files in the root folder extracting information and comparing them to the correct answer. 

Interpret the Results

11. The root folder should now contain two new files, output.csv and analysis.csv.

    1. Open the analysis.csv in your favorite spreadsheet application (like Microsoft Excel). The analysis.csv shows files that have been flagged by the plagiarism checker. These files do not necessarily represent plagiarism, but they do require further investigation.  Four checks are performed on the files. 
       1. Inconsistent “savedby” name. If one student submits several files and the last “savedby” name is not the same for all the files.
       2. Duplicate “savedby” name. If two different students submit files with the same “savedby” name, then the file may have been shared.
       3. Duplicate “creation date” for different users. It is unlikely (but not impossible) for two students to submit a file that was created on the same day, hour, minute, and second.
       4. Creation date is less than two standard deviations from the average. Files that are old may be from the internet or a previous semester.

    2. Open the output.csv file. This file shows the raw information about each SOLIDWORKS file. The units are MKS which are the system units. Converting the raw data into a grade is up to the instructor, but a sample method is shown in this example. The grading algorithm checks the mass, density, and geometry of every file.  The algorithm has been programmed into an Excel macro. You can download the excel file with the macro here. 

       1. Download and open the grades.xlsm. You may need to enable the macros. They are likely turned off for security reasons by default. 
       2. Go back to the output.csv window, go to view->macros->run macro. Then run the 'prepare for grading' macro. This macro makes a new sheet within the Excel document called 'metadata' which lets you specify how the grading algorithm performs. 
          1. Column A allows you to specify the percent error allowed for the mass of the part. Similar to how the CSWA is graded, the algorithm checks if the mass is correct. 
          2. Column B should automatically be filled with the estimated error of the geometric similarity algorithm. 
          3. Column C requires specifying the proper mass in kg. 
          4. Column D requires the correct density in kg.m^3 This information is used for checking if the material is assigned correctly. Often students draw the part correctly, but forget to assign the material. 
          5. Column E lets you specify how many points to take off for having the wrong material assigned (which is checked by looking at the density). 
          6. Finally, Column F lets you specify how many points to take off if the mass is not 100% correct. This feature allows you to specify a maximum grade that a student can receive if they do not have the part 100% correct. 
       3. Once you have inserted the information on the meta-data sheet, then you can run the grading macro. Go to View-Macros-Run Macro and then run the GradeAssignment macro. The macro computes a grade for each student 

4. The grades appear in the 'data' sheet. In this example, the grade is calculated using this algorithm. 
   1. If mass is correct and similarity score indicates identical geometry, then grade is 100%
   2. If material (and therefore the density) is wrong, then 10 points take off automatically. 
   3. If the mass is not with allowable range wrong, then 5 points are taken off automatically. 
   4. If the mass is not correct or similarity score indicates geometric differences, then Grade = SimilarityScore - AutomaticPointsOff

Conclusion 

12.  This 'Getting Started' tutorial shows a method for using Graderworks to compute a grade for a simple homework assignment that might be given in a SOLIDWORKS class. The steps for setting up Graderworks can vary based on your particular situation but follow three major steps. 
    1. Preprocessing. 
       1. Gathering files
       2. Standardizing file names and formats
    2. Run Graderworks
       1. Configuring Graderworks
       2. Running Graderworks and monitoring the progress
    3. Interpret the results
       1. Convert raw data to a Grade
       2. Check for plagiarism

13. If you have questions or need help, please contact us at help@garlandindustriesllc.com.