Autograding

Python Autograders

Autograders in Python are powerful tools that automate the testing and evaluation of student code, providing efficient feedback and streamlining the grading process.

Otter-Grader

Otter-Grader is a open-source library that enables automated testing and grading of student code, allowing for real-time feedback and flexibility in grading assignments.

Setting Up an Autograding Environment

Note: This was tested on a linux based machine, but should translate to a MacOS as well. A virtual machine was set-up with this autograding environment, if you would prefer to use this virtual machine instead of setting it up on your own machine please email apivirotto@brynmawr.edu.

  1. If Conda is not currently installed, install Miniconda. Follow the instructions for the Linux installer to download the .sh script and run the installation.
  2. Install nbconvert, Pandoc, and TeX.
## nbconvert
conda install nbconvert

## pandoc
sudo apt-get install pandoc

## tex
sudo apt-get install texlive-xetex texlive-fonts-recommended texlive-plain-generic
  1. Install otter-grader using pip.
pip install otter-grader
  1. Install Docker with the instructions at the link (Steps 1, 2, 3). Docker is required for the local grading of assignments using containerization.
  1. Install ipykernel. 
python3 -m pip install ipykernel
python3 -m ipykernel install --user
  1. Otter-grader offers a tutorial. To test your installation, you can download the tutorial repository using the commands below. Basic commands to run otter-grade to test the installation are included as well. More information about formatting your assingments and Deploying the autograder for grading assignments are found below. 
## download the tutorial repository
wget https://otter-grader.readthedocs.io/en/latest/_static/tutorial.zip

## test the assign function
otter assign demo.ipynb dist

## test the grading function
otter grade -n demo -a dist/autograder/demo-autorgrader_*.zip -v -ext zip submissions/zips

Creating and Configuring Assignments

Deploying Your Autograder

nbgrader

Coming soon!

Ok

Coming soon!