Skip to content

AI Committee

Suggestions for AI Proofing Coursework

The Education and Morality Approach

  • Explain why learning is important, and why it should matter to them.
  • Educate Students About Academic Integrity
  • Clearly Define Acceptable Use Of Technology

Use Technology

  • AI Detectors (not really viable and poor results)
  • AI Proctors like TalView (Better results but privacy concerns)
  • School VPN, Proxy, or Main-Frame connectivity (Good results, but not equitable)
  • School Monitoring Software (ethical and privacy concerns)
  • Monitor network activity
  • Keyboard strokes
  • Motion, Sound, etc.
  • Enable Lockdown Browsers
  • Remote Proctors
  • Tools to disable network and cut-n-paste features while taking the exam

Use Higher-Order Thinking Questions to Challenge AI

  • Open ended questions:
    • No multiple choice
    • Ask students to explain concepts, defend arguments, or solve problems in their own words.
  • Use Scenarios:
    • Present students with real-world situations related to the topic and ask them to develop solutions or recommendations.
  • Make questions Personal:
    • Ask students to relate the course material to their own experiences and backgrounds.
  • Peer Assessments with Feedback

Use Media to Challenge AI

  • Visuals and multimedia:
    • Questions with images, graphs, charts, and audio/video clips in assessments make it difficult for AI tools to process.
    • Require students to respond with their own audio/visual to explain a topic in their own voice.
      • AI can be trained to detect if students are reading prompts via eye movement and intonation.
    • Oral examinations via Zoom or in person
  • Hands-on Assessments/Assignments:
    • Ask students to demonstrate a skill.
      • Demonstrate a science experiment, performance, role play, etc.
      • When remote, it can be recorded and uploaded.
    • Take on REAL-WORLD community sponsored projects.
      • Examples: traffic congestion or waste management fixes/updates.
      • Have them focus on user experience and human constraints
  • Use Student Portfolios

Use Randomization

  • Autogenerate tests per student (Each studnet gets a unique test)
    • Random questions from test bank
    • Randomize question order
    • Randomize choices
  • Adaptive Testing
    • Adjusts the difficulty of questions based on a student’s previous responses.

Use Time

  • Proctor even online exams at a specific time
  • Students must share full desktop during exam.
  • Constrain the time for each question and the exam.

  • VPN, Proxy, or Remote Mainframe is required for online exams.

    • Forces student to be on campus network
    • VPN can enforce routing and preclude known AI bots (Though 2 computers or other networking tricks can bypass this)
      • Would also require detecting routing tabls and bridges routing traffic outside the VPN

  • Reference current events since AI needs to be retrained.

Use Student History

  • If a baseline for student work can be constructed, that baseline can be used to compare current work.
  • Historical papers can indicate things like
    • Writing style
    • Grammatical and vocabulary statistics.
      • Avg mistakes, Avg word length, Avg Sentence length, etc.
  • AI can even be used to construct and anaylize this baseline if enough historical work exists to do so.

Gaming AI

  • Write questions in simile and metaphor

  • Purposefully make mistakes.

    • Mis-spell facts that are the main point of the question (e.g. spell cities backwards in a geography test)
    • Repeat words in meaningful places.
    • Make multi questions (current AI tends to respond to 1 but not all points of a multi-question).
      • Separating the questions into distinc sentences makes this method less effective.

  • Introduce statistical oddities:

Scenario: You’re creating a statistics quiz. Don’t just ask for the average rainfall in a city. Instead, present a dataset with a bimodal distribution (two peaks) and ask students to explain the possible reasons behind this unusual pattern.

  • Use multimodal reasoning:

Assignment Example: Students analyze a historical event. They are given a text passage, a political cartoon depicting the event, and a short speech from a key figure. The assignment requires them to compare and contrast the perspectives presented in each modality (text, image, audio) to gain a well-rounded understanding.

  • Use Current Events:

Example: Students research a recent news story and then debate its potential long-term impact. This requires them to stay updated, think critically about new information, and go beyond the initial news report that AI likely hasn’t ingested. Ingesting the news report is possible if its in a easily extractable format though.

  • Open-Ended Questions:

Example: “What does it mean to be human in the age of artificial intelligence?” This question is philosophical and requires students to delve into complex concepts that go beyond memorizing facts.

References