Difference between revisions of "WEAT"

From PAWS Lab
Jump to: navigation, search
(changed image sizes)
Line 11: Line 11:
 
After opening the [http://adapt2.sis.pitt.edu/pcex-authoring/ <u>PCEX Authoring Tool</u>] ([https://youtu.be/IOfA0Ql3Zq0 Video Tutorial]), you will land on the ''Hub'' page. Click '''Login''', provide your account credentials and login into the tool. Then you will be redirected back to the ''Hub'' page.
 
After opening the [http://adapt2.sis.pitt.edu/pcex-authoring/ <u>PCEX Authoring Tool</u>] ([https://youtu.be/IOfA0Ql3Zq0 Video Tutorial]), you will land on the ''Hub'' page. Click '''Login''', provide your account credentials and login into the tool. Then you will be redirected back to the ''Hub'' page.
  
[[File:weat_image8.png|936px]]
+
[[File:weat_image8.png|768px]]
  
 
Fig 1) PCEX Authoring Tool: Hub Page.
 
Fig 1) PCEX Authoring Tool: Hub Page.
Line 20: Line 20:
 
In the ''Hub'' page, click on the navbar, then click on &quot;Sources&quot; to navigate to ''Sources'' page.
 
In the ''Hub'' page, click on the navbar, then click on &quot;Sources&quot; to navigate to ''Sources'' page.
  
[[File:weat_image21.png|936px]]
+
[[File:weat_image21.png|768px]]
  
 
Fig 2) PCEX Authoring Tool: Hub Page - when user is logged in.
 
Fig 2) PCEX Authoring Tool: Hub Page - when user is logged in.
Line 26: Line 26:
 
This page contains the list of sources you have created. Click &quot;'''New Source'''&quot; to create a new source.
 
This page contains the list of sources you have created. Click &quot;'''New Source'''&quot; to create a new source.
  
[[File:weat_image18.png|936px]]
+
[[File:weat_image18.png|768px]]
  
 
Fig 3) PCEX Authoring Tool: List of defined sources.
 
Fig 3) PCEX Authoring Tool: List of defined sources.
Line 32: Line 32:
 
A source has a title, problem description, and line-by-line annotated source code. Problem description can have multilines. Each line in the source code can be annotated either by providing explanations for it and/or marked as blank line.
 
A source has a title, problem description, and line-by-line annotated source code. Problem description can have multilines. Each line in the source code can be annotated either by providing explanations for it and/or marked as blank line.
  
[[File:weat_image23.png|936px]]
+
[[File:weat_image23.png|768px]]
  
 
Fig 4) PCEX Authoring Tool: Creating a source (e.g: Hello World!).
 
Fig 4) PCEX Authoring Tool: Creating a source (e.g: Hello World!).
Line 38: Line 38:
 
In a PCEX challenge, a blank line creates a parson-style problem that can be filled by the student with available distractors (check Figure 5). A distractor can be defined in the &quot;'''Distractors'''&quot; section when creating or editing a source.
 
In a PCEX challenge, a blank line creates a parson-style problem that can be filled by the student with available distractors (check Figure 5). A distractor can be defined in the &quot;'''Distractors'''&quot; section when creating or editing a source.
  
[[File:weat_image1.png|936px]]
+
[[File:weat_image1.png|768px]]
  
 
Fig 5) PCEX Authoring Tool: A PCEX challenge preview.
 
Fig 5) PCEX Authoring Tool: A PCEX challenge preview.
  
[[File:weat_image25.png|936px]]
+
[[File:weat_image25.png|768px]]
  
 
Fig 6) PCEX Authoring Tool: Define distractors (bottom section) for blank lines.
 
Fig 6) PCEX Authoring Tool: Define distractors (bottom section) for blank lines.
Line 52: Line 52:
 
As described in the user interface, these explanations can be dragged by the bars into the Annotations panel to be used/added to the currently selected line (check Figure 8). By default, previously generated explanations for the currently selected line are shown; click the &quot;'''show all lines'''&quot; to show all generated explanations. In the history panel click on another date/time to load explanations specific to that generation session.
 
As described in the user interface, these explanations can be dragged by the bars into the Annotations panel to be used/added to the currently selected line (check Figure 8). By default, previously generated explanations for the currently selected line are shown; click the &quot;'''show all lines'''&quot; to show all generated explanations. In the history panel click on another date/time to load explanations specific to that generation session.
  
[[File:weat_image26.jpg|936px]]
+
[[File:weat_image26.jpg|768px]]
  
 
Fig 7) Source Editor: ChatGPT Generated-Explanations (History).
 
Fig 7) Source Editor: ChatGPT Generated-Explanations (History).
  
[[File:weat_image22.png|936px]]
+
[[File:weat_image22.png|768px]]
  
 
Fig 8) Source Editor: Dragging previously generated explanations from history into the Annotations panel.
 
Fig 8) Source Editor: Dragging previously generated explanations from history into the Annotations panel.
Line 64: Line 64:
 
In the Annotations panel, explanations can be dragged by the bars. Drag and drop an explanation on another explanation to change their order, or hold &quot;'''alt'''&quot; key while dropping to append/merge them together, or drop the explanation on to the red trash can area to remove it (you will be asked to confirm this action since it is irreversible).
 
In the Annotations panel, explanations can be dragged by the bars. Drag and drop an explanation on another explanation to change their order, or hold &quot;'''alt'''&quot; key while dropping to append/merge them together, or drop the explanation on to the red trash can area to remove it (you will be asked to confirm this action since it is irreversible).
  
[[File:weat_image20.png|936px]]
+
[[File:weat_image20.png|768px]]
  
 
Fig 9) Source Editor: Drag explanations to reorder, merge or remove.
 
Fig 9) Source Editor: Drag explanations to reorder, merge or remove.
Line 70: Line 70:
 
In case you want to merge, cut, copy, or delete multiple explanations, click on the [[File:weat_image12.png|33x30px]] button to see more actions. Select explanations by clicking either the &quot;'''Select'''&quot; (to start the selection, then click on the[[File:weat_image15.png|22x20px]]checkboxes next to explanations to select), or &quot;'''Select all'''&quot; to select all the explanations. Then you can cut, copy, and delete the selected explanations.
 
In case you want to merge, cut, copy, or delete multiple explanations, click on the [[File:weat_image12.png|33x30px]] button to see more actions. Select explanations by clicking either the &quot;'''Select'''&quot; (to start the selection, then click on the[[File:weat_image15.png|22x20px]]checkboxes next to explanations to select), or &quot;'''Select all'''&quot; to select all the explanations. Then you can cut, copy, and delete the selected explanations.
  
[[File:weat_image19.png|936px]]
+
[[File:weat_image19.png|768px]]
  
 
Fig 10) Source Editor: Annotations panel more actions.
 
Fig 10) Source Editor: Annotations panel more actions.
Line 79: Line 79:
 
This page contains the list of activities you have created. Click &quot;'''New Activity'''&quot; to create a new activity.
 
This page contains the list of activities you have created. Click &quot;'''New Activity'''&quot; to create a new activity.
  
[[File:weat_image7.png|936px]]
+
[[File:weat_image7.png|768px]]
  
 
Fig 11) PCEX Authoring Tool: List of defined activities.
 
Fig 11) PCEX Authoring Tool: List of defined activities.
Line 87: Line 87:
 
After creating/updating a source or activity, click the preview button to ensure the activity is processed (/cached) and can be previewed by students later.
 
After creating/updating a source or activity, click the preview button to ensure the activity is processed (/cached) and can be previewed by students later.
  
[[File:weat_image16.png|936px]]
+
[[File:weat_image16.png|768px]]
  
 
Fig 12) PCEX Authoring Tool: Creating an activity(e.g: HelloWorld!).
 
Fig 12) PCEX Authoring Tool: Creating an activity(e.g: HelloWorld!).
Line 96: Line 96:
 
This page lists all publicly shared activities by different authors. You can click on the title to preview the activity, or click the open-in-new-tab icon next to the title to open it in a new tab (this url can be embedded in an iframe within your tools)
 
This page lists all publicly shared activities by different authors. You can click on the title to preview the activity, or click the open-in-new-tab icon next to the title to open it in a new tab (this url can be embedded in an iframe within your tools)
  
[[File:weat_image8.png|936px]]
+
[[File:weat_image8.png|768px]]
  
 
Fig 13) PCEX Authoring Tool: Hub Page.
 
Fig 13) PCEX Authoring Tool: Hub Page.
  
[[File:weat_image4.png|936px]]
+
[[File:weat_image4.png|768px]]
  
 
Fig 14) PCEX Authoring Tool: Activity Preview.
 
Fig 14) PCEX Authoring Tool: Activity Preview.

Revision as of 04:45, 2 April 2024

The Worked Example Authoring Tool (WEAT) is an innovative tool designed to facilitate the creation of worked examples for programming education through a human-AI collaboration approach. By integrating ChatGPT, WEAT assists instructors in generating line-by-line explanations for code examples in Java and Python. Instructors can provide the code and problem statement, and WEAT uses ChatGPT to generate explanations for each line of code. These explanations can then be reviewed, edited, and added into the worked examples, streamlining the process of creating educational programming materials.

This tool consists of three important pages:

  1. Sources, a source is a PCEX example or challenge; which has a title, problem description, and line-by-line annotated source code.
  2. Activities, an activity is a bundle of multiple sources either as an example or challenge.
  3. Hub, is where all publicly available activities are listed which can be searched by title, used, or embedded within your tool (through iframe).

After opening the PCEX Authoring Tool (Video Tutorial), you will land on the Hub page. Click Login, provide your account credentials and login into the tool. Then you will be redirected back to the Hub page.

Weat image8.png

Fig 1) PCEX Authoring Tool: Hub Page.

Sources

In the Hub page, click on the navbar, then click on "Sources" to navigate to Sources page.

Weat image21.png

Fig 2) PCEX Authoring Tool: Hub Page - when user is logged in.

This page contains the list of sources you have created. Click "New Source" to create a new source.

Weat image18.png

Fig 3) PCEX Authoring Tool: List of defined sources.

A source has a title, problem description, and line-by-line annotated source code. Problem description can have multilines. Each line in the source code can be annotated either by providing explanations for it and/or marked as blank line.

Weat image23.png

Fig 4) PCEX Authoring Tool: Creating a source (e.g: Hello World!).

In a PCEX challenge, a blank line creates a parson-style problem that can be filled by the student with available distractors (check Figure 5). A distractor can be defined in the "Distractors" section when creating or editing a source.

Weat image1.png

Fig 5) PCEX Authoring Tool: A PCEX challenge preview.

Weat image25.png

Fig 6) PCEX Authoring Tool: Define distractors (bottom section) for blank lines.

Explanations for important lines of code can be generated using the gpt-3.5-turbo model. Clicking on the "Generate Explanations" button will generate explanations using the default prompt. Newly generated explanations will be appended to the line and are distinguished with orange border color (check Figure 7).

Next to the "Generate Explanations" button, there is the Weat image9.pnghistory and Weat image6.png custom prompt toggle buttons. Clicking on the Weat image9.png button will show the previously generated explanations (check Figure 7) for this source. While clicking on the Weat image6.png provide the ability to customize the ChatGPT prompt (check Figure 7).

As described in the user interface, these explanations can be dragged by the bars into the Annotations panel to be used/added to the currently selected line (check Figure 8). By default, previously generated explanations for the currently selected line are shown; click the "show all lines" to show all generated explanations. In the history panel click on another date/time to load explanations specific to that generation session.

Weat image26.jpg

Fig 7) Source Editor: ChatGPT Generated-Explanations (History).

Weat image22.png

Fig 8) Source Editor: Dragging previously generated explanations from history into the Annotations panel.

In Figure 7, the ChatGPT prompt can be viewed. This is the default prompt used by the tool when "Generate Explanations" is clicked. If by any reason, it requires any change, you can change the color-marked sections. After customizing the prompt, click "Generate Explanations" to generate the explanations.

In the Annotations panel, explanations can be dragged by the bars. Drag and drop an explanation on another explanation to change their order, or hold "alt" key while dropping to append/merge them together, or drop the explanation on to the red trash can area to remove it (you will be asked to confirm this action since it is irreversible).

Weat image20.png

Fig 9) Source Editor: Drag explanations to reorder, merge or remove.

In case you want to merge, cut, copy, or delete multiple explanations, click on the Weat image12.png button to see more actions. Select explanations by clicking either the "Select" (to start the selection, then click on theWeat image15.pngcheckboxes next to explanations to select), or "Select all" to select all the explanations. Then you can cut, copy, and delete the selected explanations.

Weat image19.png

Fig 10) Source Editor: Annotations panel more actions.

Activities

This page contains the list of activities you have created. Click "New Activity" to create a new activity.

Weat image7.png

Fig 11) PCEX Authoring Tool: List of defined activities.

An activity contains one or more sources, either as an example or challenge.

After creating/updating a source or activity, click the preview button to ensure the activity is processed (/cached) and can be previewed by students later.

Weat image16.png

Fig 12) PCEX Authoring Tool: Creating an activity(e.g: HelloWorld!).

Hub

This page lists all publicly shared activities by different authors. You can click on the title to preview the activity, or click the open-in-new-tab icon next to the title to open it in a new tab (this url can be embedded in an iframe within your tools)

Weat image8.png

Fig 13) PCEX Authoring Tool: Hub Page.

Weat image4.png

Fig 14) PCEX Authoring Tool: Activity Preview.

Icons and Symbols

The following icons are used within this tool, and you need to familiarize yourself with them.

Weat image2.png In the source editor, this question mark marks the lines that have at least one explanation.
Weat image14.png In the source editors, this blue-empty square marks the lines that are marked as blank.
Weat image11.png In the source editors, this symbol marks the lines that are marked as blank and also have at least one explanation.
Weat image3.png In the source editor, this symbol can be used to drag explanations for reordering, or merging.
Weat image10.png Clicking on this icon in the activities and sources listings will toggle the item's archiving status.
Weat image13.png Clicking on this icon in the activities and sources listings will preview the item.
Weat image17.png Clicking on this icon in the activities listing will toggle the item's publicity status (in the Hub page).