Answer Grading Report
ivy.agent.answer-grading · v1.1.0
ivyx
Reads a CSV of questions and answers, has Jev grade each answer as wrong, partly right or right, and writes the grades as a Markdown table.
Steps
In the order the agent's file lists them, each with where its inputs come from and the values the file fixes. A branch or a loop is a step too.
- 01Ivy NodeRead the answersivy.node.csv-read
Reads a CSV file, or CSV text, into rows with the column names and row count.
- takes
pathfrom the agent's input- returns
row_count
- 02For eachGrade each answer
Runs Jev · Score once for each item of rows of step 1.
- set
instructionsScore the correctness of this answer on three levels: wrong, partly right, right.levels["wrong","partly right","right"]- secret
jev_api_keythe stored secret jev-api-key
- 03Ivy NodeLay out the tableivy.node.markdown-table
Formats rows as a Markdown table, with the columns in the order given or as they first appear.
- takes
rowsfrom step 2,results- set
columns["question","level_text"]- returns
markdown
- 04Ivy NodeWrite the reportivy.node.file-write
Writes text to a file, creating its folder, and returns the absolute path and the number of bytes written.
- takes
textfrom step 3,markdown- set
pathreports/grading.mdoverwritetrue- returns
path
Nodes it brings
Adding this agent in IVYX Studio adds these nodes with it. A node your workspace already has is kept as it is, even at another version.
What it touches
Collected from what each of its nodes declares and what the agent's own file declares, such as moving a robot, plus the model call when a step is a model turn. A declaration is the author's statement, and it is what policy rules select on.
What it needs
- A stored secret named
jev-api-key. The agent's file carries the name, never the value.
Inputs
| Field | Type | Description |
|---|---|---|
| pathrequired | string | The CSV file with the columns question and answer. |
Outputs
| Field | Type | Description |
|---|---|---|
| row_count | integer | How many answers were graded. |
| markdown | string | The table that was written. |
| path | string | The Markdown report written. |
Tests
2 of 2 test cases passed on Oct 7, 2026, in the publisher's own environment, before this version was published. The registry keeps that record; it does not run the cases again.
Requires: python:3.9, the stored secret jev-api-key
- five-answers
Five graded answers are written to reports/grading.md; the two wrong ones read wrong.
- given
pathdata/jev/answers.csv- expects
row_countequals 5markdownmatches wrongpathmatches reports/grading\.md$
- three-answers
Another file with three answers is graded, not a remembered one.
- given
pathdata/jev/answers-b.csv- expects
row_countequals 3markdownmatches right