Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Examplar improvements #1727

Open
1 of 7 tasks
ds26gte opened this issue Feb 8, 2024 · 3 comments
Open
1 of 7 tasks

Examplar improvements #1727

ds26gte opened this issue Feb 8, 2024 · 3 comments
Assignees

Comments

@ds26gte
Copy link
Contributor

ds26gte commented Feb 8, 2024

  • Show individual test results (which ones specifically failed)
  • Show result in "bug" interface
  • Suppress red box in Chat interface
  • Full editor
  • Suppress list of files (in non-development mode)
  • Incorporate Sidd's mutants/hints.json
  • Make sure testing feedback from wheat vs student impl is clearly distinguished and evident
anchor.mp4
@schanzer
Copy link
Contributor

schanzer commented Feb 8, 2024

@schanzer tagging myself so I can stay up to date on this

@ds26gte
Copy link
Contributor Author

ds26gte commented Feb 8, 2024

Update: I was very surprised to see the red box during the call, but it's actually correct. I had forgotten I put in an empty placeholder file fact-code.arr alongside test.arr that had an empty definition for fact, waiting for the user to fill it in. So it is expected that the red box for test.arr should show all errors. Here's the screenshot with a valid definition inside fact-code.arr.

anchor-better

@shriram
Copy link
Member

shriram commented Feb 9, 2024

The main issue then is to avoid confusion between feedback from the reference implementation and from the student's implementation. They mean very different things. I'm going to add this as a todo item to your list at the top so that we remember to audit for this once you have fixed various issues.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants