Hello Rohit! Super cool app idea for our speedy inference and the UI looks great. I just took the Invention and Discoveries quiz and some of the corrections were a bit unusual:
When asked about who invented the light bulb, I submitted Thomas Edison and got it wrong with the corrected answer of Alexander Graham Bell. When asked about who invented the telephone, I submitted Alexander Graham Bell and got it wrong to the corrected answer of Thomas Edison.
Maybe check that the questions and answers are aligned. This tool has great potential!
Thanx @rachel.bakke for the feedback! So basically issue was with the system_prompt I was passging to the model. Specifically, I was passing a JSON schema that included a correct_answer field before the options array. I think this caused the model to have trouble identifying the options and placing the correct option index in the “correct_option” array
Additionally, the model was using a 70B version, and now it’s using the 405B version.
To fix this, I made some changes to the system_prompt to ensure the correct option is identified. You can check the code changes here.
@rohit4444choudhary Thank so very much for contributing. This is very very cool and I could see it being a major time saver for over worked teachers and tired parents.
@rohit4444choudhary I can’t wait to see how this evolves further. The potential for students, professionals, and lifelong learners to use this tool is endless. Keep up the great work!