Demonstrations in ICL

[yliuhz]

Dear authors,

Thanks for your amazing work! After reading the repository, I'm curious about the construction of the 2-shot examples in the prompts/asqa_rejection.json file. How did you construct the "answer" of positive demos? Did you use GPT-4 as you did to build the Trust-Align dataset?

Thanks,
Yue

[shanghongsim]

Hi Yue, thank you! :) We adpated our prompts from ALCE, where we use the same few shot examples but with a modified instruction. Hope this helps!