<aside> ⛳ First draft by Joe Edelman

These are evaluation questions for democratic processes aimed at producing either fine-tuned models or policies used to fine-tune models.

Once we feel this is complete, a next task will be to make these into (a) survey questions, and (b) aggregate metrics.

Please add things I’ve missed!

</aside>

<aside> 🔑 Key

• Green lines → potential survey questions

• Purple lines → aggregate values to design a metric for </aside>

• Table of Contents

Process Questions

Satisfaction

• Did you lose motivation during the process?
• Were you confused?
• Did you drop-off?
• Did you make mistakes?
• Was the process satisfying? Did you enjoy the process?
• Would you recommend?
• Did it help you clarify what was important to you?
• Did you experience a renewal of group values and meanings?

Accessibility

• Was anything confusing?
• Does it work across cultures, languages, income levels, ages, etc?
• Does it disregard minority views that are very important to that minority?
• It is simple enough that most humans can understand it well?

Legitimacy

• Does it seem like the right group of participants was gathered?