llmp.types.VerificationType

class llmp.types.VerificationType(value, names=None, *, module=None, qualname=None, type=None, start=1, boundary=None)

Validation rank for ExampleRecords

SINGLE_VOTE: Example output is created by a single generation execution. MAJORITY_VOTE: Example output is created by a majority vote of generation executions. MAJORITY_GRADE: Example output is created by a majority grade of generation executions. USAGE_VERIFIED: Example output is used/generated multiple times without claims. HUMAN_VERIFIED: Example output is verified by human interaction.

SINGLE_VOTE = 1

MAJORITY_VOTE = 2

MAJORITY_GRADE = 3

USAGE_VERIFIED = 4

HUMAN_VERIFIED = 5