syndisco.AnnotationExperiment

class AnnotationExperiment(annotators: list[Actor], history_ctx_len: int = 3)

Bases: object

An experiment that uses LLM annotators to label synthetic discussion logs.

begin(discussions_dir: Path, output_dir: Path, verbose: bool = True) None

Start the annotation process over all discussion logs in a directory.

Parameters:
  • discussions_dir (Path) – Directory containing discussion logs.

  • output_dir (Path) – Directory to write annotation outputs.

  • verbose (bool, defaults to True) – Whether to display annotation progress.