syndisco.BaseModel

class BaseModel(name: str, max_out_tokens: int, stop_list: list[str] | None = None)

Bases: ABC

Interface for all local LLM wrappers

final get_name() → str

Get the model’s assigned pseudoname.

Returns:

The name of the model.

Return type:

str

final prompt(system_prompt: str, user_prompt: str) → str

Generate the model’s response based on a prompt.

Parameters:

• system_prompt (str) – The system prompt.

• user_prompt (str) – The user prompt.

• stop_words (list[str]) – Strings to be removed after generation.

Returns:

the model’s response

Return type:

str