Praison AI

inference • AI Agents Framework

inference: API reference for TrainModel.inference

inference

Method

</div>

This is a method of the TrainModel class in the train module.

Signature

python
def inference(instruction: Any, input_text: Any) -> Any

Parameters

ParamField Any

No description available.

ParamField Any

No description available.

Returns

ResponseField Any

The result of the operation.

Uses

  • FastLanguageModel.for_inference
  • to
  • apply_chat_template
  • generate
  • batch_decode

Source

View on GitHub

praisonai/train.py at line 266