LlamaFactory Adapter Plugin

Before you start, make sure:

1. The base LlamaFactory training environment is installed and can run training tasks normally.
2. Training data, test data, and the training model are ready.

1. Install communication dependencies

Run the following command in the LlamaFactory training environment to install gRPC and protobuf dependencies:

pip install "grpcio>=1.76" "grpcio-tools>=1.76" "protobuf"

2. Install the plugin wheel

Install the LlamaFactory adapter plugin from the EcoPhase.AI private PyPI index:

pip install -vvv \
  --index-url https://ecophase-ai.com/pypi/simple/ \
  "ecophase==1.3.0a1+llamafactory"

3. Modify the training file

Open this file:

LlamaFactory/src/llamafactory/train/sft/trainer.py

In the CustomSeq2SeqTrainer(Seq2SeqTrainer) class, insert the following code after the last line of the __init__ function:

from EcoPhase.EcoTrain import EcoTrain
EcoTrain.attach(self, enabled=True)

4. Enable the plugin

Use the enabled parameter to control whether the plugin is active:

EcoTrain.attach(self, enabled=True)

Parameter reference:

Before running a task, confirm that the code uses enabled=True.