Training
Learn how to train your CrewAI agents by giving them feedback early on and get consistent results.
Overview
The training feature in CrewAI allows you to train your AI agents using the command-line interface (CLI).
By running the command crewai train -n <n_iterations>
, you can specify the number of iterations for the training process.
During training, CrewAI utilizes techniques to optimize the performance of your agents along with human feedback. This helps the agents improve their understanding, decision-making, and problem-solving abilities.
Training Your Crew Using the CLI
To use the training feature, follow these steps:
- Open your terminal or command prompt.
- Navigate to the directory where your CrewAI project is located.
- Run the following command:
Replace <n_iterations>
with the desired number of training iterations and <filename>
with the appropriate filename ending with .pkl
.
Training Your Crew Programmatically
To train your crew programmatically, use the following steps:
- Define the number of iterations for training.
- Specify the input parameters for the training process.
- Execute the training command within a try-except block to handle potential errors.
Key Points to Note
- Positive Integer Requirement: Ensure that the number of iterations (
n_iterations
) is a positive integer. The code will raise aValueError
if this condition is not met. - Filename Requirement: Ensure that the filename ends with
.pkl
. The code will raise aValueError
if this condition is not met. - Error Handling: The code handles subprocess errors and unexpected exceptions, providing error messages to the user.
It is important to note that the training process may take some time, depending on the complexity of your agents and will also require your feedback on each iteration.
Once the training is complete, your agents will be equipped with enhanced capabilities and knowledge, ready to tackle complex tasks and provide more consistent and valuable insights.
Remember to regularly update and retrain your agents to ensure they stay up-to-date with the latest information and advancements in the field.
Happy training with CrewAI! 🚀
Small Language Model Considerations
When using smaller language models (≤7B parameters) for training data evaluation, be aware that they may face challenges with generating structured outputs and following complex instructions.
Limitations of Small Models in Training Evaluation
JSON Output Accuracy
Smaller models often struggle with producing valid JSON responses needed for structured training evaluations, leading to parsing errors and incomplete data.
Evaluation Quality
Models under 7B parameters may provide less nuanced evaluations with limited reasoning depth compared to larger models.
Instruction Following
Complex training evaluation criteria may not be fully followed or considered by smaller models.
Consistency
Evaluations across multiple training iterations may lack consistency with smaller models.
Recommendations for Training
For optimal training quality and reliable evaluations, we strongly recommend using models with at least 7B parameters or larger:
More powerful models provide higher quality feedback with better reasoning, leading to more effective training iterations.
For optimal training quality and reliable evaluations, we strongly recommend using models with at least 7B parameters or larger:
More powerful models provide higher quality feedback with better reasoning, leading to more effective training iterations.
If you must use smaller models for training evaluation, be aware of these constraints:
While CrewAI includes optimizations for small models, expect less reliable and less nuanced evaluation results that may require more human intervention during training.