Learn how to test your CrewAI Crew and evaluate their performance.
crewai test
to make it easy to test your crew. This command will run your crew for a specified number of iterations and provide detailed performance metrics. The parameters are n_iterations
and model
, which are optional and default to 2 and gpt-4o-mini
respectively. For now, the only provider available is OpenAI.
crewai test
command, the crew will be executed for the specified number of iterations, and the performance metrics will be displayed at the end of the run.
A table of scores at the end will show the performance of the crew in terms of the following metrics:
Tasks/Crew/Agents | Run 1 | Run 2 | Avg. Total | Agents | Additional Info |
---|---|---|---|---|---|
Task 1 | 9.0 | 9.5 | 9.2 | Professional Insights | |
Researcher | |||||
Task 2 | 9.0 | 10.0 | 9.5 | Company Profile Investigator | |
Task 3 | 9.0 | 9.0 | 9.0 | Automation Insights | |
Specialist | |||||
Task 4 | 9.0 | 9.0 | 9.0 | Final Report Compiler | Automation Insights Specialist |
Crew | 9.00 | 9.38 | 9.2 | ||
Execution Time (s) | 126 | 145 | 135 |