Evaluate your plugins and planners with Prompt flow

Using Prompt flow with Semantic Kernel

• Prompt flow can be used to test and evaluate plugins and planners in Semantic Kernel.
• Prompt flow allows for the creation of a flow that includes Semantic Kernel at its core.
• This integration can help improve the accuracy of planners and plugins.

Create a Prompt flow with Semantic Kernel

• Follow the provided steps to create a simple Prompt flow with Semantic Kernel.
• This will serve as the foundation for testing and evaluating the performance of planners and plugins.

Running batches with Prompt flow

• Prompt flow enables running batches of benchmark data on the created Prompt flow.
• This allows for comprehensive testing and analysis of the performance of planners.

Evaluate your plugins and planners

• Use the evaluation functionality of Prompt flow to quantifiably measure the accuracy of plugins and planners.
• This evaluation process helps identify areas for improvement and fine-tuning.

Strategies to improve plugins and planners

• Inject additional help to the planner when receiving user inputs to enhance the performance.
• Explore concrete strategies and techniques to improve the accuracy and effectiveness of plugins and planners.

Future integrations and updates

• The Prompt flow and Semantic Kernel teams are continuously working on adding more integrations.
• Keep an eye out for new features, enhancements, and integrations to further enhance the usage of Prompt flow with Semantic Kernel.