Chat Copilot Performance improvements for chat and messaging loading
Chat Copilot is introducing enhancements to improve performance and reduce cost for its customers. Currently, partitions in the system are defined by an ID, which has led to extended processing times as the CosmosDB grows. To address this issue, Chat Copilot will update partitioning to be based on the userID and chatID instead of a single ID. This change has already shown improved experiences. New deployments will automatically benefit from this performance improvement, while existing customers are recommended to remove the existing Cosmos DB containers and redeploy to see the performance update. Existing chat data can be migrated to preserve it. For more information, customers can read about Chat Copilot and review the changes in the pull request made by Nilesh Acharya, the Principal Product Manager of Semantic Kernel at Chat Copilot.