Embodiments are provided that relate to a computer system, a computer program product, and a computer-implemented method for improving performance of a virtual dialog agent system employing an automated virtual dialog agent. Embodiments involve generating ground truth (GT) from a user's knowledge base, and leveraging the GT to evaluate how the virtual dialog agent performs with the GT. The evaluation measures quality of a multi-turn virtual dialog, and generates a remediation plan directed at an algorithmic improvement of the virtual dialog agent.