Table 3 Comprehensive evaluation metrics framework with measurement methods and importance weights. The framework captures five key dimensions of decision support system effectiveness, with weights reflecting relative importance for real-world deployment scenarios.
Dimension | Metrics | Measurement method | Weight |
|---|---|---|---|
Decision quality | Accuracy, optimality, robustness | Expert agreement, provable bounds, perturbation analysis | 30% |
Knowledge utilization | Relevance, coverage, novelty | Information retrieval metrics, domain coverage analysis | 25% |
Explanation effectiveness | Comprehensibility, completeness, traceability | User studies, content analysis, graph connectivity | 20% |
Integration performance | Cross-domain success, orchestration efficiency | Multi-domain scenarios, pathway analysis | 15% |
Adaptive capabilities | Learning efficiency, transfer effectiveness | Sample efficiency, domain adaptation metrics | 10% |
