Assessing the quality of knowledge
Evaluation helps to verify whether the knowledge allows ELChat to reliably answer the questions tested.
Launch an evaluation
Section titled “Launch an evaluation”- Open Knowledge.
- Identify the quality assessment area.
- Launch a new evaluation.
- Wait until treatment is over.
- Compare the result with the previous evaluation when it exists.
Indicators displayed
Section titled “Indicators displayed”| Indicator | Useful question |
|---|---|
| Quality of assistant | What is the overall quality observed? |
| Reliability of responses | Are the answers consistent with knowledge? |
| Coverage | Are important issues sufficiently covered? |
| Risk of incorrect response | where is the risk of a misleading response highest? |
| Issues assessed | What volume is the result based on? |
Read a score with caution
Section titled “Read a score with caution”A score must be interpreted with:
- the number of questions assessed;
- the nature of the questions;
- the date and version of the knowledge;
- deviations from the previous assessment;
- detailed recommendations.
When to restart
Section titled “When to restart”- after an important import;
- after the replacement of several resources;
- after changing the pages or products;
- after dealing with knowledge gaps;
- before a major start-up.