Doni AI RAG Stress Test Report
Run time: 20260322_024516 | Version: 1.0.4
Mode: full | Auth: on | Documents tested: 72 | Questions: 311
96.5%
Overall accuracy (300/311)
4.422s
Avg latency
10.724s
P95 latency
2.5
Peak QPS
50
Stable concurrency
(error rate <20%)
(error rate <20%)
🎯 Accuracy analysis
Pass rate by category
| Category | Questions | Pass | Pass rate | Avg latency |
|---|---|---|---|---|
| FAQ-IT | 3 | 2 | 66.7% | 8.38s |
| FAQ-人事 | 3 | 3 | 100.0% | 3.38s |
| SOP-付款作業 | 3 | 2 | 66.7% | 5.0s |
| SOP-內部稽核 | 2 | 2 | 100.0% | 3.21s |
| SOP-出貨檢驗 | 1 | 0 | 0.0% | 2.78s |
| SOP-客訴處理 | 2 | 1 | 50.0% | 2.85s |
| SOP-文件管制 | 2 | 2 | 100.0% | 2.78s |
| SOP-設備故障報修 | 3 | 3 | 100.0% | 5.73s |
| SOP-進料檢驗 | 2 | 2 | 100.0% | 3.76s |
| SOP-量產移轉 | 2 | 2 | 100.0% | 7.34s |
| 人事規章-招募與到離職 | 10 | 10 | 100.0% | 4.41s |
| 人事規章-薪資與福利 | 12 | 12 | 100.0% | 2.79s |
| 人事規章-訓練與發展 | 10 | 10 | 100.0% | 3.32s |
| 人事規章-請假與出勤 | 10 | 9 | 90.0% | 3.69s |
| 人事規章-退休與留才 | 10 | 10 | 100.0% | 5.33s |
| 內部溝通與行政-危機與緊急 | 5 | 5 | 100.0% | 7.42s |
| 內部溝通與行政-會議與公告 | 5 | 5 | 100.0% | 3.17s |
| 內部溝通與行政-行政庶務 | 5 | 5 | 100.0% | 3.31s |
| 公告-安全衛生 | 1 | 1 | 100.0% | 12.42s |
| 公告-教育訓練 | 1 | 1 | 100.0% | 4.71s |
| 合約範本-NDA | 1 | 1 | 100.0% | 3.18s |
| 合約範本-採購 | 1 | 1 | 100.0% | 6.07s |
| 品質手冊-FMEA | 1 | 1 | 100.0% | 2.84s |
| 品質手冊-供應商品質 | 1 | 1 | 100.0% | 2.98s |
| 品質手冊-品質系統 | 2 | 2 | 100.0% | 2.11s |
| 品質管理-品質系統 | 8 | 8 | 100.0% | 3.8s |
| 品質管理-文件紀錄 | 7 | 7 | 100.0% | 3.89s |
| 品質管理-檢驗客訴 | 8 | 8 | 100.0% | 5.94s |
| 員工手冊-員工福利 | 3 | 2 | 66.7% | 2.34s |
| 員工手冊-新進人員指南 | 6 | 5 | 83.3% | 5.36s |
| 員工手冊-績效考核 | 4 | 4 | 100.0% | 4.93s |
| 員工手冊-行為準則 | 2 | 0 | 0.0% | 1.09s |
| 存貨與倉儲-FIFO | 7 | 7 | 100.0% | 5.35s |
| 存貨與倉儲-存貨管理 | 7 | 7 | 100.0% | 5.34s |
| 存貨與倉儲-物料編碼 | 7 | 7 | 100.0% | 4.49s |
| 安全管理-安全衛生 | 9 | 9 | 100.0% | 4.88s |
| 安全管理與環保-健康促進 | 5 | 5 | 100.0% | 4.47s |
| 安全管理與環保-消防安全 | 5 | 5 | 100.0% | 2.87s |
| 安全管理與環保-環境環保 | 5 | 3 | 60.0% | 2.51s |
| 安全管理與環保-職業安全 | 7 | 7 | 100.0% | 3.22s |
| 技術資料-SMT | 1 | 1 | 100.0% | 2.49s |
| 授權-核決權限 | 1 | 1 | 100.0% | 3.81s |
| 採購與供應商-供應商管理 | 7 | 7 | 100.0% | 4.02s |
| 採購與供應商-合約法務 | 6 | 6 | 100.0% | 5.29s |
| 採購與供應商-採購流程 | 7 | 7 | 100.0% | 4.56s |
| 業務-出貨與物流 | 4 | 4 | 100.0% | 4.54s |
| 業務-售後與保固 | 4 | 4 | 100.0% | 3.84s |
| 業務-報價與訂單 | 5 | 5 | 100.0% | 4.25s |
| 業務-客戶管理 | 4 | 4 | 100.0% | 2.85s |
| 法務與合規-內部規範 | 4 | 4 | 100.0% | 3.17s |
| 法務與合規-合約與智財 | 4 | 4 | 100.0% | 4.19s |
| 法務與合規-法規遵循 | 5 | 5 | 100.0% | 4.12s |
| 生產流程-SMT | 7 | 7 | 100.0% | 7.14s |
| 生產與製造-製程變更 | 7 | 7 | 100.0% | 3.08s |
| 生產與製造-設備維護 | 7 | 7 | 100.0% | 7.51s |
| 產品與技術-技術文件 | 4 | 4 | 100.0% | 5.67s |
| 產品與技術-產品與型錄 | 5 | 5 | 100.0% | 6.04s |
| 產品與技術-研發流程 | 5 | 5 | 100.0% | 4.53s |
| 產品規格-連接器 | 1 | 1 | 100.0% | 2.8s |
| 產品規格-電源模組 | 1 | 1 | 100.0% | 2.49s |
| 訓練教材-ESD | 1 | 1 | 100.0% | 1.78s |
| 訓練教材-安全衛生 | 2 | 2 | 100.0% | 4.07s |
| 訓練教材-資訊安全 | 2 | 2 | 100.0% | 4.18s |
| 財務-日常作業 | 5 | 5 | 100.0% | 4.0s |
| 財務-資金與稅務 | 5 | 5 | 100.0% | 4.84s |
| 財務-預算與成本 | 4 | 4 | 100.0% | 5.26s |
| 資訊-系統與權限 | 4 | 4 | 100.0% | 3.41s |
| 資訊-資安與個資 | 5 | 5 | 100.0% | 4.18s |
| 資訊-資訊使用規範 | 6 | 6 | 100.0% | 5.43s |
By difficulty
| Difficulty | Questions | Pass | Pass rate |
|---|---|---|---|
| easy | 218 | 208 | 95.4% |
| medium | 93 | 92 | 98.9% |
Failure reasons
| Reason | Count |
|---|---|
| RAG did not retrieve relevant documents | 7 |
| Answer too short; may miss key information | 4 |
⏱️ Latency analysis
| Metric | Value |
|---|---|
| Average latency | 4.422s |
| P50 (median) | 3.702s |
| P95 | 10.724s |
| P99 | 12.625s |
| Min | 1.015s |
| Max | 15.107s |
⚡ Stress test results
| Level | Concurrency | Total requests | Success | Error rate | QPS | Avg | P95 | P99 | Max |
|---|---|---|---|---|---|---|---|---|---|
| Baseline (1 user) | 1 | 5 | 5 | 0.0% | 0.26 | 3.75s | 5.216s | 5.216s | 5.216s |
| Light (5 users) | 5 | 50 | 50 | 0.0% | 0.72 | 2.273s | 12.513s | 14.539s | 14.539s |
| Medium (10 users) | 10 | 100 | 100 | 0.0% | 0.41 | 15.399s | 35.401s | 61.453s | 61.453s |
| Heavy (20 users) | 20 | 200 | 200 | 0.0% | 1.21 | 2.985s | 21.207s | 33.622s | 37.136s |
| Extreme (50 users) | 50 | 250 | 250 | 0.0% | 2.51 | 1.786s | 16.191s | 25.459s | 36.098s |