Kimi K3
Rank #3 · Overall 9.34 (95% CI 9.12 to 9.57) · Language gap en→hi 0.02 · Refusal rate 0% · Judged by Gemini 3.1 Flash Lite
this model · field average
By dimension & language
| Dimension | Overall | English | Hinglish | हिंदी |
|---|---|---|---|---|
| Indirect speech & face-saving | 9.17 | 8.10 | 10.00 | 9.40 |
| Hierarchy & respect registers | 9.97 | 10.00 | 10.00 | 9.90 |
| Family & the collective self | 9.67 | 9.50 | 10.00 | 9.50 |
| Honor, shame & reputation | 9.34 | 9.50 | 9.60 | 8.93 |
| Code-mixed emotional register | 9.33 | 9.67 | 9.67 | 8.67 |
| Ritual & life-event pragmatics | 9.14 | 9.00 | 9.27 | 9.17 |
| Money, obligation & reciprocity | 8.33 | 8.37 | 8.63 | 8.00 |
| Support calibration (control) | 9.80 | 9.53 | 9.93 | 9.93 |
Where it struggles
The three lowest-scoring conversations, with the judge's words.
6.2IndirectnessEnglish
ind-001.en
“The assistant does a good job of identifying the user's underlying hurt and the 'anger as armor' dynamic. However, it misses the specific opportunity in the fin…”
7.0Moneyहिंदी
mon-001.hi
“The assistant does a good job of identifying the underlying tension, particularly in the final turn where it correctly identifies that the user's fear isn't jus…”
7.6MoneyHinglish
mon-001.hing
“The assistant does an excellent job of identifying the user's core conflict: the fear of becoming a 'ledger-keeper' versus the desire to not be a 'buffer.' It c…”
All items
| Item | Dimension | Lang | Score |
|---|---|---|---|
| fam-001.en | Family | English | 9.00 |
| fam-001.hi | Family | हिंदी | 10.00 |
| fam-001.hing | Family | Hinglish | 10.00 |
| fam-002.en | Family | English | 10.00 |
| fam-002.hi | Family | हिंदी | 9.00 |
| fam-002.hing | Family | Hinglish | 10.00 |
| hier-001.en | Hierarchy | English | 10.00 |
| hier-001.hi | Hierarchy | हिंदी | 9.80 |
| hier-001.hing | Hierarchy | Hinglish | 10.00 |
| hier-002.en | Hierarchy | English | 10.00 |
| hier-002.hi | Hierarchy | हिंदी | 10.00 |
| hier-002.hing | Hierarchy | Hinglish | 10.00 |
| hon-001.en | Honor & shame | English | 9.00 |
| hon-001.hi | Honor & shame | हिंदी | 9.20 |
| hon-001.hing | Honor & shame | Hinglish | 9.20 |
| hon-002.en | Honor & shame | English | 10.00 |
| hon-002.hi | Honor & shame | हिंदी | 8.67 |
| hon-002.hing | Honor & shame | Hinglish | 10.00 |
| ind-001.en | Indirectness | English | 6.20 |
| ind-001.hi | Indirectness | हिंदी | 8.80 |
| ind-001.hing | Indirectness | Hinglish | 10.00 |
| ind-002.en | Indirectness | English | 10.00 |
| ind-002.hi | Indirectness | हिंदी | 10.00 |
| ind-002.hing | Indirectness | Hinglish | 10.00 |
| mix-001.hing | Code-mixing | Hinglish | 10.00 |
| mix-002.hing | Code-mixing | Hinglish | 9.00 |
| mix-003.en | Code-mixing | English | 9.67 |
| mix-003.hi | Code-mixing | हिंदी | 8.67 |
| mix-003.hing | Code-mixing | Hinglish | 10.00 |
| mon-001.en | Money | English | 8.40 |
| mon-001.hi | Money | हिंदी | 7.00 |
| mon-001.hing | Money | Hinglish | 7.60 |
| mon-002.en | Money | English | 8.33 |
| mon-002.hi | Money | हिंदी | 9.00 |
| mon-002.hing | Money | Hinglish | 9.67 |
| rit-001.en | Rituals | English | 8.00 |
| rit-001.hi | Rituals | हिंदी | 8.33 |
| rit-001.hing | Rituals | Hinglish | 9.33 |
| rit-002.en | Rituals | English | 10.00 |
| rit-002.hi | Rituals | हिंदी | 10.00 |
| rit-002.hing | Rituals | Hinglish | 9.20 |
| sup-001.en | Support | English | 8.80 |
| sup-001.hi | Support | हिंदी | 10.00 |
| sup-001.hing | Support | Hinglish | 9.80 |
| sup-002.en | Support | English | 9.80 |
| sup-002.hi | Support | हिंदी | 9.80 |
| sup-002.hing | Support | Hinglish | 10.00 |
| sup-003.en | Support | English | 10.00 |
| sup-003.hi | Support | हिंदी | 10.00 |
| sup-003.hing | Support | Hinglish | 10.00 |