| The unit is wrong | ”Best model for marketing” is too coarse. The best model depends on the prompt, cost, latency, and context length, and changes every few weeks. A router needs prompt-level signal. |
| Voters have no information | Most voters won’t run the models first. The token pays for opinions. |
| Sybil and collusion attacks | Majority payouts attract bots and vote rings. Stopping them needs slashing, and slashing needs a ground truth to slash against. There isn’t one. |
| Circular token economy | Rewards depend on token value, which depends on data sales, which depend on data quality, which depends on the token. Nothing funds the first round. |
| Regulation | Paying out on prediction outcomes invites gambling and securities scrutiny. In India, crypto gains are taxed at 30% with 1% TDS. |
| No clear buyer | Companies already use public benchmarks, LMArena, and their own evals. Published data can’t be kept exclusive. |
| ”Trains itself forever” | Sparse, lagging crowd votes are a weak training signal compared with real usage. |