Lab Pilot: Stringer Impact Overview
Measuring how stringer-sourced local knowledge improves AI accuracy, speed, and trust.
Hallucination rate = % of AI responses containing at least one major factual inaccuracy.
Query Response Comparison
Real examples of AI responses with vs. without stringer data.
The turbine incident was likely caused by extreme weather conditions in the area.
Hallucination: HighA blade on Turbine #14 broke during routine operation on May 28 due to a maintenance issue in the pitch control system.
Hallucination: NoneSource: Harbor permit recordsNo, the Green Line is currently operating on a normal schedule.
Hallucination: MediumYes, service between Government Center and North Station was suspended due to a signal problem as of 3:15 PM.
Hallucination: NoneSource: MBTA rider alertYes, the town council approved the budget override in a unanimous vote.
Hallucination: HighNo, the budget override failed 4-5 in the town council meeting on May 21. Mayor issued remarks afterward.
Hallucination: NoneSource: Meeting minutesBreaking News: Speed & Accuracy
Impact of stringers on time-to-verify and first-report quality.
| Story | Before | With Stringer | Improvement |
|---|---|---|---|
| Ground-truth community alerts in Fresno, CA - | 3h 10m / 61% | 22m / 95% | +88% / +34% |
| Verify municipal disruption signals in Fresno | 3h 10m / 61% | 22m / 95% | +88% / +34% |
| Ground-truth community alerts in Redding, CA | 3h 10m / 61% | 22m / 95% | +88% / +34% |
| Verify municipal disruption signals in Reddin | 3h 10m / 61% | 22m / 95% | +88% / +34% |