The AI field lacks clear benchmarks showing what's actually improving versus what's just hype. Create a dashboard tracking measurable capabilities across language, vision, reasoning etc.
Source data from published papers, benchmark results, and reproducible tests. Offer premium API access for companies needing reliable progress data for planning.
Start by compiling existing benchmark data into simple visualizations. The biggest risk is maintaining objectivity while keeping up with rapid changes in the field.