r/datasets • u/sirjoaco • 5d ago
dataset 15,908 answers from 378 AI models to the same 87 prompts, May 2024 to now (CC BY 4.0)
Since May 2024 every new model got the same prompts: draw a pelican on a bicycle as an SVG, build a landing page in one HTML file, tell five jokes, pick a favourite film, 87 in all. One attempt each, no system prompt, temp 0.7. I kept every answer, and it's now a dataset:
- JSON Lines, one file per question, plus models and questions
- SVG drawings as given, HTML pages with a 1280x800 screenshot each, image and audio answers as files
- release dates, and which of the 378 models are retired (101 aren't served on OpenRouter anymore)
- CC BY 4.0, DOI 10.5281/zenodo.23305275
GitHub: https://github.com/museumofmodels/collection Zenodo: https://doi.org/10.5281/zenodo.23305275 Browse it: https://museumofmodels.com
Nothing is scored, it's just the raw answers. Happy to hear what would make it more useful.
Disclosure: I made the museum and the dataset.
9
Upvotes