r/datasets • • 5d ago

dataset 15,908 answers from 378 AI models to the same 87 prompts, May 2024 to now (CC BY 4.0)

Since May 2024 every new model got the same prompts: draw a pelican on a bicycle as an SVG, build a landing page in one HTML file, tell five jokes, pick a favourite film, 87 in all. One attempt each, no system prompt, temp 0.7. I kept every answer, and it's now a dataset:

  • JSON Lines, one file per question, plus models and questions
  • SVG drawings as given, HTML pages with a 1280x800 screenshot each, image and audio answers as files
  • release dates, and which of the 378 models are retired (101 aren't served on OpenRouter anymore)
  • CC BY 4.0, DOI 10.5281/zenodo.23305275

GitHub: https://github.com/museumofmodels/collection Zenodo: https://doi.org/10.5281/zenodo.23305275 Browse it: https://museumofmodels.com

Nothing is scored, it's just the raw answers. Happy to hear what would make it more useful.

Disclosure: I made the museum and the dataset.

9 Upvotes

0 comments sorted by