For over a year now, I’ve been working on Compute Prices (https://computeprices.com).

It’s been a great way for me to better understand the cloud GPU industry, learn about data collection, normalization and use agentic coding to build a side project.

One thing I’m working on is distinguishing spot vs on demand prices and listing those separately. Also, including inference pricing for non-text AI models.

What features or data would you like to see me add next?

This is really insightful. Thank you.

Your first two points jive with my intuition that an agents primaries should be a code execution sandbox, mounted files and git.

If you have any practical examples to share I’m sure a ton of people would appreciate it.

Can you say a bit more about evals and your approach?

Human Emulator offers agent based (near instant) quotes for any computer task.