
1. Technology overview
Kashikoi is a Y Combinator Spring 2025 company based in San Francisco that builds a simulation engine for benchmarking AI agents. It addresses teams that rely on public benchmarks and prompt tweaking and cannot measure agent behaviour in realistic conditions.
The product generates world models that autonomously interview an agent and produce behavioural assessments, using a single prompt and no code. Example reports score metrics such as threat detection accuracy and false positives for a security-operations agent. The site invites teams to talk to the founders.
2. Highlighted features & specifications
- One-prompt benchmarks: describe the agent and get a custom evaluation.
- Simulated interviews: world models interact with the agent autonomously.
- Behavioural assessments: scored reports on accuracy and failure types.
- Custom data: diverse synthetic data tailored to a use case.
- Agent comparison: results can be used to compare agents.
3. Potential application
A bank benchmarking a customer-service agent on its own scenarios. A security team scoring a SOC analyst agent for false positives. An AI vendor comparing agent versions before release.
4. Benefits
Benchmarks can be set up from one prompt without code. Assessments reflect an organisation's own scenarios rather than public benchmarks. Teams can compare agents and find weak behaviours before deployment. Example reports show per-metric scores with explanations.
5. Market trends & opportunities
Enterprises are moving AI agents into production and need evaluation beyond public leaderboards. Vietnamese banks and telecoms piloting agents lack standard ways to test behaviour against their own scenarios.
6. Other information
Y Combinator Spring 2025 company based in San Francisco. The launch post says the founders built similar technology at a large enterprise AI company.
One platform connecting startups, corporations, research institutions, regions and investors











Playbook & Handbook · February 6, 2026
Winning Accelerator Playbook 2026 by BambuUP
RETAIL E-COMMERCE: AI AND REAL-TIME DATA ARE TRANSFORMING HOW RETAIL BUSINESSES OPERATE








































