Kashikoi

Organization
Kashikoi · United States
Solution Type
Platform
Collaboration
Business Collaboration (Joint Venture), Licensing

1. Technology overview

Kashikoi is a Y Combinator Spring 2025 company based in San Francisco that builds a simulation engine for benchmarking AI agents. It addresses teams that rely on public benchmarks and prompt tweaking and cannot measure agent behaviour in realistic conditions.

The product generates world models that autonomously interview an agent and produce behavioural assessments, using a single prompt and no code. Example reports score metrics such as threat detection accuracy and false positives for a security-operations agent. The site invites teams to talk to the founders.

2. Highlighted features & specifications

  • One-prompt benchmarks: describe the agent and get a custom evaluation.
  • Simulated interviews: world models interact with the agent autonomously.
  • Behavioural assessments: scored reports on accuracy and failure types.
  • Custom data: diverse synthetic data tailored to a use case.
  • Agent comparison: results can be used to compare agents.

3. Potential application

A bank benchmarking a customer-service agent on its own scenarios. A security team scoring a SOC analyst agent for false positives. An AI vendor comparing agent versions before release.

4. Benefits

Benchmarks can be set up from one prompt without code. Assessments reflect an organisation's own scenarios rather than public benchmarks. Teams can compare agents and find weak behaviours before deployment. Example reports show per-metric scores with explanations.

6. Other information

Y Combinator Spring 2025 company based in San Francisco. The launch post says the founders built similar technology at a large enterprise AI company.

Not ready to connect yet?

Save this solution and come back when you are ready to talk to the provider

Trusted by Our Partners

TechFest VietnamIOM – UN MigrationGIZ (Deutsche Gesellschaft für Internationale Zusammenarbeit)APED – Cục Phát triển doanh nghiệp tư nhân và kinh tế tập thểSIHUB – Startup and Innovation Hub of Ho Chi Minh CityHợp tác Đức (Deutsche Zusammenarbeit)SCE & Investment PromotionStartup Vietnam Foundation (SVF)National Startup Support Center (NSSC)01BoosterQuest VenturesBộ Tài chính (Ministry of Finance)ITPC – HCMC Investment and Trade Promotion CentreJICA – Japan International Cooperation AgencyNational Innovation Center (NIC)UK GovernmentBCG – Boston Consulting GroupHAWEEHeineken VietnamTalentnetMB BankVIREA – Liên chi hội Bất động sản Công nghiệp Việt NamJobTestGlobal Supply Chain Support Fund / Aavishkaar CapitalKDANPSE / JPS – Phúc Sang MinhG-AsiaPacificBlueScopeLPBankUlsan Center for Creative Economy & InnovationĐại học Bách khoa Hà Nội – Trường Điện - Điện tửVINK – Vietnam Innovation Network in KoreaTencent WeStart (Shenzhen)Ulsan CollegeK-StartupFaslinkShinhan Future's LabShinhan SecuritiesShinhan FinanceShinhan BankShinhan Life

Start with the right connection

We make innovation easy to access for every business everywhere. The next deal is you.

Contact Us