Roark Voice AI Testing and Evals

Organization
Roark · United States
Solution Type
Platform
Collaboration
Business Collaboration (Joint Venture), Licensing

1. Technology overview

Roark is a San Francisco company (Y Combinator Winter 2025 batch) that provides a quality assurance and evaluation platform for voice AI agents. It targets teams that run voice agents in areas such as healthcare, finance, insurance, home services and customer support.

The platform simulates an agent against many synthetic callers before launch, scores every production call on more than 500 audio-native metrics, supports human review and proposes diffed fixes that are re-tested before deployment. It works with agent frameworks such as Vapi, Retell, LiveKit and Pipecat.

2. Highlighted features & specifications

  • Simulation testing: runs an agent against hundreds of simulated callers before launch.
  • Post-call analysis: scores each production call on 500+ audio-native metrics.
  • Human review: lets reviewers label calls and set ground truth.
  • Self-improving loop: drafts fixes, replays them in simulation and verifies the result on live calls.
  • Integrations: works with Vapi, Retell, LiveKit and Pipecat.

3. Potential application

A bank can load-test a voice assistant before a campaign. A healthcare provider can monitor scheduling calls for compliance issues. A call centre vendor can compare prompt or model changes on simulated callers before release.

4. Benefits

Catches failures in voice agents before and after launch. Scores every production call instead of sampling a few. Lets teams prove that a fix improved a metric on live calls. The site lists SOC 2 Type II and a HIPAA BAA for regulated use.

6. Other information

Part of Y Combinator Winter 2025; listed as San Francisco, CA on its Y Combinator profile (the site states no headquarters). The site lists SOC 2 Type II and HIPAA BAA.

Not ready to connect yet?

Save this solution and come back when you are ready to talk to the provider

Trusted by Our Partners

TechFest VietnamIOM – UN MigrationGIZ (Deutsche Gesellschaft für Internationale Zusammenarbeit)APED – Cục Phát triển doanh nghiệp tư nhân và kinh tế tập thểSIHUB – Startup and Innovation Hub of Ho Chi Minh CityHợp tác Đức (Deutsche Zusammenarbeit)SCE & Investment PromotionStartup Vietnam Foundation (SVF)National Startup Support Center (NSSC)01BoosterQuest VenturesBộ Tài chính (Ministry of Finance)ITPC – HCMC Investment and Trade Promotion CentreJICA – Japan International Cooperation AgencyNational Innovation Center (NIC)UK GovernmentBCG – Boston Consulting GroupHAWEEHeineken VietnamTalentnetMB BankVIREA – Liên chi hội Bất động sản Công nghiệp Việt NamJobTestGlobal Supply Chain Support Fund / Aavishkaar CapitalKDANPSE / JPS – Phúc Sang MinhG-AsiaPacificBlueScopeLPBankUlsan Center for Creative Economy & InnovationĐại học Bách khoa Hà Nội – Trường Điện - Điện tửVINK – Vietnam Innovation Network in KoreaTencent WeStart (Shenzhen)Ulsan CollegeK-StartupFaslinkShinhan Future's LabShinhan SecuritiesShinhan FinanceShinhan BankShinhan Life

Start with the right connection

We make innovation easy to access for every business everywhere. The next deal is you.

Contact Us