OneTriangle KV Cache Transfer Inference

Organization
OneTriangle · United States
Solution Type
Platform
Collaboration
Business Collaboration (Joint Venture), Licensing

1. Technology overview

OneTriangle is a San Francisco start-up (Y Combinator batch Summer 2026, founded 2026 per YC) that optimises LLM inference. It addresses the cost of prefill on long inputs, where large-model rates apply before the model produces a first word.

The engine runs prefill on a small model and decode on a large one, transferring the KV cache between them through head-wise projection. The site reports results such as Llama 3.1 8B to 70B first-token time falling from 16.9s to 2.7s at 100k tokens. It integrates with dedicated endpoints or customer GPUs.

2. Highlighted features & specifications

  • KV cache transfer: moves cache from a small to a large model.
  • Split inference: prefill on small model, decode on large.
  • Benchmarks: published latency and cost figures.
  • Integration: works with dedicated endpoints or GPUs.
  • Demo: interactive demo and research pages.

3. Potential application

A bank running a private LLM can cut latency on long document queries. A telecom can lower cost of customer-service assistants. A cloud provider can speed up hosted model endpoints.

4. Benefits

Reports first-token time 6.3x faster and prefill cost 84 percent lower in its benchmark. Integrates with dedicated endpoints or customer GPUs. Based on published cross-model KV cache transfer research.

6. Other information

Based in San Francisco, CA per YC; Y Combinator Summer 2026 batch. Benchmark figures are the company's own.

Not ready to connect yet?

Save this solution and come back when you are ready to talk to the provider

Trusted by Our Partners

TechFest VietnamIOM – UN MigrationGIZ (Deutsche Gesellschaft für Internationale Zusammenarbeit)APED – Cục Phát triển doanh nghiệp tư nhân và kinh tế tập thểSIHUB – Startup and Innovation Hub of Ho Chi Minh CityHợp tác Đức (Deutsche Zusammenarbeit)SCE & Investment PromotionStartup Vietnam Foundation (SVF)National Startup Support Center (NSSC)01BoosterQuest VenturesBộ Tài chính (Ministry of Finance)ITPC – HCMC Investment and Trade Promotion CentreJICA – Japan International Cooperation AgencyNational Innovation Center (NIC)UK GovernmentBCG – Boston Consulting GroupHAWEEHeineken VietnamTalentnetMB BankVIREA – Liên chi hội Bất động sản Công nghiệp Việt NamJobTestGlobal Supply Chain Support Fund / Aavishkaar CapitalKDANPSE / JPS – Phúc Sang MinhG-AsiaPacificBlueScopeLPBankUlsan Center for Creative Economy & InnovationĐại học Bách khoa Hà Nội – Trường Điện - Điện tửVINK – Vietnam Innovation Network in KoreaTencent WeStart (Shenzhen)Ulsan CollegeK-StartupFaslinkShinhan Future's LabShinhan SecuritiesShinhan FinanceShinhan BankShinhan Life

Start with the right connection

We make innovation easy to access for every business everywhere. The next deal is you.

Contact Us