I came here to ask about the cost of this based on the number of tokens. Since t... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

rgaino on May 13, 2023 | parent | context | favorite | on: GitHub Copilot Chat Leaked Prompt

I came here to ask about the cost of this based on the number of tokens. Since this prompt is repeated on every single request, isn't there a way to embed it when you load the model? Or they simply use the raw OpenAI API like any of us mortals?

jonplackett on May 16, 2023 [–]

A thousand tokens in the prompt from OpenAI only costs $0.015

But if you have a million searches, each having a 10 message back and forth, just for the prompt alone that's going to cost you $150,000

Surely MS pays a lot less than the OpenAI cost though.

Consider applying for YC's Spring batch! Applications are open till Feb 11.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact