2
0 Comments

suggestions on GPT-3 api Token usage.

Hello everyone.
When creating an app that summarizes bulky content (e.g an article) using GPT-3 model, Is it possible to exclude the content to be summarized from the prompt?

The challenge currently is, because i need to send the whole content along with the prompt, it significantly increases the amount of token used for each api call from less than 200 tokens to over 1000 tokens.

has anyone experienced such before or have knowledge of how i can resolve this?

Trending on Indie Hackers
Passed $7k 💵 in a month with my boring directory of job boards 62 comments How I got 1,000+ sign-ups in less than a month with social media alone 28 comments Reaching $20k MRR using Cold Emails only 17 comments 87.7% of entrepreneurs struggle with at least one mental health issue 14 comments I made a list of sites to submit your Startup 11 comments Email marketing done right: 7 tips for designing campaigns that drive results 10 comments