2
0 Comments

suggestions on GPT-3 api Token usage.

Hello everyone.
When creating an app that summarizes bulky content (e.g an article) using GPT-3 model, Is it possible to exclude the content to be summarized from the prompt?

The challenge currently is, because i need to send the whole content along with the prompt, it significantly increases the amount of token used for each api call from less than 200 tokens to over 1000 tokens.

has anyone experienced such before or have knowledge of how i can resolve this?

Trending on Indie Hackers
How I Launched My AI Startup with a Warm Email List and Zero Marketing Budget? 27 comments What you can learn from Marc Lou 19 comments Here's how we got our first 200 users 18 comments Software Developers Can Build Beautiful Software 10 comments Worst Hire - my lessons 8 comments Transforming Habits: What I Learned from 90+ Days of Regular Workouts 7 comments