Issue with GPT-3.5/GPT-4 not continuing partial program as expected

[41968]

Dear repository maintainers,

I have noticed that when calling GPT-3.5/GPT-4, the completion results do not continue directly after the partial program, but instead output an independent and complete response. This makes it impossible to extend new nodes based on the given partial program. Therefore, can GPT-3.5/GPT-4 be used for this project, or is it necessary to use a locally deployed Huggingface model?

Thank you for your assistance.

[namin]

Hi,

Thanks for your interest. I don't run the GPT version myself (it has been contributed). I am happy to merge any PR that fixes bugs in it or improves it. One caveat is that it can be costly to use this approach with a paid model, since by design the search makes a lot of requests.

Thanks, again. ~n