Appears that HeinzSchrot https://community.zammad.org/u/HeinzSchrot created a similar python solution in December 2023, hinted at the setup, and then disappeared from the community forum
Integrate with GPT - #3 by HeinzSchrot
If anyone works on this or other LLM feature solutions please do not restrict to only “ChatGPT integration” or statically predefine support for only single provider endpoint.
There are many alternative OpenAI API compatible, HTTP servers, LLM engines, proxys, service providers and local application network server endpoints that function as “OpenAI Compatible Server”. Please support users or administrators to specify compatible server endpoint base URL addresses, API keys, and model names.
Many alternatives have standardized on compatibility GitHub - openai/openai-openapi: OpenAPI specification for the OpenAI API
For example,
etc
and ie Anthropic: "We’ve launched an OpenAI-compatible API endpoint, allowing you to test Claude models by changing just your API key, base URL, and model name in existing OpenAI integrations. "
The above may resolve some or most concerns that normally are raised, ie
“will need to anonymize data heavily else it might be critical in GDPR context?!”
“for us germans it would be the easiest to find some kind of on premise solution so data is not flying arround that much.”
etc see longer discussion at Integrate with GPT