Error using function callbacks on custom inference endpoint

[John6666]

There seems to be some incompatibility between TGI and Llama’s Function Calling, so you may need to use a slightly hacky workaround.

Resources

• Tool use does not work on Neuron backend #3114 (Same error)
• Function/tool calling never resolves #2986