TylerHilbert/PyTorchConference2025_GithubRepos
Viewer • Updated • 117 • 144 • 1
Thanks for sharing.
It makes sense the constrained decoding would create the best results for generating valid json.
I was wondering if you have any thoughts on using constrained decoding for generating code for compiled languages, such as C++. Could you utilize a compiler as feedback for the constrained decoder, and if so, would the generated code likely be correct?