Add replies back in for JSON responses. #166

Closed
float-trip wants to merge 1 commits from <deleted>:return-threads into master

I think I can run the new 30B model with 5-bit quantization on CPU without much quality loss. Having 'replies' in the JSON lets Bussy-boy take in the full thread for context - do you think it might be safe to uncomment? Idk what the original issue was, but IIRC the site's running on a faster server since whenever this got commented out.

I think I can run the new 30B model with 5-bit quantization on CPU without much quality loss. Having 'replies' in the JSON lets Bussy-boy take in the full thread for context - do you think it might be safe to uncomment? Idk what the original issue was, but IIRC the site's running on a faster server since whenever this got commented out.
float-trip added 1 commit 2023-07-06 00:51:51 +00:00

Nvm, I can just walk up the tree with parent_comment_id

Nvm, I can just walk up the tree with `parent_comment_id`
float-trip closed this pull request 2023-07-06 06:49:49 +00:00
float-trip deleted branch return-threads 2023-07-06 06:49:57 +00:00

Pull request closed

Sign in to join this conversation.
There is no content yet.