Add replies back in for JSON responses. #166
No reviewers
Labels
No Milestone
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: rDrama/rDrama#166
Loading…
Reference in New Issue
There is no content yet.
Delete Branch "<deleted>:return-threads"
Deleting a branch is permanent. Although the deleted branch may exist for a short time before cleaning up, in most cases it CANNOT be undone. Continue?
I think I can run the new 30B model with 5-bit quantization on CPU without much quality loss. Having 'replies' in the JSON lets Bussy-boy take in the full thread for context - do you think it might be safe to uncomment? Idk what the original issue was, but IIRC the site's running on a faster server since whenever this got commented out.
Nvm, I can just walk up the tree with
parent_comment_id
Pull request closed