ryan/simbarag
1
0
Fork 0
Code Issues Pull Requests 4 Actions Packages Projects Releases Wiki Activity

Batch Paperless chunk embeddings during indexing #73

Merged
ryan merged 1 commits from perf/batch-paperless-embeddings into main 2026-10-12 23:06:29 -04:00
Conversation 0 Commits 1 Files Changed 2
+76 -7

1 Commits

Author SHA1 Message Date
Ryan Chen c80125f7fe Batch Paperless chunk embeddings during indexing 
index_documents sent one embedding request and one insert per chunk.
Send chunks in batches of 32 and, only when a batch fails, retry it one
chunk at a time so the rejected chunk is still named in the logs.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-12 22:55:04 -04:00