810e3a80be
BGE-VL inherits CLIP's 77-token text positional embedding table — longer chunks crash inside the text model with a shape mismatch. Pre-tokenize with truncation=True, max_length=77 and call get_text_features directly so the high-level encode() (which does not truncate) is bypassed. Log when truncation happens — text chunks beyond the cap are silently cut, so multimodal mode is lossy on the text channel. Image channel is unaffected. |
||
|---|---|---|
| .. | ||
| data_recipe | ||
| export | ||
| inference | ||
| rag | ||
| training | ||
| __init__.py | ||
| tool_healing.py | ||