DataInspector: Inspecting input_ids Token Statistics in LLM-Foundry with packing_ratio=5.0
LLM
deep learning
Specifying a
train_loader.dataset.packing_ratio value greater than 1.0 - lightbox