Rope scale for draft models, same as compress_pos_emb. Use if the draft model was trained on long context with rope.
Declarations
Type
null or signed integer or floating point numberDefault
1.0Example
4.0
option
Rope scale for draft models, same as compress_pos_emb. Use if the draft model was trained on long context with rope.
null or signed integer or floating point number1.04.0