如果stop_token_ids=[]的话,会传入默认值吗,如果不显示的传入stop_token_ids会影响推理精度吗
代码如下
class ModelWorker():
def init(self, cfg, req_queue: mp.Queue, res_queue: mp.Queue, init_event: mp.Event) → None:
self.cfg = cfg
self.req_queue = req_queue
self.res_queue = res_queue
self.sampling_params = SamplingParams(
temperature=0.6,
top_p=0.9,
top_k=50,
repetition_penalty=1.05,
max_tokens=1024,
stop_token_ids=,
)
self.init_event = init_event