o RTh @s.ddlZdddddZd ddZd dd ZdS) Nii )gpt-3.5-turbo-0301 gpt-3.5-turbogpt-4 gpt-4-0314rcCszt|}Wntytd}Ynw|dkrEd}|D] }|d7}|D]\}}|t||7}|dkr=|d7}q(q|d7}|S|dksQ|d ksQ|d kr|d}|D] }|d7}|D]\}}|t||7}|dkrt|d7}q_qU|d7}|Std |d ) z8Returns the number of tokens used by a list of messages. cl100k_baserrnamerrrzBnum_tokens_from_messages() is not presently implemented for model z|. See https://github.com/openai/openai-python/blob/main/chatml.md for information on how messages are converted to tokens.)tiktokenencoding_for_modelKeyError get_encodingitemslenencodeNotImplementedError)messagesmodelencoding num_tokensmessagekeyvaluerO/home/air/segue/gemini/backup/venv/lib/python3.10/site-packages/genai/tokens.pynum_tokens_from_messages s@  rcCsFt||d}|durt|}||kr!|dt||d}||ks|S)zGReduce the number of messages until they are below the max token limit.)rNr)r MAX_TOKENSpop)rr max_tokensrrrr trim_messages_to_fit_token_limit/s   r )r)rN)r rrr rrrrs "