197 lines
9.4 KiB
Plaintext
197 lines
9.4 KiB
Plaintext
|
o
|
|||
|
|
àŠÚiƒ. ã @ sL d Z ddlZddlZddlZddlmZmZmZmZ G dd„ dƒZ e ƒ Z
|
|||
|
|
dS )u#
|
|||
|
|
LLM客户端 - 调用大模型API
|
|||
|
|
é N)ÚDictÚListÚOptionalÚAnyc @ s e Zd ZdZ d/dededed efd
|
|||
|
|
d „Z
|
|||
|
|
d0dee de dede
|
|||
|
|
def
|
|||
|
|
dd„Z d1dededefdd„Z d1dedededefd d „Z
|
|||
|
|
d edefd d „Zd!ed edee fd"d#„Zd$ed%edefd&d'„Z d1d$ed(edefd)d*„Zd$ed+edefd,d-„Zd.S )2Ú LLMClientu 大模型客户端ú http://192.168.2.17:19007/v1ÚxxxxÚautoéx Úbase_urlÚapi_keyÚmodelÚtimeoutc C s" | d¡| _|| _|| _|| _d S )Nú/)Úrstripr r r
|
|||
|
|
r )Úselfr r r
|
|||
|
|
r © r úP/home/xian/.openclaw/workspace-coder/works/multi-agent-bidding/app/llm_client.pyÚ__init__ s
|
|||
|
|
zLLMClient.__init__çffffffæ?é FÚmessagesÚ temperatureÚ
|
|||
|
|
max_tokensÚstreamÚreturnc
|
|||
|
|
C s¬ | j › d�}dd| j› �dœ}| j||||dœ}z’tj|||| j|d�}|jdkr7dd |j› d
|
|||
|
|
|j› �d œW S |r‘d} | ¡ D ]L}
|
|||
|
|
|
|
|||
|
|
r‹|
|
|||
|
|
d ¡}
|
|||
|
|
|
|
|||
|
|
|
|||
|
|
d
|
|||
|
|
¡r‹|
|
|||
|
|
dd… } | dkrY n3z't | ¡} d| v rt
|
|||
|
|
| d ƒdkr| d d di ¡}
|
|||
|
|
d|
|
|||
|
|
v r| |
|
|||
|
|
d 7 } W q? t jyŠ Y q?w q?d| iW S | ¡ } | d d d d } | di ¡}| |dœW S tjy¹ ddd œ Y S tjyÕ } zddt|ƒ› �d œW Y d}~S d}~ww )uD
|
|||
|
|
���天请求
|
|||
|
|
|
|||
|
|
Args:
|
|||
|
|
messages: [{"role": "user/assistant/system", "content": "..."}]
|
|||
|
|
temperature: 温度�数
|
|||
|
|
max_tokens: 最大token数
|
|||
|
|
stream: 是���输出
|
|||
|
|
|
|||
|
|
Returns:
|
|||
|
|
{"content": "...", "usage": {...}}
|
|||
|
|
z/chat/completionszapplication/jsonzBearer )z Content-TypeÚ
|
|||
|
|
Authorization)r
|
|||
|
|
r r r r )ÚheadersÚjsonr r éÈ Ú u API错误: z - )ÚcontentÚerrorzutf-8zdata: é Nz[DONE]Úchoicesr Údeltar! ÚmessageÚusage)r! r' u 请求超时u 请求异常: )r r r
|
|||
|
|
ÚrequestsÚpostr Ú status_codeÚtextÚ
|
|||
|
|
iter_linesÚdecodeÚ
|
|||
|
|
startswithr ÚloadsÚlenÚgetÚJSONDecodeErrorÚTimeoutÚRequestExceptionÚstr)r r r r r Úurlr ÚpayloadÚresponser! ÚlineÚdataÚchunkr% r' Úer r r Úchat sn
|
|||
|
|
þûû
|
|||
|
|
þ
|
|||
|
|
|
|||
|
|
|
|||
|
|
€ÿ€
|
|||
|
|
þ €ÿzLLMClient.chatr ÚpromptÚ
|
|||
|
|
system_promptc C sV g }|r | d|dœ¡ | d|dœ¡ | |¡}d|v r'|d r't|d ƒ‚|d S )u½
|
|||
|
|
简��天接�
|
|||
|
|
|
|||
|
|
Args:
|
|||
|
|
prompt: 用户输入
|
|||
|
|
system_prompt: 系统�示
|
|||
|
|
|
|||
|
|
Returns:
|
|||
|
|
模型回�文本
|
|||
|
|
Úsystem©Úroler! Úuserr" r! )Úappendr= Ú Exception)r r> r? r Úresultr r r Ú simple_chato s
|
|||
|
|
zLLMClient.simple_chatÚschemac C s t j|ddd�}|d | }d|dœd|dœg}| j|dd �}d
|
|||
|
|
|v r-|d
|
|||
|
|
r-t|d
|
|||
|
|
ƒ‚|d ¡ }z%| d ¡rS| d
|
|||
|
|
¡} d
|
|||
|
|
| d d krL| dd… n| dd… ¡}t |¡W S t j yŠ ddl
|
|||
|
|
}
|
|||
|
|
|
|
|||
|
|
d||
|
|||
|
|
j ¡} | rƒz
|
|||
|
|
t |
|
|||
|
|
¡ ¡W Y S t j y‚ Y nw |ddœ Y S w )uå
|
|||
|
|
结构化输出
|
|||
|
|
|
|||
|
|
Args:
|
|||
|
|
prompt: 用户输入
|
|||
|
|
schema: è¾“å‡ºæ ¼å¼�æ��è¿°
|
|||
|
|
system_prompt: 系统�示
|
|||
|
|
|
|||
|
|
Returns:
|
|||
|
|
解��的JSON对象
|
|||
|
|
é F©ÚindentÚ ensure_asciiu>
|
|||
|
|
|
|||
|
|
请按照以下JSONæ ¼å¼�输出，ä¸�è¦�输出其他内容:
|
|||
|
|
r@ rA rC g333333Ó?)r r" r! z```Ú
|
|||
|
|
éÿÿÿÿé Nr z\{.*\}u æ— æ³•è§£æž�为JSON)Ú raw_contentÚ parse_error)r Údumpsr= rE Ústripr. ÚsplitÚjoinr/ r2 ÚreÚsearchÚDOTALLÚgroup) r r> rH r? Ú schema_textÚ full_systemr rF r! ÚlinesrV Ú
|
|||
|
|
json_matchr r r Ústructured_output† s2 þ
|
|||
|
|
|
|||
|
|
* ÿözLLMClient.structured_outputÚ user_requestc C s* d}ddgddgdœ}| d|› �||¡S )uã
|
|||
|
|
分�用户�图
|
|||
|
|
|
|||
|
|
Args:
|
|||
|
|
user_request: 用户原始请求
|
|||
|
|
|
|||
|
|
Returns:
|
|||
|
|
{"intent": "...", "keywords": [...], "need_clarification": bool, "questions": [...]}
|
|||
|
|
u÷ ä½ æ˜¯ä¸€ä¸ªæ„�图分æž�专家。分æž�用户的请求，判æ–：
|
|||
|
|
1. ç”¨æˆ·çš„æ ¸å¿ƒæ„�图是什么
|
|||
|
|
2. ��关键信�
|
|||
|
|
3. 信�是�足够完整（�需��外澄清）
|
|||
|
|
4. 如果�完整，需�澄清的问题
|
|||
|
|
|
|||
|
|
请以JSONæ ¼å¼�输出。u! ç”¨æˆ·æ ¸å¿ƒæ„�图的简æ´�æ��è¿°u 关键信æ�¯åˆ—表u 是å�¦éœ€è¦�澄清 (true/false)u@ 需è¦�澄清的问题列表（如果need_clarification为true）)ÚintentÚkeywordsÚneed_clarificationÚ questionsu 分æž�以下用户请求:
|
|||
|
|
|
|||
|
|
)r^ )r r_ r? rH r r r Úanalyze_intent» s
|
|||
|
|
üýzLLMClient.analyze_intentr` c
|
|||
|
|
C sZ d}ddddhdhdgdœgd gd
|
|||
|
|
œ}| d |› d tj|d
|
|||
|
|
dd�› d�||¡}| dg ¡S )u
|
|||
|
|
任务拆分
|
|||
|
|
|
|||
|
|
Args:
|
|||
|
|
intent: �图分�结果
|
|||
|
|
user_request: 用户原始请求
|
|||
|
|
|
|||
|
|
Returns:
|
|||
|
|
[{"id": "...", "type": "serial/parallel", "description": "...", "dependencies": [...]}]
|
|||
|
|
uh ä½ æ˜¯ä¸€ä¸ªä»»åŠ¡è§„åˆ’ä¸“å®¶ã€‚æ ¹æ�®ç”¨æˆ·æ„�图，将请求拆分为多个å�任务。
|
|||
|
|
|
|||
|
|
规则：
|
|||
|
|
1. 识别任务之间的�赖关系
|
|||
|
|
2. æ— ä¾�èµ–çš„ä»»åŠ¡æ ‡è®°ä¸ºparallel（å�¯å¹¶è¡Œï¼‰
|
|||
|
|
3. 有ä¾�èµ–çš„ä»»åŠ¡æ ‡è®°ä¸ºserial（串行）
|
|||
|
|
4. �个任务有明确的�述
|
|||
|
|
5. �个任务有明确的输入输出�求
|
|||
|
|
|
|||
|
|
请以JSONæ ¼å¼�输出任务列表。u) ä»»åŠ¡å”¯ä¸€æ ‡è¯†ï¼ˆå¦‚task_1, task_2）u serial 或 parallelu 任务æ��è¿°u 输入è¦�求u 输出è¦�求u ä¾�赖的任务ID列表)ÚidÚtypeÚ descriptionÚ input_schemaÚ
|
|||
|
|
output_schemaÚ dependenciesu 任务执行顺åº�说明)ÚtasksÚexecution_orderu 用户原始请求: u
|
|||
|
|
|
|||
|
|
�图分�结果:
|
|||
|
|
rI FrJ u
|
|||
|
|
|
|||
|
|
请拆分为å�任务列表。rk )r^ r rR r1 )r r` r_ r? rH rF r r r Ú split_tasksÚ s& úÿ
|
|||
|
|
õýø zLLMClient.split_tasksÚtaskÚ
|
|||
|
|
agent_profilec
|
|||
|
|
C sR d}dddddgdgdœ}| d tj|d
|
|||
|
|
d d �› d
|
|||
|
|
tj|d
|
|||
|
|
d d �› d�||¡}|S )u¶
|
|||
|
|
Agent生æˆ�ç«žæ ‡
|
|||
|
|
|
|||
|
|
Args:
|
|||
|
|
task: 任务定义
|
|||
|
|
agent_profile: Agent档案
|
|||
|
|
|
|||
|
|
Returns:
|
|||
|
|
ç«žæ ‡ä¹¦å†…å®¹
|
|||
|
|
u' ä½ æ˜¯ä¸€ä¸ªæ‰§è¡ŒAgent，需è¦�ä¸ºä»»åŠ¡ç«žæ ‡ã€‚
|
|||
|
|
|
|||
|
|
è¯„ä¼°ä½ çš„èƒ½åŠ›å’Œä»»åŠ¡çš„åŒ¹é…�度，给出：
|
|||
|
|
1. 能力匹�度（0-1）
|
|||
|
|
2. 预估完�时间（秒）
|
|||
|
|
3. 自信度（0-1）
|
|||
|
|
4. 执行方案�述
|
|||
|
|
5. �置�件（如果有）
|
|||
|
|
6. 备选方案（如果有）
|
|||
|
|
|
|||
|
|
请以JSONæ ¼å¼�输出。u 能力匹é…�度 0-1u 预估完æˆ�时间(秒)u
|
|||
|
|
自信度 0-1u 执行方案æ��è¿°u å‰�ç½®æ�¡ä»¶åˆ—表u 备选方案列表)Úcapability_matchÚestimated_timeÚ
|
|||
|
|
confidenceÚapproachÚ
|
|||
|
|
prerequisitesÚalternative_approachesõ 任务:
|
|||
|
|
rI FrJ u
|
|||
|
|
|
|||
|
|
ä½ çš„æ¡£æ¡ˆ:
|
|||
|
|
u
|
|||
|
|
|
|||
|
|
请生æˆ�ç«žæ ‡ä¹¦ã€‚)r^ r rR )r rn ro r? rH rF r r r Ú generate_bid s$
|
|||
|
|
ú ÿü÷ zLLMClient.generate_bidrs c C sj d}d|dœddt j|ddd�› d |› d
|
|||
|
|
�dœg}| j|d d d
|
|||
|
|
�}d|v r/|d r/d|d iS d|d iS )uª
|
|||
|
|
执行任务
|
|||
|
|
|
|||
|
|
Args:
|
|||
|
|
task: 任务定义
|
|||
|
|
approach: 执行方案
|
|||
|
|
|
|||
|
|
Returns:
|
|||
|
|
执行结果
|
|||
|
|
u“ ä½ æ˜¯ä¸€ä¸ªä»»åŠ¡æ‰§è¡Œè€…ã€‚æ ¹æ�®ä»»åŠ¡æ��述和执行方案，完æˆ�任务并输出结果。
|
|||
|
|
|
|||
|
|
输出应该符�任务的output_schema�求。r@ rA rC rv rI FrJ u
|
|||
|
|
|
|||
|
|
执行方案: u#
|
|||
|
|
|
|||
|
|
请执行任务并输出结果。g à?i )r r r" rF r! )r rR r= )r rn rs r? r rF r r r Ú execute_task= s ÿ
|
|||
|
|
ýþ
|
|||
|
|
zLLMClient.execute_taskrF c
|
|||
|
|
C s` d}ddddgddgdœ}| d tj|d
|
|||
|
|
d d �› d
|
|||
|
|
t|tƒr&tj|d
|
|||
|
|
d d �nt|ƒ› d�||¡S )uË
|
|||
|
|
验�结果
|
|||
|
|
|
|||
|
|
Args:
|
|||
|
|
task: 任务定义
|
|||
|
|
result: 执行结果
|
|||
|
|
|