115 lines
8.4 KiB
Plaintext
115 lines
8.4 KiB
Plaintext
|
o
|
|||
|
|
·vRjˆ: ã @ sh d Z ddlZddlZddlmZ ddlmZ ddlmZ ddlm Z ddl
|
|||
|
|
m Z G dd „ d ƒZ e ƒ Z
|
|||
|
|
dS )
|
|||
|
|
u)
|
|||
|
|
æ•°æ�®å¤„ç�†æœ�务 - æ ¸å¿ƒå¤„ç�†é€»è¾‘
|
|||
|
|
é N)Údatetime)ÚConfig)Údb)Úsearch_service)Úparamhub_clientc @ sd e Zd Zdd„ Zdd„ Zdd„ Zdd„ Zd d
|
|||
|
|
„ Zd d „ Zd
|
|||
|
|
d„ Z dd„ Z
|
|||
|
|
dd„ Z dd„ Z dd„ Z
|
|||
|
|
dS )ÚDataProcessServicec C s
|
|||
|
|
t | _d S )N)r Úconfig)Úself© r
|
|||
|
|
úc/home/openclaw/.openclaw/workspace-hz4th_coder/works/param-auto-manager/services/process_service.pyÚ__init__
|
|||
|
|
s
|
|||
|
|
zDataProcessService.__init__c C sÌ |d }| d¡}| d¡}dddg dœ}zœtd|› �ƒ tj||d d
|
|||
|
|
�}|d d kr;t d
|
|||
|
|
|› d�¡ d|d< |W S | ||||¡}|sLd|d< |W S | |||¡}|s\d|d< |W S | |¡} t | ||¡\}
|
|||
|
|
} |
|
|||
|
|
r‘t
|
|||
|
|
j |||d| d|id� d |d< d| › �|d< | |d< td|› d�ƒ nd| › �|d< t
|
|||
|
|
j |||d d | id � | |||¡} | |d < |W S t
|
|||
|
|
yå }
|
|||
|
|
z(d t|
|
|||
|
|
ƒ› �}td!|› �ƒ ||d< t
|
|||
|
|
j |||d d t|
|
|||
|
|
ƒid � |W Y d}
|
|||
|
|
~
|
|||
|
|
S d}
|
|||
|
|
~
|
|||
|
|
ww )"u×
|
|||
|
|
处��个产�的完整�程
|
|||
|
|
|
|||
|
|
Args:
|
|||
|
|
product_info: {
|
|||
|
|
'product_name': str,
|
|||
|
|
'category': str (�选),
|
|||
|
|
'subcategory': str (�选)
|
|||
|
|
}
|
|||
|
|
|
|||
|
|
Returns:
|
|||
|
|
{
|
|||
|
|
'success': bool,
|
|||
|
|
'message': str,
|
|||
|
|
'review_id': str (如果�功�交),
|
|||
|
|
'new_products': list (�现的新产�)
|
|||
|
|
}
|
|||
|
|
Ú product_nameÚcategoryÚ subcategoryFÚ N)ÚsuccessÚmessageÚ review_idÚ new_productsu [处ç�†] 开始处ç�†äº§å“�: T)Úkeywordr Úinclude_internetÚtotalr u 未找到产å“� 'u ' 的相关数æ�®u 未找到相关数æ�®r u æ— æ³•æ��å�–有效数æ�®u å¡«å……æ•°æ�®å¤±è´¥Ú submittedÚdata)r
|
|||
|
|
r r Ústatusr Údetailsr u å·²æ��äº¤å®¡æ ¸ï¼Œreview_id: r u [处ç�†] 产å“� u
|
|||
|
|
æ��交æˆ�功u æ��交失败: ÚfailedÚerror)r
|
|||
|
|
r r r r r u 处ç�†å¤±è´¥: u [错误] )ÚgetÚprintr Ú
|
|||
|
|
search_allr Úsend_notificationÚextract_product_dataÚfill_product_fieldsÚget_category_typeÚsubmit_for_reviewr Úadd_process_historyÚdiscover_new_productsÚ ExceptionÚstr)r Ú product_infor
|
|||
|
|
r r ÚresultÚsearch_resultsÚextracted_dataÚ filled_dataÚ
|
|||
|
|
category_typer Úreview_id_or_errorr ÚeÚ error_msgr
|
|||
|
|
r
|
|||
|
|
r Úprocess_product s¨
|
|||
|
|
|
|||
|
|
üý üý
|
|||
|
|
ýú û ý
|
|||
|
|
û€õz"DataProcessService.process_productc
|
|||
|
|
|
|||
|
|
C sØ |||g dœ}g }| dg ¡D ]/}t | dd¡¡}| ||¡r>| | d¡| d¡| d¡| d¡t | d d¡¡d
|
|||
|
|
œ¡ q| d g ¡D ] } | || d d
|
|||
|
|
¡g¡ra| d | d¡| d¡dœ¡ qE|sfdS ||d< |S )u`
|
|||
|
|
从æ�œç´¢ç»“æžœä¸æ��å�–ç›®æ ‡äº§å“�的具体内容
|
|||
|
|
æŽ’é™¤æ— å…³äº§å“�
|
|||
|
|
)Únamer r Úraw_dataÚarticlesÚ
|
|||
|
|
product_namesú[]ÚsourceÚurlÚsummaryÚcontentÚkeywords)r9 r: r; r< r= ÚinternetÚtitler )r9 r: r< Nr5 )r ÚjsonÚloadsÚis_product_matchÚappend)
|
|||
|
|
r Útarget_productr, r r Ú extractedÚ all_contentÚarticler7 Úitemr
|
|||
|
|
r
|
|||
|
|
r r" � s: ü û€ ý€z'DataProcessService.extract_product_datac C sà |sdS |r t |¡nd}|d dddœ}| |¡}|dkr)| | |d ¡¡ n9|dkr8| | |d ¡¡ n*|d krG| | |d ¡¡ n|rbd
|
|||
|
|
|v rb|d
|
|||
|
|
D ]}| ||d ¡}|ra|||< qQd |d < t ¡
|
|||
|
|
¡ |d
|
|||
|
|
< |S )ur
|
|||
|
|
æ ¹æ�®åˆ†ç±»å—段é…�置，填充产å“�æ•°æ�®
|
|||
|
|
ä¸¥æ ¼æŒ‰ç…§æ�¥æº�æ•°æ�®ï¼Œä¸�åˆ›é€ å†…å®¹
|
|||
|
|
Nr4 TF)r4 ÚvisibleÚ is_pinnedÚmodelr5 ÚgpuÚcpuÚfieldsÚ auto_managerÚ_sourceÚ
|
|||
|
|
_extracted_at) r Úget_category_fieldsr$ ÚupdateÚextract_model_fieldsÚextract_gpu_fieldsÚextract_cpu_fieldsÚextract_field_from_datar ÚnowÚ isoformat) r r- r r Ú
|
|||
|
|
category_infor. r/ ÚfieldÚvaluer
|
|||
|
|
r
|
|||
|
|
r r# ¹ s. ý
|
|||
|
|
€z&DataProcessService.fill_product_fieldsc C sö i }|D ]t}| dd¡p
|
|||
|
|
d}| dd¡pd}|› d|› �}d|vr3t d|¡}|r3| d¡› d�|d< d |vrJt d
|
|||
|
|
|tj¡}|rJt| d¡ƒ|d < d |vrat d |tj¡} | ra| d¡ ¡ |d < d
|
|||
|
|
|vrxt d|¡}
|
|||
|
|
|
|
|||
|
|
rx|
|
|||
|
|
d¡ dd¡|d
|
|||
|
|
< q|S )u æ��å�–AI模型å—段r< r r; Ú
|
|||
|
|
Ú
|
|||
|
|
parametersz(\d+(?:\.\d+)?)\s*[Bb]é ÚBÚcontext_lengthzcontext[:\s]+(\d+)Ú organizationz:(?:by\s+|from\s+|developed\s+by\s+)([\w\s]+?)(?:\s|,|\.|$)Ú publish_datez (\d{4}[-/]\d{1,2}[-/]\d{1,2})ú/ú-)r ÚreÚsearchÚgroupÚIÚintÚstripÚreplace) r r5 rN r r< r; ÚtextÚ params_matchÚ ctx_matchÚ org_matchÚ
|
|||
|
|
date_matchr
|
|||
|
|
r
|
|||
|
|
r rT â s. €z'DataProcessService.extract_model_fieldsc
|
|||
|
|
C sÊ i }|D ]^}| dd¡p
|
|||
|
|
d}| dd¡pd}|› d|› �}d|vr2t d|¡}|r2t| d¡ƒ|d< d|vrIt d |tj¡}|rIt| d¡ƒ|d< d
|
|||
|
|
|vrbt d |¡} | rbt| d¡ d d¡ƒ|d
|
|||
|
|
< q|S )
|
|||
|
|
u æ��å�–GPUå—段r< r r; r] Ú memory_gbz
|
|||
|
|
(\d+)\s*GBr_ Ú
|
|||
|
|
cuda_coresz&(\d+)\s*(?:CUDA|cuda)\s*(?:cores|core)Ú price_usdz\$(\d+(?:,\d+)*)ú,)r rf rg rj rh ri rl )
|
|||
|
|
r r5 rN r r< r; rm Ú mem_matchÚ
|
|||
|
|
cuda_matchÚ price_matchr
|
|||
|
|
r
|
|||
|
|
r rU s& €z%DataProcessService.extract_gpu_fieldsc
|
|||
|
|
C sÆ i }|D ]\}| dd¡p
|
|||
|
|
d}| dd¡pd}|› d|› �}d|vr4t d|tj¡}|r4t| d¡ƒ|d< d|vrKt d |tj¡}|rKt| d¡ƒ|d< d
|
|||
|
|
|vr`t d |¡} | r`t| d¡ƒ|d
|
|||
|
|
< q|S ) u æ��å�–CPUå—段r< r r; r] Úcoresz(\d+)\s*(?:cores?|Cores?)r_ Úthreadsz (\d+)\s*(?:threads?|Threads?)Ú
|
|||
|
|
base_clockz(\d+(?:\.\d+)?)\s*GHz)r rf rg ri rj rh Úfloat)
|
|||
|
|
r r5 rN r r< r; rm Ú cores_matchÚ
|
|||
|
|
threads_matchÚ clock_matchr
|
|||
|
|
r
|
|||
|
|
r rV " s& €z%DataProcessService.extract_cpu_fieldsc C sl |D ]1}| dd¡p d}| dd¡pd}|› d|› �}|› d�}t ||tj¡}|r3| d¡ ¡ S qdS )u 从数æ�®ä¸æ��å�–指定å—段r< r r; r] z[:\s]+([^\n]+)r_ N)r rf rg ri rh rk ) r Ú
|
|||
|
|
field_namer5 r r< r; rm ÚpatternÚmatchr
|