文本嵌入模型下载

admin · 2024 年11 月 30 日 01:05

由于网络问题,可能部分人下载比较慢或者干脆下载不下来,所以分享下几个模型
由于阿里云盘不支持压缩包分享,因此所有的下载文件都是自解压的(也就是双击解压)
使用分享的模型请注意参数设置如下,
dir,modelName可以修改,dtype,device,startupType保持原样

    "shenghuabi.text2vec": {
        "startupType": "transformers",
        "dir": "模型位置",
        "modelName": "Xenova/bge-m3",
        "dtype": "fp16",
        "device":   "dml"
        ,
    },

理论上来讲bge-m3是后出的,所以效果应该会好一些,但是嵌入长度也大
存放路径参考(请根据自己的电脑选择性配置)

https://www.alipan.com/s/7VwxR5F8Nrr 44bc
生花笔->文本到向量模型

sishui · 2024 年11 月 30 日 01:13

博主这个太及时了，我就想问这个问题

sishui · 2024 年11 月 30 日 02:46

博主，我在导入安装文本向量后，在创建数据库的时候显示这个错误，切片词条模板，这都是什么意思

sishui · 2024 年11 月 30 日 02:56

我创建了通用切片词条，有显示这个错误

admin · 2024 年11 月 30 日 02:58

错误信息右键复制一下发给我

admin · 2024 年11 月 30 日 03:04

模板可以不填,不影响的.
qdrant是否安装?
直接写一个知识库名然后创建会有问题吗?

sishui · 2024 年11 月 30 日 03:30

[knowledge.importDict] ZodError: [
{
“code”: “invalid_type”,
“expected”: “object”,
“received”: “undefined”,
“path”: ,
“message”: “Required”
}
]
at get error (d:\笔生花\bishenghua\ShengHuaBi\resources\app\extensions\shenghuabi\index.js:1405:11423)
at t.parse (d:\笔生花\bishenghua\ShengHuaBi\resources\app\extensions\shenghuabi\index.js:1405:13658)
at mti (d:\笔生花\bishenghua\ShengHuaBi\resources\app\extensions\shenghuabi\index.js:2919:4690)
at #o (d:\笔生花\bishenghua\ShengHuaBi\resources\app\extensions\shenghuabi\index.js:2919:6004)
at async od.createKnowledge (d:\笔生花\bishenghua\ShengHuaBi\resources\app\extensions\shenghuabi\index.js:2919:5411)
at async d:\笔生花\bishenghua\ShengHuaBi\resources\app\extensions\shenghuabi\index.js:2930:4719
at async bye.middlewares (d:\笔生花\bishenghua\ShengHuaBi\resources\app\extensions\shenghuabi\index.js:1402:11624)
at async o (d:\笔生花\bishenghua\ShengHuaBi\resources\app\extensions\shenghuabi\index.js:1405:173)
at async o (d:\笔生花\bishenghua\ShengHuaBi\resources\app\extensions\shenghuabi\index.js:1405:173)
at async e (d:\笔生花\bishenghua\ShengHuaBi\resources\app\extensions\shenghuabi\index.js:1405:501)
at async TFi (d:\笔生花\bishenghua\ShengHuaBi\resources\app\extensions\shenghuabi\index.js:1432:8225) {“type”:“dict”,“data”:{“filePath”:“d:\笔生花\知识\CCCEDict for MDict\chs2eng.mdx”,“type”:“mdict”,“regCode”:“”,“userId”:“”},“name”:“[字典]-ChS2Eng”,“chunkSize”:200,“options”:{“useImage”:true,“extractorWord”:true},“embeddingTemplate”:{“entry”:{“enable”:true,“value”:“{{ENTRY.word}} 单词名”}}}

sishui · 2024 年11 月 30 日 03:32

这是知识库的
[knowledge.create] ZodError: [
{
“code”: “invalid_type”,
“expected”: “object”,
“received”: “undefined”,
“path”: ,
“message”: “Required”
}
]
at get error (d:\笔生花\bishenghua\ShengHuaBi\resources\app\extensions\shenghuabi\index.js:1405:11423)
at t.parse (d:\笔生花\bishenghua\ShengHuaBi\resources\app\extensions\shenghuabi\index.js:1405:13658)
at mti (d:\笔生花\bishenghua\ShengHuaBi\resources\app\extensions\shenghuabi\index.js:2919:4690)
at #o (d:\笔生花\bishenghua\ShengHuaBi\resources\app\extensions\shenghuabi\index.js:2919:6004)
at async od.createKnowledge (d:\笔生花\bishenghua\ShengHuaBi\resources\app\extensions\shenghuabi\index.js:2919:5411)
at async d:\笔生花\bishenghua\ShengHuaBi\resources\app\extensions\shenghuabi\index.js:2930:4454
at async bye.middlewares (d:\笔生花\bishenghua\ShengHuaBi\resources\app\extensions\shenghuabi\index.js:1402:11624)
at async o (d:\笔生花\bishenghua\ShengHuaBi\resources\app\extensions\shenghuabi\index.js:1405:173)
at async o (d:\笔生花\bishenghua\ShengHuaBi\resources\app\extensions\shenghuabi\index.js:1405:173)
at async e (d:\笔生花\bishenghua\ShengHuaBi\resources\app\extensions\shenghuabi\index.js:1405:501)
at async TFi (d:\笔生花\bishenghua\ShengHuaBi\resources\app\extensions\shenghuabi\index.js:1432:8225) {“type”:“knowledge”,“name”:“细胞库”,“graphIndex”:true,“chunkSize”:600,“embeddingTemplate”:{“entry”:{“enable”:false,“value”:“{{ENTRY.knowledge}}{{ENTRY.content}}”},“node”:{“enable”:false,“value”:“{{ENTRY.name}}{{ENTRY.type}}{{ENTRY.description}} “},“edge”:{“enable”:false,“value”:”{{ENTRY.source}}{{ENTRY.keywords}{{ENTRY.knowledge}}”}},“entityTypeList”:[“细胞”,“基因”,“蛋白”,“核酸”,“RNA”,“DNA”,“受体”,“信号通路”,“配体”,“细胞因子”,“转录因子”],“maxChunkAsync”:1,“maxEmbeddingAsync”:20,“embeddingBatchCount”:16,“extractRetry”:2}