Wparse配置
完整示例(推荐默认)
version = "1.0"
robust = "normal" # debug|normal|strict
[models]
wpl = "./models/wpl"
oml = "./models/oml"
knowledge = "./models/knowledge"
[topology]
sources = "./topology/sources"
sinks = "./topology/sinks"
[performance]
rate_limit_rps = 10000 # 限速(records/second)
parse_workers = 2 # 解析并发 worker 数
[rescue]
path = "./data/rescue"
[log_conf]
output = "File" # Console|File|Both
level = "warn,ctrl=info"
[log_conf.file]
path = "./data/logs" # 文件输出目录;文件名自动取可执行名(wparse.log)
[stat]
[[stat.pick]] # 采集阶段统计
key = "pick_stat"
target = "*"
[[stat.parse]] # 解析阶段统计
key = "parse_stat"
target = "*"
[[stat.sink]] # 下游阶段统计
key = "sink_stat"
target = "*"
说明:
[models].knowledge是知识配置根目录,默认值为./models/knowledgesemantic_dict.toml默认读取${models.knowledge}/semantic_dict.tomlknowdb.toml默认读取${models.knowledge}/knowdb.toml
变量化建议
wparse.toml 中的路径类字符串适合使用 ${VAR} 变量化,例如:
[models]
knowledge = "${WORK_ROOT}/models/knowledge"
[rescue]
path = "${WORK_ROOT}/data/rescue"
[log_conf.file]
path = "${WORK_ROOT}/data/logs"
涉及外部变量文件、敏感值和 sec_key.toml 约定时,参考:配置变量与安全字典(${VAR} / sec_key.toml)。