预测和标准完全一样(各个字段预测值完全一样)
| predict | ground_truth |
|---|---|
| [(0, 3, 'city', '上海市'), (3, 7, 'district', '浦东新区'), (7, 10, 'township', '大团镇'), (10, 14, 'road', '永春东路'), (14, 17, 'houseNumber', '53号')] | [(0, 3, 'city', '上海市'), (3, 7, 'district', '浦东新区'), (7, 10, 'township', '大团镇'), (10, 14, 'road', '永春东路'), (14, 17, 'houseNumber', '53号')] |
| [(0, 3, 'city', '上海市'), (3, 7, 'district', '浦东新区'), (7, 10, 'township', '合庆镇'), (10, 11, 'village', '北')] | [(0, 3, 'city', '上海市'), (3, 7, 'district', '浦东新区'), (7, 10, 'township', '合庆镇'), (10, 11, 'assist', '北')] |
以house_number为例:
| houseNumber_flag | houseNumber_detail |
|---|---|
| ①标注非空预测非空且相等 | {"标注": [[14, 17, "houseNumber", "53号"]], "预测": [[[14, 17, "houseNumber", "53号"]]]} |
| ②标注为空预测为空 | {"标注": [], "预测": []} |
| ③标注非空预测非空且不相等 | {"标注": [[19, 22, "houseNumber", "35号"]], "预测": [[18, 22, "houseNumber", ")35号"]], "与标注相关的预测": [[[18, 22, "houseNumber", ")35号"]]]} |
| ④标注为空预测非空 | |
| ⑤标注非空预测为空 |
准确率:标注与预测相等/总样本数
①+②/ 总样本数
精确率(precision):该字段预测正确的数量/含有该字段的数量
标注非空预测非空且相等/ 该字段标注非空数量
③/①+③+⑤
召回率(recall)
F1