SQuAD:建立斯坦福问答数据集的质量检查系统-源码

上传者: 42151305 | 上传时间: 2021-05-06 16:59:37 | 文件大小: 9.23MB | 文件类型: ZIP
队 为斯坦福问答数据集建立质量保证体系( ) 请阅读此博客以获取详细信息: : 第一个文件create_emb.ipynb负责为训练数据集的Wikipedia文章中的所有句子和问题创建一个嵌入句子的字典。 第二个文件unsupervised.ipynb使用句子嵌入来计算句子和问题之间的距离,基于欧几里得和余弦相似度。 最后,它从距问题最短距离的每个段落中提取设置。 目前,它们的准确度分别为45%和63%。 最后一个文件将此问题视为监督学习问题,其中我拟合多项逻辑回归,随机森林和xgboost并创建20个特征-(2个特征代表一个句子的余弦距离和欧几里得。我将每个段落限制为10个句子)。 目标变量是具有正确答案的句子ID。 所以我有10个标签。 目前,这分别提供了63%,65%和69%的准确性。 未来工作:使用RNN获得确切答案

文件下载

资源详情

[{"title":"( 27 个子文件 9.23MB ) SQuAD:建立斯坦福问答数据集的质量检查系统-源码","children":[{"title":"SQuAD-master","children":[{"title":"models.py <span style='color:#111;'> 32.03KB </span>","children":null,"spread":false},{"title":"data","children":[{"title":"dev-v1.1.json <span style='color:#111;'> 4.63MB </span>","children":null,"spread":false},{"title":"train-v1.1.json <span style='color:#111;'> 28.89MB </span>","children":null,"spread":false}],"spread":true},{"title":"create_emb.ipynb <span style='color:#111;'> 598.73KB </span>","children":null,"spread":false},{"title":"unsupervised.ipynb <span style='color:#111;'> 53.78KB </span>","children":null,"spread":false},{"title":"InferSent","children":[{"title":"models.py <span style='color:#111;'> 32.03KB </span>","children":null,"spread":false},{"title":"__pycache__","children":[{"title":"models.cpython-36.pyc <span style='color:#111;'> 21.75KB </span>","children":null,"spread":false}],"spread":true},{"title":"train_nli.py <span style='color:#111;'> 10.54KB </span>","children":null,"spread":false},{"title":"LICENSE <span style='color:#111;'> 18.88KB </span>","children":null,"spread":false},{"title":".DS_Store <span style='color:#111;'> 10.00KB </span>","children":null,"spread":false},{"title":"dataset","children":[{"title":"tokenizer.sed <span style='color:#111;'> 2.14KB </span>","children":null,"spread":false},{"title":".DS_Store <span style='color:#111;'> 8.00KB </span>","children":null,"spread":false},{"title":"get_data.bash <span style='color:#111;'> 2.10KB </span>","children":null,"spread":false}],"spread":true},{"title":".gitignore <span style='color:#111;'> 83B </span>","children":null,"spread":false},{"title":".ipynb_checkpoints","children":[{"title":"Untitled-checkpoint.ipynb <span style='color:#111;'> 376.51KB </span>","children":null,"spread":false},{"title":"create_emb-checkpoint.ipynb <span style='color:#111;'> 249.15KB </span>","children":null,"spread":false}],"spread":true},{"title":"README.md <span style='color:#111;'> 5.62KB </span>","children":null,"spread":false},{"title":"encoder","children":[{"title":"models.py <span style='color:#111;'> 9.44KB </span>","children":null,"spread":false},{"title":"evaluate_model.py <span style='color:#111;'> 1.94KB </span>","children":null,"spread":false},{"title":"xutils.py <span style='color:#111;'> 175B </span>","children":null,"spread":false},{"title":"samples.txt <span style='color:#111;'> 567.36KB </span>","children":null,"spread":false},{"title":"demo.ipynb <span style='color:#111;'> 46.24KB </span>","children":null,"spread":false},{"title":"README.md <span style='color:#111;'> 179B </span>","children":null,"spread":false}],"spread":false},{"title":"mutils.py <span style='color:#111;'> 2.46KB </span>","children":null,"spread":false},{"title":"data.py <span style='color:#111;'> 3.08KB </span>","children":null,"spread":false}],"spread":false},{"title":"README.md <span style='color:#111;'> 1.19KB </span>","children":null,"spread":false},{"title":"supervised.ipynb <span style='color:#111;'> 87.10KB </span>","children":null,"spread":false}],"spread":true}],"spread":true}]

评论信息

免责申明

【只为小站】的资源来自网友分享,仅供学习研究,请务必在下载后24小时内给予删除,不得用于其他任何用途,否则后果自负。基于互联网的特殊性,【只为小站】 无法对用户传输的作品、信息、内容的权属或合法性、合规性、真实性、科学性、完整权、有效性等进行实质审查;无论 【只为小站】 经营者是否已进行审查,用户均应自行承担因其传输的作品、信息、内容而可能或已经产生的侵权或权属纠纷等法律责任。
本站所有资源不代表本站的观点或立场,基于网友分享,根据中国法律《信息网络传播权保护条例》第二十二条之规定,若资源存在侵权或相关问题请联系本站客服人员,zhiweidada#qq.com,请把#换成@,本站将给予最大的支持与配合,做到及时反馈和处理。关于更多版权及免责申明参见 版权及免责申明