transformer:应用于时间序列的 Transformer 模型(最初来自 Attention is All You Need)的实现-源码

上传者: 42131705 | 上传时间: 2021-09-03 09:57:40 | 文件大小: 40.93MB | 文件类型: ZIP
时间序列转换器 Transformer 模型的实现(最初来自 )应用于时间序列(由提供支持)。 变压器型号 Transformer 是基于注意力的神经网络,旨在解决 NLP 任务。 它们的主要特点是: 特征向量维度的线性复杂度; 序列计算的并行化,而不是顺序计算; 长期记忆,因为我们可以直接查看任何输入时间序列步骤。 这个 repo 将专注于它们在时间序列中的应用。 数据集和应用作为元模型 我们的用例是为建筑能耗预测建模一个数字模拟器。 为此,我们通过对随机输入(建筑特征和使用情况、天气等)进行采样创建了一个数据集,并获得了模拟输出。 然后我们以时间序列格式转换这些变量,并将其提供给转换器。 时间序列的改编 为了在时间序列上表现良好,必须进行一些调整: 嵌入层被通用线性层取代; 原始位置编码被删除。 可以改用“常规”版本,更好地匹配输入序列日/夜模式; 在注意力图上应用一个

文件下载

资源详情

[{"title":"( 82 个子文件 40.93MB ) transformer:应用于时间序列的 Transformer 模型(最初来自 Attention is All You Need)的实现-源码","children":[{"title":"transformer-master","children":[{"title":"setup.py <span style='color:#111;'> 688B </span>","children":null,"spread":false},{"title":".gitignore <span style='color:#111;'> 213B </span>","children":null,"spread":false},{"title":"training.py <span style='color:#111;'> 4.35KB </span>","children":null,"spread":false},{"title":"export_doc.py <span style='color:#111;'> 1.10KB </span>","children":null,"spread":false},{"title":"labels.json <span style='color:#111;'> 916B </span>","children":null,"spread":false},{"title":"requirements.txt <span style='color:#111;'> 40B </span>","children":null,"spread":false},{"title":"src","children":[{"title":"benchmark.py <span style='color:#111;'> 5.28KB </span>","children":null,"spread":false},{"title":"utils","children":[{"title":"__init__.py <span style='color:#111;'> 86B </span>","children":null,"spread":false},{"title":"utils.py <span style='color:#111;'> 858B </span>","children":null,"spread":false},{"title":"search.py <span style='color:#111;'> 3.63KB </span>","children":null,"spread":false}],"spread":true},{"title":"visualization","children":[{"title":"__init__.py <span style='color:#111;'> 2.63KB </span>","children":null,"spread":false},{"title":"utils.py <span style='color:#111;'> 306B </span>","children":null,"spread":false},{"title":"plot_functions.py <span style='color:#111;'> 3.05KB </span>","children":null,"spread":false}],"spread":true},{"title":"metrics.py <span style='color:#111;'> 616B </span>","children":null,"spread":false},{"title":"dataset.py <span style='color:#111;'> 5.38KB </span>","children":null,"spread":false}],"spread":true},{"title":"cross_validation.py <span style='color:#111;'> 1.94KB </span>","children":null,"spread":false},{"title":"LICENSE <span style='color:#111;'> 34.33KB </span>","children":null,"spread":false},{"title":"training.ipynb <span style='color:#111;'> 2.55MB </span>","children":null,"spread":false},{"title":"README.md <span style='color:#111;'> 3.25KB </span>","children":null,"spread":false},{"title":"tst","children":[{"title":"__init__.py <span style='color:#111;'> 36B </span>","children":null,"spread":false},{"title":"multiHeadAttention.py <span style='color:#111;'> 13.23KB </span>","children":null,"spread":false},{"title":"utils.py <span style='color:#111;'> 2.20KB </span>","children":null,"spread":false},{"title":"positionwiseFeedForward.py <span style='color:#111;'> 1.29KB </span>","children":null,"spread":false},{"title":"loss.py <span style='color:#111;'> 1.48KB </span>","children":null,"spread":false},{"title":"decoder.py <span style='color:#111;'> 3.50KB </span>","children":null,"spread":false},{"title":"transformer.py <span style='color:#111;'> 5.18KB </span>","children":null,"spread":false},{"title":"encoder.py <span style='color:#111;'> 3.15KB </span>","children":null,"spread":false}],"spread":true},{"title":"learning_curve.py <span style='color:#111;'> 1.98KB </span>","children":null,"spread":false},{"title":"visualization.ipynb <span style='color:#111;'> 2.96MB </span>","children":null,"spread":false},{"title":"benchmark.ipynb <span style='color:#111;'> 1.24MB </span>","children":null,"spread":false},{"title":"docs","children":[{"title":"requirements.txt <span style='color:#111;'> 163B </span>","children":null,"spread":false},{"title":"Makefile <span style='color:#111;'> 639B </span>","children":null,"spread":false},{"title":"training.ipynb <span style='color:#111;'> 2.55MB </span>","children":null,"spread":false},{"title":"source","children":[{"title":"transformer.rst <span style='color:#111;'> 102B </span>","children":null,"spread":false},{"title":"index.rst <span style='color:#111;'> 152B </span>","children":null,"spread":false},{"title":"conf.py <span style='color:#111;'> 2.48KB </span>","children":null,"spread":false},{"title":"modules.rst <span style='color:#111;'> 150B </span>","children":null,"spread":false},{"title":"encoder.rst <span style='color:#111;'> 90B </span>","children":null,"spread":false},{"title":"_static","children":[{"title":"css","children":[{"title":"theme_modifs.css <span style='color:#111;'> 1.41KB </span>","children":null,"spread":false}],"spread":false}],"spread":false},{"title":"visualizations.rst <span style='color:#111;'> 116B </span>","children":null,"spread":false},{"title":"multiHeadAttention.rst <span style='color:#111;'> 123B </span>","children":null,"spread":false},{"title":"trainings.rst <span style='color:#111;'> 101B </span>","children":null,"spread":false},{"title":"notebooks","children":[{"title":"trainings","children":[{"title":"training_2019_12_28__110648.ipynb <span style='color:#111;'> 1.15MB </span>","children":null,"spread":false},{"title":"training_2020_02_25__224128.ipynb <span style='color:#111;'> 874.30KB </span>","children":null,"spread":false},{"title":"training_2019_12_03__172753.ipynb <span style='color:#111;'> 776.08KB </span>","children":null,"spread":false},{"title":"training_2019_12_29__143613.ipynb <span style='color:#111;'> 1.24MB </span>","children":null,"spread":false},{"title":"training_2019_12_06__123805.ipynb <span style='color:#111;'> 688.92KB </span>","children":null,"spread":false},{"title":"training_2019_12_15__164718.ipynb <span style='color:#111;'> 638.18KB </span>","children":null,"spread":false},{"title":"training_2020_03_05__080607.ipynb <span style='color:#111;'> 286.36KB </span>","children":null,"spread":false},{"title":"training_2020_01_07__172923.ipynb <span style='color:#111;'> 1.76MB </span>","children":null,"spread":false},{"title":"training_2019_12_23__173446.ipynb <span style='color:#111;'> 1.35MB </span>","children":null,"spread":false},{"title":"training_2019_12_03__170100.ipynb <span style='color:#111;'> 1.75MB </span>","children":null,"spread":false},{"title":"training_2019_12_15__172952.ipynb <span style='color:#111;'> 649.31KB </span>","children":null,"spread":false},{"title":"training_2019_12_25__114022.ipynb <span style='color:#111;'> 1.18MB </span>","children":null,"spread":false},{"title":"training_2019_12_23__194258.ipynb <span style='color:#111;'> 1.28MB </span>","children":null,"spread":false},{"title":"training_2020_01_10__114522.ipynb <span style='color:#111;'> 1.20MB </span>","children":null,"spread":false},{"title":"training_2020_04_01__193853.ipynb <span style='color:#111;'> 2.34MB </span>","children":null,"spread":false},{"title":"training_2020_01_03__133337.ipynb <span style='color:#111;'> 1.35MB </span>","children":null,"spread":false},{"title":"training_2019_12_04__132557.ipynb <span style='color:#111;'> 779.25KB </span>","children":null,"spread":false},{"title":"training_2020_03_04__202641.ipynb <span style='color:#111;'> 837.56KB </span>","children":null,"spread":false},{"title":"training_2020_06_27__164648.ipynb <span style='color:#111;'> 2.55MB </span>","children":null,"spread":false},{"title":"training_2019_12_15__152700.ipynb <span style='color:#111;'> 589.24KB </span>","children":null,"spread":false},{"title":"training_2019_12_03__173205.ipynb <span style='color:#111;'> 611.22KB </span>","children":null,"spread":false},{"title":"training_2020_04_14__143020.ipynb <span style='color:#111;'> 1.24MB </span>","children":null,"spread":false},{"title":"training_2020_04_27__093505.ipynb <span style='color:#111;'> 2.36MB </span>","children":null,"spread":false},{"title":"training_2019_12_24__132610.ipynb <span style='color:#111;'> 1.26MB </span>","children":null,"spread":false},{"title":"training_2019_12_06__114703.ipynb <span style='color:#111;'> 764.75KB </span>","children":null,"spread":false},{"title":"training_2020_01_06__190627.ipynb <span style='color:#111;'> 1.20MB </span>","children":null,"spread":false},{"title":"training_2020_03_31__163536.ipynb <span style='color:#111;'> 2.04MB </span>","children":null,"spread":false},{"title":"training_2019_12_20__112013.ipynb <span style='color:#111;'> 1.00MB </span>","children":null,"spread":false},{"title":"training_2019_12_28__174445.ipynb <span style='color:#111;'> 1.20MB </span>","children":null,"spread":false},{"title":"training_2019_12_20__172758.ipynb <span style='color:#111;'> 1.02MB </span>","children":null,"spread":false},{"title":"training_2020_03_12__195104.ipynb <span style='color:#111;'> 870.74KB </span>","children":null,"spread":false},{"title":"training_2020_01_31__144602.ipynb <span style='color:#111;'> 1.25MB </span>","children":null,"spread":false}],"spread":false},{"title":"visualizations","children":[{"title":"demonstrateur.ipynb <span style='color:#111;'> 5.85MB </span>","children":null,"spread":false},{"title":"visu_2020_03_28__120412.ipynb <span style='color:#111;'> 2.96MB </span>","children":null,"spread":false}],"spread":false}],"spread":false},{"title":"README.md <span style='color:#111;'> 15B </span>","children":null,"spread":false},{"title":"utils.rst <span style='color:#111;'> 84B </span>","children":null,"spread":false},{"title":"loss.rst <span style='color:#111;'> 84B </span>","children":null,"spread":false},{"title":"decoder.rst <span style='color:#111;'> 90B </span>","children":null,"spread":false},{"title":"positionwiseFeedForward.rst <span style='color:#111;'> 138B </span>","children":null,"spread":false}],"spread":false}],"spread":false},{"title":"search.py <span style='color:#111;'> 2.67KB </span>","children":null,"spread":false}],"spread":false}],"spread":true}]

评论信息

免责申明

【只为小站】的资源来自网友分享,仅供学习研究,请务必在下载后24小时内给予删除,不得用于其他任何用途,否则后果自负。基于互联网的特殊性,【只为小站】 无法对用户传输的作品、信息、内容的权属或合法性、合规性、真实性、科学性、完整权、有效性等进行实质审查;无论 【只为小站】 经营者是否已进行审查,用户均应自行承担因其传输的作品、信息、内容而可能或已经产生的侵权或权属纠纷等法律责任。
本站所有资源不代表本站的观点或立场,基于网友分享,根据中国法律《信息网络传播权保护条例》第二十二条之规定,若资源存在侵权或相关问题请联系本站客服人员,zhiweidada#qq.com,请把#换成@,本站将给予最大的支持与配合,做到及时反馈和处理。关于更多版权及免责申明参见 版权及免责申明