深度学习ADAM算法,分享给大家学习。 We introduce Adam, an algorithm for first-order gradient-based optimization of stochastic objective functions, based on adaptive estimates of lower-order moments. The method is straightforward to implement, is computationally efficient, has little memory requirements, is invariant to diagonal rescaling of the gradients, and is well suited for problems that are large in terms of data and/or parameters. The method is also appropriate for non-stationary objectives and problems with very noisy and/or sparse gradients. The hyper-parameters have intuitive interpretations and typically require little tuning. Some connections to related algorithms, on which Adam was inspired, are discussed. We also analyze the theoretical convergence properties of the algorithm and provide a regret bound on the convergence rate that is comparable to the best known results under the online convex optimization framework. Empirical results demonstrate that Adam works well in practice and compares favorably to other stochastic optimization methods. Finally, we discuss AdaMax, a variant of Adam based on the infinity norm.
2019-12-21 18:52:51 571KB Adam算法
1
Stochastic Geometry for Wireless Networks ,带详细书签, 作者 Martin Haenggi 友情奉上 :)
2019-12-21 18:52:33 7.54MB Stochastic Geometry
1
集成电路设计中静态时序分析国外经典书籍,非常值得有志于ic设计的从业人员查看研究。
2019-12-21 18:52:30 15.01MB IC设计 静态时序分析
1
Introduction to Stochastic Processes 随机过程介绍
2019-12-21 18:52:28 349KB Introduction to Stochastic Processes
1
Computer Networking: A Top-Down Approach (6th Edition) by James Kurose & Keith Ross 非扫描高清版
2019-12-21 18:52:00 8.3MB computer networking
1
非扫描版 Computer Architecture: A Quantitative Approach, Sixth Edition has been considered essential reading by instructors, students and practitioners of computer design for over 20 years. The sixth edition of this classic textbook is fully revised with the latest developments in processor and system architecture. It now features examples from the RISC-V (RISC Five) instruction set architecture, a modern RISC instruction set developed and designed to be a free and openly adoptable standard. It also includes a new chapter on domain-specific architectures and an updated chapter on warehouse-scale computing that features the first public information on Google's newest WSC.
2019-12-21 18:51:02 23.78MB computer architecture quantitative approach
1
这是一本关于随机规划比较全面的书!比较难,不太容易啃,但是读了之后收获很大。这是高清版的!
2019-12-21 18:50:33 2.47MB 随机规划
1
这个是教师手册,非常难得!!! 这个是教师手册,非常难得!!! 这个是教师手册,非常难得!!!
2019-12-21 18:50:27 1.6MB 习题答案: The Finite Element:
1
经典小波教材,适合初学者, 也可作为研究参考,讲解深入浅出,从基础到应用都有所涉及。这是高清版本的,方便阅读
2019-12-21 18:50:07 17.92MB 免费 小波 wavelet 高清
1
随机过程,英文版,第二版,Sheldoen Ross 编著 《随机过程(原书[第2版)》从概率的角度而不是分析的角度来看待随机过程,书中介绍了随机过程的基本理论,包括Poisson过程、Markov链、鞅、 Brown运动、随机序关系、Poisson逼近等,并阐明这些理论在各领域的应用
2019-12-21 18:49:28 12.23MB 随机过程
1