Skip to content

torchopt

Advanced Optimizers for Torch

v0.1.4 · Jun 6, 2023 · Apache License (>= 2)

Description

Optimizers for 'torch' deep learning library. These functions include recent results published in the literature and are not part of the optimizers offered in 'torch'. Prospective users should test these optimizers with their data, since performance depends on the specific problem being solved. The packages includes the following optimizers: (a) 'adabelief' by Zhuang et al (2020), <arXiv:2010.07468>; (b) 'adabound' by Luo et al.(2019), <arXiv:1902.09843>; (c) 'adahessian' by Yao et al.(2021) <arXiv:2006.00719>; (d) 'adamw' by Loshchilov & Hutter (2019), <arXiv:1711.05101>; (e) 'madgrad' by Defazio and Jelassi (2021), <arXiv:2101.11075>; (f) 'nadam' by Dozat (2019), <https://openreview.net/pdf/OM0jvwB8jIp57ZJjtNEZ.pdf>; (g) 'qhadam' by Ma and Yarats(2019), <arXiv:1810.06801>; (h) 'radam' by Liu et al. (2019), <arXiv:1908.03265>; (i) 'swats' by Shekar and Sochee (2018), <arXiv:1712.07628>; (j) 'yogi' by Zaheer et al.(2019), <https://papers.nips.cc/paper/8186-adaptive-methods-for-nonconvex-optimization>.

Downloads

202

Last 30 days

16463rd

202

Last 90 days

202

Last year

CRAN Check Status

2 NOTE
12 OK
Show all 14 flavors
Flavor Status
r-devel-linux-x86_64-debian-clang NOTE
r-devel-linux-x86_64-debian-gcc NOTE
r-devel-linux-x86_64-fedora-clang OK
r-devel-linux-x86_64-fedora-gcc OK
r-devel-macos-arm64 OK
r-devel-windows-x86_64 OK
r-oldrel-macos-arm64 OK
r-oldrel-macos-x86_64 OK
r-oldrel-windows-x86_64 OK
r-patched-linux-x86_64 OK
r-release-linux-x86_64 OK
r-release-macos-arm64 OK
r-release-macos-x86_64 OK
r-release-windows-x86_64 OK
Check details (14 non-OK)
NOTE r-devel-linux-x86_64-debian-clang

CRAN incoming feasibility

Maintainer: ‘Gilberto Camara <gilberto.camara.inpe@gmail.com>’

The Description field contains
  (a) 'adabelief' by Zhuang et al (2020), <arXiv:2010.07468>; (b)
  'adabound' by Luo et al.(2019), <arXiv:1902.09843>; (c) 'adahessian' by
  Yao et al.(2021) <arXiv:2006.00719>; (d) 'adamw' by Loshchilov & Hutter
  (2019), <arXiv:1711.05101>; (e) 'madgrad' by Defazio and Jelassi
  (2021), <arXiv:2101.11075>; (f) 'nadam' by Dozat (2019),
  Ma and Yarats(2019), <arXiv:1810.06801>; (h) 'radam' by Liu et al.
  (2019), <arXiv:1908.03265>; (i) 'swats' by Shekar and Sochee (2018),
  <arXiv:1712.07628>; (j) 'yogi' by Zaheer et al.(2019),
Please refer to arXiv e-prints via their arXiv DOI <doi:10.48550/arXiv.YYMM.NNNNN>.
NOTE r-devel-linux-x86_64-debian-gcc

CRAN incoming feasibility

Maintainer: ‘Gilberto Camara <gilberto.camara.inpe@gmail.com>’

The Description field contains
  (a) 'adabelief' by Zhuang et al (2020), <arXiv:2010.07468>; (b)
  'adabound' by Luo et al.(2019), <arXiv:1902.09843>; (c) 'adahessian' by
  Yao et al.(2021) <arXiv:2006.00719>; (d) 'adamw' by Loshchilov & Hutter
  (2019), <arXiv:1711.05101>; (e) 'madgrad' by Defazio and Jelassi
  (2021), <arXiv:2101.11075>; (f) 'nadam' by Dozat (2019),
  Ma and Yarats(2019), <arXiv:1810.06801>; (h) 'radam' by Liu et al.
  (2019), <arXiv:1908.03265>; (i) 'swats' by Shekar and Sochee (2018),
  <arXiv:1712.07628>; (j) 'yogi' by Zaheer et al.(2019),
Please refer to arXiv e-prints via their arXiv DOI <doi:10.48550/arXiv.YYMM.NNNNN>.
OK r-devel-linux-x86_64-fedora-clang

*


            
OK r-devel-linux-x86_64-fedora-gcc

*


            
OK r-devel-macos-arm64

*


            
OK r-devel-windows-x86_64

*


            
OK r-oldrel-macos-arm64

*


            
OK r-oldrel-macos-x86_64

*


            
OK r-oldrel-windows-x86_64

*


            
OK r-patched-linux-x86_64

*


            
OK r-release-linux-x86_64

*


            
OK r-release-macos-arm64

*


            
OK r-release-macos-x86_64

*


            
OK r-release-windows-x86_64

*


            

Check History

NOTE 12 OK · 2 NOTE · 0 WARNING · 0 ERROR · 0 FAILURE Mar 9, 2026
NOTE r-devel-linux-x86_64-debian-clang

CRAN incoming feasibility

Maintainer: ‘Gilberto Camara <gilberto.camara.inpe@gmail.com>’

The Description field contains
  (a) 'adabelief' by Zhuang et al (2020), <arXiv:2010.07468>; (b)
  'adabound' by Luo et al.(2019), <arXiv:1902.09843>; (c) 'adahessian' by
  Yao et al.(2021) <arXiv:2006.00719>; (d) 'adamw' by Loshchilov & Hutter
  (2019), <arXiv:1711.05101>; (e) 'madgrad' by Defazio and Jelassi
  (2021), <arXiv:2101.11075>; (f) 'nadam' by Dozat (2019),
  Ma and Yarats(2019), <arXiv:1810.06801>; (h) 'radam' by Liu et 
NOTE r-devel-linux-x86_64-debian-gcc

CRAN incoming feasibility

Maintainer: ‘Gilberto Camara <gilberto.camara.inpe@gmail.com>’

The Description field contains
  (a) 'adabelief' by Zhuang et al (2020), <arXiv:2010.07468>; (b)
  'adabound' by Luo et al.(2019), <arXiv:1902.09843>; (c) 'adahessian' by
  Yao et al.(2021) <arXiv:2006.00719>; (d) 'adamw' by Loshchilov & Hutter
  (2019), <arXiv:1711.05101>; (e) 'madgrad' by Defazio and Jelassi
  (2021), <arXiv:2101.11075>; (f) 'nadam' by Dozat (2019),
  Ma and Yarats(2019), <arXiv:1810.06801>; (h) 'radam' by Liu et 

Dependency Network

Dependencies Reverse dependencies torch torchopt

Version History

new 0.1.4 Mar 9, 2026