探物及理 | BUAA | 技术博客https://blog.tolshao.xyz/https://blog.tolshao.xyz/posts/nasa_motor/https://blog.tolshao.xyz/posts/nasa_motor/二刷 NASA 电机设计备忘录：“多物理场耦合”才是通关秘籍Fri, 23 Jan 2026 07:05:44 GMThttps://blog.tolshao.xyz/posts/foc1/https://blog.tolshao.xyz/posts/foc1/FOC 就是把交流当直流使？老列带你捅破这层窗户纸Wed, 21 Jan 2026 03:21:41 GMThttps://blog.tolshao.xyz/posts/ios-yellow-page-update/https://blog.tolshao.xyz/posts/ios-yellow-page-update/还在手动导入 vCard？快来试试 CardDAV 订阅吧，一劳永逸，自动更新！Thu, 24 Jul 2025 02:00:00 GMThttps://blog.tolshao.xyz/posts/python%E4%B8%BB%E9%A2%98%E5%88%86%E4%BA%AB/https://blog.tolshao.xyz/posts/python%E4%B8%BB%E9%A2%98%E5%88%86%E4%BA%AB/'人生苦短，我用python,Life is short, you need Python——Bruce Eckel'Fri, 24 Sep 2021 07:00:07 GMThttps://blog.tolshao.xyz/posts/mac%E5%BC%80%E5%90%AFhidpi/https://blog.tolshao.xyz/posts/mac%E5%BC%80%E5%90%AFhidpi/让你的显示器支持苹果的HiDPI黑科技，用降低分辨率的代价获得更好的显示效果「手动狗头」，对你的眼睛好一点Wed, 06 Jan 2021 18:41:19 GMThttps://blog.tolshao.xyz/posts/rl_gym_start/https://blog.tolshao.xyz/posts/rl_gym_start/OpenAI gym 的入门教程，参考自官网的gym手册Tue, 08 Sep 2020 07:36:04 GMThttps://blog.tolshao.xyz/posts/rl_matlab_youtube/https://blog.tolshao.xyz/posts/rl_matlab_youtube/youtube上官方matlab下深度学习RL课程笔记，从工程师的角度宏观上概述了RL问题的所有关键点和注意点Tue, 08 Sep 2020 06:55:39 GMThttps://blog.tolshao.xyz/posts/rl_pr3/https://blog.tolshao.xyz/posts/rl_pr3/利用SARSA（0）的学习方法，帮助agent学习到价值函数(表），进而选取动作。Thu, 03 Sep 2020 03:41:39 GMThttps://blog.tolshao.xyz/posts/rl_pr2_gym/https://blog.tolshao.xyz/posts/rl_pr2_gym/算法研究者，可以快速利用多种不同的环境验证迭代自己的算法有效性。算法应用，可以效仿gym中的接口，搭建自己的环境。Thu, 03 Sep 2020 02:11:11 GMThttps://blog.tolshao.xyz/posts/rl_pr_1_dp/https://blog.tolshao.xyz/posts/rl_pr_1_dp/实现用 动态规划 值迭代 的方法，求解格子世界中的随机策略价值函数Wed, 02 Sep 2020 09:27:13 GMThttps://blog.tolshao.xyz/posts/rl_10/https://blog.tolshao.xyz/posts/rl_10/介绍RL历史中的经典案例Thu, 27 Aug 2020 07:12:42 GMThttps://blog.tolshao.xyz/posts/rl_9/https://blog.tolshao.xyz/posts/rl_9/利用让Agent更稳定，探索让Agent上限更高，二者不可得兼，平衡一下吧Sun, 23 Aug 2020 10:35:12 GMThttps://blog.tolshao.xyz/posts/iina_potplayer/https://blog.tolshao.xyz/posts/iina_potplayer/教你用浏览器看电视，全球的频道都可以access，跳广告的什么的也都在这儿了Fri, 21 Aug 2020 00:49:03 GMThttps://blog.tolshao.xyz/posts/img_bed/https://blog.tolshao.xyz/posts/img_bed/免费图床，稳定可靠，结合CDN加速，棒了Wed, 19 Aug 2020 10:35:50 GMThttps://blog.tolshao.xyz/posts/rl_8/https://blog.tolshao.xyz/posts/rl_8/规划是基于模型的搜索，学习是基于数据的总结，二者结合，1+1>2Mon, 17 Aug 2020 08:05:59 GMThttps://blog.tolshao.xyz/posts/hexo_advanced/https://blog.tolshao.xyz/posts/hexo_advanced/一点点装饰你的房子，让它变得更漂亮Wed, 12 Aug 2020 15:19:44 GMThttps://blog.tolshao.xyz/posts/rl_7/https://blog.tolshao.xyz/posts/rl_7/策略梯度法，可以实现不基于价值函数的动作选取，在训练过程中稳定性更优Tue, 11 Aug 2020 07:09:31 GMThttps://blog.tolshao.xyz/posts/blog_setup/https://blog.tolshao.xyz/posts/blog_setup/不买域名，不租服务器，不写html，跟我走Fri, 07 Aug 2020 16:00:00 GMThttps://blog.tolshao.xyz/posts/ios_yellow_page/https://blog.tolshao.xyz/posts/ios_yellow_page/ios黄页，让你用iPhone打电话的时候快人一步Fri, 07 Aug 2020 07:09:31 GMThttps://blog.tolshao.xyz/posts/rk4/https://blog.tolshao.xyz/posts/rk4/当然是因为他仿真精度高啊，为啥，进来看看吧小跳最近在搭建一个数值仿真环境，由于需要用到python里面的一些库，所以不得不把simulink的模型搬过来，我们都知道在simulink里，仿真的时候设置仿真步长和微分方程求解器是必要的步骤。但是为什么要设置这个小跳却早已忘记了。Wed, 05 Aug 2020 07:09:31 GMThttps://blog.tolshao.xyz/posts/rl_6/https://blog.tolshao.xyz/posts/rl_6/离散空间的RL问题可以构建value table进行查表解决，对于连续空间的问题，可以引入值函数估计器，解决了查表运算量大的问题Wed, 05 Aug 2020 07:09:31 GMThttps://blog.tolshao.xyz/posts/deep_learning_summary/https://blog.tolshao.xyz/posts/deep_learning_summary/记录了深度学习课程的知识与亮点，不仅仅适合初学者了解深度学习，还适合机器学习从业者和研究者复习基本概念。Mon, 03 Aug 2020 07:09:31 GMThttps://blog.tolshao.xyz/posts/keras_tensorflow/https://blog.tolshao.xyz/posts/keras_tensorflow/Keras是一个高层神经网络API，能够把你的idea迅速转换为结果Mon, 03 Aug 2020 07:09:31 GMThttps://blog.tolshao.xyz/posts/rl_5/https://blog.tolshao.xyz/posts/rl_5/完成了不基于模型的策略评估之后，可以采取$psilon$-greedy等方法进行动作选取，根据状态信息进行动作选取并执行，就实现了不基于模型的控制Sat, 01 Aug 2020 07:09:31 GMThttps://blog.tolshao.xyz/posts/deep_learning/https://blog.tolshao.xyz/posts/deep_learning/深度学习是用深度神经网络的方法，将机器学习加以拓展，其优势是可以实现超复杂非线性函数的映射Thu, 23 Jul 2020 07:09:31 GMThttps://blog.tolshao.xyz/posts/advance_control_2/https://blog.tolshao.xyz/posts/advance_control_2/BiliBili_Dr_can 课程笔记Wed, 15 Jul 2020 10:09:31 GMThttps://blog.tolshao.xyz/posts/cnn/https://blog.tolshao.xyz/posts/cnn/卷积神经网络，一般用于Computer vision等领域，典型应用有物体检测、人脸识别等Wed, 15 Jul 2020 07:09:31 GMThttps://blog.tolshao.xyz/posts/rl_4/https://blog.tolshao.xyz/posts/rl_4/RL的一个重要突破就是不基于模型的控制，在控制之前，需要先用model-free control对策略进行评估Wed, 15 Jul 2020 07:09:31 GMThttps://blog.tolshao.xyz/posts/rl_3/https://blog.tolshao.xyz/posts/rl_3/规划是基于模型的搜索，学习是基于数据的总结。动态规划DP，用迭代的方法将价值函数、策略收敛到最优Fri, 10 Jul 2020 07:09:31 GMThttps://blog.tolshao.xyz/posts/mbse/https://blog.tolshao.xyz/posts/mbse/改变传统设计的繁杂工作流程，用系统的思想、数字化的语言和工具，将项目周期加快，加快，再加快Wed, 08 Jul 2020 07:09:31 GMThttps://blog.tolshao.xyz/posts/rl_2/https://blog.tolshao.xyz/posts/rl_2/将游戏过程、动力学过程抽象为马尔科夫过程MP，便于引入到RL进行研究Sun, 05 Jul 2020 07:09:31 GMThttps://blog.tolshao.xyz/posts/rl_1/https://blog.tolshao.xyz/posts/rl_1/从简单概念入手，介绍强化学习Reinforcement learning的基本结构Wed, 01 Jul 2020 07:09:31 GMThttps://blog.tolshao.xyz/posts/machine_learning/https://blog.tolshao.xyz/posts/machine_learning/Coursera网站Andrew Ng的ML课程笔记Sun, 28 Jun 2020 07:09:31 GMThttps://blog.tolshao.xyz/posts/sequence_model/https://blog.tolshao.xyz/posts/sequence_model/RNN序列模型，主要用于自然语言处理NLP等环境，引入attention机制，让网络的input在随时间步进行中，较远的运算之得以保留Thu, 25 Jun 2020 07:09:31 GMThttps://blog.tolshao.xyz/posts/paper_writting/https://blog.tolshao.xyz/posts/paper_writting/追求效率至上，知道怎么做，比早点出发更重要Sun, 03 May 2020 07:09:31 GMThttps://blog.tolshao.xyz/posts/mac_app/https://blog.tolshao.xyz/posts/mac_app/Mac2021装机必备，让你的效率提高20倍，系统、多媒体、写作都在这儿了Thu, 30 Apr 2020 16:00:00 GMThttps://blog.tolshao.xyz/posts/advanced_control/https://blog.tolshao.xyz/posts/advanced_control/经典控制理论笔记，线性系统控制理论笔记Sun, 05 Apr 2020 10:09:31 GMThttps://blog.tolshao.xyz/posts/settings_mac/https://blog.tolshao.xyz/posts/settings_mac/记录备忘mac系统、软件的设置Wed, 01 Apr 2020 07:09:31 GMThttps://blog.tolshao.xyz/posts/settings_latex/https://blog.tolshao.xyz/posts/settings_latex/备忘Latex的设置（持续更新）Wed, 18 Mar 2020 07:09:31 GMThttps://blog.tolshao.xyz/posts/settings_matlab/https://blog.tolshao.xyz/posts/settings_matlab/备忘matlab设置和snippets，自定义打印格式调整和快捷保存图片（持续更新）Sat, 01 Feb 2020 07:09:31 GMThttps://blog.tolshao.xyz/posts/settings_python/https://blog.tolshao.xyz/posts/settings_python/备忘python的snippets，python画图，从txt、excel读取数据等（持续更新）Wed, 01 Jan 2020 07:09:31 GMT