【学术讲座】：On AI3.0 Internal LearningParadigm for Advanced Deep
报告题目： On AI3.0 Internal Learning Paradigm for Advanced Deep \r
Learning/Compression
主讲嘉宾： Prof. S.Y. Kung, Dept. EE, Princeton University, \r
USA
邀请人 ： 陈佳义 \r
博士
讲座时间：2019年4月8日（周一）上午10：30
讲座地点：365游戏大厅南校区基础实验楼北座信息工程学院N605会议室
报告摘要:
Back-propagation (BP) is known to be an external \r
learning paradigm since it receives its supervision via the external (i.e. \r
input/output) interfacing nodes of a neural net (NN). Consequently, the \r
BP-based Deep Learning (NN/AI 2.0) has been applied to the training of NN’s \r
parameters exclusively, leaving the question of finding optimal structure to \r
merely trial and error. Arguably, structural training has to be a most vital \r
task facing our next-generation NN/AI technology. To this end, we propose an \r
internal learning paradigm to facilitate direct evaluation/learning of hidden \r
nodes by means of (1) internal teacher labels (ITL); and (2) internal \r
optimization metrics (IOM). Subsequently, via external/internal hybrid \r
learning, we propose a parameter/structure training scheme of optimal Deep \r
Learning/Compression Nets. In our comparative studies, the hybrid learning \r
methodology appears to show both reduced nets and better accuracy at the same \r
time. In fact, it consistently outperforms the existing AI2.0 deep \r
learning/compression techniques. It is important to note that, the internal \r
learning paradigm is, conceptually at least, one step beyond the notion of \r
Internal Neuron's Explainablility, championed by DARPA's XAI (or \r
NN/AI3.0).
嘉宾简介：
S.Y. Kung (kung@princeton.edu) is a professor in the \r
Department of Electrical Engineering at Princeton University, New Jersey. His \r
research areas include machine learning, compressive privacy, data mining and \r
analysis, statistical estimation, system identification, wireless communication, \r
very-large-scale integration (VLSI) array processors, genomic signal processing, \r
and multimedia information processing. He was a founding member of several \r
technical committees of the IEEE Signal Processing Society. He served as a \r
member of the Board of Governors of the IEEE Signal Processing Society \r
(1989–1991). He has been the editor-in-chief of Journal of VLSI Signal \r
Processing Systems since 1990. He has received multiple awards and recognitions. \r
He is a Life Fellow of the IEEE.
欢迎各位老师和同学参加。
