MSc Thesis Defense by Anish Desai: Using Multi Population Cultural Algorithms to prune Deep Neural Networks

Tuesday, April 16, 2019 - 13:30 to 15:30

SCHOOL OF COMPUTER SCIENCE

The School of Computer Science at the University of Windsor is pleased to present …

MSc Thesis Defense by:

Anish Desai
 
Date:  Tuesday, April 16, 2019
Time:  1:30 pm – 3:30 pm
Location: 3105, Lambton Tower

 

Abstract: 

The success of Deep Neural Networks (DNN) in classification is accompanied by a drastic increase in weight parameters which also increases the computational and storage costs. Pruning of DNN involves identifying and removing redundant parameters with little or no loss of accuracy. Layer-wise pruning of weights by their magnitude has shown to be an efficient method to prune neural networks. However, finding the optimal values of threshold for each layer is a challenging task given the large search space. To solve this problem, we use multi-population cultural algorithm which is an evolutionary algorithm that takes advantage of knowledge domains and faster convergence and is used in many optimization problems. We experiment it on LeNet-style models and measure level of pruning through the pruning ratio. Results show that our method achieves the best pruning ratio compared with some state-of-the-art DNN pruning methods. By removing redundant parameters, the computational and storage costs are reduced significantly. 
 

Thesis Committee:

Internal Reader:  Dr. Jianguo Lu
External Reader: Dr. Jill Urbanic
Advisor:  Dr. Ziad Kobti 
Chair: Dr. Pooya Moradian Zadeh
 
 

Thesis Defense Announcement

 

5113 Lambton Tower, 401 Sunset Ave., Windsor ON, N9B 3P4 (519) 253-3000 Ext 3716, csgradinfo@uwindsor.ca

 

 

(519)253-3000