Skip to yearly menu bar Skip to main content


Poster

Model Lego: Creating Models Like Disassembling and Assembling Building Blocks

Jiacong Hu · Jing Gao · Jingwen Ye · Yang Gao · Xingen Wang · Zunlei Feng · Mingli Song

Poster Room - TBD
[ ]
Thu 12 Dec 11 a.m. PST — 2 p.m. PST

Abstract:

With the rapid development of deep learning, the increasing complexity and scale of parameters make training a new model increasingly resource-intensive. In this paper, we start from the classic convolutional neural network (CNN) and explore a paradigm that does not require training to obtain new models. Similar to the birth of CNN inspired by receptive fields in the biological visual system, we draw inspiration from the information subsystem pathways in the biological visual system and propose Model Disassembling and Assembling (MDA). During model disassembling, we introduce the concept of relative contribution and propose a component locating technique to extract task-aware components from trained CNN classifiers. For model assembling, we present the alignment padding strategy and parameter scaling strategy to construct a new model tailored for a specific task, utilizing the disassembled task-aware components.The entire process is akin to playing with LEGO bricks, enabling arbitrary assembly of new models, and providing a novel perspective for model creation and reuse. Extensive experiments showcase that task-aware components disassembled from CNN classifiers or new models assembled using these components closely match or even surpass the performance of the baseline,demonstrating its promising results for model reuse. Furthermore, MDA exhibits diverse potential applications, with comprehensive experiments exploring model decision route analysis, model compression, knowledge distillation, and more. The source codes are included in the \emph{Supplementary Material}.

Live content is unavailable. Log in and register to view live content