MG-MLP: Multi-gated MLP for Restoring Images from Spatially Variant Degradations
Jaihyun Koh (Samsung Display),* Jaihyun Lew (Seoul National University), Jangho Lee (Incheon National University), Sungroh Yoon (Seoul National University)
The 34th British Machine Vision Conference
Abstract
We propose a novel gating mechanism, which can be applied to the MLP mixer-based architecture for image restoration. In the proposed architecture, embedded tokens are subjected to channel and token mixing, which are the primary data flow of the existing MLP mixer. The token vectors are subsequently refined through the proposed intra-token and cross-token gating. Intra-token gating determines the information that is to be propagated or discarded by the interaction of information within each token. By contrast, cross-token gating calculates the propagation weights of local information and recycles information discarded from intra-token gating by comparing the information with adjacent tokens. The two gating paths result in third-order interaction because of cascaded gating multiplication, which is similar to the self-attention of Transformer. However, the proposed method is more efficient than Transformer because it does not involve the quadratic cost of self-attention. The proposed network was applied to various spatially variant deblurring tasks; it outperformed baselines in terms of restoration performance and computational cost.Video
Citation
@inproceedings{Koh_2023_BMVC,
author = {Jaihyun Koh and Jaihyun Lew and Jangho Lee and Sungroh Yoon},
title = {MG-MLP: Multi-gated MLP for Restoring Images from Spatially Variant Degradations},
booktitle = {34th British Machine Vision Conference 2023, {BMVC} 2023, Aberdeen, UK, November 20-24, 2023},
publisher = {BMVA},
year = {2023},
url = {https://papers.bmvc2023.org/0283.pdf}
}
Copyright © 2023
The British Machine Vision Conference is organised by