Matches in SemOpenAlex for { <https://semopenalex.org/work/W4287659611> ?p ?o ?g. }
Showing items 1 to 62 of
62
with 100 items per page.
- W4287659611 abstract "Batch normalization (BN) is an important technique commonly incorporated into deep learning models to perform standardization within mini-batches. The merits of BN in improving a model's learning efficiency can be further amplified by applying whitening, while its drawbacks in estimating population statistics for inference can be avoided through group normalization (GN). This paper proposes group whitening (GW), which exploits the advantages of the whitening operation and avoids the disadvantages of normalization within mini-batches. In addition, we analyze the constraints imposed on features by normalization, and show how the batch size (group number) affects the performance of batch (group) normalized networks, from the perspective of model's representational capacity. This analysis provides theoretical guidance for applying GW in practice. Finally, we apply the proposed GW to ResNet and ResNeXt architectures and conduct experiments on the ImageNet and COCO benchmarks. Results show that GW consistently improves the performance of different architectures, with absolute gains of $1.02%$ $sim$ $1.49%$ in top-1 accuracy on ImageNet and $1.82%$ $sim$ $3.21%$ in bounding box AP on COCO." @default.
- W4287659611 created "2022-07-25" @default.
- W4287659611 creator A5001665699 @default.
- W4287659611 creator A5063481044 @default.
- W4287659611 creator A5075318877 @default.
- W4287659611 creator A5082634513 @default.
- W4287659611 creator A5090798126 @default.
- W4287659611 date "2020-09-28" @default.
- W4287659611 modified "2023-09-26" @default.
- W4287659611 title "Group Whitening: Balancing Learning Efficiency and Representational Capacity" @default.
- W4287659611 hasPublicationYear "2020" @default.
- W4287659611 type Work @default.
- W4287659611 citedByCount "0" @default.
- W4287659611 crossrefType "posted-content" @default.
- W4287659611 hasAuthorship W4287659611A5001665699 @default.
- W4287659611 hasAuthorship W4287659611A5063481044 @default.
- W4287659611 hasAuthorship W4287659611A5075318877 @default.
- W4287659611 hasAuthorship W4287659611A5082634513 @default.
- W4287659611 hasAuthorship W4287659611A5090798126 @default.
- W4287659611 hasBestOaLocation W42876596111 @default.
- W4287659611 hasConcept C111919701 @default.
- W4287659611 hasConcept C11413529 @default.
- W4287659611 hasConcept C119857082 @default.
- W4287659611 hasConcept C136886441 @default.
- W4287659611 hasConcept C144024400 @default.
- W4287659611 hasConcept C154945302 @default.
- W4287659611 hasConcept C165696696 @default.
- W4287659611 hasConcept C188087704 @default.
- W4287659611 hasConcept C19165224 @default.
- W4287659611 hasConcept C2776214188 @default.
- W4287659611 hasConcept C38652104 @default.
- W4287659611 hasConcept C41008148 @default.
- W4287659611 hasConcept C63584917 @default.
- W4287659611 hasConceptScore W4287659611C111919701 @default.
- W4287659611 hasConceptScore W4287659611C11413529 @default.
- W4287659611 hasConceptScore W4287659611C119857082 @default.
- W4287659611 hasConceptScore W4287659611C136886441 @default.
- W4287659611 hasConceptScore W4287659611C144024400 @default.
- W4287659611 hasConceptScore W4287659611C154945302 @default.
- W4287659611 hasConceptScore W4287659611C165696696 @default.
- W4287659611 hasConceptScore W4287659611C188087704 @default.
- W4287659611 hasConceptScore W4287659611C19165224 @default.
- W4287659611 hasConceptScore W4287659611C2776214188 @default.
- W4287659611 hasConceptScore W4287659611C38652104 @default.
- W4287659611 hasConceptScore W4287659611C41008148 @default.
- W4287659611 hasConceptScore W4287659611C63584917 @default.
- W4287659611 hasLocation W42876596111 @default.
- W4287659611 hasOpenAccess W4287659611 @default.
- W4287659611 hasPrimaryLocation W42876596111 @default.
- W4287659611 hasRelatedWork W11144228 @default.
- W4287659611 hasRelatedWork W11849241 @default.
- W4287659611 hasRelatedWork W12278135 @default.
- W4287659611 hasRelatedWork W13034104 @default.
- W4287659611 hasRelatedWork W351505 @default.
- W4287659611 hasRelatedWork W3987941 @default.
- W4287659611 hasRelatedWork W4272086 @default.
- W4287659611 hasRelatedWork W592020 @default.
- W4287659611 hasRelatedWork W9329549 @default.
- W4287659611 hasRelatedWork W722847 @default.
- W4287659611 isParatext "false" @default.
- W4287659611 isRetracted "false" @default.
- W4287659611 workType "article" @default.