Matches in SemOpenAlex for { <https://semopenalex.org/work/W4309953921> ?p ?o ?g. }
Showing items 1 to 76 of
76
with 100 items per page.
- W4309953921 abstract "In this paper, we present an integral pre-training framework based on masked image modeling (MIM). We advocate for pre-training the backbone and neck jointly so that the transfer gap between MIM and downstream recognition tasks is minimal. We make two technical contributions. First, we unify the reconstruction and recognition necks by inserting a feature pyramid into the pre-training stage. Second, we complement mask image modeling (MIM) with masked feature modeling (MFM) that offers multi-stage supervision to the feature pyramid. The pre-trained models, termed integrally pre-trained transformer pyramid networks (iTPNs), serve as powerful foundation models for visual recognition. In particular, the base/large-level iTPN achieves an 86.2%/87.8% top-1 accuracy on ImageNet-1K, a 53.2%/55.6% box AP on COCO object detection with 1x training schedule using Mask-RCNN, and a 54.7%/57.7% mIoU on ADE20K semantic segmentation using UPerHead -- all these results set new records. Our work inspires the community to work on unifying upstream pre-training and downstream fine-tuning tasks. Code and the pre-trained models will be released at https://github.com/sunsmarterjie/iTPN." @default.
- W4309953921 created "2022-11-30" @default.
- W4309953921 creator A5007238584 @default.
- W4309953921 creator A5015317495 @default.
- W4309953921 creator A5015744133 @default.
- W4309953921 creator A5028178607 @default.
- W4309953921 creator A5033976028 @default.
- W4309953921 creator A5047455588 @default.
- W4309953921 creator A5050660610 @default.
- W4309953921 creator A5066032427 @default.
- W4309953921 creator A5071558373 @default.
- W4309953921 date "2022-11-23" @default.
- W4309953921 modified "2023-10-11" @default.
- W4309953921 title "Integrally Pre-Trained Transformer Pyramid Networks" @default.
- W4309953921 doi "https://doi.org/10.48550/arxiv.2211.12735" @default.
- W4309953921 hasPublicationYear "2022" @default.
- W4309953921 type Work @default.
- W4309953921 citedByCount "0" @default.
- W4309953921 crossrefType "posted-content" @default.
- W4309953921 hasAuthorship W4309953921A5007238584 @default.
- W4309953921 hasAuthorship W4309953921A5015317495 @default.
- W4309953921 hasAuthorship W4309953921A5015744133 @default.
- W4309953921 hasAuthorship W4309953921A5028178607 @default.
- W4309953921 hasAuthorship W4309953921A5033976028 @default.
- W4309953921 hasAuthorship W4309953921A5047455588 @default.
- W4309953921 hasAuthorship W4309953921A5050660610 @default.
- W4309953921 hasAuthorship W4309953921A5066032427 @default.
- W4309953921 hasAuthorship W4309953921A5071558373 @default.
- W4309953921 hasBestOaLocation W43099539211 @default.
- W4309953921 hasConcept C119599485 @default.
- W4309953921 hasConcept C120665830 @default.
- W4309953921 hasConcept C121332964 @default.
- W4309953921 hasConcept C127413603 @default.
- W4309953921 hasConcept C138885662 @default.
- W4309953921 hasConcept C142575187 @default.
- W4309953921 hasConcept C153180895 @default.
- W4309953921 hasConcept C154945302 @default.
- W4309953921 hasConcept C165801399 @default.
- W4309953921 hasConcept C2776401178 @default.
- W4309953921 hasConcept C31972630 @default.
- W4309953921 hasConcept C41008148 @default.
- W4309953921 hasConcept C41895202 @default.
- W4309953921 hasConcept C66322947 @default.
- W4309953921 hasConcept C89600930 @default.
- W4309953921 hasConceptScore W4309953921C119599485 @default.
- W4309953921 hasConceptScore W4309953921C120665830 @default.
- W4309953921 hasConceptScore W4309953921C121332964 @default.
- W4309953921 hasConceptScore W4309953921C127413603 @default.
- W4309953921 hasConceptScore W4309953921C138885662 @default.
- W4309953921 hasConceptScore W4309953921C142575187 @default.
- W4309953921 hasConceptScore W4309953921C153180895 @default.
- W4309953921 hasConceptScore W4309953921C154945302 @default.
- W4309953921 hasConceptScore W4309953921C165801399 @default.
- W4309953921 hasConceptScore W4309953921C2776401178 @default.
- W4309953921 hasConceptScore W4309953921C31972630 @default.
- W4309953921 hasConceptScore W4309953921C41008148 @default.
- W4309953921 hasConceptScore W4309953921C41895202 @default.
- W4309953921 hasConceptScore W4309953921C66322947 @default.
- W4309953921 hasConceptScore W4309953921C89600930 @default.
- W4309953921 hasLocation W43099539211 @default.
- W4309953921 hasLocation W43099539212 @default.
- W4309953921 hasOpenAccess W4309953921 @default.
- W4309953921 hasPrimaryLocation W43099539211 @default.
- W4309953921 hasRelatedWork W1669643531 @default.
- W4309953921 hasRelatedWork W1982826852 @default.
- W4309953921 hasRelatedWork W2005437358 @default.
- W4309953921 hasRelatedWork W2008656436 @default.
- W4309953921 hasRelatedWork W2023558673 @default.
- W4309953921 hasRelatedWork W2110230079 @default.
- W4309953921 hasRelatedWork W2134924024 @default.
- W4309953921 hasRelatedWork W2517104666 @default.
- W4309953921 hasRelatedWork W2613186388 @default.
- W4309953921 hasRelatedWork W1967061043 @default.
- W4309953921 isParatext "false" @default.
- W4309953921 isRetracted "false" @default.
- W4309953921 workType "article" @default.