FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3169059075> ?p ?o ?g. }

• W3169059075 abstract "Knowledge distillation (KD) is a successful approach for deep neural network acceleration, with which a compact network (student) is trained by mimicking the softmax output of a pre-trained high-capacity network (teacher). In tradition, KD usually relies on access to the training samples and the parameters of the white-box teacher to acquire the transferred knowledge. However, these prerequisites are not always realistic due to storage costs or privacy issues in real-world applications. Here we propose the concept of decision-based black-box (DB3) knowledge distillation, with which the student is trained by distilling the knowledge from a black-box teacher (parameters are not accessible) that only returns classes rather than softmax outputs. We start with the scenario when the training set is accessible. We represent a sample's robustness against other classes by computing its distances to the teacher's decision boundaries and use it to construct the soft label for each training sample. After that, the student can be trained via standard KD. We then extend this approach to a more challenging scenario in which even accessing the training data is not feasible. We propose to generate pseudo samples distinguished by the teacher's decision boundaries to the largest extent and construct soft labels for them, which are used as the transfer set. We evaluate our approaches on various benchmark networks and datasets and experiment results demonstrate their effectiveness. Codes are available at: https://github.com/zwang84/zsdb3kd." @default.
• W3169059075 created "2021-06-22" @default.
• W3169059075 creator A5013555971 @default.
• W3169059075 date "2021-06-06" @default.
• W3169059075 modified "2023-09-25" @default.
• W3169059075 title "Zero-Shot Knowledge Distillation from a Decision-Based Black-Box Model" @default.
• W3169059075 cites W1690739335 @default.
• W3169059075 cites W1821462560 @default.
• W3169059075 cites W2099471712 @default.
• W3169059075 cites W2112796928 @default.
• W3169059075 cites W2134797427 @default.
• W3169059075 cites W2170413022 @default.
• W3169059075 cites W2194775991 @default.
• W3169059075 cites W2512971201 @default.
• W3169059075 cites W2515385951 @default.
• W3169059075 cites W2612445135 @default.
• W3169059075 cites W2739879705 @default.
• W3169059075 cites W2766092598 @default.
• W3169059075 cites W2766966408 @default.
• W3169059075 cites W2786945063 @default.
• W3169059075 cites W2787751390 @default.
• W3169059075 cites W2803023299 @default.
• W3169059075 cites W2874797877 @default.
• W3169059075 cites W2895383303 @default.
• W3169059075 cites W2924578333 @default.
• W3169059075 cites W2928560789 @default.
• W3169059075 cites W2945289329 @default.
• W3169059075 cites W2950967261 @default.
• W3169059075 cites W2951574208 @default.
• W3169059075 cites W2963070423 @default.
• W3169059075 cites W2963303354 @default.
• W3169059075 cites W2964111476 @default.
• W3169059075 cites W2964299589 @default.
• W3169059075 cites W2970806306 @default.
• W3169059075 cites W2976017709 @default.
• W3169059075 cites W2982802130 @default.
• W3169059075 cites W2999254033 @default.
• W3169059075 cites W3034619943 @default.
• W3169059075 cites W3034957837 @default.
• W3169059075 cites W3109689953 @default.
• W3169059075 cites W3118608800 @default.
• W3169059075 cites W3155426343 @default.
• W3169059075 doi "https://doi.org/10.48550/arxiv.2106.03310" @default.
• W3169059075 hasPublicationYear "2021" @default.
• W3169059075 type Work @default.
• W3169059075 sameAs 3169059075 @default.
• W3169059075 citedByCount "0" @default.
• W3169059075 crossrefType "posted-content" @default.
• W3169059075 hasAuthorship W3169059075A5013555971 @default.
• W3169059075 hasBestOaLocation W31690590751 @default.
• W3169059075 hasConcept C104317684 @default.
• W3169059075 hasConcept C119857082 @default.
• W3169059075 hasConcept C124101348 @default.
• W3169059075 hasConcept C13280743 @default.
• W3169059075 hasConcept C154945302 @default.
• W3169059075 hasConcept C177264268 @default.
• W3169059075 hasConcept C178790620 @default.
• W3169059075 hasConcept C180932941 @default.
• W3169059075 hasConcept C185592680 @default.
• W3169059075 hasConcept C185798385 @default.
• W3169059075 hasConcept C188441871 @default.
• W3169059075 hasConcept C198531522 @default.
• W3169059075 hasConcept C199360897 @default.
• W3169059075 hasConcept C204030448 @default.
• W3169059075 hasConcept C205649164 @default.
• W3169059075 hasConcept C2780801425 @default.
• W3169059075 hasConcept C41008148 @default.
• W3169059075 hasConcept C42023084 @default.
• W3169059075 hasConcept C43617362 @default.
• W3169059075 hasConcept C50644808 @default.
• W3169059075 hasConcept C55493867 @default.
• W3169059075 hasConcept C63479239 @default.
• W3169059075 hasConcept C94966114 @default.
• W3169059075 hasConcept C95623464 @default.
• W3169059075 hasConceptScore W3169059075C104317684 @default.
• W3169059075 hasConceptScore W3169059075C119857082 @default.
• W3169059075 hasConceptScore W3169059075C124101348 @default.
• W3169059075 hasConceptScore W3169059075C13280743 @default.
• W3169059075 hasConceptScore W3169059075C154945302 @default.
• W3169059075 hasConceptScore W3169059075C177264268 @default.
• W3169059075 hasConceptScore W3169059075C178790620 @default.
• W3169059075 hasConceptScore W3169059075C180932941 @default.
• W3169059075 hasConceptScore W3169059075C185592680 @default.
• W3169059075 hasConceptScore W3169059075C185798385 @default.
• W3169059075 hasConceptScore W3169059075C188441871 @default.
• W3169059075 hasConceptScore W3169059075C198531522 @default.
• W3169059075 hasConceptScore W3169059075C199360897 @default.
• W3169059075 hasConceptScore W3169059075C204030448 @default.
• W3169059075 hasConceptScore W3169059075C205649164 @default.
• W3169059075 hasConceptScore W3169059075C2780801425 @default.
• W3169059075 hasConceptScore W3169059075C41008148 @default.
• W3169059075 hasConceptScore W3169059075C42023084 @default.
• W3169059075 hasConceptScore W3169059075C43617362 @default.
• W3169059075 hasConceptScore W3169059075C50644808 @default.
• W3169059075 hasConceptScore W3169059075C55493867 @default.
• W3169059075 hasConceptScore W3169059075C63479239 @default.
• W3169059075 hasConceptScore W3169059075C94966114 @default.
• W3169059075 hasConceptScore W3169059075C95623464 @default.
• W3169059075 hasLocation W31690590751 @default.
• W3169059075 hasOpenAccess W3169059075 @default.

• next