Matches in SemOpenAlex for { <https://semopenalex.org/work/W2983647115> ?p ?o ?g. }
- W2983647115 abstract "Dataset distillation is a method for reducing dataset sizes by learning a small number of synthetic samples containing all the information of a large dataset. This has several benefits like speeding up model training, reducing energy consumption, and reducing required storage space. Currently, each synthetic sample is assigned a single `hard' label, and also, dataset distillation can currently only be used with image data. We propose to simultaneously distill both images and their labels, thus assigning each synthetic sample a `soft' label (a distribution of labels). Our algorithm increases accuracy by 2-4% over the original algorithm for several image classification tasks. Using `soft' labels also enables distilled datasets to consist of fewer samples than there are classes as each sample can encode information for multiple classes. For example, training a LeNet model with 10 distilled images (one per class) results in over 96% accuracy on MNIST, and almost 92% accuracy when trained on just 5 distilled images. We also extend the dataset distillation algorithm to distill sequential datasets including texts. We demonstrate that text distillation outperforms other methods across multiple datasets. For example, models attain almost their original accuracy on the IMDB sentiment analysis task using just 20 distilled sentences. Our code can be found at $href{this https URL}{text{this https URL}}$." @default.
- W2983647115 created "2019-11-22" @default.
- W2983647115 creator A5042203967 @default.
- W2983647115 creator A5053200092 @default.
- W2983647115 date "2019-10-06" @default.
- W2983647115 modified "2023-09-27" @default.
- W2983647115 title "Soft-Label Dataset Distillation and Text Dataset Distillation." @default.
- W2983647115 cites W1533861849 @default.
- W2983647115 cites W1583071929 @default.
- W2983647115 cites W1821462560 @default.
- W2983647115 cites W2001619934 @default.
- W2983647115 cites W2064675550 @default.
- W2983647115 cites W2068514419 @default.
- W2983647115 cites W2086511124 @default.
- W2983647115 cites W2099471712 @default.
- W2983647115 cites W2112796928 @default.
- W2983647115 cites W2113459411 @default.
- W2983647115 cites W2127452375 @default.
- W2983647115 cites W2131774270 @default.
- W2983647115 cites W2151537585 @default.
- W2983647115 cites W2155319834 @default.
- W2983647115 cites W2173520492 @default.
- W2983647115 cites W2194321275 @default.
- W2983647115 cites W2250539671 @default.
- W2983647115 cites W2251939518 @default.
- W2983647115 cites W2295030615 @default.
- W2983647115 cites W2426031434 @default.
- W2983647115 cites W2463507112 @default.
- W2983647115 cites W2570764145 @default.
- W2983647115 cites W2612467436 @default.
- W2983647115 cites W2785533664 @default.
- W2983647115 cites W2787560479 @default.
- W2983647115 cites W2948223045 @default.
- W2983647115 cites W2949999304 @default.
- W2983647115 cites W2963341956 @default.
- W2983647115 cites W2963470893 @default.
- W2983647115 cites W2963767194 @default.
- W2983647115 cites W2963902936 @default.
- W2983647115 cites W2964268978 @default.
- W2983647115 cites W3118608800 @default.
- W2983647115 cites W3122408561 @default.
- W2983647115 cites W4919037 @default.
- W2983647115 hasPublicationYear "2019" @default.
- W2983647115 type Work @default.
- W2983647115 sameAs 2983647115 @default.
- W2983647115 citedByCount "18" @default.
- W2983647115 countsByYear W29836471152020 @default.
- W2983647115 countsByYear W29836471152021 @default.
- W2983647115 crossrefType "posted-content" @default.
- W2983647115 hasAuthorship W2983647115A5042203967 @default.
- W2983647115 hasAuthorship W2983647115A5053200092 @default.
- W2983647115 hasConcept C108583219 @default.
- W2983647115 hasConcept C115961682 @default.
- W2983647115 hasConcept C119857082 @default.
- W2983647115 hasConcept C124101348 @default.
- W2983647115 hasConcept C127413603 @default.
- W2983647115 hasConcept C153180895 @default.
- W2983647115 hasConcept C154945302 @default.
- W2983647115 hasConcept C177264268 @default.
- W2983647115 hasConcept C185592680 @default.
- W2983647115 hasConcept C190502265 @default.
- W2983647115 hasConcept C198531522 @default.
- W2983647115 hasConcept C199360897 @default.
- W2983647115 hasConcept C201995342 @default.
- W2983647115 hasConcept C204030448 @default.
- W2983647115 hasConcept C2776760102 @default.
- W2983647115 hasConcept C2780451532 @default.
- W2983647115 hasConcept C41008148 @default.
- W2983647115 hasConcept C43617362 @default.
- W2983647115 hasConceptScore W2983647115C108583219 @default.
- W2983647115 hasConceptScore W2983647115C115961682 @default.
- W2983647115 hasConceptScore W2983647115C119857082 @default.
- W2983647115 hasConceptScore W2983647115C124101348 @default.
- W2983647115 hasConceptScore W2983647115C127413603 @default.
- W2983647115 hasConceptScore W2983647115C153180895 @default.
- W2983647115 hasConceptScore W2983647115C154945302 @default.
- W2983647115 hasConceptScore W2983647115C177264268 @default.
- W2983647115 hasConceptScore W2983647115C185592680 @default.
- W2983647115 hasConceptScore W2983647115C190502265 @default.
- W2983647115 hasConceptScore W2983647115C198531522 @default.
- W2983647115 hasConceptScore W2983647115C199360897 @default.
- W2983647115 hasConceptScore W2983647115C201995342 @default.
- W2983647115 hasConceptScore W2983647115C204030448 @default.
- W2983647115 hasConceptScore W2983647115C2776760102 @default.
- W2983647115 hasConceptScore W2983647115C2780451532 @default.
- W2983647115 hasConceptScore W2983647115C41008148 @default.
- W2983647115 hasConceptScore W2983647115C43617362 @default.
- W2983647115 hasLocation W29836471151 @default.
- W2983647115 hasOpenAccess W2983647115 @default.
- W2983647115 hasPrimaryLocation W29836471151 @default.
- W2983647115 hasRelatedWork W1821462560 @default.
- W2983647115 hasRelatedWork W2112796928 @default.
- W2983647115 hasRelatedWork W2155319834 @default.
- W2983647115 hasRelatedWork W2194775991 @default.
- W2983647115 hasRelatedWork W2570764145 @default.
- W2983647115 hasRelatedWork W2601450892 @default.
- W2983647115 hasRelatedWork W2612467436 @default.
- W2983647115 hasRelatedWork W2750384547 @default.
- W2983647115 hasRelatedWork W2963341924 @default.
- W2983647115 hasRelatedWork W2963902936 @default.