Matches in SemOpenAlex for { <https://semopenalex.org/work/W3136991969> ?p ?o ?g. }
- W3136991969 abstract "With the growth of the Internet of Things and the rise of Big Data, data processing and machine learning applications are being moved to cheap and low size, weight, and power (SWaP) devices at the edge, often in the form of mobile phones, embedded systems, or microcontrollers. The field of Cyber-Physical Measurements and Signature Intelligence (MASINT) makes use of these devices to analyze and exploit data in ways not otherwise possible, which results in increased data quality, increased security, and decreased bandwidth. However, methods to train and deploy models at the edge are limited, and models with sufficient accuracy are often too large for the edge device. Therefore, there is a clear need for techniques to create efficient AI/ML at the edge. This work presents training techniques for audio models in the field of environmental sound classification at the edge. Specifically, we design and train Transformers to classify office sounds in audio clips. Results show that a BERT-based Transformer, trained on Mel spectrograms, can outperform a CNN using 99.85% fewer parameters. To achieve this result, we first tested several audio feature extraction techniques designed for Transformers, using ESC-50 for evaluation, along with various augmentations. Our final model outperforms the state-of-the-art MFCC-based CNN on the office sounds dataset, using just over 6,000 parameters -- small enough to run on a microcontroller." @default.
- W3136991969 created "2021-03-29" @default.
- W3136991969 creator A5013164293 @default.
- W3136991969 creator A5042550507 @default.
- W3136991969 creator A5062959925 @default.
- W3136991969 creator A5079544571 @default.
- W3136991969 date "2021-03-22" @default.
- W3136991969 modified "2023-09-26" @default.
- W3136991969 title "Tiny Transformers for Environmental Sound Classification at the Edge." @default.
- W3136991969 cites W1972567154 @default.
- W3136991969 cites W1979594949 @default.
- W3136991969 cites W1996160964 @default.
- W3136991969 cites W1997527178 @default.
- W3136991969 cites W2008415856 @default.
- W3136991969 cites W2038484192 @default.
- W3136991969 cites W2052666245 @default.
- W3136991969 cites W2313745396 @default.
- W3136991969 cites W2525778437 @default.
- W3136991969 cites W2529337537 @default.
- W3136991969 cites W2593116425 @default.
- W3136991969 cites W2593451766 @default.
- W3136991969 cites W2676925568 @default.
- W3136991969 cites W2751841560 @default.
- W3136991969 cites W2766087987 @default.
- W3136991969 cites W2766397045 @default.
- W3136991969 cites W2768083292 @default.
- W3136991969 cites W2795138957 @default.
- W3136991969 cites W2909327627 @default.
- W3136991969 cites W2914312680 @default.
- W3136991969 cites W2943493972 @default.
- W3136991969 cites W2949117887 @default.
- W3136991969 cites W2949382160 @default.
- W3136991969 cites W2962910554 @default.
- W3136991969 cites W2963341956 @default.
- W3136991969 cites W2963403868 @default.
- W3136991969 cites W2963799213 @default.
- W3136991969 cites W2963838685 @default.
- W3136991969 cites W2969515962 @default.
- W3136991969 cites W2970597249 @default.
- W3136991969 cites W2972247414 @default.
- W3136991969 cites W2975429091 @default.
- W3136991969 cites W2978017171 @default.
- W3136991969 cites W2981852735 @default.
- W3136991969 cites W2996428491 @default.
- W3136991969 cites W3016195076 @default.
- W3136991969 cites W3021164770 @default.
- W3136991969 cites W3027588817 @default.
- W3136991969 cites W3030163527 @default.
- W3136991969 cites W3034445277 @default.
- W3136991969 cites W3035623224 @default.
- W3136991969 cites W3043803126 @default.
- W3136991969 cites W3044604993 @default.
- W3136991969 cites W3045733172 @default.
- W3136991969 cites W3046125265 @default.
- W3136991969 cites W3082878506 @default.
- W3136991969 cites W3094175596 @default.
- W3136991969 cites W3094502228 @default.
- W3136991969 cites W3095348033 @default.
- W3136991969 cites W3098357269 @default.
- W3136991969 hasPublicationYear "2021" @default.
- W3136991969 type Work @default.
- W3136991969 sameAs 3136991969 @default.
- W3136991969 citedByCount "0" @default.
- W3136991969 crossrefType "posted-content" @default.
- W3136991969 hasAuthorship W3136991969A5013164293 @default.
- W3136991969 hasAuthorship W3136991969A5042550507 @default.
- W3136991969 hasAuthorship W3136991969A5062959925 @default.
- W3136991969 hasAuthorship W3136991969A5079544571 @default.
- W3136991969 hasConcept C111919701 @default.
- W3136991969 hasConcept C119599485 @default.
- W3136991969 hasConcept C127413603 @default.
- W3136991969 hasConcept C138236772 @default.
- W3136991969 hasConcept C151989614 @default.
- W3136991969 hasConcept C154945302 @default.
- W3136991969 hasConcept C165696696 @default.
- W3136991969 hasConcept C165801399 @default.
- W3136991969 hasConcept C186967261 @default.
- W3136991969 hasConcept C38652104 @default.
- W3136991969 hasConcept C41008148 @default.
- W3136991969 hasConcept C45273575 @default.
- W3136991969 hasConcept C52622490 @default.
- W3136991969 hasConcept C66322947 @default.
- W3136991969 hasConcept C79974875 @default.
- W3136991969 hasConcept C95623464 @default.
- W3136991969 hasConceptScore W3136991969C111919701 @default.
- W3136991969 hasConceptScore W3136991969C119599485 @default.
- W3136991969 hasConceptScore W3136991969C127413603 @default.
- W3136991969 hasConceptScore W3136991969C138236772 @default.
- W3136991969 hasConceptScore W3136991969C151989614 @default.
- W3136991969 hasConceptScore W3136991969C154945302 @default.
- W3136991969 hasConceptScore W3136991969C165696696 @default.
- W3136991969 hasConceptScore W3136991969C165801399 @default.
- W3136991969 hasConceptScore W3136991969C186967261 @default.
- W3136991969 hasConceptScore W3136991969C38652104 @default.
- W3136991969 hasConceptScore W3136991969C41008148 @default.
- W3136991969 hasConceptScore W3136991969C45273575 @default.
- W3136991969 hasConceptScore W3136991969C52622490 @default.
- W3136991969 hasConceptScore W3136991969C66322947 @default.
- W3136991969 hasConceptScore W3136991969C79974875 @default.
- W3136991969 hasConceptScore W3136991969C95623464 @default.