FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3103410128> ?p ?o ?g. }

• W3103410128 abstract "Heavily pre-trained transformer models such as BERT have recently shown to be remarkably powerful at language modelling by achieving impressive results on numerous downstream tasks. It has also been shown that they are able to implicitly store factual knowledge in their parameters after pre-training. Understanding what the pre-training procedure of LMs actually learns is a crucial step for using and improving them for Conversational Recommender Systems (CRS). We first study how much off-the-shelf pre-trained BERT knows about recommendation items such as books, movies and music. In order to analyze the knowledge stored in BERT's parameters, we use different probes that require different types of knowledge to solve, namely content-based and collaborative-based. Content-based knowledge is knowledge that requires the model to match the titles of items with their content information, such as textual descriptions and genres. In contrast, collaborative-based knowledge requires the model to match items with similar ones, according to community interactions such as ratings. We resort to BERT's Masked Language Modelling head to probe its knowledge about the genre of items, with cloze style prompts. In addition, we employ BERT's Next Sentence Prediction head and representations' similarity to compare relevant and non-relevant search and recommendation query-document inputs to explore whether BERT can, without any fine-tuning, rank relevant items first. Finally, we study how BERT performs in a conversational recommendation downstream task. Overall, our analyses and experiments show that: (i) BERT has knowledge stored in its parameters about the content of books, movies and music; (ii) it has more content-based knowledge than collaborative-based knowledge; and (iii) fails on conversational recommendation when faced with adversarial data." @default.
• W3103410128 created "2020-11-23" @default.
• W3103410128 creator A5039590940 @default.
• W3103410128 creator A5084915697 @default.
• W3103410128 date "2020-09-22" @default.
• W3103410128 modified "2023-10-01" @default.
• W3103410128 title "What does BERT know about books, movies and music? Probing BERT for Conversational Recommendation" @default.
• W3103410128 cites W1566289585 @default.
• W3103410128 cites W1924762813 @default.
• W3103410128 cites W2069315482 @default.
• W3103410128 cites W2097638479 @default.
• W3103410128 cites W2219888463 @default.
• W3103410128 cites W2560647685 @default.
• W3103410128 cites W2590822507 @default.
• W3103410128 cites W2791808303 @default.
• W3103410128 cites W2798392716 @default.
• W3103410128 cites W2891416139 @default.
• W3103410128 cites W2898076813 @default.
• W3103410128 cites W2900464008 @default.
• W3103410128 cites W2912817604 @default.
• W3103410128 cites W2945383715 @default.
• W3103410128 cites W2945465473 @default.
• W3103410128 cites W2946417913 @default.
• W3103410128 cites W2948947170 @default.
• W3103410128 cites W2970476646 @default.
• W3103410128 cites W2970648534 @default.
• W3103410128 cites W2972156721 @default.
• W3103410128 cites W2996851481 @default.
• W3103410128 cites W3002414756 @default.
• W3103410128 cites W3004092718 @default.
• W3103410128 cites W3015612646 @default.
• W3103410128 cites W3034238904 @default.
• W3103410128 cites W3034255912 @default.
• W3103410128 cites W3044438666 @default.
• W3103410128 cites W3099984837 @default.
• W3103410128 cites W3104763958 @default.
• W3103410128 cites W4206765718 @default.
• W3103410128 cites W4246858749 @default.
• W3103410128 cites W4252076394 @default.
• W3103410128 doi "https://doi.org/10.1145/3383313.3412249" @default.
• W3103410128 hasPublicationYear "2020" @default.
• W3103410128 type Work @default.
• W3103410128 sameAs 3103410128 @default.
• W3103410128 citedByCount "27" @default.
• W3103410128 countsByYear W31034101282020 @default.
• W3103410128 countsByYear W31034101282021 @default.
• W3103410128 countsByYear W31034101282022 @default.
• W3103410128 countsByYear W31034101282023 @default.
• W3103410128 crossrefType "proceedings-article" @default.
• W3103410128 hasAuthorship W3103410128A5039590940 @default.
• W3103410128 hasAuthorship W3103410128A5084915697 @default.
• W3103410128 hasBestOaLocation W31034101282 @default.
• W3103410128 hasConcept C121332964 @default.
• W3103410128 hasConcept C137293760 @default.
• W3103410128 hasConcept C154945302 @default.
• W3103410128 hasConcept C165801399 @default.
• W3103410128 hasConcept C204321447 @default.
• W3103410128 hasConcept C23123220 @default.
• W3103410128 hasConcept C2777530160 @default.
• W3103410128 hasConcept C41008148 @default.
• W3103410128 hasConcept C557471498 @default.
• W3103410128 hasConcept C62520636 @default.
• W3103410128 hasConcept C66322947 @default.
• W3103410128 hasConceptScore W3103410128C121332964 @default.
• W3103410128 hasConceptScore W3103410128C137293760 @default.
• W3103410128 hasConceptScore W3103410128C154945302 @default.
• W3103410128 hasConceptScore W3103410128C165801399 @default.
• W3103410128 hasConceptScore W3103410128C204321447 @default.
• W3103410128 hasConceptScore W3103410128C23123220 @default.
• W3103410128 hasConceptScore W3103410128C2777530160 @default.
• W3103410128 hasConceptScore W3103410128C41008148 @default.
• W3103410128 hasConceptScore W3103410128C557471498 @default.
• W3103410128 hasConceptScore W3103410128C62520636 @default.
• W3103410128 hasConceptScore W3103410128C66322947 @default.
• W3103410128 hasLocation W31034101281 @default.
• W3103410128 hasLocation W31034101282 @default.
• W3103410128 hasOpenAccess W3103410128 @default.
• W3103410128 hasPrimaryLocation W31034101281 @default.
• W3103410128 hasRelatedWork W1517743118 @default.
• W3103410128 hasRelatedWork W1519302135 @default.
• W3103410128 hasRelatedWork W1544285860 @default.
• W3103410128 hasRelatedWork W1567338489 @default.
• W3103410128 hasRelatedWork W159132833 @default.
• W3103410128 hasRelatedWork W1978971213 @default.
• W3103410128 hasRelatedWork W240673130 @default.
• W3103410128 hasRelatedWork W3038033387 @default.
• W3103410128 hasRelatedWork W38394648 @default.
• W3103410128 hasRelatedWork W4287626481 @default.
• W3103410128 isParatext "false" @default.
• W3103410128 isRetracted "false" @default.
• W3103410128 magId "3103410128" @default.
• W3103410128 workType "article" @default.