Matches in SemOpenAlex for { <https://semopenalex.org/work/W1806227041> ?p ?o ?g. }
- W1806227041 abstract "The web is a huge and highly dynamic environment which is growing exponentially in content and developing fast in structure. No search engine can cover the whole web, thus it has to focus on the most valuable pages for crawling. So an efficient crawling algorithm for retrieving the most important pages remains a challenging issue. Several algorithms like PageRank and OPIC have been proposed. Unfortunately, they have high time complexity and low throughput. In this paper, an intelligent crawling algorithm based on reinforcement learning, called FICA is proposed that models a random surfing user. The priority for crawling pages is based on a concept we call logarithmic distance. FICA is easy to implement and its time complexity is O(E*logV) where V and E are the number of nodes and edges in the web graph respectively. Comparison of FICA with other proposed algorithms shows that FICA outperforms them in discovering highly important pages. Furthermore, FICA computes the importance (ranking) of each page during the crawling process. Thus, we can also use FICA as a ranking method for computation of page importance. A nice property of FICA is its adaptability to the web in that it adjusts dynamically with changes in the web graph. We have used UK's web graph to evaluate our approach." @default.
- W1806227041 created "2016-06-24" @default.
- W1806227041 creator A5046344140 @default.
- W1806227041 creator A5055921775 @default.
- W1806227041 creator A5082457965 @default.
- W1806227041 date "2009-01-01" @default.
- W1806227041 modified "2023-09-26" @default.
- W1806227041 title "FICA: A novel intelligent crawling algorithm based on reinforcement learning" @default.
- W1806227041 cites W1485536830 @default.
- W1806227041 cites W1489992655 @default.
- W1806227041 cites W1494146631 @default.
- W1806227041 cites W1515851193 @default.
- W1806227041 cites W1562405179 @default.
- W1806227041 cites W1845137714 @default.
- W1806227041 cites W1854214752 @default.
- W1806227041 cites W1982339055 @default.
- W1806227041 cites W1998423022 @default.
- W1806227041 cites W2007687650 @default.
- W1806227041 cites W2017726337 @default.
- W1806227041 cites W2029341294 @default.
- W1806227041 cites W2029500199 @default.
- W1806227041 cites W2063567926 @default.
- W1806227041 cites W2066636486 @default.
- W1806227041 cites W2080676333 @default.
- W1806227041 cites W2096041903 @default.
- W1806227041 cites W2097704339 @default.
- W1806227041 cites W2100703320 @default.
- W1806227041 cites W2110073539 @default.
- W1806227041 cites W2119012894 @default.
- W1806227041 cites W2121863487 @default.
- W1806227041 cites W2138621811 @default.
- W1806227041 cites W2151007976 @default.
- W1806227041 cites W2151932833 @default.
- W1806227041 cites W2157748587 @default.
- W1806227041 cites W2158601853 @default.
- W1806227041 cites W2166743161 @default.
- W1806227041 cites W2170344111 @default.
- W1806227041 cites W2294903580 @default.
- W1806227041 cites W2295141584 @default.
- W1806227041 cites W2323834113 @default.
- W1806227041 cites W3023628730 @default.
- W1806227041 doi "https://doi.org/10.3233/wia-2009-0174" @default.
- W1806227041 hasPublicationYear "2009" @default.
- W1806227041 type Work @default.
- W1806227041 sameAs 1806227041 @default.
- W1806227041 citedByCount "4" @default.
- W1806227041 countsByYear W18062270412012 @default.
- W1806227041 countsByYear W18062270412017 @default.
- W1806227041 countsByYear W18062270412018 @default.
- W1806227041 crossrefType "journal-article" @default.
- W1806227041 hasAuthorship W1806227041A5046344140 @default.
- W1806227041 hasAuthorship W1806227041A5055921775 @default.
- W1806227041 hasAuthorship W1806227041A5082457965 @default.
- W1806227041 hasConcept C100368936 @default.
- W1806227041 hasConcept C105702510 @default.
- W1806227041 hasConcept C11413529 @default.
- W1806227041 hasConcept C132525143 @default.
- W1806227041 hasConcept C136764020 @default.
- W1806227041 hasConcept C13743948 @default.
- W1806227041 hasConcept C154945302 @default.
- W1806227041 hasConcept C177606310 @default.
- W1806227041 hasConcept C18903297 @default.
- W1806227041 hasConcept C189430467 @default.
- W1806227041 hasConcept C195409031 @default.
- W1806227041 hasConcept C21959979 @default.
- W1806227041 hasConcept C23123220 @default.
- W1806227041 hasConcept C2779172887 @default.
- W1806227041 hasConcept C41008148 @default.
- W1806227041 hasConcept C521815418 @default.
- W1806227041 hasConcept C61096286 @default.
- W1806227041 hasConcept C71924100 @default.
- W1806227041 hasConcept C80444323 @default.
- W1806227041 hasConcept C86037889 @default.
- W1806227041 hasConcept C86803240 @default.
- W1806227041 hasConcept C97541855 @default.
- W1806227041 hasConceptScore W1806227041C100368936 @default.
- W1806227041 hasConceptScore W1806227041C105702510 @default.
- W1806227041 hasConceptScore W1806227041C11413529 @default.
- W1806227041 hasConceptScore W1806227041C132525143 @default.
- W1806227041 hasConceptScore W1806227041C136764020 @default.
- W1806227041 hasConceptScore W1806227041C13743948 @default.
- W1806227041 hasConceptScore W1806227041C154945302 @default.
- W1806227041 hasConceptScore W1806227041C177606310 @default.
- W1806227041 hasConceptScore W1806227041C18903297 @default.
- W1806227041 hasConceptScore W1806227041C189430467 @default.
- W1806227041 hasConceptScore W1806227041C195409031 @default.
- W1806227041 hasConceptScore W1806227041C21959979 @default.
- W1806227041 hasConceptScore W1806227041C23123220 @default.
- W1806227041 hasConceptScore W1806227041C2779172887 @default.
- W1806227041 hasConceptScore W1806227041C41008148 @default.
- W1806227041 hasConceptScore W1806227041C521815418 @default.
- W1806227041 hasConceptScore W1806227041C61096286 @default.
- W1806227041 hasConceptScore W1806227041C71924100 @default.
- W1806227041 hasConceptScore W1806227041C80444323 @default.
- W1806227041 hasConceptScore W1806227041C86037889 @default.
- W1806227041 hasConceptScore W1806227041C86803240 @default.
- W1806227041 hasConceptScore W1806227041C97541855 @default.
- W1806227041 hasLocation W18062270411 @default.
- W1806227041 hasOpenAccess W1806227041 @default.
- W1806227041 hasPrimaryLocation W18062270411 @default.