FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W1951344599> ?p ?o ?g. }

• W1951344599 abstract "As the wealth of information available on the web keeps growing, being able to harvest massive amounts of data has become a major challenge. Web crawlers are the core components to retrieve such vast collections of publicly available data. The key limiting factor of any crawler architecture is however its large infrastructure cost. To reduce this cost, and in particular the high upfront investments, we present in this paper a geo-distributed crawler solution, UniCrawl. UniCrawl orchestrates several geographically distributed sites. Each site operates an independent crawler and relies on well-established techniques for fetching and parsing the content of the web. UniCrawl splits the crawled domain space across the sites and federates their storage and computing resources, while minimizing thee inter-site communication cost. To assess our design choices, we evaluate UniCrawl in a controlled environment using the ClueWeb12 dataset, and in the wild when deployed over several remote locations. We conducted several experiments over 3 sites spread across Germany. When compared to a centralized architecture with a crawler simply stretched over several locations, UniCrawl shows a performance improvement of 93.6% in terms of network bandwidth consumption, and a speedup factor of 1.75." @default.
• W1951344599 created "2016-06-24" @default.
• W1951344599 creator A5029523970 @default.
• W1951344599 creator A5033418614 @default.
• W1951344599 creator A5038134805 @default.
• W1951344599 creator A5045846189 @default.
• W1951344599 creator A5059801724 @default.
• W1951344599 creator A5089664450 @default.
• W1951344599 date "2015-06-01" @default.
• W1951344599 modified "2023-10-16" @default.
• W1951344599 title "UniCrawl: A Practical Geographically Distributed Web Crawler" @default.
• W1951344599 cites W1613836731 @default.
• W1951344599 cites W1968155810 @default.
• W1951344599 cites W1977836056 @default.
• W1951344599 cites W1984467305 @default.
• W1951344599 cites W1989813732 @default.
• W1951344599 cites W2000273502 @default.
• W1951344599 cites W2018928332 @default.
• W1951344599 cites W2020765652 @default.
• W1951344599 cites W2029341294 @default.
• W1951344599 cites W2059713800 @default.
• W1951344599 cites W2066636486 @default.
• W1951344599 cites W2082973176 @default.
• W1951344599 cites W2105947650 @default.
• W1951344599 cites W2113184419 @default.
• W1951344599 cites W2120136770 @default.
• W1951344599 cites W2121928206 @default.
• W1951344599 cites W2154045882 @default.
• W1951344599 cites W2158601853 @default.
• W1951344599 cites W2164542999 @default.
• W1951344599 cites W2173213060 @default.
• W1951344599 cites W2295141584 @default.
• W1951344599 cites W2911388033 @default.
• W1951344599 cites W2030649419 @default.
• W1951344599 doi "https://doi.org/10.1109/cloud.2015.59" @default.
• W1951344599 hasPublicationYear "2015" @default.
• W1951344599 type Work @default.
• W1951344599 sameAs 1951344599 @default.
• W1951344599 citedByCount "13" @default.
• W1951344599 countsByYear W19513445992015 @default.
• W1951344599 countsByYear W19513445992016 @default.
• W1951344599 countsByYear W19513445992017 @default.
• W1951344599 countsByYear W19513445992018 @default.
• W1951344599 countsByYear W19513445992019 @default.
• W1951344599 countsByYear W19513445992020 @default.
• W1951344599 countsByYear W19513445992021 @default.
• W1951344599 countsByYear W19513445992023 @default.
• W1951344599 crossrefType "proceedings-article" @default.
• W1951344599 hasAuthorship W1951344599A5029523970 @default.
• W1951344599 hasAuthorship W1951344599A5033418614 @default.
• W1951344599 hasAuthorship W1951344599A5038134805 @default.
• W1951344599 hasAuthorship W1951344599A5045846189 @default.
• W1951344599 hasAuthorship W1951344599A5059801724 @default.
• W1951344599 hasAuthorship W1951344599A5089664450 @default.
• W1951344599 hasConcept C111919701 @default.
• W1951344599 hasConcept C123657996 @default.
• W1951344599 hasConcept C127413603 @default.
• W1951344599 hasConcept C136764020 @default.
• W1951344599 hasConcept C13743948 @default.
• W1951344599 hasConcept C154945302 @default.
• W1951344599 hasConcept C166957645 @default.
• W1951344599 hasConcept C186644900 @default.
• W1951344599 hasConcept C188198153 @default.
• W1951344599 hasConcept C199360897 @default.
• W1951344599 hasConcept C205649164 @default.
• W1951344599 hasConcept C26517878 @default.
• W1951344599 hasConcept C2776257435 @default.
• W1951344599 hasConcept C2781039887 @default.
• W1951344599 hasConcept C31258907 @default.
• W1951344599 hasConcept C41008148 @default.
• W1951344599 hasConcept C68339613 @default.
• W1951344599 hasConcept C77088390 @default.
• W1951344599 hasConcept C78519656 @default.
• W1951344599 hasConcept C93996380 @default.
• W1951344599 hasConceptScore W1951344599C111919701 @default.
• W1951344599 hasConceptScore W1951344599C123657996 @default.
• W1951344599 hasConceptScore W1951344599C127413603 @default.
• W1951344599 hasConceptScore W1951344599C136764020 @default.
• W1951344599 hasConceptScore W1951344599C13743948 @default.
• W1951344599 hasConceptScore W1951344599C154945302 @default.
• W1951344599 hasConceptScore W1951344599C166957645 @default.
• W1951344599 hasConceptScore W1951344599C186644900 @default.
• W1951344599 hasConceptScore W1951344599C188198153 @default.
• W1951344599 hasConceptScore W1951344599C199360897 @default.
• W1951344599 hasConceptScore W1951344599C205649164 @default.
• W1951344599 hasConceptScore W1951344599C26517878 @default.
• W1951344599 hasConceptScore W1951344599C2776257435 @default.
• W1951344599 hasConceptScore W1951344599C2781039887 @default.
• W1951344599 hasConceptScore W1951344599C31258907 @default.
• W1951344599 hasConceptScore W1951344599C41008148 @default.
• W1951344599 hasConceptScore W1951344599C68339613 @default.
• W1951344599 hasConceptScore W1951344599C77088390 @default.
• W1951344599 hasConceptScore W1951344599C78519656 @default.
• W1951344599 hasConceptScore W1951344599C93996380 @default.
• W1951344599 hasLocation W19513445991 @default.
• W1951344599 hasOpenAccess W1951344599 @default.
• W1951344599 hasPrimaryLocation W19513445991 @default.
• W1951344599 hasRelatedWork W1525245613 @default.
• W1951344599 hasRelatedWork W1967627035 @default.
• W1951344599 hasRelatedWork W2002952260 @default.

• next