Matches in SemOpenAlex for { <https://semopenalex.org/work/W109403793> ?p ?o ?g. }
Showing items 1 to 57 of
57
with 100 items per page.
- W109403793 abstract "Objectivity federated databases may contain many terabytes of data and span thousands of files. In such an environment, it is often easy for a user to pose a query that may return an iterator over millions of objects, requiring opening thousands of databases. This presentation describes several technologies developed for such settings: (1) a query estimator, which tells the user how many objects satisfy the query, and how many databases will be touched, prior to opening all of those files; (2) an order-optimized iterator, which behaves like an ordinary iterator except that elements are returned in an order optimized for efficient access, presorted by the database (and container) in which they reside; (3) a parallel implementation of the order-optimized iterator, allowing any number of processes in a parallel or distributed system to iterate over disjoint subcollections of terms satisfying the query, partitioned by the database or container in which the items reside. These technologies have been developed for scientific experiments that will require handling thousands of terabytes of data annually, but they are intended to be applicable in other massive data settings as well. In such environments, significant amounts of data will reside on tertiary storage, accessible via Objectivity`s recently-announced HPSS (High Performance Storage System) interface. When deployed in large-scale physics settings later in 1998, the query estimator will further inform the user of the number of tape mounts required to satisfy the query, and provide rough time estimates for data delivery. The order-optimized iterator will be connected to a cache manager that will prefetch from tape to disk the files needed by the query (known from the query estimation step), and will decide which items to deliver to the user next according to the order in which data become available in the disk cache." @default.
- W109403793 created "2016-06-24" @default.
- W109403793 creator A5076569806 @default.
- W109403793 date "1998-05-04" @default.
- W109403793 modified "2023-09-27" @default.
- W109403793 title "Query estimation and order-optimized iteration in very large federations" @default.
- W109403793 hasPublicationYear "1998" @default.
- W109403793 type Work @default.
- W109403793 sameAs 109403793 @default.
- W109403793 citedByCount "0" @default.
- W109403793 crossrefType "journal-article" @default.
- W109403793 hasAuthorship W109403793A5076569806 @default.
- W109403793 hasConcept C111919701 @default.
- W109403793 hasConcept C124101348 @default.
- W109403793 hasConcept C148840519 @default.
- W109403793 hasConcept C157692150 @default.
- W109403793 hasConcept C199683683 @default.
- W109403793 hasConcept C23123220 @default.
- W109403793 hasConcept C41008148 @default.
- W109403793 hasConcept C54239708 @default.
- W109403793 hasConcept C77088390 @default.
- W109403793 hasConceptScore W109403793C111919701 @default.
- W109403793 hasConceptScore W109403793C124101348 @default.
- W109403793 hasConceptScore W109403793C148840519 @default.
- W109403793 hasConceptScore W109403793C157692150 @default.
- W109403793 hasConceptScore W109403793C199683683 @default.
- W109403793 hasConceptScore W109403793C23123220 @default.
- W109403793 hasConceptScore W109403793C41008148 @default.
- W109403793 hasConceptScore W109403793C54239708 @default.
- W109403793 hasConceptScore W109403793C77088390 @default.
- W109403793 hasLocation W1094037931 @default.
- W109403793 hasOpenAccess W109403793 @default.
- W109403793 hasPrimaryLocation W1094037931 @default.
- W109403793 hasRelatedWork W1012312393 @default.
- W109403793 hasRelatedWork W1522813075 @default.
- W109403793 hasRelatedWork W1547789015 @default.
- W109403793 hasRelatedWork W1583707252 @default.
- W109403793 hasRelatedWork W1590912954 @default.
- W109403793 hasRelatedWork W1854839426 @default.
- W109403793 hasRelatedWork W1965605167 @default.
- W109403793 hasRelatedWork W1978476908 @default.
- W109403793 hasRelatedWork W2008786216 @default.
- W109403793 hasRelatedWork W2106028511 @default.
- W109403793 hasRelatedWork W2132454241 @default.
- W109403793 hasRelatedWork W2156074505 @default.
- W109403793 hasRelatedWork W2188414182 @default.
- W109403793 hasRelatedWork W2464608061 @default.
- W109403793 hasRelatedWork W261739274 @default.
- W109403793 hasRelatedWork W3005613224 @default.
- W109403793 hasRelatedWork W3128187714 @default.
- W109403793 hasRelatedWork W33218393 @default.
- W109403793 hasRelatedWork W96994564 @default.
- W109403793 hasRelatedWork W2188820191 @default.
- W109403793 isParatext "false" @default.
- W109403793 isRetracted "false" @default.
- W109403793 magId "109403793" @default.
- W109403793 workType "article" @default.