FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W2045367159> ?p ?o ?g. }

• W2045367159 abstract "In recent years, streaming-based data processing has been gaining substantial traction for dealing with overwhelming data generated by real-time applications, from both enterprise sources and scientific computing. In this work, however, we look at an emerging class of scientific data with Near Real-Time (NRT) requirement, in which data is typically generated in a bursty fashion with the near real-time constraints being applied primarily between bursts, rather than within a stream. A key challenge for this types of data sources is that the processing time per data element is not uniform, and not always feasible to predict. Given the observations on the increasing unpredictability of compute load and system dynamics, this work looks to adapt streaming-based approach to the context of this new class of large experiments and simulations that have complex run-time control and analysis issues.In particular, we deploy a novel two-tier scheme for handling the increasing unpredictability of runtime behaviors: Instead of relying on determining what and where to run the scientific workflows beforehand or partial dynamically, the decision will also be adaptively enhanced online according to system runtime status. This is enabled by embedding workflow along with data streams. Specifically, we break data outputs generated from experiments or simulations into multiple self-describing chunks, which we call active data objects. As such, if there is a transient hotspot observed, a data object with unfinished workflow pipeline can break its previous schedule and search for a least loaded location to continue the execution. Our preliminary experiment results based on synthetic workloads demonstrate the proposed active workflow system as a very promising solution by outperforming the state-of-the-art semi-dynamic workflow schedulers with an improved workflow completion time, as well as a good scalability." @default.
• W2045367159 created "2016-06-24" @default.
• W2045367159 creator A5015973975 @default.
• W2045367159 creator A5017941291 @default.
• W2045367159 creator A5023244868 @default.
• W2045367159 creator A5030373337 @default.
• W2045367159 creator A5054451484 @default.
• W2045367159 creator A5064465394 @default.
• W2045367159 creator A5071286199 @default.
• W2045367159 creator A5074035486 @default.
• W2045367159 date "2014-02-16" @default.
• W2045367159 modified "2023-10-16" @default.
• W2045367159 title "Active workflow system for near real-time extreme-scale science" @default.
• W2045367159 cites W1990659898 @default.
• W2045367159 cites W1994014016 @default.
• W2045367159 cites W2010801412 @default.
• W2045367159 cites W2015966324 @default.
• W2045367159 cites W2076992762 @default.
• W2045367159 cites W2102018241 @default.
• W2045367159 cites W2133059825 @default.
• W2045367159 cites W2149576945 @default.
• W2045367159 cites W2156896988 @default.
• W2045367159 cites W2162957845 @default.
• W2045367159 doi "https://doi.org/10.1145/2567634.2567637" @default.
• W2045367159 hasPublicationYear "2014" @default.
• W2045367159 type Work @default.
• W2045367159 sameAs 2045367159 @default.
• W2045367159 citedByCount "2" @default.
• W2045367159 countsByYear W20453671592015 @default.
• W2045367159 countsByYear W20453671592018 @default.
• W2045367159 crossrefType "proceedings-article" @default.
• W2045367159 hasAuthorship W2045367159A5015973975 @default.
• W2045367159 hasAuthorship W2045367159A5017941291 @default.
• W2045367159 hasAuthorship W2045367159A5023244868 @default.
• W2045367159 hasAuthorship W2045367159A5030373337 @default.
• W2045367159 hasAuthorship W2045367159A5054451484 @default.
• W2045367159 hasAuthorship W2045367159A5064465394 @default.
• W2045367159 hasAuthorship W2045367159A5071286199 @default.
• W2045367159 hasAuthorship W2045367159A5074035486 @default.
• W2045367159 hasConcept C121332964 @default.
• W2045367159 hasConcept C140824633 @default.
• W2045367159 hasConcept C177212765 @default.
• W2045367159 hasConcept C2778755073 @default.
• W2045367159 hasConcept C41008148 @default.
• W2045367159 hasConcept C62520636 @default.
• W2045367159 hasConcept C77088390 @default.
• W2045367159 hasConceptScore W2045367159C121332964 @default.
• W2045367159 hasConceptScore W2045367159C140824633 @default.
• W2045367159 hasConceptScore W2045367159C177212765 @default.
• W2045367159 hasConceptScore W2045367159C2778755073 @default.
• W2045367159 hasConceptScore W2045367159C41008148 @default.
• W2045367159 hasConceptScore W2045367159C62520636 @default.
• W2045367159 hasConceptScore W2045367159C77088390 @default.
• W2045367159 hasLocation W20453671591 @default.
• W2045367159 hasOpenAccess W2045367159 @default.
• W2045367159 hasPrimaryLocation W20453671591 @default.
• W2045367159 hasRelatedWork W1574425962 @default.
• W2045367159 hasRelatedWork W1767718647 @default.
• W2045367159 hasRelatedWork W2035995658 @default.
• W2045367159 hasRelatedWork W2081035100 @default.
• W2045367159 hasRelatedWork W2327228951 @default.
• W2045367159 hasRelatedWork W2353477037 @default.
• W2045367159 hasRelatedWork W2354357087 @default.
• W2045367159 hasRelatedWork W2375304607 @default.
• W2045367159 hasRelatedWork W2385499106 @default.
• W2045367159 hasRelatedWork W2391168633 @default.
• W2045367159 isParatext "false" @default.
• W2045367159 isRetracted "false" @default.
• W2045367159 magId "2045367159" @default.
• W2045367159 workType "article" @default.