Matches in SemOpenAlex for { <https://semopenalex.org/work/W1567029444> ?p ?o ?g. }
Showing items 1 to 87 of
87
with 100 items per page.
- W1567029444 abstract "Lancet [1] is a new, simulator-independent utility for succinctly specifying, launching, and collating results from large batches of interrelated simulations. Neural simulations require significant time and computational resources, particularly when exploring the large parameter spaces involved. Simulators rarely provide specific, comprehensive support for launching and collecting results across batch runs, and so the process of going from idea to publishable results typically involves an ad-hoc set of manual practices and/or one-off shell scripts. This informal process can be difficult to replicate later, because information about each of the processing steps is lost over time.Here we demonstrate how Lancet can be used together with IPython Notebook [2] to provide a fully automated and fully reproducible workflow for neural simulations and similar batch-computing tasks. This workflow covers specifying what simulations are to be launched, storing metadata about each simulation run, collating the resulting output files, analyzing the results, and generating publication-quality figures that can be traced directly back to the original simulation and analysis code. This approach scales to hundreds of parallel jobs launched and simulation results spread across thousands of files, allowing users to focus on the scientific component of their work instead of writing repetitive boilerplate code.Lancet is most useful with batch schedulers such as Oracle Grid Engine or other computing clusters, but also works well with single workstations. Users are given a small set of composable primitives that can succinctly specify large parameter spaces, from which individual jobs are generated. The declared simulation can then be reviewed in detail, avoiding mistakes before valuable time and computational resources are expended. All Lancet components are designed as self-contained, declarative objects that constitute the elements of a small DSL (domain specific language).Once all the simulations are complete and the necessary files have been generated, Lancet collates the results for further analysis. To complete the workflow, the results can then be imported into an IPython Notebook, where they can be visualized interactively, with immediate feedback and a record of the analysis steps for reproducibility. This workflow allows you to assess your results for each simulation or compare results between different simulations. The generated data can be viewed in manageable chunks, without needing to directly manipulate files on either the local or remote filesystem. As parameters associated with each simulation are automatically recorded and tracked, all the relevant parameters are available for each file viewed. You can then process your data, saving it back out to separate files or to a database backend (HDF5 format using PyTables is currently supported [3]) while maintaining all the relevant metadata.The core of Lancet is written in pure Python (Python 2 and 3 are supported), offering a general framework that is easily integrated with external tools and simulators that keeps track of all parameters used, ensuring a reproducible workflow. The fundamental design is entirely independent of the tools that are invoked, making Lancet a flexible and general tool for anyone who needs to run and analyze the data generated by hundreds of time-consuming simulations." @default.
- W1567029444 created "2016-06-24" @default.
- W1567029444 creator A5023429942 @default.
- W1567029444 creator A5033134903 @default.
- W1567029444 creator A5041783480 @default.
- W1567029444 date "2013-07-01" @default.
- W1567029444 modified "2023-09-23" @default.
- W1567029444 title "An automated simulator-independent workflow for reproducible simulation and analysis using Lancet and IPython Notebook" @default.
- W1567029444 cites W2061939373 @default.
- W1567029444 doi "https://doi.org/10.1186/1471-2202-14-s1-p22" @default.
- W1567029444 hasPubMedCentralId "https://www.ncbi.nlm.nih.gov/pmc/articles/3704619" @default.
- W1567029444 hasPublicationYear "2013" @default.
- W1567029444 type Work @default.
- W1567029444 sameAs 1567029444 @default.
- W1567029444 citedByCount "0" @default.
- W1567029444 crossrefType "journal-article" @default.
- W1567029444 hasAuthorship W1567029444A5023429942 @default.
- W1567029444 hasAuthorship W1567029444A5033134903 @default.
- W1567029444 hasAuthorship W1567029444A5041783480 @default.
- W1567029444 hasBestOaLocation W15670294441 @default.
- W1567029444 hasConcept C105795698 @default.
- W1567029444 hasConcept C111919701 @default.
- W1567029444 hasConcept C171250308 @default.
- W1567029444 hasConcept C177212765 @default.
- W1567029444 hasConcept C177264268 @default.
- W1567029444 hasConcept C187691185 @default.
- W1567029444 hasConcept C192562407 @default.
- W1567029444 hasConcept C199360897 @default.
- W1567029444 hasConcept C2524010 @default.
- W1567029444 hasConcept C2781162219 @default.
- W1567029444 hasConcept C33923547 @default.
- W1567029444 hasConcept C41008148 @default.
- W1567029444 hasConcept C519991488 @default.
- W1567029444 hasConcept C55166926 @default.
- W1567029444 hasConcept C61423126 @default.
- W1567029444 hasConcept C67953723 @default.
- W1567029444 hasConcept C70388272 @default.
- W1567029444 hasConcept C77088390 @default.
- W1567029444 hasConcept C98045186 @default.
- W1567029444 hasConceptScore W1567029444C105795698 @default.
- W1567029444 hasConceptScore W1567029444C111919701 @default.
- W1567029444 hasConceptScore W1567029444C171250308 @default.
- W1567029444 hasConceptScore W1567029444C177212765 @default.
- W1567029444 hasConceptScore W1567029444C177264268 @default.
- W1567029444 hasConceptScore W1567029444C187691185 @default.
- W1567029444 hasConceptScore W1567029444C192562407 @default.
- W1567029444 hasConceptScore W1567029444C199360897 @default.
- W1567029444 hasConceptScore W1567029444C2524010 @default.
- W1567029444 hasConceptScore W1567029444C2781162219 @default.
- W1567029444 hasConceptScore W1567029444C33923547 @default.
- W1567029444 hasConceptScore W1567029444C41008148 @default.
- W1567029444 hasConceptScore W1567029444C519991488 @default.
- W1567029444 hasConceptScore W1567029444C55166926 @default.
- W1567029444 hasConceptScore W1567029444C61423126 @default.
- W1567029444 hasConceptScore W1567029444C67953723 @default.
- W1567029444 hasConceptScore W1567029444C70388272 @default.
- W1567029444 hasConceptScore W1567029444C77088390 @default.
- W1567029444 hasConceptScore W1567029444C98045186 @default.
- W1567029444 hasLocation W15670294441 @default.
- W1567029444 hasLocation W15670294442 @default.
- W1567029444 hasLocation W15670294443 @default.
- W1567029444 hasOpenAccess W1567029444 @default.
- W1567029444 hasPrimaryLocation W15670294441 @default.
- W1567029444 hasRelatedWork W144529377 @default.
- W1567029444 hasRelatedWork W1906647448 @default.
- W1567029444 hasRelatedWork W2004299325 @default.
- W1567029444 hasRelatedWork W2029442533 @default.
- W1567029444 hasRelatedWork W2054121115 @default.
- W1567029444 hasRelatedWork W2069967271 @default.
- W1567029444 hasRelatedWork W2158946218 @default.
- W1567029444 hasRelatedWork W2168460928 @default.
- W1567029444 hasRelatedWork W2188362022 @default.
- W1567029444 hasRelatedWork W2188483006 @default.
- W1567029444 hasRelatedWork W2796899417 @default.
- W1567029444 hasRelatedWork W2797973119 @default.
- W1567029444 hasRelatedWork W2805191593 @default.
- W1567029444 hasRelatedWork W2940861739 @default.
- W1567029444 hasRelatedWork W2962749598 @default.
- W1567029444 hasRelatedWork W3023516808 @default.
- W1567029444 hasRelatedWork W3047403977 @default.
- W1567029444 hasRelatedWork W3172073973 @default.
- W1567029444 hasRelatedWork W92157899 @default.
- W1567029444 hasRelatedWork W3106510946 @default.
- W1567029444 isParatext "false" @default.
- W1567029444 isRetracted "false" @default.
- W1567029444 magId "1567029444" @default.
- W1567029444 workType "article" @default.