Matches in SemOpenAlex for { <https://semopenalex.org/work/W4386976800> ?p ?o ?g. }
Showing items 1 to 69 of
69
with 100 items per page.
- W4386976800 abstract "Computational notebooks (e.g., Jupyter, Google Colab) are widely used for interactive data science and machine learning. In those frameworks, users can start a session, then execute cells (i.e., a set of statements) to create variables, train models, visualize results, etc. Unfortunately, existing notebook systems do not offer live migration: when a notebook launches on a new machine, it loses its state, preventing users from continuing their tasks from where they had left off. This is because, unlike DBMS, the sessions directly rely on underlying kernels (e.g., Python/R interpreters) without an additional data management layer. Existing techniques for preserving states, such as copying all variables or OS-level checkpointing, are unreliable (often fail), inefficient, and platform-dependent. Also, re-running code from scratch can be highly time-consuming. In this paper, we introduce a new notebook system, ElasticNotebook, that offers live migration via checkpointing/restoration using a novel mechanism that is reliable, efficient, and platform-independent. Specifically, by observing all cell executions via transparent, lightweight monitoring, system can find a reliable and efficient way (i.e., replication plan) for reconstructing the original session state, considering variable-cell dependencies, observed runtime, variable sizes, etc. To this end, our new graph-based optimization problem finds how to reconstruct all variables (efficiently) from a subset of variables that can be transferred across machines. We show that ElasticNotebook reduces end-to-end migration and restoration times by 85%-98% and 94%-99%, respectively, on a variety (i.e., Kaggle, JWST, and Tutorial) of notebooks with negligible runtime and memory overheads of <2.5% and <10%." @default.
- W4386976800 created "2023-09-23" @default.
- W4386976800 creator A5004527098 @default.
- W4386976800 creator A5018204703 @default.
- W4386976800 creator A5023168280 @default.
- W4386976800 creator A5059389111 @default.
- W4386976800 creator A5068758601 @default.
- W4386976800 creator A5092925863 @default.
- W4386976800 date "2023-09-20" @default.
- W4386976800 modified "2023-09-29" @default.
- W4386976800 title "ElasticNotebook: Enabling Live Migration for Computational Notebooks (Technical Report)" @default.
- W4386976800 doi "https://doi.org/10.48550/arxiv.2309.11083" @default.
- W4386976800 hasPublicationYear "2023" @default.
- W4386976800 type Work @default.
- W4386976800 citedByCount "0" @default.
- W4386976800 crossrefType "posted-content" @default.
- W4386976800 hasAuthorship W4386976800A5004527098 @default.
- W4386976800 hasAuthorship W4386976800A5018204703 @default.
- W4386976800 hasAuthorship W4386976800A5023168280 @default.
- W4386976800 hasAuthorship W4386976800A5059389111 @default.
- W4386976800 hasAuthorship W4386976800A5068758601 @default.
- W4386976800 hasAuthorship W4386976800A5092925863 @default.
- W4386976800 hasBestOaLocation W43869768001 @default.
- W4386976800 hasConcept C111919701 @default.
- W4386976800 hasConcept C115537543 @default.
- W4386976800 hasConcept C120314980 @default.
- W4386976800 hasConcept C122783720 @default.
- W4386976800 hasConcept C134306372 @default.
- W4386976800 hasConcept C136764020 @default.
- W4386976800 hasConcept C17744445 @default.
- W4386976800 hasConcept C182365436 @default.
- W4386976800 hasConcept C199360897 @default.
- W4386976800 hasConcept C199539241 @default.
- W4386976800 hasConcept C2779151265 @default.
- W4386976800 hasConcept C2779182362 @default.
- W4386976800 hasConcept C33923547 @default.
- W4386976800 hasConcept C41008148 @default.
- W4386976800 hasConcept C519991488 @default.
- W4386976800 hasConceptScore W4386976800C111919701 @default.
- W4386976800 hasConceptScore W4386976800C115537543 @default.
- W4386976800 hasConceptScore W4386976800C120314980 @default.
- W4386976800 hasConceptScore W4386976800C122783720 @default.
- W4386976800 hasConceptScore W4386976800C134306372 @default.
- W4386976800 hasConceptScore W4386976800C136764020 @default.
- W4386976800 hasConceptScore W4386976800C17744445 @default.
- W4386976800 hasConceptScore W4386976800C182365436 @default.
- W4386976800 hasConceptScore W4386976800C199360897 @default.
- W4386976800 hasConceptScore W4386976800C199539241 @default.
- W4386976800 hasConceptScore W4386976800C2779151265 @default.
- W4386976800 hasConceptScore W4386976800C2779182362 @default.
- W4386976800 hasConceptScore W4386976800C33923547 @default.
- W4386976800 hasConceptScore W4386976800C41008148 @default.
- W4386976800 hasConceptScore W4386976800C519991488 @default.
- W4386976800 hasLocation W43869768001 @default.
- W4386976800 hasOpenAccess W4386976800 @default.
- W4386976800 hasPrimaryLocation W43869768001 @default.
- W4386976800 hasRelatedWork W143162329 @default.
- W4386976800 hasRelatedWork W2018297885 @default.
- W4386976800 hasRelatedWork W2120839989 @default.
- W4386976800 hasRelatedWork W2539394636 @default.
- W4386976800 hasRelatedWork W2622850751 @default.
- W4386976800 hasRelatedWork W2626674725 @default.
- W4386976800 hasRelatedWork W2740186907 @default.
- W4386976800 hasRelatedWork W4245681215 @default.
- W4386976800 hasRelatedWork W46412898 @default.
- W4386976800 hasRelatedWork W2181742266 @default.
- W4386976800 isParatext "false" @default.
- W4386976800 isRetracted "false" @default.
- W4386976800 workType "article" @default.