Matches in SemOpenAlex for { <https://semopenalex.org/work/W4310880252> ?p ?o ?g. }
Showing items 1 to 78 of
78
with 100 items per page.
- W4310880252 abstract "Since February of this year, KOA began to prepare, transfer, and ingest data as they were acquired in near-real time; in most cases data are available to observers through KOA within one minute of acquisition. Real-time ingestion will be complete for all active instruments by the end of Summer 2022. The observatory is supporting the development of modern Python data reduction pipelines, which when delivered, will automatically create science-ready data sets at the end of each night for ingestion into the archive. This presentation will describe the infrastructure developed to support real-time data ingestion, itself part of a larger initiative at the Observatory to modernize end-to-end operations. During telescope operations, the software at WMKO is executed automatically when a newly acquired file is recognized through monitoring a keyword-based observatory control system; this system is used at Keck to execute virtually all observatory functions. The monitor uses callbacks built into the control system to begin data preparation of files for transmission to the archive on an individual basis: scheduling scripts or file system related triggers are unnecessary. An HTTP-based system called from the Flask micro-framework enables file transfers between WMKO and NExScI and triggers data ingestion at NExScI. The ingestion system at NEXScI is a compact (4 KLOC), highly fault-tolerant, Python-based system. It uses a shared file system to transfer data from WMKO to NExScI. The ingestion code is instrument agnostic, with instrument parameters read from configuration files. It replaces an unwieldy (50 KLOC) C-based system that had been in use since 2004." @default.
- W4310880252 created "2022-12-20" @default.
- W4310880252 creator A5013150435 @default.
- W4310880252 creator A5014825573 @default.
- W4310880252 creator A5031340202 @default.
- W4310880252 creator A5033007150 @default.
- W4310880252 creator A5037057428 @default.
- W4310880252 creator A5040506945 @default.
- W4310880252 creator A5044024607 @default.
- W4310880252 creator A5047679858 @default.
- W4310880252 creator A5062066888 @default.
- W4310880252 creator A5075054900 @default.
- W4310880252 creator A5076256326 @default.
- W4310880252 creator A5081549432 @default.
- W4310880252 creator A5084029535 @default.
- W4310880252 creator A5087058870 @default.
- W4310880252 date "2022-12-05" @default.
- W4310880252 modified "2023-10-14" @default.
- W4310880252 title "Real-time Data Ingestion at the Keck Observatory Archive (KOA)" @default.
- W4310880252 doi "https://doi.org/10.48550/arxiv.2212.02576" @default.
- W4310880252 hasPublicationYear "2022" @default.
- W4310880252 type Work @default.
- W4310880252 citedByCount "0" @default.
- W4310880252 crossrefType "posted-content" @default.
- W4310880252 hasAuthorship W4310880252A5013150435 @default.
- W4310880252 hasAuthorship W4310880252A5014825573 @default.
- W4310880252 hasAuthorship W4310880252A5031340202 @default.
- W4310880252 hasAuthorship W4310880252A5033007150 @default.
- W4310880252 hasAuthorship W4310880252A5037057428 @default.
- W4310880252 hasAuthorship W4310880252A5040506945 @default.
- W4310880252 hasAuthorship W4310880252A5044024607 @default.
- W4310880252 hasAuthorship W4310880252A5047679858 @default.
- W4310880252 hasAuthorship W4310880252A5062066888 @default.
- W4310880252 hasAuthorship W4310880252A5075054900 @default.
- W4310880252 hasAuthorship W4310880252A5076256326 @default.
- W4310880252 hasAuthorship W4310880252A5081549432 @default.
- W4310880252 hasAuthorship W4310880252A5084029535 @default.
- W4310880252 hasAuthorship W4310880252A5087058870 @default.
- W4310880252 hasBestOaLocation W43108802521 @default.
- W4310880252 hasConcept C111919701 @default.
- W4310880252 hasConcept C121332964 @default.
- W4310880252 hasConcept C171730128 @default.
- W4310880252 hasConcept C2779919027 @default.
- W4310880252 hasConcept C2780940931 @default.
- W4310880252 hasConcept C41008148 @default.
- W4310880252 hasConcept C44870925 @default.
- W4310880252 hasConcept C519991488 @default.
- W4310880252 hasConcept C61423126 @default.
- W4310880252 hasConcept C77088390 @default.
- W4310880252 hasConcept C79403827 @default.
- W4310880252 hasConceptScore W4310880252C111919701 @default.
- W4310880252 hasConceptScore W4310880252C121332964 @default.
- W4310880252 hasConceptScore W4310880252C171730128 @default.
- W4310880252 hasConceptScore W4310880252C2779919027 @default.
- W4310880252 hasConceptScore W4310880252C2780940931 @default.
- W4310880252 hasConceptScore W4310880252C41008148 @default.
- W4310880252 hasConceptScore W4310880252C44870925 @default.
- W4310880252 hasConceptScore W4310880252C519991488 @default.
- W4310880252 hasConceptScore W4310880252C61423126 @default.
- W4310880252 hasConceptScore W4310880252C77088390 @default.
- W4310880252 hasConceptScore W4310880252C79403827 @default.
- W4310880252 hasLocation W43108802521 @default.
- W4310880252 hasLocation W43108802522 @default.
- W4310880252 hasOpenAccess W4310880252 @default.
- W4310880252 hasPrimaryLocation W43108802521 @default.
- W4310880252 hasRelatedWork W2054104202 @default.
- W4310880252 hasRelatedWork W2139703748 @default.
- W4310880252 hasRelatedWork W2188981919 @default.
- W4310880252 hasRelatedWork W2236574726 @default.
- W4310880252 hasRelatedWork W2761254753 @default.
- W4310880252 hasRelatedWork W2782165897 @default.
- W4310880252 hasRelatedWork W3023169329 @default.
- W4310880252 hasRelatedWork W3084909426 @default.
- W4310880252 hasRelatedWork W3213706029 @default.
- W4310880252 hasRelatedWork W4300438041 @default.
- W4310880252 isParatext "false" @default.
- W4310880252 isRetracted "false" @default.
- W4310880252 workType "article" @default.