Matches in SemOpenAlex for { <https://semopenalex.org/work/W4387378927> ?p ?o ?g. }
Showing items 1 to 53 of
53
with 100 items per page.
- W4387378927 abstract "Abstract Rapid strides are currently being made in the field of artificial intelligence using Transformer-based models like Large Language Models (LLMs). The potential of these methods for creating a single, large, versatile model in astronomy has not yet been explored. In this work, we propose a framework for data-driven astronomy that uses the same core techniques and architecture as used by LLMs. Using a variety of observations and labels of stars as an example, we build a Transformer-based model and train it in a self-supervised manner with cross-survey data sets to perform a variety of inference tasks. In particular, we demonstrate that a single model can perform both discriminative and generative tasks even if the model was not trained or fine-tuned to do any specific task. For example, on the discriminative task of deriving stellar parameters from Gaia XP spectra, we achieve an accuracy of 47 K in Teff, 0.11 dex in log g, and 0.07 dex in [M/H], outperforming an expert XGBoost model in the same setting. But the same model can also generate XP spectra from stellar parameters, inpaint unobserved spectral regions, extract empirical stellar loci, and even determine the interstellar extinction curve. Our framework demonstrates that building and training a single foundation model without fine-tuning using data and parameters from multiple surveys to predict unmeasured observations and parameters is well within reach. Such “Large Astronomy Models” trained on large quantities of observational data will play a large role in the analysis of current and future large surveys." @default.
- W4387378927 created "2023-10-06" @default.
- W4387378927 creator A5072780166 @default.
- W4387378927 creator A5090854438 @default.
- W4387378927 date "2023-10-05" @default.
- W4387378927 modified "2023-10-16" @default.
- W4387378927 title "Towards an astronomical foundation model for stars with a Transformer-based model" @default.
- W4387378927 doi "https://doi.org/10.1093/mnras/stad3015" @default.
- W4387378927 hasPublicationYear "2023" @default.
- W4387378927 type Work @default.
- W4387378927 citedByCount "0" @default.
- W4387378927 crossrefType "journal-article" @default.
- W4387378927 hasAuthorship W4387378927A5072780166 @default.
- W4387378927 hasAuthorship W4387378927A5090854438 @default.
- W4387378927 hasBestOaLocation W43873789271 @default.
- W4387378927 hasConcept C119857082 @default.
- W4387378927 hasConcept C121332964 @default.
- W4387378927 hasConcept C150846664 @default.
- W4387378927 hasConcept C154945302 @default.
- W4387378927 hasConcept C165801399 @default.
- W4387378927 hasConcept C2776214188 @default.
- W4387378927 hasConcept C41008148 @default.
- W4387378927 hasConcept C44870925 @default.
- W4387378927 hasConcept C62520636 @default.
- W4387378927 hasConcept C66322947 @default.
- W4387378927 hasConcept C97931131 @default.
- W4387378927 hasConceptScore W4387378927C119857082 @default.
- W4387378927 hasConceptScore W4387378927C121332964 @default.
- W4387378927 hasConceptScore W4387378927C150846664 @default.
- W4387378927 hasConceptScore W4387378927C154945302 @default.
- W4387378927 hasConceptScore W4387378927C165801399 @default.
- W4387378927 hasConceptScore W4387378927C2776214188 @default.
- W4387378927 hasConceptScore W4387378927C41008148 @default.
- W4387378927 hasConceptScore W4387378927C44870925 @default.
- W4387378927 hasConceptScore W4387378927C62520636 @default.
- W4387378927 hasConceptScore W4387378927C66322947 @default.
- W4387378927 hasConceptScore W4387378927C97931131 @default.
- W4387378927 hasLocation W43873789271 @default.
- W4387378927 hasOpenAccess W4387378927 @default.
- W4387378927 hasPrimaryLocation W43873789271 @default.
- W4387378927 hasRelatedWork W2153315159 @default.
- W4387378927 hasRelatedWork W259157601 @default.
- W4387378927 hasRelatedWork W2761785940 @default.
- W4387378927 hasRelatedWork W2965546495 @default.
- W4387378927 hasRelatedWork W3094491777 @default.
- W4387378927 hasRelatedWork W3103844505 @default.
- W4387378927 hasRelatedWork W3214715529 @default.
- W4387378927 hasRelatedWork W4205463238 @default.
- W4387378927 hasRelatedWork W4206178588 @default.
- W4387378927 hasRelatedWork W4287635093 @default.
- W4387378927 isParatext "false" @default.
- W4387378927 isRetracted "false" @default.
- W4387378927 workType "article" @default.