Matches in SemOpenAlex for { <https://semopenalex.org/work/W3187432014> ?p ?o ?g. }
- W3187432014 abstract "Recent work has made significant progress in helping users to automate single data preparation steps, such as string-transformations and table-manipulation operators (e.g., Join, GroupBy, Pivot, etc.). We in this work propose to automate multiple such steps end-to-end, by synthesizing complex data pipelines with both string transformations and table-manipulation operators. We propose a novel by-target paradigm that allows users to easily specify the desired pipeline, which is a significant departure from the traditional by-example paradigm. Using by-target, users would provide input tables (e.g., csv or json files), and point us to a target (e.g., an existing database table or BI dashboard) to demonstrate how the output from the desired pipeline would schematically look like. While the problem is seemingly underspecified, our unique insight is that implicit table constraints such as FDs and keys can be exploited to significantly constrain the space to make the problem tractable. We develop an Auto-Pipeline system that learns to synthesize pipelines using reinforcement learning and search. Experiments on large numbers of real pipelines crawled from GitHub suggest that Auto-Pipeline can successfully synthesize 60-70% of these complex pipelines with up to 10 steps." @default.
- W3187432014 created "2021-08-16" @default.
- W3187432014 creator A5034908019 @default.
- W3187432014 creator A5038037154 @default.
- W3187432014 creator A5057335988 @default.
- W3187432014 date "2021-06-25" @default.
- W3187432014 modified "2023-09-27" @default.
- W3187432014 title "Auto-Pipeline: Synthesizing Complex Data Pipelines By-Target Using Reinforcement Learning and Search" @default.
- W3187432014 cites W1551385575 @default.
- W3187432014 cites W1595483645 @default.
- W3187432014 cites W1721994796 @default.
- W3187432014 cites W1757796397 @default.
- W3187432014 cites W1981578383 @default.
- W3187432014 cites W2008896880 @default.
- W3187432014 cites W2013167115 @default.
- W3187432014 cites W2023878327 @default.
- W3187432014 cites W2041439319 @default.
- W3187432014 cites W2044469685 @default.
- W3187432014 cites W2078501237 @default.
- W3187432014 cites W2100233978 @default.
- W3187432014 cites W2101460669 @default.
- W3187432014 cites W2119803607 @default.
- W3187432014 cites W2121863487 @default.
- W3187432014 cites W2134092629 @default.
- W3187432014 cites W2137775416 @default.
- W3187432014 cites W2140523882 @default.
- W3187432014 cites W2146753709 @default.
- W3187432014 cites W2164611950 @default.
- W3187432014 cites W2182787248 @default.
- W3187432014 cites W2187800623 @default.
- W3187432014 cites W2201581102 @default.
- W3187432014 cites W2266772167 @default.
- W3187432014 cites W2427822648 @default.
- W3187432014 cites W2439326083 @default.
- W3187432014 cites W2496170334 @default.
- W3187432014 cites W2585438896 @default.
- W3187432014 cites W2612824201 @default.
- W3187432014 cites W2616147950 @default.
- W3187432014 cites W2626990892 @default.
- W3187432014 cites W2766447205 @default.
- W3187432014 cites W2798323405 @default.
- W3187432014 cites W2798578675 @default.
- W3187432014 cites W2798649495 @default.
- W3187432014 cites W2884499287 @default.
- W3187432014 cites W2897817889 @default.
- W3187432014 cites W2943955885 @default.
- W3187432014 cites W2944134933 @default.
- W3187432014 cites W2946457832 @default.
- W3187432014 cites W2946504770 @default.
- W3187432014 cites W2949244208 @default.
- W3187432014 cites W2953102298 @default.
- W3187432014 cites W2980180246 @default.
- W3187432014 cites W3012733951 @default.
- W3187432014 cites W3021274480 @default.
- W3187432014 cites W3030026364 @default.
- W3187432014 cites W3082197983 @default.
- W3187432014 cites W3105977086 @default.
- W3187432014 cites W3119752913 @default.
- W3187432014 cites W3124228780 @default.
- W3187432014 cites W3141817777 @default.
- W3187432014 hasPublicationYear "2021" @default.
- W3187432014 type Work @default.
- W3187432014 sameAs 3187432014 @default.
- W3187432014 citedByCount "0" @default.
- W3187432014 crossrefType "posted-content" @default.
- W3187432014 hasAuthorship W3187432014A5034908019 @default.
- W3187432014 hasAuthorship W3187432014A5038037154 @default.
- W3187432014 hasAuthorship W3187432014A5057335988 @default.
- W3187432014 hasConcept C121332964 @default.
- W3187432014 hasConcept C124101348 @default.
- W3187432014 hasConcept C127413603 @default.
- W3187432014 hasConcept C154945302 @default.
- W3187432014 hasConcept C157486923 @default.
- W3187432014 hasConcept C175309249 @default.
- W3187432014 hasConcept C199360897 @default.
- W3187432014 hasConcept C41008148 @default.
- W3187432014 hasConcept C43521106 @default.
- W3187432014 hasConcept C45235069 @default.
- W3187432014 hasConcept C62520636 @default.
- W3187432014 hasConcept C87717796 @default.
- W3187432014 hasConcept C97541855 @default.
- W3187432014 hasConceptScore W3187432014C121332964 @default.
- W3187432014 hasConceptScore W3187432014C124101348 @default.
- W3187432014 hasConceptScore W3187432014C127413603 @default.
- W3187432014 hasConceptScore W3187432014C154945302 @default.
- W3187432014 hasConceptScore W3187432014C157486923 @default.
- W3187432014 hasConceptScore W3187432014C175309249 @default.
- W3187432014 hasConceptScore W3187432014C199360897 @default.
- W3187432014 hasConceptScore W3187432014C41008148 @default.
- W3187432014 hasConceptScore W3187432014C43521106 @default.
- W3187432014 hasConceptScore W3187432014C45235069 @default.
- W3187432014 hasConceptScore W3187432014C62520636 @default.
- W3187432014 hasConceptScore W3187432014C87717796 @default.
- W3187432014 hasConceptScore W3187432014C97541855 @default.
- W3187432014 hasLocation W31874320141 @default.
- W3187432014 hasOpenAccess W3187432014 @default.
- W3187432014 hasPrimaryLocation W31874320141 @default.
- W3187432014 hasRelatedWork W152012241 @default.
- W3187432014 hasRelatedWork W1538427300 @default.
- W3187432014 hasRelatedWork W155936315 @default.