Matches in SemOpenAlex for { <https://semopenalex.org/work/W3092786229> ?p ?o ?g. }
- W3092786229 endingPage "464" @default.
- W3092786229 startingPage "444" @default.
- W3092786229 abstract "The analysis of massive databases is a key issue for most applications today and the use of parallel computing techniques is one of the suitable approaches for that. Apache Spark is a widely employed tool within this context, aiming at processing large amounts of data in a distributed way. For the Statistics community, R is one of the preferred tools. Despite its growth in the last years, it still has limitations for processing large volumes of data in single local machines. In general, the data analysis community has difficulty to handle a massive amount of data on local machines, often requiring high-performance computing servers. One way to perform statistical analyzes over massive databases is combining both tools (Spark and R) via the sparklyr package, which allows for an R application to use Spark. This paper presents an analysis of Brazilian public data from the Bolsa Família Programme (BFP—conditional cash transfer), comprising a large data set with 1.26 billion observations. Our goal was to understand how this social program acts in different cities, as well as to identify potentially important variables reflecting its utilization rate. Statistical modeling was performed using random forest to predict the utilization rated of BFP. Variable selection was performed through a recent method based on the importance and interpretation of variables in the random forest model. Among the 89 variables initially considered, the final model presented a high predictive performance capacity with 17 selected variables, as well as indicated high importance of some variables for the observed utilization rate in income, education, job informality, and inactive youth, namely: family income, education, occupation and density of people in the homes. In this work, using a local machine, we highlighted the potential of aggregating Spark and R for analysis of a large database of 111.6 GB. This can serve as proof of concept or reference for other similar works within the Statistics community, as well as our case study can provide important evidence for further analysis of this important social support programme." @default.
- W3092786229 created "2020-10-22" @default.
- W3092786229 creator A5004412146 @default.
- W3092786229 creator A5023752401 @default.
- W3092786229 creator A5025418231 @default.
- W3092786229 creator A5026114571 @default.
- W3092786229 creator A5038804247 @default.
- W3092786229 creator A5059695755 @default.
- W3092786229 creator A5064745062 @default.
- W3092786229 creator A5088492477 @default.
- W3092786229 date "2020-10-19" @default.
- W3092786229 modified "2023-10-01" @default.
- W3092786229 title "Local Processing of Massive Databases with R: A National Analysis of a Brazilian Social Programme" @default.
- W3092786229 cites W1503593025 @default.
- W3092786229 cites W1965670655 @default.
- W3092786229 cites W1985554463 @default.
- W3092786229 cites W2050812011 @default.
- W3092786229 cites W2087855121 @default.
- W3092786229 cites W2122494808 @default.
- W3092786229 cites W2155261478 @default.
- W3092786229 cites W2285924575 @default.
- W3092786229 cites W2474835145 @default.
- W3092786229 cites W2542459869 @default.
- W3092786229 cites W2556483642 @default.
- W3092786229 cites W2897711619 @default.
- W3092786229 cites W2902867417 @default.
- W3092786229 cites W2911964244 @default.
- W3092786229 cites W2999309192 @default.
- W3092786229 cites W3013531585 @default.
- W3092786229 cites W4250664506 @default.
- W3092786229 doi "https://doi.org/10.3390/stats3040028" @default.
- W3092786229 hasPublicationYear "2020" @default.
- W3092786229 type Work @default.
- W3092786229 sameAs 3092786229 @default.
- W3092786229 citedByCount "4" @default.
- W3092786229 countsByYear W30927862292022 @default.
- W3092786229 countsByYear W30927862292023 @default.
- W3092786229 crossrefType "journal-article" @default.
- W3092786229 hasAuthorship W3092786229A5004412146 @default.
- W3092786229 hasAuthorship W3092786229A5023752401 @default.
- W3092786229 hasAuthorship W3092786229A5025418231 @default.
- W3092786229 hasAuthorship W3092786229A5026114571 @default.
- W3092786229 hasAuthorship W3092786229A5038804247 @default.
- W3092786229 hasAuthorship W3092786229A5059695755 @default.
- W3092786229 hasAuthorship W3092786229A5064745062 @default.
- W3092786229 hasAuthorship W3092786229A5088492477 @default.
- W3092786229 hasBestOaLocation W30927862291 @default.
- W3092786229 hasConcept C119857082 @default.
- W3092786229 hasConcept C124101348 @default.
- W3092786229 hasConcept C134306372 @default.
- W3092786229 hasConcept C166957645 @default.
- W3092786229 hasConcept C169258074 @default.
- W3092786229 hasConcept C177264268 @default.
- W3092786229 hasConcept C182365436 @default.
- W3092786229 hasConcept C199360897 @default.
- W3092786229 hasConcept C205649164 @default.
- W3092786229 hasConcept C2522767166 @default.
- W3092786229 hasConcept C2779343474 @default.
- W3092786229 hasConcept C2781215313 @default.
- W3092786229 hasConcept C33923547 @default.
- W3092786229 hasConcept C41008148 @default.
- W3092786229 hasConcept C75684735 @default.
- W3092786229 hasConcept C77088390 @default.
- W3092786229 hasConceptScore W3092786229C119857082 @default.
- W3092786229 hasConceptScore W3092786229C124101348 @default.
- W3092786229 hasConceptScore W3092786229C134306372 @default.
- W3092786229 hasConceptScore W3092786229C166957645 @default.
- W3092786229 hasConceptScore W3092786229C169258074 @default.
- W3092786229 hasConceptScore W3092786229C177264268 @default.
- W3092786229 hasConceptScore W3092786229C182365436 @default.
- W3092786229 hasConceptScore W3092786229C199360897 @default.
- W3092786229 hasConceptScore W3092786229C205649164 @default.
- W3092786229 hasConceptScore W3092786229C2522767166 @default.
- W3092786229 hasConceptScore W3092786229C2779343474 @default.
- W3092786229 hasConceptScore W3092786229C2781215313 @default.
- W3092786229 hasConceptScore W3092786229C33923547 @default.
- W3092786229 hasConceptScore W3092786229C41008148 @default.
- W3092786229 hasConceptScore W3092786229C75684735 @default.
- W3092786229 hasConceptScore W3092786229C77088390 @default.
- W3092786229 hasIssue "4" @default.
- W3092786229 hasLocation W30927862291 @default.
- W3092786229 hasLocation W30927862292 @default.
- W3092786229 hasOpenAccess W3092786229 @default.
- W3092786229 hasPrimaryLocation W30927862291 @default.
- W3092786229 hasRelatedWork W2545366524 @default.
- W3092786229 hasRelatedWork W2769430831 @default.
- W3092786229 hasRelatedWork W2803295405 @default.
- W3092786229 hasRelatedWork W2810431902 @default.
- W3092786229 hasRelatedWork W2993053943 @default.
- W3092786229 hasRelatedWork W3012518171 @default.
- W3092786229 hasRelatedWork W3027515818 @default.
- W3092786229 hasRelatedWork W3134081317 @default.
- W3092786229 hasRelatedWork W3211874991 @default.
- W3092786229 hasRelatedWork W4297540011 @default.
- W3092786229 hasVolume "3" @default.
- W3092786229 isParatext "false" @default.
- W3092786229 isRetracted "false" @default.
- W3092786229 magId "3092786229" @default.