Matches in SemOpenAlex for { <https://semopenalex.org/work/W3100552002> ?p ?o ?g. }
Showing items 1 to 95 of
95
with 100 items per page.
- W3100552002 endingPage "106582" @default.
- W3100552002 startingPage "106582" @default.
- W3100552002 abstract "Effective and fast attribute reduction algorithm on high-dimensional dataset is one of the most important issues of big data, and several parallel attribute reduction algorithms were implemented by using MapReduce. However, MapReduce is not suitable for iterative computing, which causes low calculation efficiency in many cases. In this paper, we proposed a novel parallel attribute reduction algorithm by considering the new generation distributed computing framework Apache Spark. First, the core attribute decision strategy is proposed to replace the traditional attribute significance calculation, and the number of iterations is reduced fromCR−R2∕2+|R|∕2 to C (C represents the number of condition attributes and R represents the number of attributes in the reduct result). Furthermore, for high-dimensional datasets, we designed a batch processing strategy to reduce the number of iterations exponentially. Second, the proposed algorithm was speeded up with three techniques, including: (1) the network data transmission is minimized based on the localized operation; (2) a single cache iteration method is suggested to reduce disk I/O cost; (3) some calculations are skipped by an interruption strategy. In the experimental analysis, we succeeded with various types of real big datasets and random datasets in a real distributed computing environment and compared with the classic MapReduce-based parallel attribute reduction algorithm PAAR_PR in various aspects. Experimental conclusions proved that the computing efficiency of our algorithm has been improved by more than 98% compared to the classic parallel attribute reduction algorithm PAAR_PR." @default.
- W3100552002 created "2020-11-23" @default.
- W3100552002 creator A5000922713 @default.
- W3100552002 creator A5029856513 @default.
- W3100552002 creator A5047766920 @default.
- W3100552002 creator A5091321177 @default.
- W3100552002 date "2021-01-01" @default.
- W3100552002 modified "2023-10-11" @default.
- W3100552002 title "A fast parallel attribute reduction algorithm using Apache Spark" @default.
- W3100552002 cites W2004075750 @default.
- W3100552002 cites W2005943617 @default.
- W3100552002 cites W2057608478 @default.
- W3100552002 cites W2079680557 @default.
- W3100552002 cites W2097484305 @default.
- W3100552002 cites W2119565742 @default.
- W3100552002 cites W2143451122 @default.
- W3100552002 cites W2159128662 @default.
- W3100552002 cites W2173213060 @default.
- W3100552002 cites W2190012392 @default.
- W3100552002 cites W2332026188 @default.
- W3100552002 cites W2337976471 @default.
- W3100552002 cites W2517012834 @default.
- W3100552002 cites W2610222147 @default.
- W3100552002 cites W2772082296 @default.
- W3100552002 cites W2801376377 @default.
- W3100552002 cites W2893420242 @default.
- W3100552002 cites W2902288057 @default.
- W3100552002 cites W2966955944 @default.
- W3100552002 cites W2973154938 @default.
- W3100552002 cites W2980702664 @default.
- W3100552002 cites W3009076569 @default.
- W3100552002 cites W3025363454 @default.
- W3100552002 cites W3043048877 @default.
- W3100552002 doi "https://doi.org/10.1016/j.knosys.2020.106582" @default.
- W3100552002 hasPublicationYear "2021" @default.
- W3100552002 type Work @default.
- W3100552002 sameAs 3100552002 @default.
- W3100552002 citedByCount "8" @default.
- W3100552002 countsByYear W31005520022021 @default.
- W3100552002 countsByYear W31005520022022 @default.
- W3100552002 countsByYear W31005520022023 @default.
- W3100552002 crossrefType "journal-article" @default.
- W3100552002 hasAuthorship W3100552002A5000922713 @default.
- W3100552002 hasAuthorship W3100552002A5029856513 @default.
- W3100552002 hasAuthorship W3100552002A5047766920 @default.
- W3100552002 hasAuthorship W3100552002A5091321177 @default.
- W3100552002 hasConcept C111012933 @default.
- W3100552002 hasConcept C111335779 @default.
- W3100552002 hasConcept C11413529 @default.
- W3100552002 hasConcept C115537543 @default.
- W3100552002 hasConcept C124101348 @default.
- W3100552002 hasConcept C173608175 @default.
- W3100552002 hasConcept C199360897 @default.
- W3100552002 hasConcept C2524010 @default.
- W3100552002 hasConcept C2781215313 @default.
- W3100552002 hasConcept C33923547 @default.
- W3100552002 hasConcept C41008148 @default.
- W3100552002 hasConcept C69177213 @default.
- W3100552002 hasConcept C75684735 @default.
- W3100552002 hasConcept C75814411 @default.
- W3100552002 hasConceptScore W3100552002C111012933 @default.
- W3100552002 hasConceptScore W3100552002C111335779 @default.
- W3100552002 hasConceptScore W3100552002C11413529 @default.
- W3100552002 hasConceptScore W3100552002C115537543 @default.
- W3100552002 hasConceptScore W3100552002C124101348 @default.
- W3100552002 hasConceptScore W3100552002C173608175 @default.
- W3100552002 hasConceptScore W3100552002C199360897 @default.
- W3100552002 hasConceptScore W3100552002C2524010 @default.
- W3100552002 hasConceptScore W3100552002C2781215313 @default.
- W3100552002 hasConceptScore W3100552002C33923547 @default.
- W3100552002 hasConceptScore W3100552002C41008148 @default.
- W3100552002 hasConceptScore W3100552002C69177213 @default.
- W3100552002 hasConceptScore W3100552002C75684735 @default.
- W3100552002 hasConceptScore W3100552002C75814411 @default.
- W3100552002 hasFunder F4320321001 @default.
- W3100552002 hasLocation W31005520021 @default.
- W3100552002 hasOpenAccess W3100552002 @default.
- W3100552002 hasPrimaryLocation W31005520021 @default.
- W3100552002 hasRelatedWork W1571368810 @default.
- W3100552002 hasRelatedWork W1985171608 @default.
- W3100552002 hasRelatedWork W2005943617 @default.
- W3100552002 hasRelatedWork W2292958489 @default.
- W3100552002 hasRelatedWork W2342469683 @default.
- W3100552002 hasRelatedWork W2377731241 @default.
- W3100552002 hasRelatedWork W2392079855 @default.
- W3100552002 hasRelatedWork W2902601219 @default.
- W3100552002 hasRelatedWork W3180573364 @default.
- W3100552002 hasRelatedWork W4231468729 @default.
- W3100552002 hasVolume "212" @default.
- W3100552002 isParatext "false" @default.
- W3100552002 isRetracted "false" @default.
- W3100552002 magId "3100552002" @default.
- W3100552002 workType "article" @default.