Matches in SemOpenAlex for { <https://semopenalex.org/work/W2551150146> ?p ?o ?g. }
- W2551150146 endingPage "e129" @default.
- W2551150146 startingPage "e125" @default.
- W2551150146 abstract "Clinical trials and basic science studies without statistically significant results are less likely to be published than studies with statistically significant results. Systematic reviews and meta-analyses that omit unpublished data are at high risk of distorted conclusions. Here, we describe methods to search beyond bibliographical databases to reduce evidence selection bias in systematic reviews. Unpublished studies may be identified by searching conference proceedings. Moreover, clinical trial registries—databases of planned and ongoing trials—and regulatory agency websites such as the European Medicine Agency (EMA) and the United States Food and Drug Administration (FDA) may provide summaries of efficacy and safety data. Primary and secondary outcomes are prespecified in trial registries, thus allowing the assessment of outcome reporting bias by comparison with the trial report. The sources of trial data and documents are still evolving, with ongoing initiatives promoting broader access to clinical study reports and individual patient data. There is currently no established methodology to ensure that the multiple sources of information are incorporated. Nonetheless, systematic reviews must adapt to these improvements and cover the new sources in their search strategies. Clinical trials and basic science studies without statistically significant results are less likely to be published than studies with statistically significant results. Systematic reviews and meta-analyses that omit unpublished data are at high risk of distorted conclusions. Here, we describe methods to search beyond bibliographical databases to reduce evidence selection bias in systematic reviews. Unpublished studies may be identified by searching conference proceedings. Moreover, clinical trial registries—databases of planned and ongoing trials—and regulatory agency websites such as the European Medicine Agency (EMA) and the United States Food and Drug Administration (FDA) may provide summaries of efficacy and safety data. Primary and secondary outcomes are prespecified in trial registries, thus allowing the assessment of outcome reporting bias by comparison with the trial report. The sources of trial data and documents are still evolving, with ongoing initiatives promoting broader access to clinical study reports and individual patient data. There is currently no established methodology to ensure that the multiple sources of information are incorporated. Nonetheless, systematic reviews must adapt to these improvements and cover the new sources in their search strategies. CME Activity Dates: November 21, 2016Expiration Date: November 21, 2017Estimated Time to Complete: 1 hourPlanning Committee/Speaker Disclosure: Kenneth A. Katz is founder of Prevention Health Labs, Inc. and also has stock ownership in Synta Pharmaceuticals, Madrigal Pharmaceuticals, and Arrowhead Pharmaceuticals. All other authors, planning committee members, CME committee members and staff involved with this activity as content validation reviewers have no financial relationships with commercial interests to disclose relative to the content of this CME activity.Commercial Support Acknowledgment: This CME activity is supported by an educational grant from Lilly USA, LLC.Description: This article, designed for dermatologists, residents, fellows, and related healthcare providers, seeks to reduce the growing divide between dermatology clinical practice and the basic science/current research methodologies on which many diagnostic and therapeutic advances are built.Objectives: At the conclusion of this activity, learners should be better able to:•Recognize the newest techniques in biomedical research.•Describe how these techniques can be utilized and their limitations.•Describe the potential impact of these techniques.CME Accreditation and Credit Designation: This activity has been planned and implemented in accordance with the accreditation requirements and policies of the Accreditation Council for Continuing Medical Education through the joint providership of William Beaumont Hospital and the Society for Investigative Dermatology. William Beaumont Hospital is accredited by the ACCME to provide continuing medical education for physicians.William Beaumont Hospital designates this enduring material for a maximum of 1.0 AMA PRA Category 1 Credit(s)™. Physicians should claim only the credit commensurate with the extent of their participation in the activity.Method of Physician Participation in Learning Process: The content can be read from the Journal of Investigative Dermatology website: http://www.jidonline.org/current. Tests for CME credits may only be submitted online at https://beaumont.cloud-cme.com/RTMS-Dec16 – click ‘CME on Demand’ and locate the article to complete the test. Fax or other copies will not be accepted. To receive credits, learners must review the CME accreditation information; view the entire article, complete the post-test with a minimum performance level of 60%; and complete the online evaluation form in order to claim CME credit. The CME credit code for this activity is: 21310. For questions about CME credit email [email protected] CME Activity Dates: November 21, 2016 Expiration Date: November 21, 2017 Estimated Time to Complete: 1 hour Planning Committee/Speaker Disclosure: Kenneth A. Katz is founder of Prevention Health Labs, Inc. and also has stock ownership in Synta Pharmaceuticals, Madrigal Pharmaceuticals, and Arrowhead Pharmaceuticals. All other authors, planning committee members, CME committee members and staff involved with this activity as content validation reviewers have no financial relationships with commercial interests to disclose relative to the content of this CME activity. Commercial Support Acknowledgment: This CME activity is supported by an educational grant from Lilly USA, LLC. Description: This article, designed for dermatologists, residents, fellows, and related healthcare providers, seeks to reduce the growing divide between dermatology clinical practice and the basic science/current research methodologies on which many diagnostic and therapeutic advances are built. Objectives: At the conclusion of this activity, learners should be better able to:•Recognize the newest techniques in biomedical research.•Describe how these techniques can be utilized and their limitations.•Describe the potential impact of these techniques. CME Accreditation and Credit Designation: This activity has been planned and implemented in accordance with the accreditation requirements and policies of the Accreditation Council for Continuing Medical Education through the joint providership of William Beaumont Hospital and the Society for Investigative Dermatology. William Beaumont Hospital is accredited by the ACCME to provide continuing medical education for physicians. William Beaumont Hospital designates this enduring material for a maximum of 1.0 AMA PRA Category 1 Credit(s)™. Physicians should claim only the credit commensurate with the extent of their participation in the activity. Method of Physician Participation in Learning Process: The content can be read from the Journal of Investigative Dermatology website: http://www.jidonline.org/current. Tests for CME credits may only be submitted online at https://beaumont.cloud-cme.com/RTMS-Dec16 – click ‘CME on Demand’ and locate the article to complete the test. Fax or other copies will not be accepted. To receive credits, learners must review the CME accreditation information; view the entire article, complete the post-test with a minimum performance level of 60%; and complete the online evaluation form in order to claim CME credit. The CME credit code for this activity is: 21310. For questions about CME credit email [email protected] As highlighted in related Research Techniques Made Simple articles, reporting bias remains one of the greatest threats to the validity of systematic reviews (Abuabara et al., 2012Abuabara K. Freeman E.E. Dellavalle R. The role of systematic reviews and meta-analysis in dermatology.J Invest Dermatol. 2012; 132: e2Abstract Full Text Full Text PDF PubMed Scopus (19) Google Scholar, Drucker et al., 2016Drucker A.M. Fleming P. Chan A.-W. Research techniques made simple: assessing risk of bias in systematic reviews.J Invest Dermatol. 2016; 136: e109-e114Abstract Full Text Full Text PDF PubMed Scopus (78) Google Scholar). To obtain a fair assessment of the effects of an intervention, systematic reviews of interventions for skin diseases should use stringent efforts to include all relevant evidence. An exhaustive search of trials is the most important step in systematic review methodology to reduce evidence selection bias. However, many published articles labeled as “systematic reviews” search only a fraction of the evidence by limiting the search to one or two convenient databases. In this article, we describe a workflow for searching sources beyond bibliographical databases (Figure 1). These techniques will be useful for systematic reviewers for planning an optimal search strategy and for readers of systematic reviews to judge whether suboptimal methods of identifying trials may have introduced bias.Summary Points•Trials without statistically significant results are less likely to be published than trials that show apparent differences (publication bias). Moreover, trial outcomes that do not support the use of the new treatment are less likely to be published than those that do support its use (outcome reporting bias).•Systematic reviews and meta-analyses that omit unpublished data are at high risk of biased conclusions. To increase their validity, systematic reviews should rely on a thorough search for published and unpublished trials.•The Cochrane Central Register of Controlled Trials, MEDLINE, and EMBASE should be searched for published trials.•Sources for finding unpublished trials have expanded recently. Conference proceedings, clinical trial registries, regulatory agency reviews, and health technology assessment reports should be searched for unpublished trials.•A limitation is that there is no standard methodology yet to decide which sources of unpublished trials to search and how to search them. •Trials without statistically significant results are less likely to be published than trials that show apparent differences (publication bias). Moreover, trial outcomes that do not support the use of the new treatment are less likely to be published than those that do support its use (outcome reporting bias).•Systematic reviews and meta-analyses that omit unpublished data are at high risk of biased conclusions. To increase their validity, systematic reviews should rely on a thorough search for published and unpublished trials.•The Cochrane Central Register of Controlled Trials, MEDLINE, and EMBASE should be searched for published trials.•Sources for finding unpublished trials have expanded recently. Conference proceedings, clinical trial registries, regulatory agency reviews, and health technology assessment reports should be searched for unpublished trials.•A limitation is that there is no standard methodology yet to decide which sources of unpublished trials to search and how to search them. For a systematic review of dermatological interventions, the least one can do is to make every effort to identify all published randomized trials. Searching the Cochrane Central Register of Controlled Trials, MEDLINE, and EMBASE will likely allow the researcher to find most published trials. The Cochrane Central Register of Controlled Trials is particularly important to search because it offers a concentrated source of reports of randomized trials. Other specialized bibliographical databases may be relevant to specific topics (see Supplementary Appendix S1 online). Searching bibliographical databases should follow the methodological principles for information retrieval (Lefebvre et al., 2011Lefebvre C. Manheimer E. Glanvill J. Searching for studies.in: Higgins J. Green S. Cochrane handbook for systematic reviews of interventions: version 5.1.0. The Cochrane Collaboration, London2011Google Scholar). In particular, search equations should seek increased sensitivity and use ad hoc filters to identify randomized trials (such as the Cochrane Highly Sensitive Search Strategies or filters listed at https://sites.google.com/a/york.ac.uk/issg-search-filters-resource/home). Such a search should be complemented by screening the reference lists of all selected trials and by searching for previous systematic reviews on the same topic and screening the lists of selected trials. About 50% of clinical trial results that are presented at meetings and congresses remain unpublished (Scherer et al., 2007Scherer R.W. Langenberg P. von Elm E. Full publication of results initially presented in abstracts.Cochrane Database Syst Rev. 2007; : MR000005PubMed Google Scholar). As a consequence, conference abstracts should be searched to identify trials with unpublished results. Data reported in conference abstracts may be not be as reliable as full publications, because abstracts may contain preliminary results and may not contain sufficient information to assess methodological quality. However, abstracts allow documenting the existence of unpublished trials (more specifically, their number and sample size) and unpublished outcomes. It allows statistical analysis to gauge the sensitivity of the systematic review conclusions to the nondissemination of these trials. Some databases index conference proceedings. However, there is currently no centralized registry of abstracts from all conferences. Systematic reviewers most frequently hand search or electronically search abstracts made available by the corresponding societies (e.g., American Academy of Dermatology, European Society for Dermatological Research, Society for Investigative Dermatology, Japanese Society for Investigative Dermatology) through journal supplements or on their websites. The Cochrane Skin Group has hand searched and added to its Specialized Register 42 journals and 28 conference proceedings (see Supplementary Appendix S1). Clinical trial registries—databases of planned and ongoing trials–have become essential sources for identifying unpublished trials. In 2005, the International Committee of Medical Journal Editors stated that to be considered for publication, trials need to have been registered in a public, International Committee of Medical Journal Editors-approved registry before the beginning of enrollment. Systematic review authors can search the World Health Organization International Clinical Trials Registry Platform Search Portal, which gathers records of trials registered on 16 data providers, including clinicaltrials.gov and the European Union Clinical Trials Register. Besides institutional registries, pharmaceutical companies have also developed clinical trial registries. When a relevant completed trial is identified but no published article can be matched, the systematic review authors can contact the trialists or sponsors to inquire about the trial status and ask for results. Some researchers have even suggested that only prospectively registered trials should be included in meta-analyses because the risk of bias with any other form of trial is too great (Roberts et al., 2015Roberts I. Ker K. Edwards P. Beecher D. Manno D. Sydenham E. The knowledge system underpinning healthcare is not fit for purpose and must change.BMJ. 2015; 350: h2463Crossref PubMed Scopus (89) Google Scholar). Trial registries also allow identification of unreported outcomes, because the primary and secondary outcomes are documented in each trial record. In cases of publication, one can compare the reported outcomes with the registered outcomes and assess selective outcome reporting bias, that is, when negative outcomes remain unreported (Nankervis et al., 2012Nankervis H. Baibergenova A. Williams H.C. Thomas K.S. Prospective registration and outcome-reporting bias in randomized controlled trials of eczema treatments: a systematic review.J Invest Dermatol. 2012; 132: 2727-2734Abstract Full Text Full Text PDF PubMed Scopus (43) Google Scholar). An example of outcome reporting bias is the Multicenter Selective Lymphadenectomy Trial (Williams, 2015Williams H.C. Place your bet and show us your hand.Br J Dermatol. 2015; 173: 1104-1105Crossref PubMed Scopus (2) Google Scholar), one study that sought to determine whether wide excision followed by sentinel node biopsy and immediate lymphadenectomy for nodal metastases is better than wide excision followed by nodal observation for melanoma. The trial produced much valuable data, yet the primary outcome of overall survival, which was identified in the original trial registration, was never published in the final report. Derivation of overall survival data from the study report suggested no overall survival increase for sentinel biopsy plus selective lymphadenectomy (Williams, 2015Williams H.C. Place your bet and show us your hand.Br J Dermatol. 2015; 173: 1104-1105Crossref PubMed Scopus (2) Google Scholar). Clinical trial registries may also contain summary trial data. At clinicaltrials.gov, the results of applicable clinical trials, as defined by section 801 of the FDA Amendments Act, are required to be posted, and the results of many other trials are also posted voluntarily. For systematic reviewers, it is therefore crucial to use clinicaltrials.gov to find trial results, in particular safety information. The EMA has also enacted a proactive publication of summary results through the European Union Clinical Trials Register. Some pharmaceutical companies have also developed their own clinical trial result databases. Regulatory agencies, such as the FDA and the EMA, also offer access to additional data through the pharmaceutical companies’ approval applications (see Supplementary Appendix S2 online). The FDA provides a searchable catalog of approved drug products. These unpublished trial data are directly usable for systematic reviews, and their inclusion can result in modification of the conclusions. In a re-analysis of 41 meta-analyses based on published data only, the addition of unpublished FDA trial data changed the outcome to a lower treatment effect in 46.3% of meta-analyses, did not change the estimate in 7.4%, and changed the outcome to a larger treatment effect in 46.3% (Hart et al., 2012Hart B. Lundh A. Bero L. Effect of reporting bias on meta-analyses of drug trials: reanalysis of meta-analyses.BMJ. 2012; 344: d7202Crossref PubMed Scopus (177) Google Scholar). The EMA publishes European Public Assessment Reports for every medicine application, whether it has been granted or refused a marketing authorization. A comparison of FDA and EMA data for 27 drugs has shown that detailed data on efficacy and harms were available; the information was easier to find on the EMA than on the FDA website, but more data on harms were available on the latter (Schroll et al., 2015Schroll J.B. Abdel-Sattar M. Bero L. The Food and Drug Administration reports provided more data but were more difficult to use than the European Medicines Agency reports.J Clin Epidemiol. 2015; 68: 102-107Abstract Full Text Full Text PDF PubMed Scopus (7) Google Scholar). The benefit of searching regulatory agency websites is exemplified in studies on use of imiquimod cream for molluscum contagiosum. In a Cochrane review published in 2009 (van der Wouden et al., 2009van der Wouden J.C. van der Sande R. van Suijlekom-Smit L.W.A. Berger M. Butler C.C. Koning S. Interventions for cutaneous molluscum contagiosum.Cochrane Database Syst Rev. 2009; (CD004767)Crossref Scopus (71) Google Scholar), the one published trial comparing imiquimod with placebo in 23 patients showed a relative risk of 3.67 (95% confidence interval = 0.48–28.0) for complete clearance of lesions. However, three industry-sponsored unpublished trials were included in a FDA’s publicly available review (Papadopoulos, 2007Papadopoulos E. Clinical review NDA 20723 Aldara, imiquimod 5% cream, http://www.fda.gov/downloads/Drugs/DevelopmentApprovalProcess/DevelopmentResources/UCM428714.pdf; 2007 (accessed 16 May 2016).Google Scholar). These three trials randomized a total of 827 patients. When added to the published trial, the pooled relative risk was 0.93 (95% confidence interval = 0.73–1.19), suggesting that imiquimod is ineffective for that indication. Finally, health technology assessment agencies, through their requests to industry, may have access to unpublished data and make them publicly available by publishing benefit assessment dossiers online (see Supplementary Appendix S1). A comprehensive search is even more important when considering that no statistical method allows complete documenting or excluding of reporting bias in a systematic review with certainty. Asymmetry of the funnel plot may indicate that smaller trials give different findings than larger trials, but funnel plot asymmetry has several possible causes, and its presence or absence cannot be equated with the presence or absence of reporting bias. Moreover, many statistical methods have been introduced to detect or adjust for reporting bias, but their use is inappropriate in most meta-analyses because of too few trials or excessive heterogeneity (Ioannidis, 2008Ioannidis J.P. Interpretation of tests of heterogeneity and bias in meta-analysis.J Eval Clin Pract. 2008; 14: 951-957Crossref PubMed Scopus (343) Google Scholar). Comprehensive searching adds to the resources needed to complete the systematic review, but searching some sources may not always yield additional evidence. Among 114 systematic reviews that searched FDA documents, unpublished data were available from the FDA for 17% (McDonagh et al., 2013McDonagh M.S. Peterson K. Balshem H. Helfand M. US Food and Drug Administration documents can provide unpublished evidence relevant to systematic reviews.J Clin Epidemiol. 2013; 66: 1071-1081Abstract Full Text Full Text PDF PubMed Scopus (15) Google Scholar). The extent and depth of the search strategy might be adapted according to the review question and context. For example, in a systematic review of a drug for an unapproved indication, searching the FDA documents is unlikely to provide unpublished evidence. Specific indications or guidelines for reviews that will most likely benefit from searching additional sources such as the FDA do not yet exist. Another challenge is that multiple reports for the same trial may be identified, and discrepancies for results can exist between different sources (Hartung et al., 2014Hartung D.M. Zarin D.A. Guise J.M. McDonagh M. Paynter R. Helfand M. Reporting discrepancies between the ClinicalTrials.gov results database and peer-reviewed publications.Ann Intern Med. 2014; 160: 477-483Crossref PubMed Scopus (148) Google Scholar). Systematic review authors then have to link all reports of the same trial together and decide and describe clearly which report is to be chosen as the primary source of information. Although there is no established consensus, an order of priority may be prespecified. For instance, FDA-prepared documents may be considered as more reliable than journal articles. In fact, FDA statistical reviewers reanalyze raw data, whereas journal articles may be affected by selective reporting of a subset of statistical analyses based on the results. Trial registration is now a legal requirement in the United States, European Union, and many countries, but compliance is far from perfect. Enhanced transparency is encouraged by the alltrials.net campaign, an initiative of several organizations such as Cochrane, The BMJ, and the Centre for Evidence-Based Medicine, calling for registration and reporting of results of all clinical trials. Another project, OpenTrials.net, will aggregate information from a wide variety of existing sources to provide a comprehensive picture of all the data and documents available for all trials. One key source of trial data is clinical study reports, which are prepared by trial sponsors and transmitted to regulators. These documents are still infrequent but are becoming increasingly publicly available through requests to the EMA and FDA. Moreover, the goal to obtain reporting transparency will be reached as prominent journals continue to establish clear requirements for making trial data available (Taichman et al., 2016Taichman D.B. Backus J. Baethge C. Bauchner H. de Leeuw P.W. Drazen J.M. et al.Sharing clinical trial data: a proposal from the International Committee of Medical Journal Editors.Ann Intern Med. 2016; 164: 505-506Crossref PubMed Scopus (81) Google Scholar). The clinicalstudydatarequest.com and the Yale University Open Data Access (http://yoda.yale.edu/, accessed 5 October 2016) websites allow researchers to request access to individual patient data and supporting documents from industry-sponsored clinical trials. Moreover, the European Medicines Agency policy has released guidance on the publication of clinical data for medicinal products. This policy has entered into force in 2015 for the publication of clinical reports, but in a later stage it will also concern the publication of individual patient data. Systematic reviews must adapt to these improvements and cover the multiple new information sources in their search strategies. Conference proceedings, clinical trial registries, regulatory agency reviews, and health technology assessment reports contain unpublished evidence that can be essential in resolving publication bias and selective outcome reporting.Multiple Choice Questions1.Which of the following would result in publication bias?A.Trials with negative results were not published and could not be selected in the systematic review.B.Trials with statistically significant results were cited more often by subsequent articles, increasing the likelihood of being selected in the systematic review.C.Trials were published in languages other than English and could not be selected in the systematic review.D.Trials were published more than once, increasing the likelihood of the trial being selected in the systematic review.E.All of the above2.Searching beyond bibliographical databases for a systematic review potentially reduces which of the following?A.Publication biasB.Validity of the systematic reviewC.Outcome reporting biasD.Labor intensity of the searchE.A and C3.The sources to search for published trials include which of the following?A.MEDLINE onlyB.The Cochrane Central Register of Controlled TrialsC.The Cochrane Database of Systematic ReviewsD.EMBASEE.B, C, and D4.The sources to search for unpublished trials include which of the following?A.clinicaltrials.govB.alltrials.netC.[email protected]D.Proceedings to the American Academy of Dermatology Annual MeetingE.A, C, and D5.Which of the following are some limitations of sources of unpublished trials?A.Clinical trial registries include ongoing and completed trials and potentially posted trial results.B.Reviews obtained from regulatory agencies typically lack sufficient detail to assess the risk of bias for a trial.C.Conference abstracts are not restricted by treatment type (pharmacological and nonpharmacological).D.Searching conference abstracts, clinical trial registries, and regulatory and health technology assessment agency websites is burdensome.E.B and D 1.Which of the following would result in publication bias?A.Trials with negative results were not published and could not be selected in the systematic review.B.Trials with statistically significant results were cited more often by subsequent articles, increasing the likelihood of being selected in the systematic review.C.Trials were published in languages other than English and could not be selected in the systematic review.D.Trials were published more than once, increasing the likelihood of the trial being selected in the systematic review.E.All of the above2.Searching beyond bibliographical databases for a systematic review potentially reduces which of the following?A.Publication biasB.Validity of the systematic reviewC.Outcome reporting biasD.Labor intensity of the searchE.A and C3.The sources to search for published trials include which of the following?A.MEDLINE onlyB.The Cochrane Central Register of Controlled TrialsC.The Cochrane Database of Systematic ReviewsD.EMBASEE.B, C, and D4.The sources to search for unpublished trials include which of the following?A.clinicaltrials.govB.alltrials.netC.[email protected]D.Proceedings to the American Academy of Dermatology Annual MeetingE.A, C, and D5.Which of the following are some limitations of sources of unpublished trials?A.Clinical trial registries include ongoing and completed trials and potentially posted trial results.B.Reviews obtained from regulatory agencies typically lack sufficient detail to assess the risk of bias for a trial.C.Conference abstracts are not restricted by treatment type (pharmacological and nonpharmacological).D.Searching conference abstracts, clinical trial registries, and regulatory and health technology assessment agency websites is burdensome.E.B and D The authors state no conflict of interest. Download .pdf (.02 MB) Help with pdf files Quiz and brief explanation of correct answers Download .ppt (.18 MB) Help with ppt files Teaching Slides Download .pdf (1.78 MB) Help with pdf files Supplementary Appendices S1 and S2" @default.
- W2551150146 created "2016-11-30" @default.
- W2551150146 creator A5007055690 @default.
- W2551150146 creator A5014513186 @default.
- W2551150146 creator A5015449458 @default.
- W2551150146 creator A5020273160 @default.
- W2551150146 creator A5022664611 @default.
- W2551150146 date "2016-12-01" @default.
- W2551150146 modified "2023-10-18" @default.
- W2551150146 title "Research Techniques Made Simple: Workflow for Searching Databases to Reduce Evidence Selection Bias in Systematic Reviews" @default.
- W2551150146 cites W1983686777 @default.
- W2551150146 cites W2043658255 @default.
- W2551150146 cites W2051247471 @default.
- W2551150146 cites W2066729510 @default.
- W2551150146 cites W2090073443 @default.
- W2551150146 cites W2117128578 @default.
- W2551150146 cites W2144112749 @default.
- W2551150146 cites W2167873535 @default.
- W2551150146 cites W2171310196 @default.
- W2551150146 cites W2499012676 @default.
- W2551150146 cites W2538488284 @default.
- W2551150146 cites W4253701488 @default.
- W2551150146 doi "https://doi.org/10.1016/j.jid.2016.09.019" @default.
- W2551150146 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/27884295" @default.
- W2551150146 hasPublicationYear "2016" @default.
- W2551150146 type Work @default.
- W2551150146 sameAs 2551150146 @default.
- W2551150146 citedByCount "12" @default.
- W2551150146 countsByYear W25511501462017 @default.
- W2551150146 countsByYear W25511501462018 @default.
- W2551150146 countsByYear W25511501462019 @default.
- W2551150146 countsByYear W25511501462020 @default.
- W2551150146 countsByYear W25511501462021 @default.
- W2551150146 countsByYear W25511501462022 @default.
- W2551150146 countsByYear W25511501462023 @default.
- W2551150146 crossrefType "journal-article" @default.
- W2551150146 hasAuthorship W2551150146A5007055690 @default.
- W2551150146 hasAuthorship W2551150146A5014513186 @default.
- W2551150146 hasAuthorship W2551150146A5015449458 @default.
- W2551150146 hasAuthorship W2551150146A5020273160 @default.
- W2551150146 hasAuthorship W2551150146A5022664611 @default.
- W2551150146 hasBestOaLocation W25511501461 @default.
- W2551150146 hasConcept C105795698 @default.
- W2551150146 hasConcept C111472728 @default.
- W2551150146 hasConcept C124101348 @default.
- W2551150146 hasConcept C138885662 @default.
- W2551150146 hasConcept C154945302 @default.
- W2551150146 hasConcept C177212765 @default.
- W2551150146 hasConcept C185592680 @default.
- W2551150146 hasConcept C189708586 @default.
- W2551150146 hasConcept C23123220 @default.
- W2551150146 hasConcept C2522767166 @default.
- W2551150146 hasConcept C2779473830 @default.
- W2551150146 hasConcept C2780586882 @default.
- W2551150146 hasConcept C33923547 @default.
- W2551150146 hasConcept C40423286 @default.
- W2551150146 hasConcept C41008148 @default.
- W2551150146 hasConcept C55493867 @default.
- W2551150146 hasConcept C77088390 @default.
- W2551150146 hasConcept C81917197 @default.
- W2551150146 hasConceptScore W2551150146C105795698 @default.
- W2551150146 hasConceptScore W2551150146C111472728 @default.
- W2551150146 hasConceptScore W2551150146C124101348 @default.
- W2551150146 hasConceptScore W2551150146C138885662 @default.
- W2551150146 hasConceptScore W2551150146C154945302 @default.
- W2551150146 hasConceptScore W2551150146C177212765 @default.
- W2551150146 hasConceptScore W2551150146C185592680 @default.
- W2551150146 hasConceptScore W2551150146C189708586 @default.
- W2551150146 hasConceptScore W2551150146C23123220 @default.
- W2551150146 hasConceptScore W2551150146C2522767166 @default.
- W2551150146 hasConceptScore W2551150146C2779473830 @default.
- W2551150146 hasConceptScore W2551150146C2780586882 @default.
- W2551150146 hasConceptScore W2551150146C33923547 @default.
- W2551150146 hasConceptScore W2551150146C40423286 @default.
- W2551150146 hasConceptScore W2551150146C41008148 @default.
- W2551150146 hasConceptScore W2551150146C55493867 @default.
- W2551150146 hasConceptScore W2551150146C77088390 @default.
- W2551150146 hasConceptScore W2551150146C81917197 @default.
- W2551150146 hasIssue "12" @default.
- W2551150146 hasLocation W25511501461 @default.
- W2551150146 hasLocation W25511501462 @default.
- W2551150146 hasLocation W25511501463 @default.
- W2551150146 hasLocation W25511501464 @default.
- W2551150146 hasOpenAccess W2551150146 @default.
- W2551150146 hasPrimaryLocation W25511501461 @default.
- W2551150146 hasRelatedWork W2063589661 @default.
- W2551150146 hasRelatedWork W2081035100 @default.
- W2551150146 hasRelatedWork W2168764238 @default.
- W2551150146 hasRelatedWork W2551029045 @default.
- W2551150146 hasRelatedWork W2725700675 @default.
- W2551150146 hasRelatedWork W2903478575 @default.
- W2551150146 hasRelatedWork W2937759506 @default.
- W2551150146 hasRelatedWork W3142359244 @default.
- W2551150146 hasRelatedWork W3176311559 @default.
- W2551150146 hasRelatedWork W4234676039 @default.
- W2551150146 hasVolume "136" @default.
- W2551150146 isParatext "false" @default.
- W2551150146 isRetracted "false" @default.