Matches in SemOpenAlex for { <https://semopenalex.org/work/W4365211704> ?p ?o ?g. }
Showing items 1 to 81 of
81
with 100 items per page.
- W4365211704 abstract "In recent years, Text-to-Image (T2I) models have been extensively studied, especially with the emergence of diffusion models that achieve state-of-the-art results on T2I synthesis tasks. However, existing benchmarks heavily rely on subjective human evaluation, limiting their ability to holistically assess the model's capabilities. Furthermore, there is a significant gap between efforts in developing new T2I architectures and those in evaluation. To address this, we introduce HRS-Bench, a concrete evaluation benchmark for T2I models that is Holistic, Reliable, and Scalable. Unlike existing bench-marks that focus on limited aspects, HRS-Bench measures 13 skills that can be categorized into five major categories: accuracy, robustness, generalization, fairness, and bias. In addition, HRS-Bench covers 50 scenarios, including fashion, animals, transportation, food, and clothes. We evaluate nine recent large-scale T2I models using metrics that cover a wide range of skills. A human evaluation aligned with 95% of our evaluations on average was conducted to probe the effectiveness of HRS-Bench. Our experiments demonstrate that existing models often struggle to generate images with the desired count of objects, visual text, or grounded emotions. We hope that our benchmark help ease future text-to-image generation research. The code and data are available at https://eslambakr.github.io/hrsbench.github.io" @default.
- W4365211704 created "2023-04-13" @default.
- W4365211704 creator A5001065533 @default.
- W4365211704 creator A5011402606 @default.
- W4365211704 creator A5020511969 @default.
- W4365211704 creator A5050244716 @default.
- W4365211704 creator A5063344807 @default.
- W4365211704 creator A5085089542 @default.
- W4365211704 date "2023-04-11" @default.
- W4365211704 modified "2023-09-28" @default.
- W4365211704 title "HRS-Bench: Holistic, Reliable and Scalable Benchmark for Text-to-Image Models" @default.
- W4365211704 doi "https://doi.org/10.48550/arxiv.2304.05390" @default.
- W4365211704 hasPublicationYear "2023" @default.
- W4365211704 type Work @default.
- W4365211704 citedByCount "0" @default.
- W4365211704 crossrefType "posted-content" @default.
- W4365211704 hasAuthorship W4365211704A5001065533 @default.
- W4365211704 hasAuthorship W4365211704A5011402606 @default.
- W4365211704 hasAuthorship W4365211704A5020511969 @default.
- W4365211704 hasAuthorship W4365211704A5050244716 @default.
- W4365211704 hasAuthorship W4365211704A5063344807 @default.
- W4365211704 hasAuthorship W4365211704A5085089542 @default.
- W4365211704 hasBestOaLocation W43652117041 @default.
- W4365211704 hasConcept C104317684 @default.
- W4365211704 hasConcept C119857082 @default.
- W4365211704 hasConcept C124101348 @default.
- W4365211704 hasConcept C127413603 @default.
- W4365211704 hasConcept C13280743 @default.
- W4365211704 hasConcept C134306372 @default.
- W4365211704 hasConcept C153083717 @default.
- W4365211704 hasConcept C154945302 @default.
- W4365211704 hasConcept C177148314 @default.
- W4365211704 hasConcept C185592680 @default.
- W4365211704 hasConcept C185798385 @default.
- W4365211704 hasConcept C188198153 @default.
- W4365211704 hasConcept C205649164 @default.
- W4365211704 hasConcept C2522767166 @default.
- W4365211704 hasConcept C33923547 @default.
- W4365211704 hasConcept C41008148 @default.
- W4365211704 hasConcept C48044578 @default.
- W4365211704 hasConcept C55493867 @default.
- W4365211704 hasConcept C63479239 @default.
- W4365211704 hasConcept C77088390 @default.
- W4365211704 hasConcept C78519656 @default.
- W4365211704 hasConceptScore W4365211704C104317684 @default.
- W4365211704 hasConceptScore W4365211704C119857082 @default.
- W4365211704 hasConceptScore W4365211704C124101348 @default.
- W4365211704 hasConceptScore W4365211704C127413603 @default.
- W4365211704 hasConceptScore W4365211704C13280743 @default.
- W4365211704 hasConceptScore W4365211704C134306372 @default.
- W4365211704 hasConceptScore W4365211704C153083717 @default.
- W4365211704 hasConceptScore W4365211704C154945302 @default.
- W4365211704 hasConceptScore W4365211704C177148314 @default.
- W4365211704 hasConceptScore W4365211704C185592680 @default.
- W4365211704 hasConceptScore W4365211704C185798385 @default.
- W4365211704 hasConceptScore W4365211704C188198153 @default.
- W4365211704 hasConceptScore W4365211704C205649164 @default.
- W4365211704 hasConceptScore W4365211704C2522767166 @default.
- W4365211704 hasConceptScore W4365211704C33923547 @default.
- W4365211704 hasConceptScore W4365211704C41008148 @default.
- W4365211704 hasConceptScore W4365211704C48044578 @default.
- W4365211704 hasConceptScore W4365211704C55493867 @default.
- W4365211704 hasConceptScore W4365211704C63479239 @default.
- W4365211704 hasConceptScore W4365211704C77088390 @default.
- W4365211704 hasConceptScore W4365211704C78519656 @default.
- W4365211704 hasLocation W43652117041 @default.
- W4365211704 hasOpenAccess W4365211704 @default.
- W4365211704 hasPrimaryLocation W43652117041 @default.
- W4365211704 hasRelatedWork W112744582 @default.
- W4365211704 hasRelatedWork W1992807924 @default.
- W4365211704 hasRelatedWork W2789601449 @default.
- W4365211704 hasRelatedWork W2989932438 @default.
- W4365211704 hasRelatedWork W3088526462 @default.
- W4365211704 hasRelatedWork W4200270698 @default.
- W4365211704 hasRelatedWork W4200283151 @default.
- W4365211704 hasRelatedWork W4200327704 @default.
- W4365211704 hasRelatedWork W4210620793 @default.
- W4365211704 hasRelatedWork W4312365371 @default.
- W4365211704 isParatext "false" @default.
- W4365211704 isRetracted "false" @default.
- W4365211704 workType "article" @default.