Matches in SemOpenAlex for { <https://semopenalex.org/work/W4282941808> ?p ?o ?g. }
- W4282941808 endingPage "3230" @default.
- W4282941808 startingPage "3218" @default.
- W4282941808 abstract "Reconstructing the 3D geometry of the surgical site and detecting instruments within it are important tasks for surgical navigation systems and robotic surgery automation. Traditional approaches treat each problem in isolation and do not account for the intrinsic relationship between segmentation and stereo matching. In this paper, we present a learning-based framework that jointly estimates disparity and binary tool segmentation masks. The core component of our architecture is a shared feature encoder which allows strong interaction between the aforementioned tasks. Experimentally, we train two variants of our network with different capacities and explore different training schemes including both multi-task and single-task learning. Our results show that supervising the segmentation task improves our network's disparity estimation accuracy. We demonstrate a domain adaptation scheme where we supervise the segmentation task with monocular data and achieve domain adaptation of the adjacent disparity task, reducing disparity End-Point-Error and depth mean absolute error by 77.73% and 61.73% respectively compared to the pre-trained baseline model. Our best overall multi-task model, trained with both disparity and segmentation data in subsequent phases, achieves 89.15% mean Intersection-over-Union in RIS and 3.18 millimetre depth mean absolute error in SCARED test sets. Our proposed multi-task architecture is real-time, able to process ( 1280×1024 ) stereo input and simultaneously estimate disparity maps and segmentation masks at 22 frames per second. The model code and pre-trained models are made available: https://github.com/dimitrisPs/msdesis." @default.
- W4282941808 created "2022-06-16" @default.
- W4282941808 creator A5048400975 @default.
- W4282941808 creator A5058848836 @default.
- W4282941808 creator A5068825369 @default.
- W4282941808 creator A5077630267 @default.
- W4282941808 date "2022-11-01" @default.
- W4282941808 modified "2023-10-15" @default.
- W4282941808 title "MSDESIS: Multitask Stereo Disparity Estimation and Surgical Instrument Segmentation" @default.
- W4282941808 cites W1511599987 @default.
- W4282941808 cites W1590518343 @default.
- W4282941808 cites W1944715619 @default.
- W4282941808 cites W1991617202 @default.
- W4282941808 cites W2109297031 @default.
- W4282941808 cites W2811195474 @default.
- W4282941808 cites W2958981985 @default.
- W4282941808 cites W2980176422 @default.
- W4282941808 cites W2989184872 @default.
- W4282941808 cites W3092936655 @default.
- W4282941808 cites W3106432280 @default.
- W4282941808 cites W3110677656 @default.
- W4282941808 cites W3181702434 @default.
- W4282941808 cites W3203177522 @default.
- W4282941808 cites W3214532513 @default.
- W4282941808 cites W4200072305 @default.
- W4282941808 cites W4210790836 @default.
- W4282941808 doi "https://doi.org/10.1109/tmi.2022.3181229" @default.
- W4282941808 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/35675257" @default.
- W4282941808 hasPublicationYear "2022" @default.
- W4282941808 type Work @default.
- W4282941808 citedByCount "0" @default.
- W4282941808 crossrefType "journal-article" @default.
- W4282941808 hasAuthorship W4282941808A5048400975 @default.
- W4282941808 hasAuthorship W4282941808A5058848836 @default.
- W4282941808 hasAuthorship W4282941808A5068825369 @default.
- W4282941808 hasAuthorship W4282941808A5077630267 @default.
- W4282941808 hasBestOaLocation W42829418082 @default.
- W4282941808 hasConcept C105795698 @default.
- W4282941808 hasConcept C120665830 @default.
- W4282941808 hasConcept C121332964 @default.
- W4282941808 hasConcept C138885662 @default.
- W4282941808 hasConcept C139807058 @default.
- W4282941808 hasConcept C153180895 @default.
- W4282941808 hasConcept C154945302 @default.
- W4282941808 hasConcept C162324750 @default.
- W4282941808 hasConcept C165064840 @default.
- W4282941808 hasConcept C187736073 @default.
- W4282941808 hasConcept C2776401178 @default.
- W4282941808 hasConcept C2780451532 @default.
- W4282941808 hasConcept C31972630 @default.
- W4282941808 hasConcept C33923547 @default.
- W4282941808 hasConcept C41008148 @default.
- W4282941808 hasConcept C41895202 @default.
- W4282941808 hasConcept C65909025 @default.
- W4282941808 hasConcept C68537008 @default.
- W4282941808 hasConcept C89600930 @default.
- W4282941808 hasConceptScore W4282941808C105795698 @default.
- W4282941808 hasConceptScore W4282941808C120665830 @default.
- W4282941808 hasConceptScore W4282941808C121332964 @default.
- W4282941808 hasConceptScore W4282941808C138885662 @default.
- W4282941808 hasConceptScore W4282941808C139807058 @default.
- W4282941808 hasConceptScore W4282941808C153180895 @default.
- W4282941808 hasConceptScore W4282941808C154945302 @default.
- W4282941808 hasConceptScore W4282941808C162324750 @default.
- W4282941808 hasConceptScore W4282941808C165064840 @default.
- W4282941808 hasConceptScore W4282941808C187736073 @default.
- W4282941808 hasConceptScore W4282941808C2776401178 @default.
- W4282941808 hasConceptScore W4282941808C2780451532 @default.
- W4282941808 hasConceptScore W4282941808C31972630 @default.
- W4282941808 hasConceptScore W4282941808C33923547 @default.
- W4282941808 hasConceptScore W4282941808C41008148 @default.
- W4282941808 hasConceptScore W4282941808C41895202 @default.
- W4282941808 hasConceptScore W4282941808C65909025 @default.
- W4282941808 hasConceptScore W4282941808C68537008 @default.
- W4282941808 hasConceptScore W4282941808C89600930 @default.
- W4282941808 hasFunder F4320320006 @default.
- W4282941808 hasFunder F4320334627 @default.
- W4282941808 hasIssue "11" @default.
- W4282941808 hasLocation W42829418081 @default.
- W4282941808 hasLocation W42829418082 @default.
- W4282941808 hasLocation W42829418083 @default.
- W4282941808 hasLocation W42829418084 @default.
- W4282941808 hasLocation W42829418085 @default.
- W4282941808 hasOpenAccess W4282941808 @default.
- W4282941808 hasPrimaryLocation W42829418081 @default.
- W4282941808 hasRelatedWork W127013308 @default.
- W4282941808 hasRelatedWork W1614704886 @default.
- W4282941808 hasRelatedWork W2144434930 @default.
- W4282941808 hasRelatedWork W2376536876 @default.
- W4282941808 hasRelatedWork W2391245565 @default.
- W4282941808 hasRelatedWork W2786306966 @default.
- W4282941808 hasRelatedWork W3014239205 @default.
- W4282941808 hasRelatedWork W3110752836 @default.
- W4282941808 hasRelatedWork W3192645019 @default.
- W4282941808 hasRelatedWork W2585909798 @default.
- W4282941808 hasVolume "41" @default.
- W4282941808 isParatext "false" @default.
- W4282941808 isRetracted "false" @default.