Presentation
Time:
Ph.D. Dissertation Defense: Rubi Quiñones
Date:
9:00 am –
10:00 am
Zoom Room: https://unl.zoom.us/j/98911207446#success
“Unsupervised Cosegmentation and Phenotypes for Multi -Modal, -Perspective, and -State Imagery”
Cosegmentation is used to segment the object(s) from the background by simultaneously analyzing multiple images. The state-of-the-art cosegmentation methods do not satisfactorily address the challenges in segmenting multiple images of evolving objects such as growth sequences of plants. Segmenting the plant from the background is critical in plant phenotyping applications whose goal is to compute any measurable traits from plant images. Current segmentation algorithms typically use low-level methods to isolate the plant from the background. The results are often inadequate leading to degradation in the performance of subsequent algorithms, including the computation of phenotypes. The goal of this research is to increase segmentation accuracy in the plant phenotyping domain by leveraging cosegmentation techniques. First, we show the significant bias in current cosegmentation algorithms and datasets by testing their efficacy of a multiple-aspects (views, modalities, and time) plant imagery dataset. Second, we develop an unsupervised cosegmentation-coattention deep learning framework, called OSC-CO2, that can leverage the results of multiple algorithms specifically meant to increase the overall accuracy in a multiple-aspects plant image dataset. Finally, we propose a suite of novel phenotypes that leverage the information from multiple images across an aspect to describe information-rich phenotypes that represent higher-order properties of the plant. The efficacy of the segmentation algorithm and the phenotypes is demonstrated using multi-aspect imagery from a high-throughput plant phenotyping facility. The broader impact of this research is the advancement of plant phenomics in understanding the plant’s environmental interactions for maximal resilience and yield and indirectly aiding food security and sustainable crop production.
Committee Members:
Ashok Samal, Chair
Sruti Das Choudhury, Co-Chair
Francisco Munoz-Arriola, Co-Chair
HongFeng Yu, Member & Reader
Christopher Bohn, Member
Tala Awada, Outside Representative & Reader
Cosegmentation is used to segment the object(s) from the background by simultaneously analyzing multiple images. The state-of-the-art cosegmentation methods do not satisfactorily address the challenges in segmenting multiple images of evolving objects such as growth sequences of plants. Segmenting the plant from the background is critical in plant phenotyping applications whose goal is to compute any measurable traits from plant images. Current segmentation algorithms typically use low-level methods to isolate the plant from the background. The results are often inadequate leading to degradation in the performance of subsequent algorithms, including the computation of phenotypes. The goal of this research is to increase segmentation accuracy in the plant phenotyping domain by leveraging cosegmentation techniques. First, we show the significant bias in current cosegmentation algorithms and datasets by testing their efficacy of a multiple-aspects (views, modalities, and time) plant imagery dataset. Second, we develop an unsupervised cosegmentation-coattention deep learning framework, called OSC-CO2, that can leverage the results of multiple algorithms specifically meant to increase the overall accuracy in a multiple-aspects plant image dataset. Finally, we propose a suite of novel phenotypes that leverage the information from multiple images across an aspect to describe information-rich phenotypes that represent higher-order properties of the plant. The efficacy of the segmentation algorithm and the phenotypes is demonstrated using multi-aspect imagery from a high-throughput plant phenotyping facility. The broader impact of this research is the advancement of plant phenomics in understanding the plant’s environmental interactions for maximal resilience and yield and indirectly aiding food security and sustainable crop production.
Committee Members:
Ashok Samal, Chair
Sruti Das Choudhury, Co-Chair
Francisco Munoz-Arriola, Co-Chair
HongFeng Yu, Member & Reader
Christopher Bohn, Member
Tala Awada, Outside Representative & Reader