Skip to content

Commit

Permalink
Update index.html
Browse files Browse the repository at this point in the history
  • Loading branch information
lisun-ai authored Jul 1, 2024
1 parent f6ca151 commit 65f21fe
Showing 1 changed file with 38 additions and 2 deletions.
40 changes: 38 additions & 2 deletions index.html
Original file line number Diff line number Diff line change
Expand Up @@ -127,7 +127,7 @@ <h1 class="title is-1 publication-title">MedSyn: Text-guided Anatomy-aware Synth
<h2 class="title is-3">Abstract</h2>
<div class="content has-text-justified">
<p>
This paper introduces an novel methodology for producing high-quality 3D lung CT images guided by textual information. While diffusion-based generative models are increasingly used in medical imaging, current state-of-the-art approaches are limited to low-resolution outputs and underutilize radiology reports' abundant information. Nevertheless, expanding text-guided generation to high-resolution 3D images poses significant memory and anatomical detail-preserving challenges. Addressing the memory issue, we introduce a hierarchical scheme that uses a modified UNet architecture. We start by synthesizing low-resolution images conditioned on the text, serving as a foundation for subsequent generators for complete volumetric data. To ensure the anatomical plausibility of the generated samples, we provide further guidance by generating vascular, airway, and lobular segmentation masks in conjunction with the CT images. The model demonstrates the capability to use textual input and segmentation tasks to generate synthesized images. Algorithmic comparative assessments and blind evaluations conducted by 10 board-certified radiologists indicate that our approach exhibits superior performance compared to baseline methods, especially in accurately retaining crucial anatomical features such as fissure lines and airways. This study focuses on two main objectives: (1) the development of a method for creating images based on textual prompts and anatomical components, and (2) the capability to generate new images conditioning on anatomical elements.
This paper introduces a novel methodology for producing high-quality 3D lung CT images guided by textual information. While diffusion-based generative models are increasingly used in medical imaging, current state-of-the-art approaches are limited to low-resolution outputs and underutilize radiology reports' abundant information. Nevertheless, expanding text-guided generation to high-resolution 3D images poses significant memory and anatomical detail-preserving challenges. Addressing the memory issue, we introduce a hierarchical scheme that uses a modified UNet architecture. We start by synthesizing low-resolution images conditioned on the text, serving as a foundation for subsequent generators for complete volumetric data. To ensure the anatomical plausibility of the generated samples, we provide further guidance by generating vascular, airway, and lobular segmentation masks in conjunction with the CT images. The model demonstrates the capability to use textual input and segmentation tasks to generate synthesized images. Algorithmic comparative assessments and blind evaluations conducted by 10 board-certified radiologists indicate that our approach exhibits superior performance compared to baseline methods, especially in accurately retaining crucial anatomical features such as fissure lines and airways. This study focuses on two main objectives: (1) the development of a method for creating images based on textual prompts and anatomical components, and (2) the capability to generate new images conditioning on anatomical elements.
</p>
</div>
</div>
Expand All @@ -141,7 +141,7 @@ <h2 class="title is-3">Abstract</h2>

<div class="columns is-centered has-text-centered">
<div class="column is-six-fifths">
<h2 class="title is-3"> Schematic</h2>
<h2 class="title is-3"> Model Schematic</h2>
</div>
</div>

Expand All @@ -151,6 +151,42 @@ <h2 class="title is-3"> Schematic</h2>
</div>
</div>

<div class="columns is-centered has-text-centered">
<div class="column is-six-fifths">
<h2 class="title is-3"> Comparison of Generated Samples</h2>
</div>
</div>

<div class="columns is-centered has-text-centered">
<div class="column is-six-fifths">
<img id="teaser" width="50%" src="./static/images/visualize_slice_v3.jpg">
</div>
</div>

<div class="columns is-centered has-text-centered">
<div class="column is-six-fifths">
<h2 class="title is-3"> Generation Conditioned on Reports</h2>
</div>
</div>

<div class="columns is-centered has-text-centered">
<div class="column is-six-fifths">
<img id="teaser" width="50%" src="./static/images/prompt_comparison.jpg">
</div>
</div>

<div class="columns is-centered has-text-centered">
<div class="column is-six-fifths">
<h2 class="title is-3"> Generation Conditioned on Segmentation Mask</h2>
</div>
</div>

<div class="columns is-centered has-text-centered">
<div class="column is-six-fifths">
<img id="teaser" width="50%" src="./static/images/marginalization.jpg">
</div>
</div>

</section>


Expand Down

0 comments on commit 65f21fe

Please sign in to comment.