Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Llava model bringup #1173

Merged
merged 1 commit into from
Feb 8, 2025
Merged

Conversation

ashokkumarkannan1
Copy link
Contributor

@ashokkumarkannan1 ashokkumarkannan1 commented Feb 4, 2025

Ticket

Fix #1177

What's changed

Add Model tests for Llava Model

Logs

test_llava.log

Current Issue

E           NotImplementedError: The following operators are not implemented: ['aten::masked_scatter']

And this will be solved in this PR - #1188

Copy link

github-actions bot commented Feb 4, 2025

TestsPassedSkippedFailed ❌️
TT-Forge-FE Tests1 ran0 passed0 skipped1 failed
TestResult
TT-Forge-FE Tests
pytest
test_llava.forge.test.models.pytorch.multimodal.llava.test_llava❌ failure

3 similar comments
Copy link

github-actions bot commented Feb 4, 2025

TestsPassedSkippedFailed ❌️
TT-Forge-FE Tests1 ran0 passed0 skipped1 failed
TestResult
TT-Forge-FE Tests
pytest
test_llava.forge.test.models.pytorch.multimodal.llava.test_llava❌ failure

Copy link

github-actions bot commented Feb 4, 2025

TestsPassedSkippedFailed ❌️
TT-Forge-FE Tests1 ran0 passed0 skipped1 failed
TestResult
TT-Forge-FE Tests
pytest
test_llava.forge.test.models.pytorch.multimodal.llava.test_llava❌ failure

Copy link

github-actions bot commented Feb 4, 2025

TestsPassedSkippedFailed ❌️
TT-Forge-FE Tests1 ran0 passed0 skipped1 failed
TestResult
TT-Forge-FE Tests
pytest
test_llava.forge.test.models.pytorch.multimodal.llava.test_llava❌ failure

@ashokkumarkannan1 ashokkumarkannan1 force-pushed the akannan/llava_model_bringup branch from f698620 to 2ce6727 Compare February 5, 2025 08:38
Copy link

github-actions bot commented Feb 5, 2025

TestsPassedSkippedFailed ❌️
TT-Forge-FE Tests1 ran0 passed0 skipped1 failed
TestResult
TT-Forge-FE Tests
pytest
test_llava.forge.test.models.pytorch.multimodal.llava.test_llava❌ failure

3 similar comments
Copy link

github-actions bot commented Feb 5, 2025

TestsPassedSkippedFailed ❌️
TT-Forge-FE Tests1 ran0 passed0 skipped1 failed
TestResult
TT-Forge-FE Tests
pytest
test_llava.forge.test.models.pytorch.multimodal.llava.test_llava❌ failure

Copy link

github-actions bot commented Feb 5, 2025

TestsPassedSkippedFailed ❌️
TT-Forge-FE Tests1 ran0 passed0 skipped1 failed
TestResult
TT-Forge-FE Tests
pytest
test_llava.forge.test.models.pytorch.multimodal.llava.test_llava❌ failure

Copy link

github-actions bot commented Feb 5, 2025

TestsPassedSkippedFailed ❌️
TT-Forge-FE Tests1 ran0 passed0 skipped1 failed
TestResult
TT-Forge-FE Tests
pytest
test_llava.forge.test.models.pytorch.multimodal.llava.test_llava❌ failure

@ashokkumarkannan1 ashokkumarkannan1 force-pushed the akannan/llava_model_bringup branch from ca89f31 to b32df62 Compare February 6, 2025 09:16
@ashokkumarkannan1 ashokkumarkannan1 changed the title llava model bringup Add Llava model bringup Feb 6, 2025
@ashokkumarkannan1 ashokkumarkannan1 marked this pull request as ready for review February 6, 2025 09:19
@ashokkumarkannan1 ashokkumarkannan1 self-assigned this Feb 6, 2025
Copy link

github-actions bot commented Feb 6, 2025

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests590 ran465 passed125 skipped0 failed
TestResult
No test annotations available

Copy link

github-actions bot commented Feb 6, 2025

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests648 ran508 passed140 skipped0 failed
TestResult
No test annotations available

Copy link

github-actions bot commented Feb 6, 2025

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests648 ran508 passed140 skipped0 failed
TestResult
No test annotations available

return bool(re.match(regex, url))


def load_model(variant):
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we keep model loading and Wrapper as part of the test?

Just to be able to see right from the test if we're doing some customizations on the model.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure,. Updated Now.

@ashokkumarkannan1 ashokkumarkannan1 force-pushed the akannan/llava_model_bringup branch from b32df62 to caf9657 Compare February 7, 2025 14:00
Copy link

github-actions bot commented Feb 7, 2025

TestsPassedSkippedFailed ❌️
TT-Forge-FE Tests1 ran0 passed0 skipped1 failed
TestResult
TT-Forge-FE Tests
pytest
test_llava.forge.test.models.pytorch.multimodal.llava.test_llava❌ failure

3 similar comments
Copy link

github-actions bot commented Feb 7, 2025

TestsPassedSkippedFailed ❌️
TT-Forge-FE Tests1 ran0 passed0 skipped1 failed
TestResult
TT-Forge-FE Tests
pytest
test_llava.forge.test.models.pytorch.multimodal.llava.test_llava❌ failure

Copy link

github-actions bot commented Feb 7, 2025

TestsPassedSkippedFailed ❌️
TT-Forge-FE Tests1 ran0 passed0 skipped1 failed
TestResult
TT-Forge-FE Tests
pytest
test_llava.forge.test.models.pytorch.multimodal.llava.test_llava❌ failure

Copy link

github-actions bot commented Feb 7, 2025

TestsPassedSkippedFailed ❌️
TT-Forge-FE Tests1 ran0 passed0 skipped1 failed
TestResult
TT-Forge-FE Tests
pytest
test_llava.forge.test.models.pytorch.multimodal.llava.test_llava❌ failure

@nvukobratTT
Copy link
Contributor

@ashokkumarkannan1 seems like your CI is failing due to imports. Can you check it?

@ashokkumarkannan1 ashokkumarkannan1 force-pushed the akannan/llava_model_bringup branch from caf9657 to 49e939e Compare February 8, 2025 06:19
Copy link

github-actions bot commented Feb 8, 2025

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests590 ran465 passed125 skipped0 failed
TestResult
No test annotations available

1 similar comment
Copy link

github-actions bot commented Feb 8, 2025

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests590 ran465 passed125 skipped0 failed
TestResult
No test annotations available

Copy link

github-actions bot commented Feb 8, 2025

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests648 ran508 passed140 skipped0 failed
TestResult
No test annotations available

1 similar comment
Copy link

github-actions bot commented Feb 8, 2025

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests648 ran508 passed140 skipped0 failed
TestResult
No test annotations available

@ashokkumarkannan1
Copy link
Contributor Author

@ashokkumarkannan1 seems like your CI is failing due to imports. Can you check it?

Fixed now. @nvukobratTT

@ashokkumarkannan1 ashokkumarkannan1 merged commit b0a7d77 into main Feb 8, 2025
10 checks passed
@ashokkumarkannan1 ashokkumarkannan1 deleted the akannan/llava_model_bringup branch February 8, 2025 07:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Model Bringup: Llava
3 participants