Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add test for deepseek_coder #1309

Merged
merged 1 commit into from
Feb 28, 2025
Merged

Conversation

meenakshiramanathan1
Copy link
Contributor

@meenakshiramanathan1 meenakshiramanathan1 commented Feb 24, 2025

Model is currently failing in verify with pcc drop of 0.32

Copy link

TestsPassed ☑️Skipped ⚠️Failed ❌️
TT-Forge-FE Tests604 ran477 passed126 skipped1 failed
TestResult
TT-Forge-FE Tests
pytest
test_dla.test_dla_pytorch[dla34]❌ failure

Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests604 ran478 passed126 skipped0 failed
TestResult
No test annotations available

Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests662 ran525 passed137 skipped0 failed
TestResult
No test annotations available

1 similar comment
Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests662 ran525 passed137 skipped0 failed
TestResult
No test annotations available

@meenakshiramanathan1 meenakshiramanathan1 force-pushed the mramanathan/deepseek_coder branch 5 times, most recently from a18ac4e to f7ccdd2 Compare February 25, 2025 05:22
Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests662 ran525 passed137 skipped0 failed
TestResult
No test annotations available

Copy link

TestsPassed ☑️Skipped ⚠️Failed ❌️
TT-Forge-FE Tests604 ran477 passed126 skipped1 failed
TestResult
TT-Forge-FE Tests
pytest
test_dla.test_dla_pytorch[dla34]❌ failure

Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests662 ran525 passed137 skipped0 failed
TestResult
No test annotations available

Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests604 ran478 passed126 skipped0 failed
TestResult
No test annotations available

Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests604 ran478 passed126 skipped0 failed
TestResult
No test annotations available

Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests662 ran525 passed137 skipped0 failed
TestResult
No test annotations available

Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests604 ran478 passed126 skipped0 failed
TestResult
No test annotations available

Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests662 ran525 passed137 skipped0 failed
TestResult
No test annotations available

Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests662 ran525 passed137 skipped0 failed
TestResult
No test annotations available

Copy link

TestsPassed ☑️Skipped ⚠️Failed ❌️
TT-Forge-FE Tests604 ran477 passed126 skipped1 failed
TestResult
TT-Forge-FE Tests
pytest
test_dla.test_dla_pytorch[dla34]❌ failure

Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests662 ran525 passed137 skipped0 failed
TestResult
No test annotations available

Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests604 ran478 passed126 skipped0 failed
TestResult
No test annotations available

Copy link

TestsPassedSkippedFailed ❌️
TT-Forge-FE Tests1 ran0 passed0 skipped1 failed
TestResult
TT-Forge-FE Tests
pytest
test_deepseek_coder.forge.test.models.pytorch.multimodal.deepseek_coder.test_deepseek_coder❌ failure

1 similar comment
Copy link

TestsPassedSkippedFailed ❌️
TT-Forge-FE Tests1 ran0 passed0 skipped1 failed
TestResult
TT-Forge-FE Tests
pytest
test_deepseek_coder.forge.test.models.pytorch.multimodal.deepseek_coder.test_deepseek_coder❌ failure

Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests675 ran542 passed133 skipped0 failed
TestResult
No test annotations available

Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests617 ran482 passed135 skipped0 failed
TestResult
No test annotations available

@meenakshiramanathan1 meenakshiramanathan1 force-pushed the mramanathan/deepseek_coder branch 2 times, most recently from a55f004 to 13567fa Compare February 27, 2025 15:56
Copy link

TestsPassedSkippedFailed ❌️
TT-Forge-FE Tests2 ran0 passed0 skipped2 failed
TestResult
TT-Forge-FE Tests
pytest
test_deepseek_math.forge.test.models.pytorch.multimodal.deepseek_math.test_deepseek_math❌ failure
test_deepseek_math_prefill.forge.test.models.pytorch.multimodal.deepseek_math.test_deepseek_math_prefill❌ failure

3 similar comments
Copy link

TestsPassedSkippedFailed ❌️
TT-Forge-FE Tests2 ran0 passed0 skipped2 failed
TestResult
TT-Forge-FE Tests
pytest
test_deepseek_math.forge.test.models.pytorch.multimodal.deepseek_math.test_deepseek_math❌ failure
test_deepseek_math_prefill.forge.test.models.pytorch.multimodal.deepseek_math.test_deepseek_math_prefill❌ failure

Copy link

TestsPassedSkippedFailed ❌️
TT-Forge-FE Tests2 ran0 passed0 skipped2 failed
TestResult
TT-Forge-FE Tests
pytest
test_deepseek_math.forge.test.models.pytorch.multimodal.deepseek_math.test_deepseek_math❌ failure
test_deepseek_math_prefill.forge.test.models.pytorch.multimodal.deepseek_math.test_deepseek_math_prefill❌ failure

Copy link

TestsPassedSkippedFailed ❌️
TT-Forge-FE Tests2 ran0 passed0 skipped2 failed
TestResult
TT-Forge-FE Tests
pytest
test_deepseek_math.forge.test.models.pytorch.multimodal.deepseek_math.test_deepseek_math❌ failure
test_deepseek_math_prefill.forge.test.models.pytorch.multimodal.deepseek_math.test_deepseek_math_prefill❌ failure

Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests617 ran482 passed135 skipped0 failed
TestResult
No test annotations available

Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests675 ran542 passed133 skipped0 failed
TestResult
No test annotations available

1 similar comment
Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests675 ran542 passed133 skipped0 failed
TestResult
No test annotations available

Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests617 ran482 passed135 skipped0 failed
TestResult
No test annotations available

@meenakshiramanathan1 meenakshiramanathan1 force-pushed the mramanathan/deepseek_coder branch 4 times, most recently from 4a4c492 to b1e2744 Compare February 28, 2025 06:04
Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests675 ran542 passed133 skipped0 failed
TestResult
No test annotations available

Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests617 ran482 passed135 skipped0 failed
TestResult
No test annotations available

Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests675 ran542 passed133 skipped0 failed
TestResult
No test annotations available

Copy link

TestsPassed ✅Skipped ⚠️Failed
TT-Forge-FE Tests617 ran482 passed135 skipped0 failed
TestResult
No test annotations available

@meenakshiramanathan1 meenakshiramanathan1 merged commit a9a9376 into main Feb 28, 2025
10 checks passed
@meenakshiramanathan1 meenakshiramanathan1 deleted the mramanathan/deepseek_coder branch February 28, 2025 07:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants