enhance vit model

[ahatamiz]

Signed-off-by: ahatamizadeh [email protected]

PR Removes the activation function in ViT classification head.

Description

For some unknown reason, there is an activation function in the classification head of the ViT model. This PR removes it as the architecture should be agnostic to the choice of final activation function.

Status

Ready

Types of changes

• Non-breaking change (fix or new feature that would not break existing functionality).
• Breaking change (fix or new feature that would cause existing functionality to change).
• New tests added to cover the changes.
• Integration tests passed locally by running ./runtests.sh -f -u --net --coverage.
• Quick tests passed locally by running ./runtests.sh --quick --unittests --disttests.
• In-line docstrings updated.
• Documentation updated, tested make html command in the docs/ folder.

[ahatamiz]

Noticed a similar PR is also submitted. Closing this PR as the issue would be addressed.