Skip to content

Commit

Permalink
Update the latest model asset ids for evaluationresults of mistral mo…
Browse files Browse the repository at this point in the history
…dels (#3582)

* updating model evaluation environment with modelling_llama patch.

* reverting the changes for transformers patch.

* update latest model asset ids for mistralai models.

---------

Co-authored-by: Chandra Sekhar Gupta Aravapalli <[email protected]>
Co-authored-by: vizhur <[email protected]>
  • Loading branch information
3 people authored Nov 8, 2024
1 parent 702cec7 commit 392f40e
Show file tree
Hide file tree
Showing 113 changed files with 487 additions and 487 deletions.
Original file line number Diff line number Diff line change
@@ -1,18 +1,18 @@
type: evaluationresult
name: boolq_mistral-community-mixtral-8x22b-v0-1_question_answering
version: 2.04.11
version: 2.08.11
display_name: boolq_mistral-community-Mixtral-8x22B-v0-1_question_answering
description: mistral-community-Mixtral-8x22B-v0-1 run for boolq dataset
dataset_family: boolq
dataset_name: boolq

model_name: mistral-community-Mixtral-8x22B-v0-1
model_version: "1"
model_asset_id: azureml://registries/azureml/models/mistral-community-Mixtral-8x22B-v0-1/versions/1
model_version: "5"
model_asset_id: azureml://registries/azureml/models/mistral-community-Mixtral-8x22B-v0-1/versions/5

relationships:
- relationshipType: Source
assetId: azureml://registries/azureml/models/mistral-community-Mixtral-8x22B-v0-1/versions/1
assetId: azureml://registries/azureml/models/mistral-community-Mixtral-8x22B-v0-1/versions/5

tags:
evaluation_type: text_generation
Expand Down
Original file line number Diff line number Diff line change
@@ -1,18 +1,18 @@
type: evaluationresult
name: boolq_mistral_7b_instruct_v01_question_answering
version: 2.04.11
version: 2.08.11
display_name: boolq_mistral_7b_instruct_v01_question_answering
description: mistralai-mistral-7b-instruct-v01 run for boolq dataset
dataset_family: boolq
dataset_name: boolq

model_name: mistralai-mistral-7b-instruct-v01
model_version: "1"
model_asset_id: azureml://registries/azureml/models/mistralai-Mistral-7B-Instruct-v01/versions/1
model_name: mistralai-Mistral-7B-Instruct-v01
model_version: "10"
model_asset_id: azureml://registries/azureml/models/mistralai-Mistral-7B-Instruct-v01/versions/10

relationships:
- relationshipType: Source
assetId: azureml://registries/azureml/models/mistralai-Mistral-7B-Instruct-v01/versions/1
assetId: azureml://registries/azureml/models/mistralai-Mistral-7B-Instruct-v01/versions/10

tags:
evaluation_type: text_generation
Expand Down
Original file line number Diff line number Diff line change
@@ -1,18 +1,18 @@
type: evaluationresult
name: boolq_mistral_7b_v01_question_answering
version: 2.04.11
version: 2.08.11
display_name: boolq_mistral_7b_v01_question_answering
description: mistralai-mistral-7b-v01 run for boolq dataset
dataset_family: boolq
dataset_name: boolq

model_name: mistralai-mistral-7b-v01
model_version: "3"
model_asset_id: azureml://registries/azureml/models/mistralai-Mistral-7B-v01/versions/3
model_name: mistralai-Mistral-7B-v01
model_version: "17"
model_asset_id: azureml://registries/azureml/models/mistralai-Mistral-7B-v01/versions/17

relationships:
- relationshipType: Source
assetId: azureml://registries/azureml/models/mistralai-Mistral-7B-v01/versions/3
assetId: azureml://registries/azureml/models/mistralai-Mistral-7B-v01/versions/17

tags:
evaluation_type: text_generation
Expand Down
Original file line number Diff line number Diff line change
@@ -1,18 +1,18 @@
type: evaluationresult
name: boolq_mistralai-mistral-7b-instruct-v0-2_question_answering
version: 2.04.11
version: 2.08.11
display_name: boolq_mistralai-Mistral-7B-Instruct-v0-2_question_answering
description: mistralai-Mistral-7B-Instruct-v0-2 run for boolq dataset
dataset_family: boolq
dataset_name: boolq

model_name: mistralai-Mistral-7B-Instruct-v0-2
model_version: "1"
model_asset_id: azureml://registries/azureml/models/mistralai-Mistral-7B-Instruct-v0-2/versions/1
model_version: "5"
model_asset_id: azureml://registries/azureml/models/mistralai-Mistral-7B-Instruct-v0-2/versions/5

relationships:
- relationshipType: Source
assetId: azureml://registries/azureml/models/mistralai-Mistral-7B-Instruct-v0-2/versions/1
assetId: azureml://registries/azureml/models/mistralai-Mistral-7B-Instruct-v0-2/versions/5

tags:
evaluation_type: text_generation
Expand Down
Original file line number Diff line number Diff line change
@@ -1,18 +1,18 @@
type: evaluationresult
name: boolq_mistralai-mixtral-8x22b-instruct-v0-1_question_answering
version: 2.04.11
version: 2.08.11
display_name: boolq_mistralai-Mixtral-8x22B-Instruct-v0-1_question_answering
description: mistralai-Mixtral-8x22B-Instruct-v0-1 run for boolq dataset
dataset_family: boolq
dataset_name: boolq

model_name: mistralai-Mixtral-8x22B-Instruct-v0-1
model_version: "1"
model_asset_id: azureml://registries/azureml/models/mistralai-Mixtral-8x22B-Instruct-v0-1/versions/1
model_version: "4"
model_asset_id: azureml://registries/azureml/models/mistralai-Mixtral-8x22B-Instruct-v0-1/versions/4

relationships:
- relationshipType: Source
assetId: azureml://registries/azureml/models/mistralai-Mixtral-8x22B-Instruct-v0-1/versions/1
assetId: azureml://registries/azureml/models/mistralai-Mixtral-8x22B-Instruct-v0-1/versions/4

tags:
evaluation_type: text_generation
Expand Down
Original file line number Diff line number Diff line change
@@ -1,18 +1,18 @@
type: evaluationresult
name: boolq_mistralai-mixtral-8x22b-v0-1_question_answering
version: 2.04.11
version: 2.08.11
display_name: boolq_mistralai-Mixtral-8x22B-v0-1_question_answering
description: mistralai-Mixtral-8x22B-v0-1 run for boolq dataset
dataset_family: boolq
dataset_name: boolq

model_name: mistralai-Mixtral-8x22B-v0-1
model_version: "1"
model_asset_id: azureml://registries/azureml/models/mistralai-Mixtral-8x22B-v0-1/versions/1
model_version: "4"
model_asset_id: azureml://registries/azureml/models/mistralai-Mixtral-8x22B-v0-1/versions/4

relationships:
- relationshipType: Source
assetId: azureml://registries/azureml/models/mistralai-Mixtral-8x22B-v0-1/versions/1
assetId: azureml://registries/azureml/models/mistralai-Mixtral-8x22B-v0-1/versions/4

tags:
evaluation_type: text_generation
Expand Down
Original file line number Diff line number Diff line change
@@ -1,18 +1,18 @@
type: evaluationresult
name: boolq_mistralai-mixtral-8x7b-instruct-v01_question_answering
version: 2.04.11
version: 2.08.11
display_name: boolq_mistralai-Mixtral-8x7B-Instruct-v01_question_answering
description: mistralai-Mixtral-8x7B-Instruct-v01 run for boolq dataset
dataset_family: boolq
dataset_name: boolq

model_name: mistralai-Mixtral-8x7B-Instruct-v01
model_version: "2"
model_asset_id: azureml://registries/azureml/models/mistralai-Mixtral-8x7B-Instruct-v01/versions/2
model_version: "9"
model_asset_id: azureml://registries/azureml/models/mistralai-Mixtral-8x7B-Instruct-v01/versions/9

relationships:
- relationshipType: Source
assetId: azureml://registries/azureml/models/mistralai-Mixtral-8x7B-Instruct-v01/versions/2
assetId: azureml://registries/azureml/models/mistralai-Mixtral-8x7B-Instruct-v01/versions/9

tags:
evaluation_type: text_generation
Expand Down
Original file line number Diff line number Diff line change
@@ -1,18 +1,18 @@
type: evaluationresult
name: boolq_mistralai-mixtral-8x7b-v01_question_answering
version: 2.04.11
version: 2.08.11
display_name: boolq_mistralai-Mixtral-8x7B-v01_question_answering
description: mistralai-Mixtral-8x7B-v01 run for boolq dataset
dataset_family: boolq
dataset_name: boolq

model_name: mistralai-Mixtral-8x7B-v01
model_version: "4"
model_asset_id: azureml://registries/azureml/models/mistralai-Mixtral-8x7B-v01/versions/4
model_version: "14"
model_asset_id: azureml://registries/azureml/models/mistralai-Mixtral-8x7B-v01/versions/14

relationships:
- relationshipType: Source
assetId: azureml://registries/azureml/models/mistralai-Mixtral-8x7B-v01/versions/4
assetId: azureml://registries/azureml/models/mistralai-Mixtral-8x7B-v01/versions/14

tags:
evaluation_type: text_generation
Expand Down
Original file line number Diff line number Diff line change
@@ -1,18 +1,18 @@
type: evaluationresult
name: gsm8k_mistral-community-mixtral-8x22b-v0-1_question_answering
version: 2.04.11
version: 2.08.11
display_name: gsm8k_mistral-community-Mixtral-8x22B-v0-1_question_answering
description: mistral-community-Mixtral-8x22B-v0-1 run for gsm8k dataset
dataset_family: gsm8k
dataset_name: gsm8k

model_name: mistral-community-Mixtral-8x22B-v0-1
model_version: "1"
model_asset_id: azureml://registries/azureml/models/mistral-community-Mixtral-8x22B-v0-1/versions/1
model_version: "5"
model_asset_id: azureml://registries/azureml/models/mistral-community-Mixtral-8x22B-v0-1/versions/5

relationships:
- relationshipType: Source
assetId: azureml://registries/azureml/models/mistral-community-Mixtral-8x22B-v0-1/versions/1
assetId: azureml://registries/azureml/models/mistral-community-Mixtral-8x22B-v0-1/versions/5

tags:
evaluation_type: text_generation
Expand Down
Original file line number Diff line number Diff line change
@@ -1,18 +1,18 @@
type: evaluationresult
name: gsm8k_mistral_7b_instruct_v01_question_answering
version: 2.04.11
version: 2.08.11
display_name: gsm8k_mistral_7b_instruct_v01_question_answering
description: mistralai-mistral-7b-instruct-v01 run for gsm8k dataset
dataset_family: gsm8k
dataset_name: gsm8k

model_name: mistralai-mistral-7b-instruct-v01
model_version: "1"
model_asset_id: azureml://registries/azureml/models/mistralai-Mistral-7B-Instruct-v01/versions/1
model_name: mistralai-Mistral-7B-Instruct-v01
model_version: "10"
model_asset_id: azureml://registries/azureml/models/mistralai-Mistral-7B-Instruct-v01/versions/10

relationships:
- relationshipType: Source
assetId: azureml://registries/azureml/models/mistralai-Mistral-7B-Instruct-v01/versions/1
assetId: azureml://registries/azureml/models/mistralai-Mistral-7B-Instruct-v01/versions/10

tags:
evaluation_type: text_generation
Expand Down
Original file line number Diff line number Diff line change
@@ -1,18 +1,18 @@
type: evaluationresult
name: gsm8k_mistral_7b_v01_question_answering
version: 2.04.11
version: 2.08.11
display_name: gsm8k_mistral_7b_v01_question_answering
description: mistralai-mistral-7b-v01 run for gsm8k dataset
dataset_family: gsm8k
dataset_name: gsm8k

model_name: mistralai-mistral-7b-v01
model_version: "1"
model_asset_id: azureml://registries/azureml/models/mistralai-Mistral-7B-v01/versions/1
model_name: mistralai-Mistral-7B-v01
model_version: "17"
model_asset_id: azureml://registries/azureml/models/mistralai-Mistral-7B-v01/versions/17

relationships:
- relationshipType: Source
assetId: azureml://registries/azureml/models/mistralai-Mistral-7B-v01/versions/1
assetId: azureml://registries/azureml/models/mistralai-Mistral-7B-v01/versions/17

tags:
evaluation_type: text_generation
Expand Down
Original file line number Diff line number Diff line change
@@ -1,18 +1,18 @@
type: evaluationresult
name: gsm8k_mistralai-mistral-7b-instruct-v0-2_question_answering
version: 2.04.11
version: 2.08.11
display_name: gsm8k_mistralai-Mistral-7B-Instruct-v0-2_question_answering
description: mistralai-Mistral-7B-Instruct-v0-2 run for gsm8k dataset
dataset_family: gsm8k
dataset_name: gsm8k

model_name: mistralai-Mistral-7B-Instruct-v0-2
model_version: "1"
model_asset_id: azureml://registries/azureml/models/mistralai-Mistral-7B-Instruct-v0-2/versions/1
model_version: "5"
model_asset_id: azureml://registries/azureml/models/mistralai-Mistral-7B-Instruct-v0-2/versions/5

relationships:
- relationshipType: Source
assetId: azureml://registries/azureml/models/mistralai-Mistral-7B-Instruct-v0-2/versions/1
assetId: azureml://registries/azureml/models/mistralai-Mistral-7B-Instruct-v0-2/versions/5

tags:
evaluation_type: text_generation
Expand Down
Original file line number Diff line number Diff line change
@@ -1,18 +1,18 @@
type: evaluationresult
name: gsm8k_mistralai-mixtral-8x22b-instruct-v0-1_question_answering
version: 2.04.11
version: 2.08.11
display_name: gsm8k_mistralai-Mixtral-8x22B-Instruct-v0-1_question_answering
description: mistralai-Mixtral-8x22B-Instruct-v0-1 run for gsm8k dataset
dataset_family: gsm8k
dataset_name: gsm8k

model_name: mistralai-Mixtral-8x22B-Instruct-v0-1
model_version: "1"
model_asset_id: azureml://registries/azureml/models/mistralai-Mixtral-8x22B-Instruct-v0-1/versions/1
model_version: "4"
model_asset_id: azureml://registries/azureml/models/mistralai-Mixtral-8x22B-Instruct-v0-1/versions/4

relationships:
- relationshipType: Source
assetId: azureml://registries/azureml/models/mistralai-Mixtral-8x22B-Instruct-v0-1/versions/1
assetId: azureml://registries/azureml/models/mistralai-Mixtral-8x22B-Instruct-v0-1/versions/4

tags:
evaluation_type: text_generation
Expand Down
Original file line number Diff line number Diff line change
@@ -1,18 +1,18 @@
type: evaluationresult
name: gsm8k_mistralai-mixtral-8x22b-v0-1_question_answering
version: 2.04.11
version: 2.08.11
display_name: gsm8k_mistralai-Mixtral-8x22B-v0-1_question_answering
description: mistralai-Mixtral-8x22B-v0-1 run for gsm8k dataset
dataset_family: gsm8k
dataset_name: gsm8k

model_name: mistralai-Mixtral-8x22B-v0-1
model_version: "1"
model_asset_id: azureml://registries/azureml/models/mistralai-Mixtral-8x22B-v0-1/versions/1
model_version: "4"
model_asset_id: azureml://registries/azureml/models/mistralai-Mixtral-8x22B-v0-1/versions/4

relationships:
- relationshipType: Source
assetId: azureml://registries/azureml/models/mistralai-Mixtral-8x22B-v0-1/versions/1
assetId: azureml://registries/azureml/models/mistralai-Mixtral-8x22B-v0-1/versions/4

tags:
evaluation_type: text_generation
Expand Down
Original file line number Diff line number Diff line change
@@ -1,18 +1,18 @@
type: evaluationresult
name: gsm8k_mistralai-mixtral-8x7b-instruct-v01_question_answering
version: 2.04.11
version: 2.08.11
display_name: gsm8k_mistralai-Mixtral-8x7B-Instruct-v01_question_answering
description: mistralai-Mixtral-8x7B-Instruct-v01 run for gsm8k dataset
dataset_family: gsm8k
dataset_name: gsm8k

model_name: mistralai-Mixtral-8x7B-Instruct-v01
model_version: "2"
model_asset_id: azureml://registries/azureml/models/mistralai-Mixtral-8x7B-Instruct-v01/versions/2
model_version: "9"
model_asset_id: azureml://registries/azureml/models/mistralai-Mixtral-8x7B-Instruct-v01/versions/9

relationships:
- relationshipType: Source
assetId: azureml://registries/azureml/models/mistralai-Mixtral-8x7B-Instruct-v01/versions/2
assetId: azureml://registries/azureml/models/mistralai-Mixtral-8x7B-Instruct-v01/versions/9

tags:
evaluation_type: text_generation
Expand Down
Original file line number Diff line number Diff line change
@@ -1,18 +1,18 @@
type: evaluationresult
name: gsm8k_mistralai-mixtral-8x7b-v01_question_answering
version: 2.04.11
version: 2.08.11
display_name: gsm8k_mistralai-Mixtral-8x7B-v01_question_answering
description: mistralai-Mixtral-8x7B-v01 run for gsm8k dataset
dataset_family: gsm8k
dataset_name: gsm8k

model_name: mistralai-Mixtral-8x7B-v01
model_version: "4"
model_asset_id: azureml://registries/azureml/models/mistralai-Mixtral-8x7B-v01/versions/4
model_version: "14"
model_asset_id: azureml://registries/azureml/models/mistralai-Mixtral-8x7B-v01/versions/14

relationships:
- relationshipType: Source
assetId: azureml://registries/azureml/models/mistralai-Mixtral-8x7B-v01/versions/4
assetId: azureml://registries/azureml/models/mistralai-Mixtral-8x7B-v01/versions/14

tags:
evaluation_type: text_generation
Expand Down
Original file line number Diff line number Diff line change
@@ -1,18 +1,18 @@
type: evaluationresult
name: hellaswag_mistral-community-mixtral-8x22b-v0-1_question_answering
version: 2.04.11
version: 2.08.11
display_name: hellaswag_mistral-community-Mixtral-8x22B-v0-1_question_answering
description: mistral-community-Mixtral-8x22B-v0-1 run for hellaswag dataset
dataset_family: hellaswag
dataset_name: hellaswag

model_name: mistral-community-Mixtral-8x22B-v0-1
model_version: "1"
model_asset_id: azureml://registries/azureml/models/mistral-community-Mixtral-8x22B-v0-1/versions/1
model_version: "5"
model_asset_id: azureml://registries/azureml/models/mistral-community-Mixtral-8x22B-v0-1/versions/5

relationships:
- relationshipType: Source
assetId: azureml://registries/azureml/models/mistral-community-Mixtral-8x22B-v0-1/versions/1
assetId: azureml://registries/azureml/models/mistral-community-Mixtral-8x22B-v0-1/versions/5

tags:
evaluation_type: text_generation
Expand Down
Loading

0 comments on commit 392f40e

Please sign in to comment.