Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

110M TinyStories hits instruction limit for non-empty prompt #12

Open
icppWorld opened this issue Sep 28, 2023 · 0 comments
Open

110M TinyStories hits instruction limit for non-empty prompt #12

icppWorld opened this issue Sep 28, 2023 · 0 comments
Assignees
Labels
unknown Don't know yet if it is a bug, an enhancement or a limitation

Comments

@icppWorld
Copy link
Owner

For the 110M TinyStories canister, this works fine:

dfx canister call --network ic  "obk3p-xiaaa-aaaag-ab2oa-cai" new_chat '()'
dfx canister call --network ic  "obk3p-xiaaa-aaaag-ab2oa-cai" inference '(record {prompt = "" : text; steps = 10 : nat64; temperature = 0.0 : float32; topp = 0.9 : float32; rng_seed = 0 : nat64;})'

But this fails:

dfx canister call --network ic  "obk3p-xiaaa-aaaag-ab2oa-cai" new_chat '()'
dfx canister call --network ic  "obk3p-xiaaa-aaaag-ab2oa-cai" inference '(record {prompt = "Bobby" : text; steps = 10 : nat64; temperature = 0.0 : float32; topp = 0.9 : float32; rng_seed = 0 : nat64;})'

Error: Failed update call.
Caused by: Failed update call.
  The replica returned a replica error: Replica Error: reject code CanisterError, reject message Canister obk3p-xiaaa-aaaag-ab2oa-cai exceeded the instruction limit for single message execution., error code None
@icppWorld icppWorld self-assigned this Sep 28, 2023
@icppWorld icppWorld added the unknown Don't know yet if it is a bug, an enhancement or a limitation label Sep 28, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
unknown Don't know yet if it is a bug, an enhancement or a limitation
Projects
None yet
Development

No branches or pull requests

1 participant