👷 Automatically dispatch tasks to hf.js

[coyotte508]

This will send a dispatch even to hf.js, where we need to create a matching action to receive the event with repository_dispatch: https://docs.github.com/en/actions/using-workflows/events-that-trigger-workflows#repository_dispatch

This will allow us to automate updating https://github.com/huggingface/huggingface.js/blob/main/packages/tasks/src/library-to-tasks.ts (with an action that will open a PR to this file)

cc @pcuenca @mishig25 @osanseviero @julien-c

cc @Wauplin in case you might want that too for some reason

Migration

Set a REPO_DISPATCH_TOKEN secret, a PAT that has read/write & metadata on huggingface/huggingface.js

[Wauplin]

Thanks for the ping @coyotte508. We don't have a LIBRARY_TASK_MAPPING_EXCLUDING_TRANSFORMERS equivalent in Python but good to know 👍

[xianbaoqian]

This dispatch thing looks really cool! I haven't used this feature but the code seems reasonable.

[pcuenca]

Nice! How is this payload received and interpreted in the remote repo, is that already in place?

[coyotte508]

now that the PR is approved as soon as #355 (comment) is handled will work on it

we need to create a github workflow with repository_dispatch on hf.js

[coyotte508]

@glegendre01 now that the PR is approved can you handle that please 🙏 ?

Set a REPO_DISPATCH_TOKEN secret, a PAT that has read/write & metadata on huggingface/huggingface.js

(don't have admin access on the repo and we probably want a token from machineuser)

[julien-c]

@osanseviero are we sure this is needed?

I feel like with the Inference revamp will we even still have this repo?

[glegendre01]

@coyotte508, secret created. can you test it ?

[osanseviero]

@julien-c fair point; let's pause this PR as a bunch of this might be unneeded in a couple of weeks and this is mostly to update a .ts file that does not change very often (just when a new task is added in this API)

[coyotte508]

ok for the record @glegendre01 the token works (reran job with ✔️)

[glegendre01]

ok, keep me informed if we need to clean up the token finally