How to pre-load localattention extension?

[SibylGao]

Hi, thanks for sharing your awesome work! But I found that 'localattention' is loaded while importing ops, which makes it quite slow to run the model. So is there any way to preload this module, like, load it in setup.py files?

[dikubab]

I also face the same problem, I tried to apply #8. It is not working for me. Can you help on how to generate 'localattention' ?

[SibylGao]

I also face the same problem, I tried to apply #8. It is not working for me. Can you help on how to generate 'localattention' ?

Hi, actually it works well but a little bit slow for me. Could you give more details about your issue?

[dikubab]

localattention.so: cannot open shared object file: No such file or directory

[dikubab]

[dikubab]

@SibylGao can you provide me solution about how you handeled it.