OpenCL w/POCL; Vulkan backends?

[Oichkatzelesfrettschen]

In lots of pain, not sure how to express these thoughts other than... old board style it seems.

be me, an open-source enthusiast
diving into Mozilla-Ocho/llamafile repo
goal: make LLMs accessible to devs, aspiring devs, students, and users alike
stumble upon POCL 6.0+ and its cool features
POCL is all about OpenCL everywhere, for everyone
coarse-grain SVM for that sweet, sweet shared memory action
remote backend for offloading tasks to other network nodes
Vulkan API enters the chat
cross-platform graphics and compute API
Vulkan SC for safety-critical systems, based on Vulkan 1.2
thinking about version compatibility
targeting lower versions for broader hardware support
thinking about low it could go for compatibility
community benchmarking with Phoronix Test Suite
everyone's invited to the benchmarking party
all this for the greater good of llamafile
llamafile for everyone on everything

Ultimately the goal is to bring AI to all. To target the latest, bleeding edge with ongoing efforts but to take a breath, pause, and look at those who are stuck with the hardware they have now.

[jart]

We've got a nice party going on here. If you're in pain, then pain is good. Without pain there's no reward. We're masters of pain. We know how to play the game. We're breathing new life and intelligence into a lot of everyday computers that would otherwise have been left behind, while encouraging a broader participation in modern artificial intelligence developments. I have high hopes for the future, but I think the journey is the destination.

[ChristianWeyer]

😁

[Oichkatzelesfrettschen]

Haha thanks, so that means there is hope for pocl?! And Vulkan!?

We've got a nice party going on here. If you're in pain, then pain is good. Without pain there's no reward. We're masters of pain. We know how to play the game. We're breathing new life and intelligence into a lot of everyday computers that would otherwise have been left behind, while encouraging a broader participation in modern artificial intelligence developments. I have high hopes for the future, but I think the journey is the destination.