Thread - Nostr Hypermedia

If I did everything correctly, when you open this website, you should be able to run any AI language model locally in your browser, any device. It will utilize your native hardware with new WebGPU API to run these models. This is just a demo; I am working on a proper interface for NostrNet.work users. Demo: https://ai.nostrnet.work

Replies (17)

Disturbia disturbia@BitcoinNostr.com 2 years ago

running locally mined AI on a pc as native app is resource intensive already. i think this will be even more so

iefan 🕊️ iefan@primal.net 2 years ago

Yes, it entirely runs on your hardware. On upcoming NostrNet PWA, you should even be able to turn off your internet, and it will still work. There are numerous options, including 1 billion models that can also run on your phone. Click on ""model name" on top centre, it will show you the list of all the models.

Duncan Cary Palmer duncan@sdbitcoiners.com 2 years ago

I get this: https://image.nostr.build/c49eb6968aec97ab2fbda46d8df57c5c4d4bc60eaf8da1b8eab14aab0355ae49.jpg#m=image%2Fjpeg&dim=864x1920&blurhash=%5B24.0pspS1WU%5E%2Bs%3AW%3BWB%3FHoLWoay%25MbHofaytQWVofj%5BS_WVt7j%5BbtWBs%3AofozWBs%3BkC%252aeofof&x=3b96a77c2fe2ab6132b2f8f4336eaed7eaead68cf49ca0fb3c54839cf49207fd

1 replies ↓

boston wine win@nostrplebs.com 2 years ago

Error on iOS/Safari

1 replies ↓

Disturbia disturbia@BitcoinNostr.com 2 years ago

thanks. on my mobile device it defaulted to one model. still, it lags quite a bit. haha

iefan 🕊️ iefan@primal.net 2 years ago

Safari/iOS WebKit does not support the WebGPU API yet; it works on every other device. You can try it on a PC, Android, Mac Additionally, Apple is planning to enable WebGPU for Safari, so you will have it very soon.

1 replies ↓

iefan 🕊️ iefan@primal.net 2 years ago

2 replies ↓

boston wine win@nostrplebs.com 2 years ago

Sweet! I’ll try it out on my laptop this evening 🤙

Duncan Cary Palmer duncan@sdbitcoiners.com 2 years ago

Running Graphene OS on Pixel 7a...

Marakesh 𓅦 Marakesh@coinos.io 2 years ago

I get that same message on my Android...

1 replies ↓

iefan 🕊️ iefan@primal.net 2 years ago

Chrome?

2 replies ↓

Duncan Cary Palmer duncan@sdbitcoiners.com 2 years ago

Vanadium, in my case...

npub1fam8...et3s 2 years ago

Getting stuck in Pixel 6 stock using chrome/brave at: [System Initalize] Finish loading on WebGPU - arm Any chance in future to use the tensor TPU for quicker responses?

1 replies ↓

Marakesh 𓅦 Marakesh@coinos.io 2 years ago

Kiwi Browser. But I just tried Chrome and got the same message again.

1 replies ↓

iefan 🕊️ iefan@primal.net 2 years ago

I encountered the same issue on Kiwi, but it works fine on Chrome. Have you attempted to switch models? The primary problem with this app is that the webGPU API it is using is not supported by all browsers. However, it is expected to be supported by all major browsers very soon.

1 replies ↓

iefan 🕊️ iefan@primal.net 2 years ago

I think Google is building Gemini model for it. If they make it open source, we will see multiple variants of it.

Marakesh 𓅦 Marakesh@coinos.io 2 years ago

I'm not sure what you mean by switch models? I just tried to open nostrnet.work on Chrome and got the message that I needed to install it as a Progressive Web App. So I did that and then tried to open ai.nostrnet.work from the PWA and still get that same message.