Hi all, I have to disable all video uploads and links for the rest of the month, my data-out was all-time record, 1.7TB /$100 just for today, not sure whatβs up..
Login to reply
Replies (92)
π²π²π²
Wow
π±
π
Is this something that can be handled on AWS? Are their prices higher?
Hmmm π€
View quoted note β
Are prices higher or are people uploading way more? Whatβs the problem here?
Wait i misread that. Your data out is whatβs costing. Hmm π€
Ordinalsβ¦. Its definitely Ordinals! I just know it!
I would love running a personal instance so I can host my own stuff.
π―
γγγπ
View quoted note β
is theres a way or a hack for people to just make a twitter account and upload videos there but can automatically post the video url from nostr?
Do you have a cap on max upload size? Perhaps someone is uploading entire films or something...
Solid π
Shit. Do you have any analytics to get an idea of where it's coming from?
Also β remember to ask for more money. We have to make #nostr sustainable.
Thank you for the donation π
I donβt know exactly, but the more I monitor over time, the more I just think it is normal, growing traffic, and how my infrastructure is currently.. there is no βsingle sourceβ, itβs coming from everywhere! A lot of traffic from
Florida last few days!!
you're welcome!
interesting, I don't know of anything going on in FL recently... π
I have no idea about the infra of serving files but I'll bet seeing what specific files (without destroying privacy) are driving traffic is a solved problem to some degree.
prevent le spam
Oh, fuck yeah. 100% this.
π€£ has to be!
ππ€
I do, but likely the video which isnβt compressed or optimized is getting viewed a lot.
You can do it now, you would just have to copy and paste your link.
Eventually the apps should let you add your own image server.
Iβm certainπ€£
I feel like it's got to be something intentional because nostr use overall has been dipping a bit...
i think this can be easy be done⦠setup your own imgproxy or picsur server. in #snort i think you can add already your own imgproxy server.
it would be great if the apps allow to add the own server to host pictures.
GitHub
GitHub - CaramelFur/Picsur: An easy to use, selfhostable image sharing service like Imgur with built in converting
An easy to use, selfhostable image sharing service like Imgur with built in converting - CaramelFur/Picsur
GitHub
GitHub - imgproxy/imgproxy: Fast and secure standalone server for resizing, processing, and converting images on the fly
Fast and secure standalone server for resizing, processing, and converting images on the fly - imgproxy/imgproxy
My bad π
AWS has cheap hosting, but I think it generally goes against nostr culture to do so. Someone's gotta get paid to host data, but maybe relays like nostr.build could act like the central node for mining pools, where nostr.build farms data hosting out to a keet.io channel that's supported by a number of at-home NASs. Nostr.build could monitize the service they provide by requiring a payment for uploading pictures, and then stream sats to split among the host participants based on who has the data available when its requested. I'm a bit of a keet.io shill, but I think it could help split the load if people are going to be sharing lots of data here.
Maybe Bitcoin Conf footage?
We'll support you!
I could easily give nostr 10tB on my NAS with unlimited data cap, but I'd feel a lot better about running that through keet and pooling with a few others for simplicity and not breaking peoples experience if I have a power outage.
ππ€£
May I ask how you've been financing this up until now?
Good question π§
Well for oneβ¦. I bought a premium account on Nostr.Build
Honestly it's totally fine for nostr.build to focus just on image hosting, for now at least. Video hosting can get super space/bandwidth intensive very quickly, so it's best to keep that for when the revenue model has consistent inflow!
If Imgur and YouTube need ads and premium subscriptions to be able to afford video uploads, it's totally understandable that nostr.build would need enough flow from things like that before it can handle video.
Keep up the good work my friend!
For instance, you can make video uploads a premium-only feature
Crazy how much you have to pay every month now
Did you implemented some sort of throttling, above all using the single assets as filter? I suspect that native clients are not yet so good in caching, they can fetch the same data over and over.
Oh I didn't even know this was possible yetπ―
I think that if a user paid for the Nostr.build, their ability to upload videos should not be taken away, do you agree?
I almost see this as a DDOS attack and is what bitcoin should be able to solve. To protect services and data with the power of the POW network.
How can we help fix this?
Might as well just add the imgur upload API to clients at that pt!
We will get the prices down. Fishcake and I are working on a whole new infrastructure that will help..
Let see how it goes, I love hosting free video, but it is expensiveβ¦
click per view splits canβt come soon enough
Does imgur even support video?
i dunno im thinkin like when you put a twitter link post it spits out the url of the video like this
Twitter Video Downloader - Download twitter videos & GIF Online
Twitter video downloader is an online tool to download Twitter videos & GIFs which are embedded in tweets. Save any video from Twitter. It
Is it all traffic from Nostr clients/users, or is there even a way to tell that? I could see free media hosting being appealing to a lot of people for a lot of reasons.
Yeah, a few ways! Accounts and donations mostly.
AWS gave me $1000 grant a few months ago, but only ~$300 left, this month is ~$600, received $150 in Zaps, sold $100 of accounts, I may pay $50-$200 a month depending. I donβt care paying a few $100 out of pocket, I just canβt wake up with $1000 monthly bill π
** we are working on a whole new architecture backend which will be much more cost effective and plan to deploy next weekend. It will fix a lot of things and will absolutely bring prices down.
Itβs mostly nostr because Iβve pushed most clients to the api and website traffic is way down, but there is still a lot of website traffic, but that could be nostr also..
A really cool strategy once we get accounts integrated with the clients, is to push people to the accounts and just offer bare minimum for free, but not there yet.
This man needs to be zapped for all his great work in #Nostr π§‘β‘
View quoted note β
Yea account integration with clients will be good for sure ππ€
Itβs top on my list, itβs a win for everyone.
We have two new account features coming with the new infrastructure,
- killer new acct dashboard
- api for βcreators page buttonβ (will add a βgifβ button of curated content to apps. 1st step into acct/app integration..)
Then we can move to Podcast Storage and RSS Monthly Subscriptions π€ͺπ
OMG all the Zaps rock! Thank you all!! This will literally pay a huge chunk of the bill, incredible, blown away this is even possible.. πππ€π«
Yeah I guess I need to figure out how to do this one
Great work π«
I see all the data-out and traffic as a βgood problemβ
π«‘ Respect, with the increasing demand for video and pictures, this can be quite a burden.
Nostr is growing... We're going to need to start to diversify our media upload options such as using nostrimg.com, void.cat, nostrfiles.dev, and good ole imgur.com.
View quoted note β
wow
Why not your own Dropbox or mega or google drive?
β‘οΈ
Thank you for all that you do for #nostr
I donβt know anything about mega, but Google Drive and Dropbox make it inconvenient, if not impossible, to get a direct link to your media. The share links they provide display the media in their own viewer instead of linking directly to the file.
you can, but you'll go through your bandwidth allotment if you have a couple large files and have a lot of followers or popular notes.
the data smell of victory!
View quoted note β
True but there are third party extensions that make that easier
I'd second video being premium only whenever you're ready to do it!
zap the media uploaders!!!
Do you see a lot of imagebots in the logs perhaps? Might want to grep logs for user agents. Can block nicely with robots.txt and if bad crawlers with AWS Firewall or WAF. Could be someone trying to mirror content by scraping so look for IPs and rate limit then. Can use against logs if do not already have something.
GoAccess - Visual Web Log Analyzer
Micro-zap payments per upload? Show minimum Sats for image or video with option to add more Sats when upload.
Added the robots.txt earlier this month, yeah, trying to limit all scraping , increased compression an reduced video upload max.
New load balancing arch will likely solve these problems.
Goaccess.io looks perfect. Just point that to my web logs?
Yes, can install and run from command line. Or will generate HTML, json, or csv reports. Is very powerful with a lot of features. If logs big can tar up logs and download to run locally.
This is perfect, AWS analytics are crap..
Any chance there is a real-time public view I can share with all?
Yep, just look at the goaccess demo shows realtime example.
Great resource, thank you! New feature coming soon!! :)
oh wow damn, shucksss. hope you figure it out
So I have essentially a toddler level of understanding how all this shit works, but to echo someone else in the comments, I don't have any problem whatsoever in paying x amount sats to upload an image or video especially if it's already integrated into the process....
#grownostr
View quoted note β
Fishcake is fixing it. Load balancing servers with image proxy shrinking and caching from s3. Itβs going to be beautiful and fixes a lot of other problems also.. So many cool things coming to nostr.build!!
You all are fucking crazy ππππ
π€¬
Probably me sorry.
Yes indeed thank you for what you have done for the community here, and good to hear you'll be able to decrease costs. Do you have plans to implement a revenue model? Subscibtion proportional to storage used? Or a %of a zap-splits? Are you gathering data on what users would prefer?
Holy smoke.
I agree with others. Value for value, a lightning payment to upload a video would be a great feature.
Select file, pay lightning payment, file uploads and link is generated. I would pay for that.
I would not pay a subscription though
What the f? Why do you think this is suddenly happening?
This is a genesis note for me to join the @nostr.build to work on scaling and efficiency problems. Those were simple times π€£π€―
(Felt nostalgic today)
View quoted note β