GM Nostr ☀️ Some Primal services were affected by the Cloudflare outage for a few hours earlier today. Specifically, our web app, external wallet transactions, and partially our blossom media server. We are fully back up now and continue to monitor the situation. Our sincere apologies for the inconvenience. Running services which are resistant to ddos attacks is hard without relying on providers like Cloudflare unfortunately. We are working on upgrading our infrastructure so that we are more resilient in the future. As long as we learn and improve every time as a result of these incidents, we are on the right track.

Replies (40)

Thomas 's avatar
Thomas 1 month ago
I didn’t have any issues with @primal - was able to post and see new Posts. 👍🏻
It’s been awhile since I smoked the devils lettuce 🥬 so … sure 😂🤙🏴‍☠️👻🐝
casey's avatar
casey 1 month ago
I challenge you guys to stop using centralized services period, and revisit the protocol. make your app decentralized as the protocol intends. Instead of handicapping it.
Thanks for the clear postmortem. Honest, fast incident notes like this turn outages into trust builders. Resilience is infra, but also communication.
Would primal be willing to purchase services, at a higher cost, with worse guarantees, from many, much smaller companies? Specifically if some of us running small hosting businesses, with formal service contracts, willing to take some parts of your load (or possibly all of it)?
yes, we can improve things by reading from multiple sources, preferably directly from relays. but the problem of hosting web apps and media services that are resistant to ddos attacks remains. if you have constructive feedback in that area - we are open to suggestions.
casey's avatar
casey 1 month ago
You didn’t need to stop? True Nostr apps were working fine 🤷‍♂️
casey's avatar
casey 1 month ago
That’s what I’m trying to say. Go back to using relays as the spec intends And you won’t have to rely on cloud services like cloudflare crippling your product. The caching service is a real problem that keeps getting swept under the rug. I’m not a dev so I can’t fix. I’m just identify the problem. And it doesn’t need to be a problem.
casey's avatar
casey 1 month ago
What’s stopping Primal from using relays?
casey's avatar
casey 1 month ago
👏 I’m buried in proposal hell. So I’m not totally up to date on my feed. Love what you do. Wasn’t directed at you not doing work. 🫡
Benking's avatar
Benking 1 month ago
Great to hear things are back on track! Appreciate all the hard work you’re putting into making Primal stronger 💪☀️
BTC21's avatar
BTC21 1 month ago
Every failure is a reminder: decentralization isn’t a feature, it’s a path. The more we rely on giants, the more we learn why we must outgrow them.
The_Crin's avatar
The_Crin 1 month ago
Like Linux, Nostr has a long way to go before it can be considered a truly decentralized system.
FYI, new notifications are not showing up on the notifications screen since the Cloudflare outage, but the new notification dots do show up on the feed screen. Android app, latest release.
Default avatar
Tresdy 1 month ago
Pedos. You’re sick people. image
I completely agree with your position. Decentralization is key to individual sovereignty and unlocking a new level of sustainable progress, away from centralized systems. It's the way forward. 👍
hey @miljan I'm getting a cloudflare specific HTTP 524 error when trying to fetch the lnurlp endpoint for users (primal.net/.well-known/lnurlp/username) which is making it impossible to zap Primal wallet users. Can you check on it?
Sorry to bother you, perhaps related to the outage, but my built-in Primal wallet has stopped working. I was able to connect my own, but there's definitely sats trapped. I've deleted, reinstalled, uses Amber, not used Amber, etc.... but the toggle to Enable Primal Wallet" is unclickable. Latest version of app, on a Google pixel. Thanks, love the app.
And disregard, lol, struggled with it yesterday and day before and now it worked! False alarm! Thanks again!