Excellent and thorough report! Thank you so much! Having been on calls that long only a few times in my career... you have my respect. (I hope you ordered pizza!)
As someone who has had the misfortune of dealing with 3 Storage outages over the past 4 years (2 of which last year). I feel with everyone who was involved in the recovery process.
Thank you all for your great work and the awesome write-up!
Writing post-mortems is a pain, but well worth it, when you can learn from your mistakes.
Sharing it with the community is awesome, as it brings great transparency and lets us all understand what happened and what was done to prevent it from happening again.
Again, thank you all for your work!
Well, at least you have given us the clear truth and are allowing us to at least continue viewing what's already there. That is what truly counts.
We understand you are trying your darndest. Good luck. 🤞
I hope the problem will be resolved this week. I don't want to wait so long for the site to work.... Thanks for the detailed report. I hope you're doing well there ❤️
This bullshit is beyond getting old. I'm going on 20 years living with FA. I just want to scratch my furry fandom itch once or twice a day. What is the goddamned problem?
not exactly; the journal doesn’t explain how tech debt got so bad they had this issue in the first place. their tech stack has been proven shoddy many times over at this point, and the funds raised go toward flashy kit instead of anything useful
I mean... the current downtime is specifically part of their efforts to mitigate that tech debt. I don't see how a detailed tearful mea culpa of how we got here is going to somehow fix 15+ years of tech debt overnight either, but it doesn't seem like anything less is going to satisfy some folks.
You can see our recent update via the announcement journal explaining in detail what the issue is. You can still scratch your itch as much as you like! Though if it becomes chronic you may want to speak to a doctor! Enjoy 🥳
You can actually see what others are up to right now! The sight has been brought back online. The only thing still needing work done is uploading which is well on it's way to getting resolved.
Surprising they're using that family and one big flat filesystem here, but..I bailed on IT years ago 'cause I got sick of it. Somebody Else's Problem now.
As Diamond would say, read-only FA's better than no FA at all. Hope you tech furs can get the problems fully ironed out soon~! I'd help you, but all I can offer are my tits~
Every partition got this massive list that tells you a lot about the files on it.
That list accidentally broke when they made the partition bigger. To solve that they made a new one and are moving everything to it. This takes ages...
I said it on the initial "the website is down and we can't find the issue" post.
"You know the issue is particularly bad when furry IT people can't find the issue" now it's "the issue is particularly fucked when furry STEM people have to take a week to fix it."
I think the problem is more number of files. While transferring large files is slow...it's actually slower when there's many many small files. I'd move my movie folder over my image folder any day.
Good news, I'm glad I have access to the site at least! Is it possible to send notes now, and will they reach my customers? FA is my only way to contact them
File Read-Only Mode only affects stored Files. So images, banners, profile pics and the likes.
Everything else like Notes, Journals and Favs are fully functional. They prioritized this so that we could continue communication and business in the mean-time.
Comments
https://x.com/GucciFeline/status/1445137685023059974
Anyway, I hope things get better from now on.
Thank you all for your great work and the awesome write-up!
Sharing it with the community is awesome, as it brings great transparency and lets us all understand what happened and what was done to prevent it from happening again.
Again, thank you all for your work!
We understand you are trying your darndest. Good luck. 🤞
Absolute props for that. Rare in this world~
Hopefully the migration progress goes smoothly
You can see our recent update via the announcement journal explaining in detail what the issue is. You can still scratch your itch as much as you like! Though if it becomes chronic you may want to speak to a doctor! Enjoy 🥳
Furaffinity: "We fucked up big time 2 seconds ago. We're on it."
Nothing good needs a 15 hour call…
Hope you can sort it!
Every partition got this massive list that tells you a lot about the files on it.
That list accidentally broke when they made the partition bigger. To solve that they made a new one and are moving everything to it. This takes ages...
"You know the issue is particularly bad when furry IT people can't find the issue" now it's "the issue is particularly fucked when furry STEM people have to take a week to fix it."
Unsure if that includes the backups or it's just the live storage
Everything else like Notes, Journals and Favs are fully functional. They prioritized this so that we could continue communication and business in the mean-time.
*Hucks a big bag of coffee at y'all*
(Joking aside, thanks for keeping us in the loop on things)
*tosses a monitor*