User avatar
🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca
1y
Also, while doing my monthly "look at the things to make sure the servers stay healthy", I realized my media cache had grown to like 500 gigs. I aggressively cut the max file size and max days to cache remote media, because it's full of a bunch of giant mp4 videos from someone. That should fix it. Though I wish I could kick off a MediaCleanupTask now, instead of waiting for midnight. Oh well. We aren't going to run out of space in the next 24 hours or anything.
2
1
2
0
User avatar
🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca
1y
Oh, I can! I always forget about swagger and the API.
curl -X 'POST' \
'fed.interfree.ca/api/iceshrimp/admin/drive/prune-expired-media' \
-H 'accept: /' \
-H 'Authorization: Bearer redacted' \
-d ''
And then it dies because I just asked it to delete hundreds of gigs of files and the poor queue is stuffed. But, like, it's doing the thing. Even if it can't return a result.
1
0
1
0
User avatar
🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca
1y
Because I know how much you all care about this ongoing situation: My media cache is now down to a much more reasonable 38 gigs. The entire world might be on fire, but at least you're now aware that a random Canadian guy you don't know fixed a problem that doesn't affect you on his single-person instance running software you don't use! Let the rejoicing commence.
1
0
3
0
User avatar
James H @quanin@allovertheplace.ca
1y
@fastfinge Is now a bad time to tell you that my multi-person instance on a software a lot of people use has a media cache of 90 GB? And I'm only aware of slightly more instances than you are.
1
0
1
0
User avatar
🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca
1y
@quanin But did you have the max file size to cache set to 1 gb? And a cache time of 30 days? I cut that way down rofl.
2
0
0
0
User avatar
James H @quanin@allovertheplace.ca
1y
@fastfinge I don't appear to have the ability to set a max file size. But I do have a weekly maintenance script that cuts out any file that's older than 30 days.
1
0
0
0
User avatar
🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca
1y
@quanin Ah, I think Mastodon's default is 30 megs or something. github.com/mastodon/mastodon/issues/20490
1
0
0
0
User avatar
James H @quanin@allovertheplace.ca
1y
@fastfinge Probably. I knew it was something reasonable anyway.
1
0
0
0
User avatar
🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca
1y
@quanin But that's not reasonable! Your users need to distribute 24-bit lossless 9600 flac files of cat noises. And you should pay for it! Honestly this is why I don't open my instance. I want to have unreasonable defaults so I can do the thing I want to do, and just cut back when I get overloaded.
1
0
0
0
User avatar
James H @quanin@allovertheplace.ca
1y
@fastfinge Oh, see, the 24-byt lossless cat noises still get distributed. They just don't get cached until absolutely needed. If no one clicks on your 4 GB cat video, then my instance doesn't need to serve your 4 GB cat video.
1
0
0
0
User avatar
🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca
1y
@quanin Right, but your users can't upload them. How can I get my 4 GB cat videos from your users? You're violating my constitutional rights!
1
0
0
0
User avatar
James H @quanin@allovertheplace.ca
1y
@fastfinge Dropbox. :P
1
0
0
0
User avatar
🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca
1y
@quanin Oh, dropbox! What a good idea! Why bother setting up S3 or anything complicated like that when I can just use dropbox? Wait...was that not what you meant?
2
0
0
0
User avatar
🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca
1y
@quanin Seriously though I'm just waiting for the IPFS toolchain to mature a bit. Then I'll set up IPFS across the servers, store everything on IPFS, and serve via IPFS to people that support it, and run a restricted gateway for those who don't. That way I get deduplication and replication for free, and adding pinning services is easy if I want to be more globally distributed.
1
0
0
0
User avatar
James H @quanin@allovertheplace.ca
1y
@fastfinge Looking at the code it looks like the max upload limits are set by filetype. Images are 10 MB, for example.
2
0
0
0
User avatar
🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca
1y
@quanin Whereas Iceshrimp will just let me upload WMA, or flac, or shortin', or wav, or musepack, or whatever. Can't deal with it? That's your problem, buddy.
1
0
0
0
User avatar
James H @quanin@allovertheplace.ca
1y
@fastfinge Right. But does Iceshrimp let you play it through a web interface? Mastodon does. So it needs to be browser compatible. Most browsers aren't playing WMA files. And probably if the person who wants to play it is on a mac they're not playing WMA files.
1
0
0
0
User avatar
🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca
1y
@quanin Yup, it does. If your browser can handle it, it works fine. If not, you get a download link. Advantage of that approach is that I sometimes upload media that isn't media at all. Text files, code, whatever. Everyone but Mastodon handles that gracefully.
1
0
0
0
User avatar
James H @quanin@allovertheplace.ca
1y
@fastfinge Yeah, because that's not media and probably shouldn't be uploaded as media. Because the second someone tries to use that in an app, it goes splork. You're using a nonstandard platform and then complaining that the standard exists.
1
0
0
0
User avatar
🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca
1y
@quanin The app should just offer a download. The standard, in this instance, is too opinionated. Filetype detection is a solved problem.
1
0
0
0
User avatar
James H @quanin@allovertheplace.ca
1y
@fastfinge Filetype detection on the internet is a serverside issue and has been for years. The problem is not the lack of filetype detection. The problem is most platforms have decided to allow media, but not documents, and the apps (Mona, Feditext, whatever) expect media. Filetype detection in this instance goes as far as "Not media? No upload.". And that's all the platform needs to do, which is all the apps expect it to do.
0
0
0
0