I wanted to find out if using #IPFS as a storage backend would give file deduplication "for free", but unfortunately it looks like ImageMagick operations on the same input file are not deterministic, so you still end up with different hashes when the same file is uploaded more than once. #mastodev

Of course it sounds nice in theory if your server didn't need to download a remote file and would simply save a given hash to then just put it into a IPFS gateway URL, however I believe in practice that's not sufficient. No guarantee that the software that creates a post uses the same thumbnail dimensions that Mastodon needs, so the file still needs to be downloaded to the server, converted, then re-uploaded to IPFS, and if that process is non-deterministic, it's not worth it...


@Gargron Even if thumbnails are not deduplicated, original files are

@val Only if they are smaller than the threshold where they are downsized.

Sign in to participate in the conversation

oc.todon.fr is an actively-moderated mostly French-speaking Mastodon instance. oc.todon.fr est une instance Mastodon principalement francophone et avec une modération active.