Free and Open Source Software

17926 readers

41 users here now

If it's free and open source and it's also software, it can be discussed here. Subcommunity of Technology.

This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago

MODERATORS

[email protected]

App to search Duplicates in Android (discuss.tchncs.de)

submitted 1 year ago by [email protected] to c/[email protected]

20 comments fedilink hide all child comments

Hello, i have many folders with pictures and some of them are duplicates, is there an app that can detect that?

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 4 points 1 year ago (1 children)

Here's a script from GPT4:

#!/bin/bash

# Create a temporary file for storing file checksums
tempfile=$(mktemp)

# Generate MD5 checksums for all files in the current directory and its sub-directories
find . -type f -exec md5sum '{}' \; | sort > $tempfile

# Detect and delete duplicates
awk 'BEGIN {
    lasthash = "";
    lastfile = "";
}
{
    if ($1 == lasthash) {
        print "Deleting duplicate file: " $2;
        system("rm -f \""$2"\"");
    } else {
        lasthash = $1;
        lastfile = $2;
    }
}' $tempfile

# Clean up
rm -f $tempfile

This script can be run with Termux from the root of your internal storage. Usually /sdcard or /storage/emulated/0. Do not confuse this with running from root if you are rooted.

Before using a script that interacts with your files you should backup anything that is important just in case.

Furthermore, if you comment out:

system("rm -f \""$2"\"");

By adding a # in front of it like this:

# system("rm -f \""$2"\"");

You can run the script and see what files the script would delete without actually deleting them. I would recommend doing this as I have not tested this script.

[–] [email protected] 2 points 1 year ago

Haha thats so cool, I'll try that option as well :)