CodeMirror/czkawka
1
0
Fork 0
mirror of synced 2024-05-01 02:54:05 +12:00
Code Issues Projects Releases Wiki Activity
426 commits 5 branches 36 tags 16 MiB
Commit graph

186 commits

Author SHA1 Message Date
Rafał Mikrut ce8161fd7e Release 3.0.0 2021-03-11 21:41:33 +01:00
Douman 67a07f1f98
Use xxhash-rust >=0.8.2 to avoid bug in stateful implementation (#283) 2021-03-08 07:47:17 +01:00
Rafał Mikrut 0bbe9fe4a3 Revert "Disable for now broken tga and gif files (#270)" 
This reverts commit 87f5ca63
 2021-03-06 13:36:00 +01:00
Rafał Mikrut 17f97bd958
Add option to turn off cache (#263) 2021-03-04 12:09:53 +01:00
Thomas Andreas Jung 1d904a858e
Dryrun for duplicates (#277) 
```
    czkawka_cli dup --dryrun -d $(pwd)/folder -m1 -D aen
    Found 2 duplicated files in 1 groups with same content which took 2 B:
    Size - 2 B (2) - 2 files
    /home/thomas/Development/czkawka/folder/a
    /home/thomas/Development/czkawka/folder/b
    ----

    -------------------------------MESSAGES--------------------------------
    Delete /home/thomas/Development/czkawka/folder/a
    Delete /home/thomas/Development/czkawka/folder/b
    ---------------------------END OF MESSAGES-----------------------------
    ```
 2021-03-01 12:23:43 +01:00
Thomas Andreas Jung ed7b197100
Use one implementation for all duplicate file removales (#278) 2021-02-27 09:00:59 +01:00
Rafał Mikrut 13add1cbed
Add hardlinking support for GUI (#276) 2021-02-24 13:53:46 +01:00
Rafał Mikrut 4c770b582b
Add option to not ignore hard links (#273) 2021-02-22 20:14:33 +01:00
Rafał Mikrut 7ea0126525 Release 2.4.0 2021-02-22 12:24:05 +01:00
Rafał Mikrut 87f5ca63b9
Disable for now broken tga and gif files (#270) 2021-02-22 11:17:32 +01:00
Thomas Andreas Jung e3457edab2
Use one implementation for all hash calculations (#268) 
All implementations are the same they only differ by hasher and the file read
limit.
 2021-02-22 10:52:21 +01:00
Thomas Andreas Jung 1e94587de8
Ignore duplicates if those are hard links (#234) 
This is a proof of concept.

```
$ echo a > hardlinks/a
$ cp hardlinks/{a,b}
$ ln hardlinks/{a,c}
$ cargo run --bin czkawka_cli dup -m 1 --directories $(pwd)/hardlinks -f /dev/stderr > /dev/null
-------------------------------------------------Files with same hashes-------------------------------------------------
Found 1 duplicated files which in 1 groups which takes 2 B.

---- Size 2 B (2) - 2 files
/home/thomas/Development/czkawka/hardlinks/a
/home/thomas/Development/czkawka/hardlinks/b
```

Open:
- Windows support
- Probably this should be a cli option
 2021-02-20 12:28:06 +01:00
Thomas Andreas Jung 03d41e173f
Keep original file if replacing duplicate with hardlink fails (#253) 
If the user could not create a hard link (due to permissions or
different block devices) then czkawka lost the duplicate file.

```
$ mkdir hardlink
$ cd hardlink
$ echo a > a
$ cp a b
$ chown thetestuser:thetestuser a
$ ls -il .

25169246 -rw-rw-r-- 1 thetestuser thetestuser 2 Feb  7 11:18 a
25169641 -rw-rw-r-- 1 thomas      thomas      2 Feb  7 11:18 b

$ cargo run --bin czkawka_cli dup --directories $(pwd) -m 1 -f
test101.result --delete-method HARD

[...]
-------------------------------WARNINGS--------------------------------
Failed to link /home/thomas/Development/czkawka/hardlink/b ->
/home/thomas/Development/czkawka/hardlink/a
---------------------------END OF WARNINGS-----------------------------

$ ls -il .
25169246 -rw-rw-r-- 1 thetestuser thetestuser 2 Feb  7 11:18 a
```

Now czkawka keeps all files and the warning provides more information
why czkawka can't replace the duplicate with a hard link.

```
$ cargo run --bin czkawka_cli dup --directories $(pwd) -m 1 -f
test101.result --delete-method HARD

-------------------------------WARNINGS--------------------------------
Failed to link /home/thomas/Development/czkawka/hardlink/b ->
/home/thomas/Development/czkawka/hardlink/a (Operation not permitted (os
error 1))
---------------------------END OF WARNINGS-----------------------------
[...]

25169246 -rw-rw-r-- 1 thetestuser thetestuser 2 Feb  7 11:18 a
25169641 -rw-rw-r-- 1 thomas      thomas      2 Feb  7 11:18 b
```
 2021-02-11 19:04:23 +01:00
Rafał Mikrut 10156ccfd3 Uncomment code about saving similar images result to file 2021-02-09 17:29:49 +01:00
Rafał Mikrut df44f9c342
Update list of checked images (#252) 2021-02-06 14:24:15 +01:00
Rafał Mikrut 9bb574235a
Add checking for broken music opt-in (#249) 2021-02-05 19:07:20 +01:00
Thomas Andreas Jung 3ffa55b008
Add delete method to replace duplicate files with hard links (#236) 
This results in the same space saving but keeps the "deleted" files around.

$ mkdir hardlink
$ cd hardlink
$ echo a > a
$ cp a b
$ ln a c
$ touch -t 01010000 a
$ ls -il --time-style=full-iso .
25169323 -rw-rw-r-- 2 thomas thomas 2 2021-01-01 00:00:00.000000000 +0100 a
25169558 -rw-rw-r-- 1 thomas thomas 2 2021-01-31 18:11:08.298161098 +0100 b
25169323 -rw-rw-r-- 2 thomas thomas 2 2021-01-01 00:00:00.000000000 +0100 c

$ czkawka_cli dup --directories $(pwd)/hardlink -m 1 -f hardlink.result --delete-method HARD

$ ls --time-style=full-iso -li hardlink
25169323 -rw-rw-r-- 3 thomas thomas 2 2021-01-01 00:00:00.000000000 +0100 a
25169323 -rw-rw-r-- 3 thomas thomas 2 2021-01-01 00:00:00.000000000 +0100 b
25169323 -rw-rw-r-- 3 thomas thomas 2 2021-01-01 00:00:00.000000000 +0100 c
 2021-02-05 17:59:34 +01:00
Rafał Mikrut 9f3da0e70f
Add support for CRC32 and XXH3 hash (#243) 2021-02-03 19:59:06 +01:00
Rafał Mikrut 7d8334bb0c
Add template for multiple hashes (#240) 2021-02-03 18:11:04 +01:00
Rafał Mikrut b8049efe62
Remove checking for ico in similar images (#227) 2021-01-25 11:32:10 +01:00
Rafał Mikrut 49ddc041ee
Add about dialog (#226) 2021-01-24 12:01:02 +01:00
Rafał Mikrut bb7bf12354 Release 2.3.2 2021-01-21 20:52:43 +01:00
Rafał Mikrut 69090755df Release 2.3.1 2021-01-20 15:41:44 +01:00
Rafał Mikrut 943f8f78f1 Release 2.3.0 2021-01-15 16:49:13 +01:00
Rafał Mikrut e1beaeed28
Decrease ram usage (#212) 2021-01-15 12:41:45 +01:00
Rafał Mikrut cc8d42e0ff
Add support for finding broken zip and audio files (#210) 2021-01-15 11:04:52 +01:00
Rafał Mikrut 7ec665ab7a
Add cache for duplicate (#205) 2021-01-14 12:17:15 +01:00
Rafał Mikrut 6e89bcb507
Add cache for broken files (#204) 2021-01-13 16:03:05 +01:00
Rafał Mikrut eeaaea20cc
Add broken files support (#202) 2021-01-12 20:06:12 +01:00
Rafał Mikrut 1a011644bf
Remove save workaround and fix crashes (#200) 2021-01-12 13:48:34 +01:00
Rafał Mikrut da4bdd19e2 Release 2.2.0 2021-01-11 12:26:03 +01:00
Rafał Mikrut 80bbc9ba85
Move image cache to cache from config dir (#197) 2021-01-11 09:54:23 +01:00
Rafał Mikrut 7992ba30de
Fix included/excluded files which contains commas (#195) 2021-01-10 20:44:10 +01:00
Rafał Mikrut 9975605f75
Add buffered write/read (#186) 2021-01-09 11:52:43 +01:00
Rafał Mikrut 3adbfdc5b6
Remove some debug variables (#185) 2021-01-07 23:20:51 +01:00
Rafał Mikrut 8d4a264c6d
Use master gtk plugin again (#179) 
* Use master gtk plugin again
 2021-01-03 16:54:07 +01:00
Rafał Mikrut 72d74dd8e2
Adds Mac GUI (#160) 
* Adds Mac GUI

* Update Rust to 1.4.9
 2020-12-31 19:53:49 +01:00
Rafał Mikrut 4eefe114dd Release 2.1.0 2020-12-31 10:29:36 +01:00
Rafał Mikrut 083db7aa51
Add manual adding of directories (#165) 2020-12-30 13:41:18 +01:00
Rafał Mikrut 10c32c90c0
Add support for delete button (#159) 2020-12-29 19:31:09 +01:00
Rafał Mikrut 33545dfa22
Fix using empty hash (#140) 2020-12-27 14:42:26 +01:00
Rafał Mikrut 3f333e7ceb
Add cache support for similar images (#139) 2020-12-27 10:56:26 +01:00
Rafał Mikrut 123bba381f Release 2.0.0 2020-12-23 23:12:50 +01:00
Rafał Mikrut 05c8153b1a Add more default excluded items 2020-12-23 22:17:04 +01:00
Rafał Mikrut 880787a67f
Show errors in image previewer when failed to generate it (#130) 2020-12-23 21:16:40 +01:00
Rafał Mikrut 5672431257
Add minimal similarity level (#129) 2020-12-23 20:10:10 +01:00
Rafał Mikrut 4e3a6f63fe
Add new windows dark theme (#125) 2020-12-21 18:22:59 +01:00
Rafał Mikrut 1d59199bb2
Add support for checking for invalid symlinks (#124) 2020-12-21 16:09:39 +01:00
Rafał Mikrut 40f981dcd3
Add custom selection/unselection (#117) 2020-12-14 13:07:35 +01:00
Rafał Mikrut f0f3073f94 Release version 1.5.1 2020-12-08 17:51:18 +01:00
Rafał Mikrut e6a6e5567b Release 1.5.0 2020-12-02 12:01:30 +01:00
Rafał Mikrut 7ac4a26229
Add progress bar (#106) 2020-12-02 10:25:27 +01:00
Rafał Mikrut 4dfb960e85 Small cosmetic changes to readme and similar images 
Also added support for m4a music tags
 2020-11-22 11:03:15 +01:00
Rafał Mikrut c62617df30 Release 1.4.0 2020-11-09 15:50:28 +01:00
Rafał Mikrut 29a0716be5
Add very small similarity level to finding similar images, add option to choose level from CLI, fix bug with duplicated entries in similar pictures (#104) 2020-11-09 12:55:27 +01:00
Rafał Mikrut 88d47e49cf
Add select for all modes (#102) 2020-11-09 10:09:22 +01:00
Rafał Mikrut 3e61544ec4
Add support for multithreading to zeroed files (#101) 2020-11-08 19:01:48 +01:00
Rafał Mikrut f359905ebc
Add support for multithreading in duplicate finder (#100) 2020-11-08 16:19:40 +01:00
Rafał Mikrut 31e35576ec
Add support for multithreading to finding same music (#99) 2020-11-08 09:10:49 +01:00
Rafał Mikrut 2f72dd9d19
Add multithread support to similar image finder (#98) 2020-11-08 07:41:29 +01:00
Rafał Mikrut 110d6015bc
Similar images improvements: (#97) 
Headers without data
By default only checking for High Similarity(faster search)
 2020-11-07 16:26:40 +01:00
Rafał Mikrut 5d4f4db8c1
Simplify some GUI code (#96) 2020-11-04 18:15:06 +01:00
Rafał Mikrut 1fb66b32f0 Release version 1.3.0 2020-11-02 22:47:36 +01:00
Rafał Mikrut ecebb3a1af
Implement finding duplicated music by tags/artist/year etc. (#95) 2020-11-02 21:56:07 +01:00
Rafał Mikrut 8ba780ded6
Add missing options in some modes (#90) 2020-10-31 19:19:33 +01:00
Rafał Mikrut 777ac50f07
Add support for checking for zeroed files (#88) 2020-10-31 10:29:11 +01:00
Rafał Mikrut 7112ff6b92
Add support for checking same file names (#84) 2020-10-24 20:44:21 +02:00
Rafał Mikrut d996c3c46b
Add pre hash check (#83) 2020-10-24 06:56:39 +02:00
Rafał Mikrut 4d90e3170e
Remove warnings about non existent directories in Windows (#79) 2020-10-21 22:44:09 +02:00
Rafał Mikrut 2326072222 Release version 1.2.1 2020-10-17 12:56:05 +02:00
Rafał Mikrut beb14f9f1d
Improve similar images GUI a little and add sorting to Similarity Enum (#73) 2020-10-15 17:51:47 +02:00
Syfaro a55fe3de9a
Make image similarity search significantly faster. (#72) 2020-10-15 17:43:59 +02:00
Rafał Mikrut d2c7398bdd Release version 1.2.0 2020-10-15 10:50:42 +02:00
Rafał Mikrut 1178e145ae
Add similar images support for GUI (#69) 2020-10-15 09:04:02 +02:00
Rafał Mikrut 3dd203f246
Add support for finding similar images to CLI (#66) 2020-10-14 21:10:27 +02:00
Dariusz Niedoba acfecd7ca3
Replace String with PathBuf for paths (#59) 2020-10-14 18:41:37 +02:00
Rafał Mikrut 67a775beff Release version 1.1 2020-10-10 21:36:25 +02:00
Rafał Mikrut d015b305f2
Add Windows support (#58) 2020-10-10 15:18:04 +02:00
Rafał Mikrut 8bbb12c7d4
Add ability to stop task from GUI (#55) 2020-10-10 11:15:20 +02:00
Caduser2020 085da0369e
Improve code quality. (#52) 
* Remove verbose constructs in core.

* Use self and const fn where appropriate.

* Remove needless borrows.

* Fix name in function arguments.

* Merge 'master' into quality

* Decrease function complexity.

* Run fmt.

* Fix clippy.

* Fix duplicate extension files.

* Fix excluded items.

* Fix allowed extensions (Part 2).

* Fix temporary files.
 2020-10-09 22:32:08 +02:00
Rafał Mikrut be30afdac6
Add support for searching in other thread (#51) 2020-10-07 22:22:39 +02:00
Rafał Mikrut 1a87a69116 Fixes some typos 2020-10-07 10:34:15 +02:00
Rafał Mikrut 71353823e7 Update version to 1.0.1 2020-10-06 21:28:04 +02:00
Rafał Mikrut 3b63798751 Don't crash when found file name which is not valid Unicode 2020-10-06 17:10:34 +02:00
Rafał Mikrut 8d263fdff2 Minimal file size in duplicate finder should be always greater than 0 2020-10-03 09:51:02 +02:00
Rafał Mikrut a0c99ab14b Don't crash when modified time of file is before unix epoch 2020-10-02 17:59:46 +02:00
Stefan Seering 1829d19b28 Switch to automatic updates for the program version. 2020-10-02 15:33:51 +02:00
Rafał Mikrut 8d824036b2 Release 1.0.0 version 2020-10-02 08:58:02 +02:00
Rafał Mikrut d3652c1e86 Updated README.md 2020-10-01 21:29:40 +02:00
Rafał Mikrut d7529cb64b Added support for Big, Temporary and empty file finder in GUI 2020-10-01 19:26:25 +02:00
Rafał Mikrut 7a1a9ea9f6 Change SystemTime to u64 2020-10-01 06:53:10 +02:00
Rafał Mikrut f550b42fc2 Add support for selecting and unselecting all records in duplicate finder 2020-09-30 16:38:45 +02:00
Rafał Mikrut 4bca6a133d Add Save system 2020-09-30 14:47:39 +02:00
Rafał Mikrut fe78ca4428 Add more info about packages 2020-09-29 09:27:45 +02:00
Rafał Mikrut d34100461e Bump version to 0.1.4 dev 2020-09-27 11:17:14 +02:00
Rafał Mikrut 18020cebde Added temporary ffile finder and also printed improved help 2020-09-27 10:31:14 +02:00
Rafał Mikrut 2cf5dcd513 Added support for empty file finder 2020-09-26 21:50:16 +02:00
Rafał Mikrut 338352f384 Added checking for duplicates by checking hash of first 1MB of file 2020-09-26 20:46:35 +02:00
Rafał Mikrut 4fb2a0cc92 Smaller code refactoring 2020-09-26 19:51:28 +02:00
Rafał Mikrut 85432f1c18 Fix some typos in words and remove empty space 2020-09-26 17:16:12 +02:00