1
0
Fork 0
mirror of synced 2024-04-28 01:22:53 +12:00
Commit graph

85 commits

Author SHA1 Message Date
Rafał Mikrut cf668d02a7
Implement threaded search in rest of modes(except empty folders) (#504)
* Implement threaded search in rest of modes(except empty folders)

* Add more tools in gui to use allowed extension

* Change progress window to modal

* Nazair

* Clippy
2021-12-17 19:29:37 +01:00
Peter Blackson 859e01b30e
Parallel BFS with Rayon (#502)
* Tester

* Parallel BFS with Rayon

* Rustfmt

* Refactor code

* Use `extend` instead of `append`

* Remove no longer needed derives
2021-12-16 20:49:59 +01:00
Rafał Mikrut 975b285c1f
Make UI take less space (#500) 2021-12-13 19:13:53 +01:00
Rafał Mikrut f334bd6975
Add better custom selecting (#479) 2021-12-02 15:33:06 +01:00
Rafał Mikrut 1fd53b854b
Add prehash cache support (#477) 2021-12-01 20:09:04 +01:00
Rafał Mikrut 51271dcdf0
Remove HashMB mode (#476)
* Remove HashMB mode

* Add some explanation and remove this from GUI

* Not needing to handle everything
2021-12-01 12:37:17 +01:00
Rafał Mikrut 4871016a3c
Add option to not remove outdated cache entries (#472)
* Add option to not remove outdated cache entries

* Default duplicates cache size lowered to 512 KB

* Add some tooltips,
Add logic to opening cache/config folders

* Add option to clear cache files from outdated results(manually)
2021-11-30 12:45:09 +01:00
Rafał Mikrut cf2e822435 Reformat code with idea tool 2021-11-27 20:57:10 +01:00
Rafał Mikrut b7e4eaccaf Modified include organization 2021-11-27 20:49:20 +01:00
Rafał Mikrut d302c3b2d8 Update cache creating 2021-11-27 20:42:31 +01:00
Rafał Mikrut 29129d3ec0
Support for finding similar videos (#460)
* Add support for similar videos to CLI

* Add GUI support for similar videos

* Video duplicates

* git_dup

* Documentation
2021-11-23 11:10:24 +01:00
Rafał Mikrut 742139379c
Add better errors explanation(native from libraries) (#446) 2021-11-14 15:53:55 +01:00
Rafał Mikrut a92a113714
Add maximum file size (#407)
* Add maximum file size

* Add maximum file size
2021-08-06 23:23:11 +02:00
Rafał Mikrut da76f75e11
Update Rust to 1.54 (#400) 2021-07-30 07:16:35 +02:00
Rafał Mikrut 4fc8655272
Sort cache and allow to optimize later other code (#322) 2021-05-08 18:29:52 +02:00
Rafał Mikrut b08cedd5a6
Allow to set minimal file size to caching (#321) 2021-05-06 21:54:44 +02:00
Rafał Mikrut 775b6b4f10
Fix crashes with too small message queue (#316) 2021-04-14 08:23:59 +02:00
Rafał Mikrut 0fa6692d39
Fix error with saving results of name duplicates (#307) 2021-04-01 11:37:16 +02:00
Rafał Mikrut 50ad3f9873
Update to Rust 1.5.1 (#302) 2021-03-27 13:14:02 +01:00
Rafał Mikrut 17f97bd958
Add option to turn off cache (#263) 2021-03-04 12:09:53 +01:00
Thomas Andreas Jung 1d904a858e
Dryrun for duplicates (#277)
```
    czkawka_cli dup --dryrun -d $(pwd)/folder -m1 -D aen
    Found 2 duplicated files in 1 groups with same content which took 2 B:
    Size - 2 B (2) - 2 files
    /home/thomas/Development/czkawka/folder/a
    /home/thomas/Development/czkawka/folder/b
    ----

    -------------------------------MESSAGES--------------------------------
    Delete /home/thomas/Development/czkawka/folder/a
    Delete /home/thomas/Development/czkawka/folder/b
    ---------------------------END OF MESSAGES-----------------------------
    ```
2021-03-01 12:23:43 +01:00
Thomas Andreas Jung ed7b197100
Use one implementation for all duplicate file removales (#278) 2021-02-27 09:00:59 +01:00
Rafał Mikrut 13add1cbed
Add hardlinking support for GUI (#276) 2021-02-24 13:53:46 +01:00
Rafał Mikrut 4c770b582b
Add option to not ignore hard links (#273) 2021-02-22 20:14:33 +01:00
Thomas Andreas Jung e3457edab2
Use one implementation for all hash calculations (#268)
All implementations are the same they only differ by hasher and the file read
limit.
2021-02-22 10:52:21 +01:00
Thomas Andreas Jung 1e94587de8
Ignore duplicates if those are hard links (#234)
This is a proof of concept.

```
$ echo a > hardlinks/a
$ cp hardlinks/{a,b}
$ ln hardlinks/{a,c}
$ cargo run --bin czkawka_cli dup -m 1 --directories $(pwd)/hardlinks -f /dev/stderr > /dev/null
-------------------------------------------------Files with same hashes-------------------------------------------------
Found 1 duplicated files which in 1 groups which takes 2 B.

---- Size 2 B (2) - 2 files
/home/thomas/Development/czkawka/hardlinks/a
/home/thomas/Development/czkawka/hardlinks/b
```

Open:
- Windows support
- Probably this should be a cli option
2021-02-20 12:28:06 +01:00
Thomas Andreas Jung 03d41e173f
Keep original file if replacing duplicate with hardlink fails (#253)
If the user could not create a hard link (due to permissions or
different block devices) then czkawka lost the duplicate file.

```
$ mkdir hardlink
$ cd hardlink
$ echo a > a
$ cp a b
$ chown thetestuser:thetestuser a
$ ls -il .

25169246 -rw-rw-r-- 1 thetestuser thetestuser 2 Feb  7 11:18 a
25169641 -rw-rw-r-- 1 thomas      thomas      2 Feb  7 11:18 b

$ cargo run --bin czkawka_cli dup --directories $(pwd) -m 1 -f
test101.result --delete-method HARD

[...]
-------------------------------WARNINGS--------------------------------
Failed to link /home/thomas/Development/czkawka/hardlink/b ->
/home/thomas/Development/czkawka/hardlink/a
---------------------------END OF WARNINGS-----------------------------

$ ls -il .
25169246 -rw-rw-r-- 1 thetestuser thetestuser 2 Feb  7 11:18 a
```

Now czkawka keeps all files and the warning provides more information
why czkawka can't replace the duplicate with a hard link.

```
$ cargo run --bin czkawka_cli dup --directories $(pwd) -m 1 -f
test101.result --delete-method HARD

-------------------------------WARNINGS--------------------------------
Failed to link /home/thomas/Development/czkawka/hardlink/b ->
/home/thomas/Development/czkawka/hardlink/a (Operation not permitted (os
error 1))
---------------------------END OF WARNINGS-----------------------------
[...]

25169246 -rw-rw-r-- 1 thetestuser thetestuser 2 Feb  7 11:18 a
25169641 -rw-rw-r-- 1 thomas      thomas      2 Feb  7 11:18 b
```
2021-02-11 19:04:23 +01:00
Thomas Andreas Jung 3ffa55b008
Add delete method to replace duplicate files with hard links (#236)
This results in the same space saving but keeps the "deleted" files around.

$ mkdir hardlink
$ cd hardlink
$ echo a > a
$ cp a b
$ ln a c
$ touch -t 01010000 a
$ ls -il --time-style=full-iso .
25169323 -rw-rw-r-- 2 thomas thomas 2 2021-01-01 00:00:00.000000000 +0100 a
25169558 -rw-rw-r-- 1 thomas thomas 2 2021-01-31 18:11:08.298161098 +0100 b
25169323 -rw-rw-r-- 2 thomas thomas 2 2021-01-01 00:00:00.000000000 +0100 c

$ czkawka_cli dup --directories $(pwd)/hardlink -m 1 -f hardlink.result --delete-method HARD

$ ls --time-style=full-iso -li hardlink
25169323 -rw-rw-r-- 3 thomas thomas 2 2021-01-01 00:00:00.000000000 +0100 a
25169323 -rw-rw-r-- 3 thomas thomas 2 2021-01-01 00:00:00.000000000 +0100 b
25169323 -rw-rw-r-- 3 thomas thomas 2 2021-01-01 00:00:00.000000000 +0100 c
2021-02-05 17:59:34 +01:00
Rafał Mikrut 9f3da0e70f
Add support for CRC32 and XXH3 hash (#243) 2021-02-03 19:59:06 +01:00
Rafał Mikrut 7d8334bb0c
Add template for multiple hashes (#240) 2021-02-03 18:11:04 +01:00
Rafał Mikrut 49ddc041ee
Add about dialog (#226) 2021-01-24 12:01:02 +01:00
Rafał Mikrut e1beaeed28
Decrease ram usage (#212) 2021-01-15 12:41:45 +01:00
Rafał Mikrut 7ec665ab7a
Add cache for duplicate (#205) 2021-01-14 12:17:15 +01:00
Rafał Mikrut 7992ba30de
Fix included/excluded files which contains commas (#195) 2021-01-10 20:44:10 +01:00
Rafał Mikrut 9975605f75
Add buffered write/read (#186) 2021-01-09 11:52:43 +01:00
Rafał Mikrut 3adbfdc5b6
Remove some debug variables (#185) 2021-01-07 23:20:51 +01:00
Rafał Mikrut 7ac4a26229
Add progress bar (#106) 2020-12-02 10:25:27 +01:00
Rafał Mikrut 88d47e49cf
Add select for all modes (#102) 2020-11-09 10:09:22 +01:00
Rafał Mikrut f359905ebc
Add support for multithreading in duplicate finder (#100) 2020-11-08 16:19:40 +01:00
Rafał Mikrut 5d4f4db8c1
Simplify some GUI code (#96) 2020-11-04 18:15:06 +01:00
Rafał Mikrut 7112ff6b92
Add support for checking same file names (#84) 2020-10-24 20:44:21 +02:00
Rafał Mikrut d996c3c46b
Add pre hash check (#83) 2020-10-24 06:56:39 +02:00
Dariusz Niedoba acfecd7ca3
Replace String with PathBuf for paths (#59) 2020-10-14 18:41:37 +02:00
Rafał Mikrut d015b305f2
Add Windows support (#58) 2020-10-10 15:18:04 +02:00
Rafał Mikrut 8bbb12c7d4
Add ability to stop task from GUI (#55) 2020-10-10 11:15:20 +02:00
Caduser2020 085da0369e
Improve code quality. (#52)
* Remove verbose constructs in core.

* Use self and const fn where appropriate.

* Remove needless borrows.

* Fix name in function arguments.

* Merge 'master' into quality

* Decrease function complexity.

* Run fmt.

* Fix clippy.

* Fix duplicate extension files.

* Fix excluded items.

* Fix allowed extensions (Part 2).

* Fix temporary files.
2020-10-09 22:32:08 +02:00
Rafał Mikrut be30afdac6
Add support for searching in other thread (#51) 2020-10-07 22:22:39 +02:00
Rafał Mikrut 1a87a69116 Fixes some typos 2020-10-07 10:34:15 +02:00
Rafał Mikrut 3b63798751 Don't crash when found file name which is not valid Unicode 2020-10-06 17:10:34 +02:00
Rafał Mikrut 8d263fdff2 Minimal file size in duplicate finder should be always greater than 0 2020-10-03 09:51:02 +02:00