quietlight/Skraak - Change 27HKDBYTNASZMCIKAVZ4TMPZD35PAC7LMMIEHKY6MHJMZZ4AFUPAC

changet train api to take a list of images instead of glob pattern

Created by quietlight on March 7, 2024

27HKDBYTNASZMCIKAVZ4TMPZD35PAC7LMMIEHKY6MHJMZZ4AFUPAC

Dependencies

In channels

main

Change contents

Replacement in src/Train.jl at line 15 [3.335620]
B:BD[3.335928] → [3.335928:335964]
```
    glob_pattern::String="*/*.png",
```
[3.335928]
[3.335964]
```
    images::Vector{String},
```

Replacement in src/Train.jl at line 27 [3.335620]

B:BD[3.336185] → [3.336185:336198]

B:BD[3.336198] → [2.6:80]

using Skraak
glob_pattern = "kiwi_set*/*/[N,K]/*.png" #11699814-element Vector{String}

[3.336185]

[2.80]

using Skraak, Glob
images = glob("kiwi_set*/*/[N,K]/*.png") #11699814-element Vector{String}

Replacement in src/Train.jl at line 30 [3.335620]

B:BD[2.182] → [2.182:259]

train("K1-10_total_set_no_augumentation", 2, glob_pattern, model, 0.97, 64)

[2.182]

[2.259]

train("K1-10_total_set_no_augumentation", 2, images, model, 0.97, 64)

Replacement in src/Train.jl at line 32 [3.335620]

∅:D[2.260] → [4.6:188]

B:BD[3.336198] → [4.6:188]

∅:D[5.61] → [6.0:1]

∅:D[7.81] → [6.0:1]

∅:D[8.174] → [6.0:1]

∅:D[9.187] → [6.0:1]

∅:D[4.188] → [6.0:1]

B:BD[3.336312] → [6.0:1]

B:BD[6.1] → [8.175:427]

∅:D[8.427] → [10.225:278]

B:BD[10.225] → [10.225:278]

glob_pattern = "original_set*/*/[N,K]/*.png" #from SSD2/PrimaryDataset 7758648 hard coded a random selection of not, 1:1
train("K1-9_original_set", 20, glob_pattern, true, 0.90, 64)
glob_pattern = "kiwi_set_2023-11-13/*/[N,K]/*.png" #from SSD2/PrimaryDataset 
model = "/media/david/SSD2/PrimaryDataset/media/david/SSD2/PrimaryDataset/model_K1-6_CPU_epoch-3-0.9798-2024-02-01.jld2"
train("K1-6_ft1", 10, glob_pattern, model, 0.95, 64)
glob_pattern = "*/[D,F,M,N]/*.png" #from SSD2/Clips

[2.260]

[10.278]

images = glob("*/[D,F,M,N]/*.png") #from SSD2/Clips

Replacement in src/Train.jl at line 34 [3.335620]
B:BD[10.367] → [10.367:409]
```
train("DFMN1-5", 20, glob_pattern, model)
```
[10.367]
[3.336642]
```
train("DFMN1-5", 20, images, model)
```

Replacement in src/Train.jl at line 43 [3.335620]

B:BD[3.336787] → [2.261:323]

    glob_pattern::String = "*/*.png", #images::Vector{String}

[3.336787]

[3.336825]

    images::Vector{String} #glob_pattern::String = "*/*.png"

Replacement in src/Train.jl at line 49 [3.335620]

B:BD[3.336948] → [4.189:251]

    images = glob(glob_pattern) #|> shuffle! |> x -> x[1:640]

[3.336948]

[3.337010]

    #images = glob(glob_pattern) #|> shuffle! |> x -> x[1:640]

Replacement in src/Train.jl at line 163 [3.335620]

B:BD[3.340292] → [2.324:418]

        #x -> Noise.add_gauss(x, (rand() * 0.2)) |>
        #x -> apply_mask!(x, 3, 3, 12) |>

[3.340292]

[3.340384]

        x -> Noise.add_gauss(x, (rand() * 0.2)) |>
        x -> apply_mask!(x, 3, 3, 12) |>

Replacement in src/Train.jl at line 323 [3.335620]

B:BD[11.1071] → [11.1071:1162]

        test_confusion_matrix[1,1] > a && begin
            a = test_confusion_matrix[1,1]

[11.1071]

[3.345118]

        #test_confusion_matrix[1,1] > a && begin
            #a = test_confusion_matrix[1,1]

Replacement in src/Train.jl at line 332 [3.335620]
B:BD[3.345399] → [3.345399:345411]
```
        end
```
[3.345399]
[3.345411]
```
        #end
```