roofAI — 19: train on AIRS on SageMaker — 4

Next, in roofAI, training on SageMaker,

change icon ▶️ 🏛️

kamangir publish

document training a model on sagemaker ▶️ https://github.com/kamangir/roofAI/tree/main/roofAI/semseg#set-up

animated gif doesn’t show up in https://github.com/kamangir/roofAI/edit/main/roofAI/semseg/README.md#predict, fix. ✅

at the gallery.

using https://github.com/kamangir/roofAI/tree/main/roofAI/semseg#set-up

roof conda help

@seed sagemaker

run “bash” before pasting the seed.

#! /bin/bash
echo "abcli-7.2427.1.2023-06-aws-batch-a seed for sagemaker"

cd git/awesome-bash-cli
pip3 install -e .

source ./bash/abcli.sh

fix -d error.

roof conda create_env validate

using https://github.com/kamangir/roofAI/tree/main/roofAI/semseg#train

roofAI semseg train \
    profile=DEBUG \
    $(@ref roofAI_ingest_AIRS_v1) \
    $(@timestamp) \
    --classes roof

train-summary.png: iou: xlim <-> ylim.

train-summary.png: both subplots += legend.

run a DEBUG train and validate ⏫.

roofAI semseg train \
    profile=DEBUG,upload \
    $(@ref roofAI_ingest_AIRS_v1) \
    $(@timestamp) \
    --classes roof

@select 2023-10-29-11-17-56-43659; @download object . train-summary.png; open .

FULL train and register,

using https://github.com/kamangir/roofAI/blob/main/roofAI/semseg/README.md#train

roofAI semseg train \
    profile=FULL,register,suffix=full_v2 \
    $(@ref roofAI_ingest_AIRS_v1) \
    $(@timestamp) \
    --classes roof

deleted the conda env accidentally, killed, will restart. ⏬

validate predict in a notebook on SageMaker, need to select an environment,

using https://github.com/kamangir/roofAI/blob/main/roofAI/semseg/README.md#set-up

updated https://github.com/kamangir/roofAI/tree/main/notebooks

pip installs 🛑 change of plan — will run the notebook on Mac.

roofAI semseg predict \
    profile=VALIDATION \
    $(@ref roofAI_semseg_model_AIRS_full_v1) \
    $(@ref roofAI_ingest_AIRS_v1) \
    $(@timestamp)

log model id on the prediction, log record_id,

validate on SageMaker.

roofAI semseg predict \
    profile=VALIDATION,upload \
    $(@ref roofAI_semseg_model_AIRS_full_v1) \
    $(@ref roofAI_ingest_AIRS_v1) \
    $(@timestamp)

@select 2023-10-29-12-59-01-62429; @download object . predict-00000.png; open .

roofAI semseg train \
    profile=FULL,register,suffix=full_v2 \
    $(@ref roofAI_ingest_AIRS_v1) \
    $(@timestamp) \
    --classes roof

Next: $(@ref roofAI_semseg_model_AIRS_full_v2) is training + contour simplification + serving the model on SageMaker.