AWS Batch — 8
3 min readOct 2, 2023
Next, dev and use abcli_scripts_show_usage
,
scripts help
abcli_scripts source - vanwatch/ingest-and-analyze.sh help
abcli_scripts source help vanwatch/ingest-and-analyze.sh
scripts help vanwatch/ingest-and-analyze
scripts source - \
vanwatch/ingest-and-analyze help
scripts source help \
vanwatch/ingest-and-analyze
scripts help vanwatch
scripts source dryrun \
vanwatch/ingest-and-analyze count=10 \
vanwatch-local-2023-10-01-round2-v2
scripts source - \
vanwatch/ingest-and-analyze count=10,dryrun \
vanwatch-local-2023-10-01-round2-v3
scripts source - \
vanwatch/ingest-and-analyze count=5 \
vanwatch-local-2023-10-01-round2-v8; open .
compose: option, default: 1,
update docker to ADD
abcli
and scripts
.
abcli docker help
abcli docker build dryrun
abcli docker build
abcli docker browse
✅
abcli docker run dryrun
abcli seed docker
abcli docker run
# Ctrl+V
abcli seed docker
cd ~/git
filename="Dockerfile"
tag="kamangir/abcli"
docker build \
--build-arg HOME=$HOME \
-t $tag \
-f notebooks-and-scripts/$filename \
.
docker push $tag:latest
cd notebooks-and-scripts
docker-compose run abcli bash
# ctrl+V
@docker build run
# Ctrl+V
Next: pass aws credentials to the docker image,
docker run \
-e AWS_ACCESS_KEY_ID=your_access_key \
-e AWS_SECRET_ACCESS_KEY=your_secret_key \
your_image_name