AWS Batch — 10

Arash Kamangir
3 min readDec 26, 2023

--

Next, in 📜 notebooks and scripts, submit to aws batch,

@source - vanwatch/ingest-and-analyze - count=5

design @batch,

@batch help
@batch source dryrun vanwatch/ingest-and-analyze - count=5
@batch source - vanwatch/ingest-and-analyze - count=5

digest https://docs.aws.amazon.com/batch/latest/userguide/submit_job.html

[
"bash",
"-c",
"source /root/git/awesome-bash-cli/bash/abcli.sh install,minimal,aws_batch abcli_scripts source - vanwatch/ingest-and-analyze - count=5"
]

CannotStartContainerError: ResourceInitializationError: unable to create new container: mount callback failed on /tmp/containerd-mount1077447851: no users found

using https://repost.aws/questions/QUnB654b-uRwmSdvjSISkOFg/aws-batch-container-error-resourceinitializationerror-no-users-found

Essential container in task exited

https://ca-central-1.console.aws.amazon.com/cloudwatch/home?region=ca-central-1#logsV2:log-groups/log-group/%2Faws%2Fbatch%2Fjob/log-events/abcli-custom-v1%2Fdefault%2F981d8749e1f64db78af1189de5e58cf7

implement mono-color,

@docker build push
abcli docker source dryrun \
vanwatch/ingest-and-analyze - count=5
@docker source - \
vanwatch/ingest-and-analyze - count=5
@docker build run
@docker build push;
@docker source - \
vanwatch/ingest-and-analyze dryrun count=5
@init; @docker build run

lower prior.

system.sh: line 71: sudo: command not found, also 83n

initialize.sh: line 6: git: command not found, also line 5, 7.

@batch list
@batch list status=FAILED
@docker source - \
vanwatch/ingest-and-analyze dryrun count=5

Next: refactors.

--

--

No responses yet