Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Return Code: 1, CMD #5

Open
zhaoanbei opened this issue Sep 20, 2020 · 1 comment
Open

Return Code: 1, CMD #5

zhaoanbei opened this issue Sep 20, 2020 · 1 comment

Comments

@zhaoanbei
Copy link

Hi
Sorry to interrupt. I tried to run this repo on sagemaker with code below:

estimator = Estimator(role=role,
train_instance_count=1,
train_instance_type=instance_type,
image_name=ecr_image
)

estimator.fit({'training':'s3_path','checkpoint':'s3_path/faster_rcnn_inception_v2_coco_2018_01_28/'})

And error:
Exception during training: Return Code: 1, CMD: ['/usr/local/bin/python', '/opt/ml/code/tensorflow-models/research/object_detection/model_main.py', '--model_dir', '/opt/ml/model', '--pipeline_config_path', '/opt/ml/input/data/training/pipeline.config', '--num_train_steps', '100']
Traceback (most recent call last):
File "/opt/ml/code/train", line 83, in
commandline_util.run_python_script(training_script, default_params)
File "/opt/ml/code/utils/commandline_util.py", line 34, in run_python_script
run(script_cmd)
File "/opt/ml/code/utils/commandline_util.py", line 27, in run
raise Exception(error_msg)
Exception: Return Code: 1, CMD: ['/usr/local/bin/python', '/opt/ml/code/tensorflow-models/research/object_detection/model_main.py', '--model_dir', '/opt/ml/model', '--pipeline_config_path', '/opt/ml/input/data/training/pipeline.config', '--num_train_steps', '100']

Is there any suggestions?

@svpino
Copy link
Owner

svpino commented Sep 20, 2020

Can you look at the full stack trace in CloudWatch? There should be more information there.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants