aws-samples / aws-codepipeline-codebuild-with-postman Goto Github PK

Phase context status code: COMMAND_EXECUTION_ERROR Message: Error while executing command: aws cloudformation package --template-file petstore-api.yaml --s3-bucket <redacted bucket name> --s3-prefix api-code --output-template-file petstore-api-output.yaml. Reason: exit status 255

I received this error message after changing the placeholder for the bucket name in the main branch of my forked repo since my build was not reading the branch I created despite specifying the new branch during configuration.

I am trying to follow the tutorial to automate tests using Postman at [https://aws.amazon.com/blogs/devops/automating-your-api-testing-with-aws-codebuild-aws-codepipeline-and-postman/]; I am new to AWS.

Hi,

Firstly, thanks for the nice work and I've learned few things after working through this.
I have experienced 2 issues and my pipeline was successful after applying the fixes.
I can understand Issue 2 is kind of intentionally created to demonstrate the capability of CodeBuild reports. However it would be good to explain the steps to fix the test assertion failure.

Issue 1: newman command failed (refer below error)

Command did not exit successfully newman run PetStoreAPI.postman_collection.json --environment PetStoreAPIEnvironment.postman_environment.json -r junit exit status 1

Phase complete: BUILD State: FAILED
Phase context status code: COMMAND_EXECUTION_ERROR Message: Error while executing command: newman run PetStoreAPI.postman_collection.json --environment PetStoreAPIEnvironment.postman_environment.json -r junit. Reason: exit status 1
Entering phase POST_BUILD

Fix: add cli in the command (refer below) in postman-newman-buildspec.yml
newman run PetStoreAPI.postman_collection.json
--environment PetStoreAPIEnvironment.postman_environment.json
-r cli,junit

Issue 2: Assertion failure for Is response time is less than 200ms. Reason: It's taking up to ~600ms
I've updated PetStoreAPI.postman_collection.json with 600 in 3 locations and copied the file to S3 bucket
pm.expect(pm.response.responseTime).to.be.below(600)