bedrock

Implementation details for API bedrock

Coverage Overview


AvailabilityTesting*
OperationImplementedImageInternal Test SuiteExternal Test SuiteTerraform ValidatedAWS ValidatedSnapshot TestedDetails
BatchDeleteEvaluationJob
CreateEvaluationJob
CreateGuardrail
CreateGuardrailVersion
CreateInferenceProfile
CreateMarketplaceModelEndpoint
CreateModelCopyJob
CreateModelCustomizationJob
CreateModelImportJob
CreateModelInvocationJob✔️pro✔️✔️✔️Show Tests
CreateProvisionedModelThroughput
DeleteCustomModel
DeleteGuardrail
DeleteImportedModel
DeleteInferenceProfile
DeleteMarketplaceModelEndpoint
DeleteModelInvocationLoggingConfiguration
DeleteProvisionedModelThroughput
DeregisterMarketplaceModelEndpoint
GetCustomModel
GetEvaluationJob
GetFoundationModel✔️pro
GetGuardrail
GetImportedModel
GetInferenceProfile
GetMarketplaceModelEndpoint
GetModelCopyJob
GetModelCustomizationJob
GetModelImportJob
GetModelInvocationJob✔️pro✔️✔️✔️Show Tests
GetModelInvocationLoggingConfiguration
GetPromptRouter
GetProvisionedModelThroughput
ListCustomModels
ListEvaluationJobs
ListFoundationModels✔️pro✔️✔️✔️Show Tests
ListGuardrails
ListImportedModels
ListInferenceProfiles
ListMarketplaceModelEndpoints
ListModelCopyJobs
ListModelCustomizationJobs
ListModelImportJobs
ListModelInvocationJobs✔️pro
ListPromptRouters
ListProvisionedModelThroughputs
ListTagsForResource
PutModelInvocationLoggingConfiguration
RegisterMarketplaceModelEndpoint
StopEvaluationJob
StopModelCustomizationJob
StopModelInvocationJob✔️pro
TagResource
UntagResource
UpdateGuardrail
UpdateMarketplaceModelEndpoint
UpdateProvisionedModelThroughput

Terminology

  • Internal Test Suite: tested by LocalStack's internal integration test suite
  • External Test Suite: covered by an external integration test suite, that runs against LocalStack
  • Terraform Validated: operation tested with Terraform
  • AWS Validated: the integration test that includes this operation call was validated against AWS
  • Snapshot Tested: the operation is part of a snapshot parity test, which verifies the responses by LocalStack and AWS are the same

Testing Details

This section gives an overview about the internal integration test suite and the specific test cases that recorded the API call.

How to read the test details?

For each operation we put up a list of the related integration test cases.
Those operation calls have been recorded during the execution of the outlined test cases. Some calls might be internal, i.e., they are not explicitly called in the test, but are triggered implicitly by the LocalStack framework.

  • Parameters: The tests are ordered by the parameters used, which are highlighted in bold.
  • Test Details: LocalStack Community or LocalStack Pro indicates where the test originates. For each test you see:
    • test name
    • status code returned (which is the expected one for the test case)
    • information about validation:
      • AWS validated the test is validated against AWS, meaning it run successfully against real AWS as well
      • Snapshot Tested this is a snapshot parity test, meaning the responses are validated against AWS


CreateModelInvocationJob

Parameters: clientRequestToken, inputDataConfig, jobName, modelId, outputDataConfig, roleArn
  • LocalStack Pro
    • test_invocation_jobs LocalStack Pro: tests/aws/services/bedrock/test_bedrock.py::TestBedrock::test_invocation_jobs HTTP Status Code: 200 AWS validated Snapshot Tested

GetModelInvocationJob

Parameters: jobIdentifier
  • LocalStack Pro
    • test_invocation_jobs LocalStack Pro: tests/aws/services/bedrock/test_bedrock.py::TestBedrock::test_invocation_jobs HTTP Status Code: 200 AWS validated Snapshot Tested

ListFoundationModels

Parameters: - (without any parameters)
  • LocalStack Pro
    • test_list_foundation_models LocalStack Pro: tests/aws/services/bedrock/test_bedrock.py::TestBedrock::test_list_foundation_models HTTP Status Code: 200 AWS validated Snapshot Tested

Last modified October 28, 2024: Update Parity Coverage Docs (#1526) (487b8f1d4)