To use the Amazon Bedrock provider, you'll first need to activate the models you wish to use. Currently, Promptitude supports the following providers and models:
Meta Llama
Llama 2 Chat (13B) |
Llama 2 Chat (70B) |
Anthropic
Claude 3.5 Sonnet |
Claude 3 Haiku |
Claude 3 Sonnet |
Claude 2.0 |
Claude Instant |
Mistral AI
Mistral 7B |
Mixtral 8*7B |
AI21 Labs
Jurassic-2 Mid |
Jurassic-2 Ultra |
Cohere
Command |
Command-Light |
At Promptitude, we're continually working to expand our support for more models and providers. This guide will walk you through how to activate the models you wish to use in Promptitude.
Note: đ If there are any providers or models you'd like to use that we don't currently support, feel free to reach out to us, and we'll do our best to assist you!
Prerequisites
An active AWS account
Your account must have the necessary IAM permissions to activate the models
An active payment method
Step-by-Step Guide
âď¸ Activate the models you want to use
Log in to your AWS Management Console: https://aws.amazon.com/
In the search bar, type "Amazon Bedrock" and select it from the dropdown list to open the Bedrock service page:
In the Amazon Bedrock dashboard, youâll see a list of available foundation models from various providers. Select the Model You Want to Activate: For example, Anthropic Claude.
On the page, scroll down to the Models section, select the model you want to access, and click Request model access.
Note: Ensure that the model is available for use in Promptitude.
On the page, click Modify model access:
In the Request model access assistant, select the model you wish to request access to, and click Next:
Review your configuration and click Submit:
It may take some time to see the status of your request. However, if everything went smoothly, youâll see a new status of âAccess grantedâ for your model. You can now execute it in Promptitude using your Amazon Bedrock connection:
đ Summary
By following these steps, you can activate your Amazon Bedrock models and use them later in Promptitude with your Amazon Bedrock connection. It's important to remember that only the models available in Promptitude can be executed.