Supported LoRAs

Below is the list of requirements for the LoRA:

We are actively expanding our capabilities. If you have specific needs, please contact us, and we can work on the support!

• Trained using huggingface PEFT
• Hosted on huggingface
• Must be based on one of the supported base models:
  • meta-llama/Meta-Llama-3-8B-Instruct
  • meta-llama/Meta-Llama-3-70B-Instruct
  • mistralai/Mixtral-8x7B-Instruct-v0.1
• The rank(r) <= 32 Here is one of the example: empower-dev/example-lora