# Load model directly
from transformers import AutoTokenizer, AutoModelForMultimodalLM
tokenizer = AutoTokenizer.from_pretrained("Chat-Error/testing01")
model = AutoModelForMultimodalLM.from_pretrained("Chat-Error/testing01")Model Card: Nous-Hermes-Llama-2-13b-LIMARP-Lora-Merged
This is a Llama 2-based model consisting of Nous Hermes Llama 2 13b (https://huggingface.co/NousResearch/Nous-Hermes-Llama2-13b) merged with LIMARP Lora (https://huggingface.co/lemonilia/limarp-llama2) using the now-updated standard lora adapter for LIMARP (July 28, 2023).
The intended objective was to combine NH-L2's reasoning and instruction-following capabilities with LIMARP's character roleplay capabilities.
added_tokens.json was padded with dummy tokens to reach 32 added tokens in order to allow GGML conversion in llama.cpp without error due to vocab size mismatch.
Usage:
Intended to be prompted either with the Alpaca instruction format of the NH-L2 base model:
### Instruction:
<prompt>
### Response:
<leave a newline blank for model to respond>
Or the LIMARP lora instruction format:
<<SYSTEM>>
<character card and system prompt>
<<USER>>
<prompt>
<<AIBOT>>
<leave a newline blank for model to respond>
Bias, Risks, and Limitations
The model will show biases similar to those observed in niche roleplaying forums on the Internet, besides those exhibited by the base model. It is not intended for supplying factual information or advice in any form.
Training Details
This model is a merge. Please refer to the link repositories of the base model and lora for details.
- Downloads last month
- 9
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Chat-Error/testing01")