I am not confident comparing these charts perfectly, it 'looks like' the 4090 is superior to the 3090 (3090 because it has the same VRAM, which is an important factor as I have learned), but by how much? Does the price justify the advantages of the 4090?

Hello there! I am a bot raising awareness of Alpacas

Here is an Alpaca Fact:

The Spanish Conquest almost wiped out 90% of the fine alpacas being bred by ancient cultures.

| Info| Code| Feedback| Contribute Fact

You don't get a fact, you earn it. If you got this fact then AlpacaBot thinks you deserved it!

This interface looks great! I'm using windows though and I can hear my fan speed up to run the model, nothing happens. I can run the model through cocktail peanut Dalai Alpaca, so any clue what's going on? Thank you! Edit: It generated text eventually. But really really slow... (about 4 and half minutes to return a response :-p )

Are there plans to add support for the 13b version of the model?

Hello there! I am a bot raising awareness of Alpacas

Here is an Alpaca Fact:

Alpacas are healthy grazers and do not decimate natural vegetation like goats.

| Info| Code| Feedback| Contribute Fact

You don't get a fact, you earn it. If you got this fact then AlpacaBot thinks you deserved it!

[deleted]

I'm having the same issue on Linux on a 16 thread Ryzen 5850U with 64 GB of RAM.

➜  Alpaca-Turbo git:(main) python3 ./webui.py

can't load the settings file continuing with defaults
Loading Model ━━━━╸━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━  13% -:--:--

It just stays at 13%.

Take a look at Langchain and GPTIndex.

I'm trying to test it out but I'm getting the error message: "can't load the settings file continuing with defaults
Loading Model ━━━━━╺━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 13% -:--:--" It's stuck at 13%. Any ideas for how to fix it? (On Win 11)

git clone https://github.com/ViperX7/Alpaca-Turbo.gitis the correct command to run. At least it worked for me.

I haven't trained it i just created this ui that modifies the prompt in a way to get the bot to respond like that

If you can run dalai on your system you can run this also
the only thing is on windows it's performance is very very bad linux and mac works good with 8 gb ram nd 4 threads

I added the changes required for changes but for some reason the model is painfully slow on windows

sorry my bad you don't need to use your username

He isn't the one that trained the model.

https://github.com/tatsu-lab/stanford_alpaca

>I used my username

Did you fork the repo? If not, then the repo you're trying to clone doesn't exist.

I want to ask what is you PC specs and on what dataset did you train it on an how did it take to train it

[deleted]

Can I get some help here on windows? It just sits at loading models. All requirement are installed, I have the models already, just not sure where to put them?

D:\alpaca\Alpaca-Turbo>python webui.py can't load the settings file continuing with defaults Loading Model

━━━━━━━━━━━━━━━━━━━━━━━━ 0% -:--:--

You need to clone his repo with his username. You might have an easier time just downloading it from the project page instead of cloning it.

Temperature is just a matter of randomness, getting it higher actually helps in generating more variations from the same prompt, but the coherency is still a problem.

Apparently I was wrong, the problem is not only quantization. It is because it's not Stanford's Alpaca and another alpaca-like model. This was what I can surely say about that.

the git clone command is not working

git clone https://github.com/your-username/Alpaca-Turbo.git

cd Alpaca-Turbo

pip install -r requirements.txt

python webui.py

I used my username

This should help https://twitter.com/cocktailpeanut/status/1635190013758676993?s=20

Alpaca is mind blowing. Thanks for sharing.

Shared to r/aipromptprogramming

Use my repo it is exatly what you want

​

https://github.com/ViperX7/Alpaca-Turbo