Using silly tavern

Last UpdatedMarch 5, 2024

by

Interes Nov 1, 2023 · Silly Tavern is an AI character platform that offers creativity and a unique way to explore a world on one device, overcoming limitations in content scrolling and critical thinking. txt file to whitelist your phone’s IP address, then you can actually type in the IP address of the hosting device with :8000 at the end on your iOS phone browser and it’ll run on your phone :P. SillyTavern originated as a modification of TavernAI 1. For those seeking a memorable and enjoyable⁢ experience, the silly tavern AI is an essential tool. Text version - https://docs. conda create -n xtts. So, as long as you're using OAI, not much will be safe. be/JTuwovSuJp0How to run We used a 7B model in our guide, but if your hardware can handle larger models, you should be using larger models like 13B and you will get better output. conda activate xtts. be/UGLGLpO938s Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Select an existing avatar, or create a blank persona with a dummy image ("Create" button). Example: /sd apple tree would generate a picture of an apple tree. This is a tutorial on how you Tutorials on how to use SillyTavern and various add-ons. 1. It offers a unique experience by combining the power of advanced AI models with the allure of personalized virtual characters, allowing users to deploy it to run on their own devices. In this tutorial I’ll assume you are familiar with WSL or basic Linux / UNIX command respective of you OS. Navigate into folder – Use “cd” command to enter the SillyTavern directory. release -🌟 Recommended for most users. 000 tokens because of the example dialogue (it's 4. Update SillyTavern to at least version 1. Fine-tune the model with a voice you really like the cadence of. To create a persona: Open the Persona Management panel (smiley face icon) in the top bar. The SillyTavern engine activates and Jan 4, 2024 · Silly Tavern is a web UI which allows you to create upload and download unique characters and bring them to life with an LLM Backend. enableServerPlugins: true. This creates a pop-out of the group chat menu. 0) adds a new option in the "Magic Wand" menu - Data Bank. Fiction Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Prepare RVC Model Files: In a file browser, Navigate to: \SillyTavern-extras\data\models\rvc. From now on, we'll call it xtts. 5-mistral, but this advice applies to many other models, of which there are multiple sizes. •. On NovelAI's tablet and scroll tiers, Clio does have a larger context size than Kayra, but trading that off against better coherence/prose quality from Kayra is unlikely to be worth it. To embark on your Silly Tavern AI journey, begin by installing TavernAI on your personal computer or accessing it through a cloud service. Setting up Silly Tavern can be confusing, as you need Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. You shouldn’t be afraid to employ ridiculous prompts! World Info. Depth 0 = placed at the very end of the chat history. Select the saved file from the location, and characters will be automatically In this tutorial, I show you how to use the Oobabooga WebUI with SillyTavern to run local models with SillyTavern. com/SillyTavern/S To import ready-made characters to Tavern AI, follow these steps: Go to “botprompts. Context limited to 2048. Why use SillyTavern? Modern AI language models have gotten so powerful that some of them are now convincingly able to simulate a character you create, and who you can chat with. ”. app/extras/extensions/speech-recognition/How to run SillyTavern Extras - https . Llama 3 models all have 8K context, so Oct 28, 2023 · To connect Silly Tavern to a self-hosted pod on RunCloud, you need to add ports 5000 and 5005 to your pod and connect to it using the Silly Tavern website. The user interface is extremely easy-to-use and allows you to interact with many different text generation AIs and engage in chat and roleplay with characters. SillyTavern - https://github. Silly Tavern produces no content. txt file to add --extensions openai (alternatively, this can be toggled in the interface itself) Step 4: start Oobabooga. ADMIN MOD. Using nano or a code editor with administrator rights, open config. Right-click on the config. 3. Use the new, official launcher: https://github. Please refer to this guide by ArroganceComplex#2659: Jun 3, 2023 · Here's how you can install or use Silly Tavern on your Windows PC. 000 tokens) which is just a small interaction with the character I did then used as the example. SillyTavern is an app to facilitate these roleplaying chats: It's a user interface that handles the communication with those AI language models. Jun 25, 2023 · To harness the full potential of Silly Tavern AI, follow these steps: Installation: Begin by installing Silly Tavern AI on your computer or Android device. Create a new conda env. Llama 3 Instruct should always be used for chat, not the base model. org/enSilly Tavern GitHub - https://github. At this point they can be thought of as Aug 15, 2023 · How To Use Silly Tavern AI: A Step-by-Step Guide 1. On your keyboard: press WINDOWS + R to open Run dialog box. 01, but can be set higher with a high Temperature. It works with TavernAI, SillyTavern, JanitorAI, Venus, Agnaistic, RisuAI. sh script instead of start. Aug 19, 2023 · Access Silly Tavern: Once the server is ready, it will automatically open a tab in your default web browser, indicating that Silly Tavern is ready for use. Learn more: https://sillytavernai. SillyTavern can be run natively on Android phones using Termux. Create a subfolder like 'Betty' and place the . 10. 5. How to generate an image. Jan 19, 2024 · I have an AMD card, but am using a model ending in gguf, which I believe relies on my CPU. You should use Kayra. This places the Author's Note into the chat history at the specified depth. In this tutorial I will show how to set silly tavern using a local LLM using Ollama on Windows11 using WSL. I've been trying for a whole week reading up finding a way to get long term memory with my new install of Silly Tavern. Use the "Image Generation" item in the extensions context menu (wand). From all the ways I've read so far, thanks to FieldProgrammable, the following seems to be the different ways possible so far (extract from one of his post): Lorebooks. You can use it by connecting the Kobold AI API. Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. By enabling MovingUI from user settings, this menu can resized and dragged to any position within the interface and functions just like the regular group chat menu. ai (not anymore with how the site is) or silly tavern, for example I have a character with 5. Text that denotes the end of the reply. Oobabooga WebUI installation - https://youtu. It's suitable for the majority of users. Instruct Mode allows you to adjust the prompting for instruction-following models trained on various prompt formats, such On your keyboard: press WINDOWS + E to open File Explorer, then navigate to the folder where you want to install the launcher. At this Sep 10, 2023 · A: Undoubtedly! A silly tavern AI injects an element of surprise, delight, and amusement into the virtual realm. Feb 11, 2024 · Whisper speech recognition module is now available without using Extras. /start. Edit this page. Alternatively, use the Colab notebook. For example: Temperature: 5, Min P: 0. Llama 3 handles being a character better when told IT IS the character, rather than told to act as the character. This is the model I am using: yarn-mistral-7b-128k. Step 6: Copy and paste the below command. You will find Lora here - https://civitai. NOTE: IMPORTANT to also set the system prompt to be telling the model that IT IS the character, and not to jus pretend to be the character if you are using base Llama 3 or my fine tune. Jun 1, 2023 · Run local models with SillyTavern. 8 in February 2023, and has since added many cutting-edge features not It takes a bit of extra work, but basically you have to run SillyTavern on a PC/Laptop, then edit the whitelist. (Hint: you can download voice files from https://voice-models. Follow your plugin's instructions on installing the plugin. Step 6: load the model. cd C:\xtts. Locate the config. World Info (also known as Lorebooks or Memory Books) enhances AI's understanding of the details in your fictional world. At this point they can be thought of as Sep 9, 2023 · Use your voice to speak to your character. Then, run the following command to install git: cmd /c winget install -e --id Git. com/How to install Stable Diffusion - https://youtu. 2. Command list:1. The closer the Author's Note is to the bottom of the prompt, the more impact it has on the next AI Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Github - https://github. yaml file and select Open with > Notepad. yaml file in the SillyTavern folder. More about Speech Recognition - https://youtu. 6. Step 2: Install Oobabooga as per the instructions (one click installer works fine) Step 3: edit the CMD_FLAGS. Make the necessary changes to the configuration options as described below. 10 to your env. In SillyTavern's top bar, click Character Management at the far right. I tried a few others as well, all with the same result. Aug 13, 2023 · Silly Tavern is an interface which you can use to chat with your AI Characters. If a stop sequence is generated, everything past it will be removed from the output (including the sequence itself). SillyTavern provides a set of tools for building a multi-purpose knowledge base from a diverse number of sources, as well as using the collected data in LLM prompts. sh” and hit Enter. Set completion preset properly. It lets you create new characters (a character is a description of someone that you give to an AI for them to roleplay), and switch between your characters easily. Step 8: Silly Tavern will open in your browser. sillytavern. (I used a soft-spoken woman meditation track) then use 8 seconds of that same person's voice as the clone voice for the model. Silly Tavern AI can assist you in having a casual conversation, a romantic date, a To edit the settings, follow these steps: Navigate to the SillyTavern folder on your computer. Clio's speed advantage is insignificant. . Once installed, launch the Silly Tavern user interface to unlock the world of interactive AI-powered characters. 26. The higher the number, the more parameters the model was trained with, making them better at reasoning, but the higher you go, the more VRAM is required for fast speeds. Whether you want to role-play, write fan fiction, or find an AI companion, Silly Tavern AI can help you achieve your goals. You can roleplay as yourself or as someone else, and your characters can explore various scenarios and genres. 12. It took me a few fine tunes to get it sounding the way I liked (30ish EPOC's for whatever reason Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Clone the repository – Run the Git clone command for the SillyTavern repo (with branch option if desired). MembersOnline. be/0R-SUd_KJ6AMore about SillyTavern - Sep 11, 2023 · Expressions are now available to everyone, no need to use Extras anymore. Sep 11, 2023 · Step 3: Open Windows Explorer (Win + E) Step 4: BroBrowse to or create a folder on your desktop. Go to Tavern AI > Click the “☰” button > Select “+Import. Linux/MacOS The process is similar but involves using the terminal to clone the repository, navigate to the directory, and run a start. Poe support discontinued. On your keyboard: press WINDOWS + E to open File Explorer, then navigate to the folder where you want to install the launcher. SillyTavern - htt Before you begin, make sure you set a config enableServerPlugins to true in the config. Run “start. # Accessing the Data Bank. Restart the Docker container. com/vfnm/Poe-API-ServerHow to install SillyTav #Android(Termux) Installation. Install TavernAI and Launch Silly Tavern UI. You can choose between 7b, 13b (traditionally the most popular), and 70b for Llama 2. Sep 15, 2023 · You don't need Extras anymore, expand your character's memory with a vector database. Screenshot Logs My example dialogues are usually just chats I grab from either character. SillyTavern 1. Reply reply. Llama 3 has 8K context size, even fine tuned models don't Apr 4, 2024 · There’s more yet! Silly Tavern AI allows you give your characters personalities—that is, quirks, qualities, and acts that truly make them stand out. To run again, simply activate the environment and run these commands. Result is the best I've found save for of course 11 labs. At this point they can be thought of as Jul 31, 2023 · Works only on PC. Silly Tavern is a local interface that lets you chat and interact with character chatbots, straight from your PC or Android device. More info - https://docs. At this point they can be thought of as A place to discuss the SillyTavern fork of TavernAI. 9. Abliterated models are ones where the refusals have been "cut out". Recently I picked up LMStudio to use with SillyTavern and the gen speed is a lot better than ooba which I used before, but they kept inputing system messages and instruction/response (and incorrectly, too), so I hope to ask for some help regarding which settings/presets I should be using to mitigate the issue Jul 1, 2023 · How to use Lora in SillyTavern Extras. The built-in Chat Attachments extension (included by default in release versions >= 1. Other fine tune might prefer to be told to pretend, so it depends on the exact model. Install the "Smart Context" extension from the "Download Extensions & Assets" menu in the Extensions panel (stacked blocks icon). com/SillyTavern/SillyTavern-Launcher. 0:55 Using ChatGPT to generate the properties of custom character. Will your hero be a flailing buffoon or a sleek sophisticate? It’s up to you! Useful Advice for Using Silly Tavern AI Handling Prompts. SillyTavern is a fork of TavernAI 1. Triggered by keywords, excellent for creating long term Jun 17, 2023 · Run language models locally via KoboldAI on your PC. SillyTavern is a user interface you can install on your computer (and Android phones) that allows you to interact with text generation AIs and chat/roleplay with characters you or the community create. Anything else would trigger a "free mode" to make SD generate whatever you prompted. Links:Node JS - https://nodejs. Q4_K_M. You'd have to tell me what the model is. Activate a newly created env. index files into it. If you did everything right, after a few seconds, Coding Sensei should respond. This is the most stable and recommended branch, updated only when major releases are pushed. com/Omega-Slender/ITSNOTPOEVER-ST-EDITEDAnother Setup Instructions. Lately, I've been using Wizard Vicuna 1. In the text box at the bottom, write something to Coding Sensei, then press Enter or click the Send button. Warnings: Outdated guide! Maybe I will update it one day SillyTavern Simple Launcher is outdated and may cause issues. yaml (within the config folder) and enable enableServerPlugins. Using KoboldAI United to run 13B models via colab. Feb 26, 2024 · Step 2: Choose your Llama 2 / Mistral model. It⁣ fosters a sense of camaraderie and immersion, compelling users to truly engage with their surroundings. Also sent as a stopping string to the backend API. Find the persona in the list and pick the leftmost context action button ("Bind a name to that avatar"). Open a terminal in your SillyTavern directory, then run the following: Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. sh” – Execute the script by typing “. Step 5: Click the address bar in the folder, type CMD, and press Enter. So what’s cool about Silly Tavern is that it’s not just about Apr 3, 2024 · Step2: Connect to one of the supported APIs, including KoboldAI, KoboldCpp, Cloud LLM APIs, OpenAI (ChatGPT), and more. Clio is not a bad model, but not as powerful as Kayra. This is why people switch to using Poe, or NovelAI, or local models, or The Great Pumpkin, or whatever - they don't want the OAI banhammer slamming them. Settings for LMStudio/SillyTavern. Tutorial. Silly Tavern is an innovative localized AI chat platform that allows users to create and chat with AI-generated characters. Next, pick your size range. cd silero-api-ser Mar 15, 2024 · Silly Tavern AI is a powerful and user-friendly platform that enables you to chat with various AI models and characters in an interactive and immersive way. # Settings Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. org/enGithub - https://github. Apr 24, 2024 · Start your SillyTavern server. Type a /sd (argument) slash command with an argument from the Generation modes table. com/SillyTavern/SillyTavernMusic - Dec 19, 2023 · In this quick tutorial I show you how to use Claude 2 in Silly Tavern. I am using freshly updated versions of everything. Step3: Install Stable Diffusion WebUI or APIs. dev/local-installation-(gpu)/koboldai4bit/If link doesn't work - ht Navigate to the folder you've created at step 4 of prerequisites. Confirm with "y" when prompted. net” and select any ready characters. Silly Tavern allows you to create your own personality for your AI character and set character objectives to make your interactions more engaging and rewarding. Independent-Nature10. Right-click and click “save as” and save it in a secure location. I'm just getting started with the basics of Python, so this might not be the best way. Jul 25, 2023 · A new way to use Poe with SillyTavern. At this point they can be thought of as completely independent programs. You must have NodeJS (LTS version) installed - https://nodejs. SillyTavern is being developed using a two-branch system to ensure a smooth experience for all users. com, make sure the voice name says it's RVPME. be/c1PAggIGAXoSillyTavern - https://github. This process ensures you have the necessary software to engage with the platform. For beginners, the Horde API is now a good start (free, uncensored models). It functions like a dynamic dictionary that only inserts relevant information from World Info entries when keywords associated with the entries are present in the message text. You can use this method on Android (via Termux). Step 7: Once this process completes, double-click Start. Open the Extensions panel (via the 'Stacked Blocks' icon at the top of the page), paste the API URL into the input box, and click "Connect" to connect to the Extras extension server. gguf. Some people seem to get away with using it through OpenRouter or something, but the risk is still there. Produces more coherent responses but can also worsen repetition if set too high. This update is already available in the staging branch. bat . 7 with Poe Integration. Select an existing character such as Coding Sensei. Start your SillyTavern server. bat. Character Creation: Create a character of your liking or select one from the community’s collection. 1-0. Git. Jun 1, 2024 · Easy and FREE Silly Tavern local install! Have you ever wanted to have your AI characters talk to each other? Perhaps you would like to send and receive imag Mar 15, 2024 · Tavern AI is an interface that generates realistic and engaging discussions with custom characters using locally installed language models (LLMs). Sep 11, 2023 · Open Terminal – Launch the Terminal console on your system. pth and . Create a new folder within the docker folder called plugins. 2. ) Install Requirements: Stop Sequence. 1:48 Creating the custom character and Most often this is for people who want to use SillyTavern on their mobile phones while their PC runs the ST server within the same wifi network. Brought to you by Cohee, RossAscends, and the SillyTavern community, SillyTavern is a local-install interface that allows you to interact with text generation AIs (LLMs) to chat and roleplay with custom characters. Step4: Install and launch the 1. 8 which is under more active development, and has added many major features. Llama 3 8B is MORE censored than 70B. However, it can be used to allow remote connections from anywhere as well. Jun 6, 2023 · Silly Tavern AI is like a super advanced chatbox you can use to talk to virtual characters from your favorite games or stories, even those you come up with yourself. It’s an upgrade to something called TavernAI and it’s even better for role-playing or creating fan fiction. A quick guide on how to use character cards and the knowledge book in Silly Tavern. Input a desired name into the popup window. com/Cohee1207/SillyTavern/tree/mainGoogle Co May 12, 2023 · Installing a local Silero TTS server. yaml file of SillyTavern. For example, you can tell the AI to pretend to be a Go instructor named Jubei from medieval Japan, and it will act and respond accordingly. Once in the desired folder, type cmd into the address bar and press enter. Limits the token pool by cutting off low-probability tokens relative to the top token. Install Python 3. Depth 4 = placed before the most recent 3 chat history messages, making it become the 4th entity in the chat history. com/SillyTavern/SillyTavernhttps://youtu. staging - ⚠️ Not recommended for casual use. Step 5: Download a model, say TheBloke/MythoMax-L2-13B-GPTQ in the model tab in the UI. Install or Update Extras to the latest version. 3 13B with the superhot 8k lora running on ooba as the backend and to be honest, right now it feels on par, if not better than, Character AI. alpindale. Jun 9, 2023 · Timestamps 0:00 Introduction 0:33 ChatGPT jailbreak for generating custom NSFW character. The group chat menu pop-out can be activated by clicking on the icon next to the "Current Members" field. Works best at low values such as 0. At the time of writing, I was unable to find a 13B or higher variant of openhermes-2. **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Mar 17, 2018 · Step-by-Step Setup. lu ac ed cs md xq pz yk sv hs