Silly tavern no connection. " and "Bad Request". 0 Desktop Information No response Describe the problem Installed extensions do not appear under "Manage extensions" when not connected to the inter A SillyTavern extension that helps you create character cards based on your ST data with LLMs using connection profiles. js,But recently SillyTavern has bee May 8, 2023 · Hello, when I try to connect to Novel ai api I get this error, how can I fix it? Jun 2, 2023 · As of the last update, my responses are not transferring from KoboldCPP (tried several versions). Edit2: there's also some options in the config file to play with. 6. My goal is to have my computer connected to the remove server, simply changing t I don't recommend opening ports. 11. I have downloaded tavern and kobold ai on my pc and it's working perfectly now I want to use silly tavern on my phone while running it on my pc is there a way I can do that? Or does silly tavern not support it? (Please don't tell me to go use Google collab) Mar 5, 2024 · SillyTavern is prematurely sending an Abort command to KoboldCPP if the prompt/response takes too long. To make it listen on all network interfaces (i. The channels I mentioned have instructions for downloading and running a model in ooba, and seting up ST to communicate with it. bat Make sure o SillyTavern can access this API out of the box with no additional settings required Uses the GPU of individual volunteers (Horde Workers) to process responses for your chat inputs Jun 14, 2024 · Environment 🪟 Windows System win11，edge、chrome、firefox Version 12. js' then I have full functionality and can connect to Silly Tavern Extras via http from local or remote IP addresses, but remote IP May 13, 2024 · When I try to connect to the koboldcpp API over the local network, nothing happens (no connection). It doesn't actually lose connection at all, from what I can tell, as simply opening up the API menu in ST and clicking Connect will fix it every time. Jan 4, 2024 · Silly Tavern is a web UI which allows you to create upload and download unique characters and bring them to life with an LLM Backend. This video shows how to install SillyTavern locally on Windows and how to connect it to Ollama privately and locally for roleplay. g. How to point Silly Tavern to it? May 26, 2025 · This document covers the troubleshooting and diagnostic capabilities built into the SillyTavern Launcher (STL). At this My English is not good, so I used translation software. How can I solve this problem ? After that, you should be able to go back to Tavern and hit the "connect" button to turn the red light green. Similarly, when trying to connect to the oobabooga API, the situation is the same. yaml set listen to true. And if all these things didn't work, then just drop the tavern for a couple of days and after they past, try it again. -- Anonymous If it doesn't help too, try to reload the collab page and try the link again. "Novel Sep 19, 2024 · I have a valid API key from NotDiamond AI platform and its compatible with OpenAI, but whenever i open Silly Tavern's Custom Connection menu in Chat Completion section and input the base URL and my API key and hit "Connect", i always get a "Not Found" Error, even though the same link works in the Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. 4 Describe the problem Can't connect to olla To connect to Runpod. At this SillyTavernSillyTavern provides a single unified interface for many LLM APIs (KoboldAI/CPP, Horde, NovelAI, Ooba, Tabby, OpenAI, OpenRouter, Claude, Mistral and more), a mobile-friendly layout, Visual Novel Mode, Automatic1111 & ComfyUI API image generation integration, TTS, WorldInfo (lorebooks), customizable UI, auto-translate, more prompt options than you'd ever want or need, and endless We would like to show you a description here but the site won’t allow us. PC can't connect to API over network. I know it's not an issue with my API key as the billing information is correct and I did troubleshooting with a friends API key that is working for them yet it did not work for me. Check your connection settings / API key and Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Although, I’m having some difficulties trying to connect my IPhone to my PC. Contribute to nodeposition/SillyTavern- development by creating an account on GitHub. 1 Desktop Information No response Describe the problem Could not get a reply from API. It seems to run, in fact I can select a local model and chat with it. See more details on the OpenRouter FAQ page. Become a Patron 🔥 - htt Jan 1, 2024 · After enabling ssl (required to allow microphone access on remote connections), then the connection to Silly Tavern Extras fails. 5. Also I done JavaScri May 26, 2025 · Authentication through Tailscale identity providers No direct internet exposure of SillyTavern ports Device-based access control through Tailscale admin console Network access is restricted to devices authenticated within the same Tailscale network, providing secure remote access without exposing services to the public internet. " What do I do? A place to discuss the SillyTavern fork of TavernAI. I use a VPN like tailscale or nord vpns meshnet feature to connect my phone and PC running silly tavern to the same network. A place to discuss the SillyTavern fork of TavernAI. However, when I message the bot on Silly Tavern, I get no replies. ), this, open config. If it's incorrect, I apologize. The type bar loads green partially over and over again, and an hourglass flashes next to it. I saw a post talking about Command-R-plus and thought about trying it. At this . I would like to use it with Silly Tavern but I can't seem to find a way. I tried the configuration method where I whitelist my local IP, but I still haven’t managed to access SillyTavern on my phone : ( ( Did I do something wrong, or is the method no longer working? Help is very much appreciated :> For all of you guys out there having trouble with Tavern AI have I got something for you. After I entering the key and hit connect it shows erro:etimeout in the shell… (I tried checking the bypass status check box but no luck) Has it something to do with the version of the tavern? And if so what is the right version for OpenAI? Somebody please help! Or maybe recommend an This guide aims to help you get set up using SillyTavern with a local AI running on your PC (we'll start using the proper terminology from now on and call it an LLM). -If I launch ST with 'node server. 12. 0 Desktop Information Node v19. com If the connection attempt appears in the console, but is forbidden, it is a whitelist issue. Jul 25, 2023 · To run Silly Tavern AI smoothly, it requires stable internet connectivity. After using Cohere's playground and thinking it was pretty good, I wanted to play with it on SillyTavern. Using sillytavern with kobold is dead easy, no problems there. Tried checking connection, refreshing the page, restarting silly tavern to no avail, then tried using the update and start. It provides guidance for setting up the application across different platforms and preparing it for first use. When it happens, sometimes a refresh of the page will fix it. This VRAM Calculator by Nyx will tell you approximately how much RAM/VRAM your model requires. 1 Desktop Information Node v21. 5 or some other hosted AI. Silly Tavern version 1. How can I make SillyTavern complete the connection through the proxy? Save Connection Profiles to quickly switch between different APIs, models and formatting templates. None - no explicit processing applied unless strictly required by the API Merge consecutive messages from the same role Semi-strict - merge roles and allow only one optional system message Strict - merge roles, allow only one optional system message, and require a user message to be first Why exactly do you need to do that? I mean I never connected oobabooga with silly, is there any benefit to connecting them? Xactly the same problem. KoboldCPP is still processing prompt context OR generating response but hasn't sent it to SillyTavern yet. But the moment I try to verify API connection using the test message, it comes back as "Could not get a reply from API. I see all these posts from people who are struggling with the termux thing on their phone and it seems like a much bigger pain, unless you're just using silly tavern to connect to something like GPT3. Our goal is to empower users with as much utility and control over their LLM prompts as possible, embracing the steep learning curve as part of the fun. Configuring those programs is quite technical so I will skip the details on this guide. I know there's probably a simple solution, but still, any help would be appreciated. Sure enough, the new version couldn't use the new key to connect, but the old one could. 15. e its connections to the outside world, such as ethernet, wifi, etc. 3. Refreshing the page also works. What it's not: It's easy to think of "Text Completion" as local models and "Chat Completion" as cloud-based LLMs, but that's not the case. After i updated (?) silly tavern, i try to check if the ai responds and when looking at the console i see "error:response timed out. SillyTavern provides a single unified interface for many LLM APIs (KoboldAI/CPP, Horde, NovelAI, Ooba, Tabby, OpenAI, OpenRouter, Claude, Mistral and more), a mobile-friendly layout, Visual Novel Mode, Automatic1111 & ComfyUI API image generation integration, TTS, WorldInfo (lorebooks), customizable UI, auto-translate, more prompt options than you'd ever want or need, and endless growth Jul 12, 2023 · Check your connection settings / API key and try again. Learn how to resolve the problem of Silly Tavern AI not working or not responding with these helpful methods and solutions. My SillyTavern is set up on a VPS and started using Forever to run server. This guide will show you how to setup ZeroTier to access your SillyTavern instance installed on your PC remotely without exposing your ports to the internet. To Reproduce Launch oogabooga's start_windows. Jun 23, 2023 · Have you searched for similar bugs? Yes Describe the question I have oobabooga up and running, everything works. Join the whimsical world of Silly Tavern AI, a curious conversational companion that serves up humor, creativity, and delightful dialogue in the guise of a charming tavern keeper. Also is it possible to have text streaming in ST same as Ooba? Im using a laptop so i get 2-3 tk/s with 13B-20B GGUF models which is fine with Ooba as text streaming is around reading speed but i end up waiting a minute or two in ST. Learn how to connect SillyTavern in Salenai to OpenRouter, import advanced prompts, and configure your instance for the best AI chat experience. An open-source implementation of the Tailscale server exists and you can also host the server using Headscale, but that is outside of the scope of this tutorial. In this tutorial I’ll assume you are familiar with WSL or basic Linux / UNIX command respective of you OS. Otherwise, the server will not start. You can use it by connecting the Kobold AI API. " Anyone have any idea how to fix it? Silly Tavern is an interface which you can use to chat with your AI Characters. 8 'staging' (d636385) Desktop Information NovelAI and Cohere APIs Describe the problem Attempts to connect to any chat APIs (Cohere and NovelAI Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. 1. 9. To have a quick conversation without selecting a character card or to just test the LLM connection, simply type your prompt input into the input bar on the Welcome Screen after opening SillyTavern. Any ideas? Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Can anyone help with this? We would like to show you a description here but the site won’t allow us. In SillyTavern console window it shows "is_generating: false,". NovelAI is a paid subscription service that allows unlimited monthly access to their high-quality in-house text generation, image generation, and Sub to the new main channel: / @hushmoneylabz Today Tim walks us through setting up SillyTavern, and using Text-Gen-WebUI as our backend. AI or Chub. Complete all the fields below. LLM Frontend for Power Users. Follow our step-by-step guide to enhance your experience! I'm clueless. However, since it is an open-sourced program, Malicious Workers could modify the code to: log your activity (input prompts, AI responses). The troubleshooting system provides automated diagnostics for common issues, system info my setup of silly tavern. yaml and show_openrouter_api: true. But prompting Silly Tavern doesn't work. If no name was specified, the persona will be named " [Unnamed Persona]". No subscription or monthly bill - you pay for what you actually use. This will create an empty "Assistant" character card that you can customize later. Step into Silly Tavern and unleash your creativity. At this May 14, 2024 · I'm running Silly Tavern locally, and accessing it using Tailscale though my phone, tablet and other devices. Every time I try and use SillyTavern, no API connects. For me, after I dropped it for three days because nothing helped, it's working just fine right now. So I am running ollama on my Linux machine and I want to access it from my PC running silly tavern. If you are using a Text Completion profile, make sure your profile contains API, preset, model, and instruct. hello i just installed koboldAI locally and sillytavern but i cant figure out how to connect them i set the api url to my local and it says Jun 6, 2023 · Warning. If there are fluctuations in the internet speed or no internet then the application will not work or respond. At this very time I try and use SillyTavern, no API connects. At this Download a model and setup silly tavern to connect text-generation-webui. Just spoonfeed me the easiest and fastest way I can start using SillyTavern. If ST is listening for remote connections but the connection attempt does not appear in the console, it is a network issue. 2651. Performance Tips Why is the UI so slow/jittery? Try enabling the No Blur Effect (Fast UI) mode on the User settings panel. Just to be sure, I generated a new key and tried it in both versions. At this A place to discuss the SillyTavern fork of TavernAI. It is very strange because sometimes it can connect successfully, but after sending one or two messages, it shows that the connection was lost. 0 Describe the problem I'm currently unable to connect SillyTavern to the Oobabooga Text Generation A place to discuss the SillyTavern fork of TavernAI. But the most Apr 1, 2025 · I have a problem with open router option in API. 2. IMPORTANT: SillyTavern is a single-user program, so anyone who logs in will be able to see all characters and chats, and be able to change any settings inside the UI. I love how insanely fast and easy to use LMStudio is compared to Oogabooga or Cobalt, but i can't find a way to make API work for me. At this Jul 31, 2023 · SillyTavern will "lose connection" with the API every so often. Most API platforms allow to view the generated API key only once, at the time of its creation. And there don't seem to be any other proxy front ends out there for windows other than sillytavern. 0 Branch: staging Model: Gemini Pro, Gemini Pro Visio Android with Termux Install and run SillyTavern directly on your Android device No computer needed, full functionality Complex installation, performance limitations Apr 21, 2023 · Describe the bug Triggering the AI to produce a response gives nothing. if tavern AI is causing you issues try giving silly tavern a try. Jun 11, 2024 · Environment 🪟 Windows System Firefox Version 1. It's helpful to understand what this means. Not even when I refresh the page, nor wait for 3 days. The older version I was using, 1. Using default address/port 127. Dec 23, 2023 · Environment Self-Hosted (Bare Metal) System Windows 10, Opera Version SillyTavern 1. I believe the default "localhost" address it loads with is the correct one. Nov 29, 2024 · When I actually do this (the program is running on the computer, of course), the connection doesn't happen. Jan 1, 2024 · Environment Self-Hosted (Bare Metal) System Win 11 Version 1. To get permanent access to free models with a generous daily limit, you need to buy at least $10 in credits once. It is not showing up in my API list. No matter how long I wait, even through changing settings, the bot never sends a reply. However, it can be used to allow remote connections from anywhere as well. If you are using a Chat Completion profile; API, settings, model A place to discuss the SillyTavern fork of TavernAI. Please help, how do I fix this? Edit: It can connect when I use Horde, but not when I don't, for some weird reason. At this May 8, 2023 · I noticed that even though I turned on the proxy, I still couldn't complete the connection, probably because SillyTavern doesn't use the system's proxy route. Originally forked from TavernAI 1. " This also means I'm not getting a response from the chatbots. 3 days ago · Installation and Setup Relevant source files This document covers the installation process, system requirements, and initial configuration steps for SillyTavern. 8 which is under more active development, and has added many major features. What happened and how to fixWhenever I use SillyTavern on android it will lost connection after a few chat. I would ask in the discord, but Apr 28, 2023 · Users encounter no connection issues while using TavernAI, resulting from a slow internet connection, an exposed API key, or When you first navigate to the "API Connections" page in ST, you will notice a drop-down option to select between options using nomenclature such as "Chat Completion" and "Text Completion". Design and interact with customized AI characters for an unparalleled chat experience. 1 (161083) Version SillyTavern 1. Existing data will be migrated to personas. I did everything I could to fix it like creat a config. For server A place to discuss the SillyTavern fork of TavernAI. Build your world, your work, or your dreams. If you lose it, you will need to generate a new one. Make sure your browser is using Hardware Acceleration. Mar 19, 2025 · If SillyTavern refuses to start and is giving you the "fatal error: failed to start server", or the "node command not found in PATH" message in the console, Interact with AI, your way. --api is enabled I start SillyTavern, click on API, select the Text Gen WebUI ooba and click connect, but it doesn't connect Dec 11, 2023 · Environment Self-Hosted (Bare Metal) System Chrome 119, Windows 11 22H2 Version 1. I'm using the same configuration as with the Anthropic and OpenAI APIs so I'm a But Tavern AI continually fails to connect to the link provided by KoboldAI on startup, whether it be the local or remote play. 重新生成回答或者保留当前回复前提下额外生成一条回复 如果持续不满意，可以尝试修改你的指令，可能AI不能理解，导致回复不理想或者尝试修改AI角色的回复 经常会碰到回复大段文字中，有一小段是满意的，也可以总结一下多次满意的段落，然后合并替换掉AI的内容 回答不满意经常发生在用户 Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Apr 4, 2025 · When my iPhone tries to connect, there is no message in the console. Edit: use the IP address provided by your VPN. Step-by-step instructions on how to use Mancer with SillyTavern. This section does not refer to OpenAI/Claude reverse proxies. At this I don't download every release, but I recently downloaded the latest (1. It was tried on different mobile devices outside the local network, but no connection was achieved. Ai 'the bloke llm' running oogabooga, I can get the model loaded running interfacing nicely through its standard web interface But I cant get a remote terminal / Silly tavern to connect properly even with the API & OpenAI flag enabled in ooogabooga Tailscale is a VPN provider enabling a secure remote connection to your PC. 4 Desktop Information Ollama 0. This refers exclusively to HTTP/HTTPS Reverse Proxies Learn how to resolve common problems with Tavern AI, from internet connection issues to server problems. For detailed information about the underlying dependencies and libraries, see System Dependencies and Libraries. If using response streaming, set the streaming FPS to a lower value (10-15 FPS is Jan 19, 2024 · No, the path you want to copy is the env folder in \text-generation-webui\installer_files\ Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. I've left it open in a side tab for long periods of time just to see if anything would ever load, but nothing does. (Note: For remote connection ensure your network is set to KoboldCpp is a self-contained API for GGML and GGUF models. The same message typed directly on the comouter works okay, generating text on my phone directly on Oobabooga is okay too. This is a tutorial on how you A place to discuss the SillyTavern fork of TavernAI. LLM Frontend for Power Users SillyTavern (or ST for short) is a locally installed user interface that allows you to interact with text generation LLMs, image generation engines, and TTS voice models. By default, it only listens to localhost (connection requests within the OS). But until I do one of those things, ST will refuse to communicate with KoboldCPP. If this takes too long, SillyTavern will behave as if it has reached a timeout and send Seems like a connection issue to me as there is no error but im not sure. This is useful when you actively use multiple API connections or need to switch between different configurations without surfing through the menus. Jan 25, 2025 · After SillyTavern webui has been running in browser for a while, it spits out errors like "Chat could not be saved" or "Settings could not be saved" It usually happens after the webui tab has been left open for several hours. SillyTavern is a fork of TavernAI 1. To be honest, I have no idea how to access sillytavern, which is running locally on my computer, but on my phone. Contribute to victoralvelais/SillyTavern development by creating an account on GitHub. I’m really new to this so this question may sound dumb but I just can’t use OpenAI in sillytavern. 33. Then it's as easy as typing in your ST ip:port in your browser. produce bad or offensive responses. At this redditmedia. Apr 3, 2024 · Introduction to SillyTavern and Its Connection with Stable Diffusion Discover the seamless integration of Stable Diffusion within SillyTavern’s Extras, enhancing the user experience and unlocking new creative possibilities. 98 ,Windows 11, Docker Desktop 4. 1:11434 Works fine on Linux. In this tutorial I will show how to set silly tavern using a local LLM using Ollama on Windows11 using WSL. May 17, 2023 · I can't connect to KoboldAI, the connect button just doesn't work. 0 Kobolcpp_nocuda release Mythalion 13b Describe the problem When i try to acces silly tavern on my phone over local ne A place to discuss the SillyTavern fork of TavernAI. Neither is e. Did you know that using KoboldCpp with SillyTavern is one of the most popular private local alternatives to services like Character. This is a quick guide for Silly Tavern. What gives? A FastAPI based application that allows for generating text using an LLM using the Exllamav2 backend, with support for Exl2, GPTQ, and FP16 models. This video is a quick guide to Jan 22, 2025 · When I try to connect to the API Key, it just says "settings cannot be saved check the server connection and reload the page to prevent data loss. Auto1111 and Oobabooga are connecting with no issue when I access Silly Tavern through these other devices, but only after I en Jun 18, 2024 · I am running a server LMStudio and LLama 3. 8, has no problem with it. At this Aug 11, 2024 · Environment 🪟 Windows System MS Edge 127. Otherwise your bug report will be ignored! Have you searched for similar bugs? Yes Describe the bug Sillytavern stopped connecting to poe. Most often this is for people who want to use SillyTavern on their mobile phones while their PC runs the ST server on the same wifi network. Contribute to Came-dev/SillyTavern1126 development by creating an account on GitHub. 1 'staging' Desktop Information Node. I can see in terminal that they are generating, so everything is getting sent from Silly Tavern, bu Aug 29, 2025 · SillyTavern Overview Relevant source files SillyTavern is a locally-installed web application that provides a unified interface for interacting with multiple Large Language Models (LLMs), image generation engines, and text-to-speech systems. com normally. At this It seems to be installed and running, but insists on using online models? From what I've read I can use Kobold, but before doing that I see that only KoboldClassic and KoboldHorde are available? I've installed Kobaldccp. For the past several days I just can't get the bot to respond. bat file in the silly tavern directory. AI Horde is a crowdsourced, distributed GPU cluster run entirely by volunteers. Some models have free access with a limited number of daily requests. At this May 4, 2024 · SillyTavern is a Chat UI that allows you to interact with text generation AIs and chat/roleplay with characters you or the community create. AI? Let me show you how to set A place to discuss the SillyTavern fork of TavernAI. Personas allow you to easily switch roles or "characters" you speak as, without having to manually update your username/avatar each time. To Re These settings control the sampling process when generating text using a language model. 0. By default, your inputs are anonymously sent and responses can not be seen by the person running the Horde Worker. Ports are open on both ends. When ST is not listening for remote connections, you should see this message in the console: After enabling remote connection listening, you must configure at least one access control method. Apr 17, 2024 · Environment 🪟 Windows System Windows 10 Version 1. 4, I think) and its not accepting my OpenAI key. We would like to show you a description here but the site won’t allow us. **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Enable Reduced motion in the UI theme settings to remove cosmetic animations. Now I'm able to load Silly Tavern and Oobabooga on my phone. So their API connection to your ST interface is local: it's all happening within your computer, excellent for full control and privacy. If you want to get started with local LLMs for local roleplay, writing assistance or coding in less than 5 minutes total, you’ve come to the right place. 8 in February 2023, it has evolved into a comprehensive AI interaction platform with over 200 contributors and serves Mar 19, 2025 · SillyTavern & KoboldCpp on Windows 10 and 11 – the full guide. Read it before bothering people with tech support questions. But why doesn't sillytavern support lm studio? lm studio's interface is extremely basic, it doesn't support character cards and many of the nicer features that koboldcpp and faraday do. Note: Legacy user avatars/names that weren't tied to a persona have been removed. js verision: v18. eljg kyh ykpcx dkevc ovbtbtr uiq vkyao mfuuj tqtqur wqttz