{"id":99,"date":"2023-01-31T14:11:46","date_gmt":"2023-01-31T14:11:46","guid":{"rendered":"https:\/\/drunk.support\/?p=99"},"modified":"2023-01-31T15:48:35","modified_gmt":"2023-01-31T15:48:35","slug":"creating-a-gpt3-powered-support-bot-for-wp-fusion","status":"publish","type":"post","link":"https:\/\/drunk.support\/creating-a-gpt3-powered-support-bot-for-wp-fusion\/","title":{"rendered":"Creating a GPT3 powered support bot for WP Fusion"},"content":{"rendered":"\n<p>I&#8217;ve been itching for a few weeks to try training a GPT3 chat bot on some of our <a href=\"https:\/\/wpfusion.com\/documentation\/\">WP Fusion<\/a> support resources.<\/p>\n\n\n\n<p>We have over 400 pages of docs, 4,500 chat logs, and over 18,000 support tickets at our disposal, so there&#8217;s quite a bit of data.<\/p>\n\n\n\n<p>@gilgNYC&#8217;s tweet over the weekend about creating a Shopify help center Q&amp;A bot inspired me to give it a try.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-rich is-provider-twitter wp-block-embed-twitter\"><div class=\"wp-block-embed__wrapper\">\n<blockquote class=\"twitter-tweet\" data-width=\"500\" data-dnt=\"true\"><p lang=\"en\" dir=\"ltr\">I created Shoppy AI, a GPT-powered Q&amp;A bot taught using Shopify&#39;s Help Center documentation + embeddings. <br><br>I&#39;m thinking Shopify will do this eventually but it was a fun weekend project. <a href=\"https:\/\/t.co\/l0zkTOA6hC\">pic.twitter.com\/l0zkTOA6hC<\/a><\/p>&mdash; Gil (@gilgNYC) <a href=\"https:\/\/twitter.com\/gilgNYC\/status\/1619493246375432194?ref_src=twsrc%5Etfw\">January 29, 2023<\/a><\/blockquote><script async src=\"https:\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script>\n<\/div><\/figure>\n\n\n\n<p>I mostly followed LangChain&#8217;s <a href=\"https:\/\/github.com\/hwchase17\/chat-langchain\">ChatLangChain<\/a> instructions but did need to make some changes to make it work with a different dataset.<\/p>\n\n\n\n<p>If you already have your data in a Notion database, <a href=\"https:\/\/github.com\/hwchase17\/notion-qa\">this tutorial<\/a> may be simpler to follow.<\/p>\n\n\n\n<p>You can try out LangChain&#8217;s <a href=\"https:\/\/chat.langchain.dev\/\">deployed chatbot here<\/a> \ud83e\udd9c.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Tools<\/h2>\n\n\n\n<p>I&#8217;m doing this on my local machine running OSX Ventura. Things will be a bit different on Windows \/ Linux.<\/p>\n\n\n\n<p>To get going you&#8217;ll want:<\/p>\n\n\n\n<ul>\n<li><a href=\"https:\/\/brew.sh\/\">Homebrew<\/a> package manager<\/li>\n\n\n\n<li><a href=\"https:\/\/openai.com\/api\/\">OpenAI developer account<\/a>. This comes with $18 free credit but you&#8217;ll probably want to add a credit card. I ended up spending about $65 in API tokens to get the first training working<\/li>\n\n\n\n<li><a href=\"https:\/\/www.freecodecamp.org\/news\/python-version-on-mac-update\/\">Python 3<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.geeksforgeeks.org\/how-to-install-pip-in-macos\/\">pip<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/langchain.readthedocs.io\/en\/latest\/\">LangChain<\/a><\/li>\n\n\n\n<li>Weaviate (the <a href=\"https:\/\/console.weaviate.io\/\">cloud service<\/a> is the simplest to get started with)<\/li>\n\n\n\n<li><code>wget<\/code> (can be installed with Homebrew)<\/li>\n\n\n\n<li>(optional) Some kind of API testing tool for managing the data stored in Weaviate. I use <a href=\"https:\/\/insomnia.rest\/\">Insomnia<\/a>.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Getting started<\/h2>\n\n\n\n<p>Create a directory to store everything and check out <a href=\"https:\/\/github.com\/hwchase17\/chat-langchain\">ChatLangChain<\/a> using<\/p>\n\n\n\n<p><code>git clone https:\/\/github.com\/hwchase17\/chat-langchain.git<\/code><\/p>\n\n\n\n<p>Switch into the directory and install the requirements using <\/p>\n\n\n\n<p><code>pip3 install -r requirements.txt &nbsp;<\/code><\/p>\n\n\n\n<p>Now we need to scrape our documentation. For this we use <code>wget<\/code>, which isn&#8217;t available on macs by default, but can be installed using<\/p>\n\n\n\n<p><code>brew install wget<\/code><\/p>\n\n\n\n<p>And then we can scrape the target URL using <\/p>\n\n\n\n<p><code>wget -r -A.html https:\/\/wpfusion.com\/documentation\/<\/code><\/p>\n\n\n\n<p>If everything works you should see your content saved to a bunch of .html files in subdirectories off of your project directory.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><a href=\"https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image.png\"><img decoding=\"async\" width=\"1024\" height=\"609\" src=\"https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-1024x609.png\" alt=\"\" class=\"wp-image-101\" srcset=\"https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-1024x609.png 1024w, https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-300x178.png 300w, https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-768x457.png 768w, https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-1536x914.png 1536w, https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-2048x1218.png 2048w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/a><\/figure>\n\n\n\n<p>The next step is ingesting the data.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Ingesting<\/h2>\n\n\n\n<p>The next step is to ingest the data into a vectorstore, in this case <a href=\"https:\/\/weaviate.io\/\">Weaviate<\/a>.<\/p>\n\n\n\n<p>I made a few modifications to the ChatLangChain ingest script. You can see the modified file on <a href=\"https:\/\/github.com\/verygoodplugins\/chat-langchain\/blob\/master\/ingest.py\">our forked version<\/a>.<\/p>\n\n\n\n<p>Notably:<\/p>\n\n\n\n<ol>\n<li>We use Elementor for our docs and blog content, so the BeautifulSoup HTML parser has been updated to look for any content inside of <code>div.elementor-widget-theme-post-content<\/code><\/li>\n\n\n\n<li>I&#8217;ve added error handling in <code>check_batch_result()<\/code> based on the <a href=\"https:\/\/weaviate.io\/developers\/weaviate\/client-libraries\/python#error-handling\">Weaviate docs<\/a><\/li>\n\n\n\n<li>The <code>Path()<\/code> command needs to be updated to point to the directory of your scraped HTML files<\/li>\n\n\n\n<li><code>.rglob(\"*\"):<\/code> was changed to <code>.rglob(\"*.html\"):<\/code> to exclude any non-HTML files (RSS feeds, etc)<\/li>\n\n\n\n<li><code>url = str(p).replace(\"index.html\", \"\")<\/code> removes the .html extension from the files before they are synced to Weaviate\u2014 since our documentation resources don&#8217;t end in .html, this avoids 404 errors<\/li>\n\n\n\n<li><code>client.schema.delete_class(\"Paragraph\")<\/code> will throw an error the first time you run the script since the <code>Paragraph<\/code> class doesn&#8217;t exist. I&#8217;ve updated this to <code>client.schema.delete_all()<\/code>. This means every time you run the script, the Weaviate data will be reset and re-ingested\n<ul>\n<li>Q: Can we somehow update this so new resources can be ingested without erasing the pervious data, while avoiding duplicates? \ud83e\udd14<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li>I changed the model from <code>ada<\/code> to <code>curie<\/code>. This should in theory give better results, but it is more expensive to ingest. For an overview of the models see <a href=\"https:\/\/platform.openai.com\/docs\/models\/overview\">the OpenAI docs<\/a>.<\/li>\n\n\n\n<li>Finally I set some batch parameters using <code>client.batch()<\/code>. I was running into API limits exceeded errors trying to sync all 2,095 objects at once. So this breaks them up into smaller chunks, and also assigns <code>check_batch_result<\/code> as the error handler. For more info see the <a href=\"https:\/\/weaviate.io\/developers\/weaviate\/client-libraries\/python#error-handling\">Weaviate Python docs<\/a>.<\/li>\n<\/ol>\n\n\n\n<p>First set your environment variables using<\/p>\n\n\n\n<p><code>export OPENAI_API_KEY=xxxx<\/code><\/p>\n\n\n\n<p><code>export WEAVIATE_URL=\"https:\/\/yyyy.weaviate.network\/\"<\/code><\/p>\n\n\n\n<p>And then run the ingest using<\/p>\n\n\n\n<p><code>python3 ingest.py<\/code><\/p>\n\n\n\n<p>If everything is working correctly, your HTML documents will be loaded, chunked, and sent to Weaviate in batches.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><a href=\"https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-1.png\"><img decoding=\"async\" width=\"1024\" height=\"486\" src=\"https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-1-1024x486.png\" alt=\"\" class=\"wp-image-102\" srcset=\"https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-1-1024x486.png 1024w, https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-1-300x142.png 300w, https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-1-768x365.png 768w, https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-1-1536x729.png 1536w, https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-1-2048x972.png 2048w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/a><\/figure>\n\n\n\n<p>To confirm everything worked, I like to load up the Weaviate objects endpoint in Insomnia just to check that the data is there and the URLs are correct:<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><a href=\"https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-2.png\"><img decoding=\"async\" width=\"1024\" height=\"652\" src=\"https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-2-1024x652.png\" alt=\"\" class=\"wp-image-103\" srcset=\"https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-2-1024x652.png 1024w, https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-2-300x191.png 300w, https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-2-768x489.png 768w, https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-2.png 1407w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/a><\/figure>\n\n\n\n<p><strong>Optional: <\/strong>You can add additional example questions and responses in the <code>ingest_examples.py<\/code> file and ingest those by running<\/p>\n\n\n\n<p><code>python3 ingest_examples.py<\/code><\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Customize the prompt<\/h2>\n\n\n\n<p>Finally, to get optimal answers, you should customize the prompt in the <code>chain.py<\/code> file.<\/p>\n\n\n\n<p>The <a href=\"https:\/\/blog.langchain.dev\/langchain-chat\/\">LangChain blog<\/a> has some info on how they engineered their prompt:<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">You are an AI assistant for the open source library LangChain. The documentation is located at https:\/\/langchain.readthedocs.io.\nYou are given the following extracted parts of a long document and a question. Provide a conversational answer with a hyperlink to the documentation.\nYou should only use hyperlinks that are explicitly listed as a source in the context. Do NOT make up a hyperlink that is not listed.\nIf the question includes a request for code, provide a code block directly from the documentation.\nIf you don't know the answer, just say \"Hmm, I'm not sure.\" Don't try to make up an answer.\nIf the question is not about LangChain, politely inform them that you are tuned to only answer questions about LangChain.\nQuestion: {question}\n=========\n{context}\n=========\nAnswer in Markdown:<\/pre>\n\n\n\n<p>For our purposes, we&#8217;ve just replaced the references to LangChain with WP Fusion, and left the rest the same.<\/p>\n\n\n\n<p>I may run some experiments with different prompts later \ud83d\udcdd<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Start a chat<\/h2>\n\n\n\n<p>Finally, you can start a chat with your model by running<\/p>\n\n\n\n<p><code>python3 app.py<\/code><\/p>\n\n\n\n<p>This will start a <a href=\"https:\/\/www.gradio.app\/\">Gradio server<\/a> running on your local machine, and give you the URL to connect to it. In my case it&#8217;s <code>http:\/\/127.0.0.1:7860<\/code><\/p>\n\n\n\n<p>Open the URL in your browser, paste in your OpenAI key, and start a chat. If everything is working, you should get a response. If not, check your console for any errors.<\/p>\n\n\n\n<p>To share the chat widget publicly, set <code>share=True<\/code> in the <code>launch()<\/code> function and Gradio will give you a public URL where others can try out your bot.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Examples<\/h2>\n\n\n\n<figure class=\"wp-block-image size-large\"><a href=\"https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-3.png\"><img decoding=\"async\" width=\"1024\" height=\"612\" src=\"https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-3-1024x612.png\" alt=\"\" class=\"wp-image-104\" srcset=\"https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-3-1024x612.png 1024w, https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-3-300x179.png 300w, https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-3-768x459.png 768w, https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-3-1536x918.png 1536w, https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-3-2048x1225.png 2048w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/a><\/figure>\n\n\n\n<p>Here we can see the bot has correctly understood WP Fusion&#8217;s features <a href=\"https:\/\/wpfusion.com\/documentation\/ecommerce\/woocommerce\/\">with regards to WooCommerce<\/a>, and can provide a code example from the docs for customizing which order statuses are synced with your CRM.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><a href=\"https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-8.png\"><img decoding=\"async\" width=\"1024\" height=\"418\" src=\"https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-8-1024x418.png\" alt=\"\" class=\"wp-image-113\" srcset=\"https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-8-1024x418.png 1024w, https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-8-300x123.png 300w, https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-8-768x314.png 768w, https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-8-1536x627.png 1536w, https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-8-2048x836.png 2048w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/a><\/figure>\n\n\n\n<p>Here the bot understands that WP Fusion has a <a href=\"https:\/\/wpfusion.com\/documentation\/membership\/paid-memberships-pro\/\">Paid Memberships Pro integration<\/a>, the available features, and also the ecommerce plugins that WP Fusion supports.<\/p>\n\n\n\n<p>It can suggest some basic strategies for using WP Fusion with an LMS, and provides steps for setting up the initial connection to HubSpot.<\/p>\n\n\n\n<p>Each reply links to the relevant page in the <a href=\"http:\/\/wpfusion.com\/documentation\/\">WP Fusion documentation<\/a>.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><a href=\"https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-4.png\"><img decoding=\"async\" width=\"1024\" height=\"416\" src=\"https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-4-1024x416.png\" alt=\"\" class=\"wp-image-106\" srcset=\"https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-4-1024x416.png 1024w, https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-4-300x122.png 300w, https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-4-768x312.png 768w, https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-4-1536x624.png 1536w, https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-4-2048x833.png 2048w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/a><\/figure>\n\n\n\n<p>The bot can understand the gist of a question and locate the relevant article.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><a href=\"https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-5.png\"><img decoding=\"async\" width=\"1024\" height=\"82\" src=\"https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-5-1024x82.png\" alt=\"\" class=\"wp-image-107\" srcset=\"https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-5-1024x82.png 1024w, https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-5-300x24.png 300w, https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-5-768x62.png 768w, https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-5.png 1472w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/a><\/figure>\n\n\n\n<p>When it can&#8217;t help, it provides contact information.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><a href=\"https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-6.png\"><img decoding=\"async\" width=\"1024\" height=\"244\" src=\"https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-6-1024x244.png\" alt=\"\" class=\"wp-image-108\" srcset=\"https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-6-1024x244.png 1024w, https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-6-300x71.png 300w, https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-6-768x183.png 768w, https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-6-1536x365.png 1536w, https:\/\/drunk.support\/wp-content\/uploads\/2023\/01\/image-6-2048x487.png 2048w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/a><\/figure>\n\n\n\n<p>The bot is <em>not<\/em> as good as ChatGPT at modifying an existing code snippet. While the answer here is correct, I would have preferred a complete example for the <code>pending<\/code> order status like in the previous prompt.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>I&#8217;ve been itching for a few weeks to try training a GPT3 chat bot on some of our WP Fusion support resources. We have over 400 pages of docs, 4,500 chat logs, and over 18,000 support tickets at our disposal, so there&#8217;s quite a bit of data. @gilgNYC&#8217;s tweet over the weekend about creating a [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":105,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_seopress_robots_primary_cat":"none","footnotes":""},"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/drunk.support\/wp-json\/wp\/v2\/posts\/99"}],"collection":[{"href":"https:\/\/drunk.support\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/drunk.support\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/drunk.support\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/drunk.support\/wp-json\/wp\/v2\/comments?post=99"}],"version-history":[{"count":10,"href":"https:\/\/drunk.support\/wp-json\/wp\/v2\/posts\/99\/revisions"}],"predecessor-version":[{"id":124,"href":"https:\/\/drunk.support\/wp-json\/wp\/v2\/posts\/99\/revisions\/124"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/drunk.support\/wp-json\/wp\/v2\/media\/105"}],"wp:attachment":[{"href":"https:\/\/drunk.support\/wp-json\/wp\/v2\/media?parent=99"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/drunk.support\/wp-json\/wp\/v2\/categories?post=99"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/drunk.support\/wp-json\/wp\/v2\/tags?post=99"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}