Run Your Own ChatGPT Alternatives with Chat with RTX and GPT4All

My latest video looks at ChatGPT alternatives that can be operated on personal computers, including PCs and Macs.

I first look at Nvidia’s Chat with RTX, a tool enabling users to run a ChatGPT-like chatbot locally. Chat with RTX only works with Nvidia’s newer 30 or 40 series GPUs, which could be a limitation for some users. I tested it on a Lenovo Legion 5 Pro (affiliate link) that had an RTX 4060 GPU on board. Disclosure: the laptop is on loan from Lenovo.

I then tried GPT4All, an alternative open-source large language model client that offers similar functionality to Chat with RTX but without the need for high-end GPU hardware. Like Chat with RTX, GPT4all is user-friendly, requiring minimal setup and no advanced developer tools. GPT4All is compatible with various operating systems, including Macs, Linux, and Windows, broadening its accessibility. However, for optimal performance, 16 GB of system RAM is recommended especially on Windows.

In testing these platforms, I observed that while these AI models are capable, they are not nearly as good as ChatGPT. My test involved having the AI’s summarize one of my prior video transcripts for a blog post. I found that they more often than not got the context of the video wrong and even made stuff up rather than adhering to the facts in the source text it was summarizing.

But this does show how fast AI technology is moving from large data centers into something that can be run locally on a laptop. I was particularly impressed with how fast and responsive GPT4All was on my M2 Macbook Air as compared to a Lenovo Thinkbook running with a 13th generation Intel processor.

Both chat clients allow the user to choose from a number of different large language models. Although I only looked at three of those models in the video, there are many more offered as a free download to explore. These models are being updated all the time so I’m sure we’ll see some rapid improvements as the year progresses.

ChatGPT Saves Me Time by Converting YouTube Transcripts to Blog Posts

I’ve been around for awhile in the tech media space so I’m always weary when the next new “shiny object” emerges on the scene. Google Glass, VR, crypto and NFTs were mega hyped by influencers only to fall way short when it came to mass consumer adoption.

Over the last several months the chattering influencer class has shifted focus almost entirely to artificial intelligence (AI) driven by the very rapid advancements in Large Language Model (LLM) chatbots like ChatGPT. I haven’t heard a peep about NFTs in months!

I approached this new technology with a healthy degree of skepticism. While it certainly has a “gee whiz” factor to it could it actually have some real utility in my day-to-day life?

I decided to pony up the $20 monthly subscription fee for ChatGPT Plus to see if it could save me some time and make my workflow more efficient. And surprisingly – it did. You can learn more in my latest video.

I’ve been using ChatGPT to help write these blog posts based on the transcripts of my YouTube videos for the last month or two. Last week ChatGPT became even more useful through the introduction of plugins that allow ChatGPT to perform tasks that go beyond its pre-existing knowledge cutoff of September, 2021.

One of the plugins I’ve been using is VoxScript, which can pull down full video transcripts from YouTube which the ChatGPT can use to produce summaries for this blog and my email newsletter.

Here’s how it works: I provide ChatGPT with the URL of my YouTube video and ask it to write a summary in the first person in a journalistic, neutral language style. ChatGPT uses VoxScript to pull down the full transcript from the video and starts writing the summary. The result is usually a well-written summary that captures the key points of the video, saving me about 30 minutes to an hour of writing time.

The AI does an impressive job of interpreting the automatically generated YouTube transcripts, even correcting inaccuracies and presenting the information in a coherent manner.

Of course, it’s not perfect, and I do have to tweak some parts to ensure it aligns with my voice and style. But overall, it can generate anywhere from 75-90% of the post depending on what the topic is. This post, for example, needed a little more work done to it by yours truly but the framework it provided was a great time saver.

As AI technology continues to evolve, I’m excited to see how it can further enhance productivity and efficiency in various fields. And AI is more than just chatbots. For example Tesla’s full self driving system is an artificial intelligence neural network running locally on their cars trained to drive a car.

As always, I’m interested in hearing about your experiences with AI. If you’ve found a practical use for AI that has improved your workflow definitely head over to YouTube and share your experiences in the comments section of the video.

Plex Amp Sonic Sage Adds ChatGPT AI Music Recommendations

In my latest video I dive into the world of AI-powered music discovery with the Plex Amp player and its new “Sonic Sage” feature. Sonic Sage uses ChatGPT to deliver playlist recommendations.

Here’s how it works: Sonic Sage interfaces with OpenAI’s GPT model. To get it running, you’ll need an API key from the OpenAI platform. There is a small cost for using this key but I’ve found it to be minimal. So far I’ve only racked up about 5 cents of cost for well over 20 queries.

Once you’ve enabled Sonic Sage, it lives right inside the search icon on your Plex Amp app. ChatGPT uses your queries to generate music recommendations. You can ask it for anything, from general genres to very specific prompts. For example, you could ask for “high energy, lesser-known female rockers from the last 20 years”, and Sonic Sage will whip up a playlist to match.

The AI’s recommendations are based on how you word your prompts. While it’s not perfect at always getting things right, it does a pretty solid job of delivering great music to match what you’re looking for. The only drawback I’ve noticed so far is that these AI-generated playlists can’t be saved, but I’m sure this could change in the future.

This feature works best with a very large personal library or with Tidal, a subscription music service that integrates with Plex and Plex Amp. Tidal costs $8.99 a month if you subscribe through Plex and delivers all of its music as CD quality lossless FLAC audio. I covered the Tidal integration in a previous video.

In my view, Sonic Sage adds an interesting new dimension to Plex Amp’s already awesome music discovery capabilities.