FreeAskInternet: Free, Private LLM Search & Answers – No GPU

FreeAskInternet is a completely free, private, and locally-run search aggregator and answer generator that harnesses the power of Language Model (LLM) technology without requiring GPU support.

Users can ask questions, and the system will perform multi-engine searches, combine the search results with the ChatGPT3.5 language model, and generate answers based on those search results.

Key Features

Completely Free (No API Keys Required)

FreeAskInternet is entirely free to use, with no need for any API keys.

Fully Local (No GPU Needed, Runs on Any Computer)

The system runs completely locally, eliminating the need for a GPU. It can be used on any computer.

Totally Private (All Processes Run Locally)

All processes are executed locally, ensuring complete privacy for the user.

No LLM Hardware Support Required (No GPU!)

FreeAskInternet does not require any LLM hardware support or a GPU to function.

Utilizes Free ChatGPT3.5 API (No API Key Needed!)

The system leverages the free ChatGPT3.5 API, eliminating the need for an API key. Thanks to OpenAI for making this possible!

Quick and Easy Deployment with Docker Compose

FreeAskInternet can be quickly and easily deployed using Docker Compose.

User-Friendly Web and Mobile Interface

The system features a web and mobile-friendly interface, allowing easy access from any device. Thanks to ChatGPT-Next-Web for this functionality.

How It Works

1. The system obtains the user’s question input in ChatGPT-Next-Web (running locally) and performs searches on multiple search engines via searxng (also running locally).
2. It crawls the content of the search result links and passes it to ChatGPT3.5 (using OpenAI’s ChatGPT3.5 via the locally-run FreeGPT35), requesting ChatGPT3.5 to answer the question based on the provided content as reference.
3. The answer is then streamed to the ChatGPT-Next-Web chat interface.

Usage Instructions

Clone the Project Locally

1. Clone the project to your local machine:

git clone https://github.com/nashsu/FreeAskInternet.git

2. Navigate to the project directory:

cd ./FreeAskInternet

Start the Service with Docker Compose

Run the following command to start the service:

docker-compose up -d

After starting, you can open the web interface at http://localhost:3000.

Updating to the Latest Version

1. Navigate to the project directory:

cd ./FreeAskInternet

2. Pull the latest code:

git pull

3. Remove the backend service and image:

docker compose rm backend
docker image rm nashsu/free_ask_internet

4. Restart the service:

docker-compose up -d

Conclusion

FreeAskInternet is a completely free, private, and locally-run search aggregator and answer generator. Users can ask questions, and the system will perform multi-engine searches, combining the search results with the ChatGPT3.5 language model to generate answers based on those results.

Please note that this project is still in its early stages and may contain some errors.

Note: The content of this article is for reference only. For the latest project features, please refer to the official GitHub page.