Setup and installation of 'Instant RAGFlow: Ready-to-Use AI Knowledge Retrieval Engine' on AWS

This section describes how to launch and connect to ‘Instant RAGFlow: Ready-to-Use AI Knowledge Retrieval Engine’ VM solution on AWS.

1. Open Instant RAGFlow: Ready-to-Use AI Knowledge Retrieval Engine VM listing on AWS marketplace.

2. Click on View purchase options.

• Login with your credentials and follow the instruction.
• Review the prices and subscribe to the product by clicking on subscribe button located at the bottom of this page. Once you are subscribed to the offer, click on Launch your software button.

• Next page will show you the options to launch the instance, Launch through EC2 and One-click launch from AWS Marketplace. Tick the 2nd option One-click launch from AWS Marketplace.

• Select a Region where you want to launch the VM(such as US East (N.Virginia))

• Optionally change the EC2 instance type. (This defaults to t2.xlarge instance type, 4 vCPUs and 16 GB RAM.)

• Optionally change the network name and subnetwork names.

Minimum VM Specs : 16GB Memory /4vCPU

Please note that the VM can also be deployed using NVIDIA GPU instance. If you want to deploy this instance with GPU configuration then Please choose NVIDIA GPU (e.g g4dn.xlarge) or check the available NVIDIA GPU instances on AWS documentation page.

• Select the Security Group. Be sure that whichever Security Group you specify have ports 22 (for SSH), 3389 (for RDP) and 443 (for HTTPS) exposed. Or you can create the new SG by clicking on “Create Security Group” button. Provide the name and description and save the SG for this instance.

• Be sure to download the key-pair which is available by default, or you can create the new key-pair and download it.

• Click on Launch..

• Instant RAGFlow: Ready-to-Use AI Knowledge Retrieval Engine will begin deploying.

3. A summary page displays. To see this instance on EC2 Console click on View instance on EC2 link.

4. To connect to this instance through putty, copy the IPv4 Public IP Address from the VM’s details page.

5. Open putty, paste the IP address and browse your private key you downloaded while deploying the VM, by going to SSH->Auth->Credentials, click on Open. Enter ubuntu as userid

6. Once connected, change the password for ubuntu user using below command

sudo passwd ubuntu

7. Now the password for ubuntu user is set, you can connect to the VM’s desktop environment from any local Windows Machine using RDP protocol or Linux Machine using Remmina.

From your local windows machine, goto “start” menu, in the search box type and select “Remote desktop connection”. In the “Remote Desktop connection” wizard, copy the public IP address and click connect

8. This will connect you to the VM’s desktop environment. Provide the username “ubuntu” and the password set in the above “Reset password” step to authenticate. Click OK

9. Now you are connected to the out of box Instant RAGFlow: Ready-to-Use AI Knowledge Retrieval Engine VM’s desktop environment via Windows Machine.

10. To connect using RDP via Linux machine, first note the external IP of the VM from VM details page, then from your local Linux machine, goto menu, in the search box type and select “Remmina”.

Note: If you don’t have Remmina installed on your Linux machine, first Install Remmina as per your linux distribution.

11. In the “Remmina Remote Desktop Client” wizard, select the RDP option from dropdown and paste the external ip and click enter.

12. This will connect you to the VM’s desktop environment. Provide “ubuntu” as the userid and the password set in above reset password step to authenticate. Click OK

13. Now you are connected to out of box Instant RAGFlow: Ready-to-Use AI Knowledge Retrieval Engine VM’s desktop environment via Linux machine.

14. After VM deployment it takes “7-10 minutes” to complete the RAGFlow initial setup. To monitor the init process run below command from SSH terminal. Once you see “Completed executing peronce script” in the below tail command output, you are good to go.

tail -f /var/log/cloud-init-output.log

15. Copy the Public IP address of the VM. Paste it into the address bar of your local browser as https://public_ip_of_vm. Make sure to use https and not http. When you access the page, your browser will display a security certificate warning. In Firefox, click on the Advanced button, then select Accept the Risk and Continue. In other browsers as well , simply proceed past the warning by accepting or continuing to the site.

16. For the first time, you will need to register new account here. Click on “Sign Up”" link at the bottom. Provide your details and create a new account. Once created, log in with new registered account now.

17. This is RAGFlow Home Page where you will see various options to explore.

18. Before using RAGFlow, you need to configure an LLM provider. The VM comes pre-installed with Ollama LLMs, making it easy to get started right away.

To add Ollama LLMs and begin using RAGFlow’s Chat, Search, or Agent features, please visit the How to use Ragflow Page.

For more details, please visit Official Documentation page