Using Ollama from the command line allows you to take advantage of LLM from within your programs and shells. This environment assumes that ollama is installed with Docker. Access ollama via CLI Check which model is installed. Models that are not installed will be downloaded automatically when you run the command, but you can also […]
Edit /etc/wsl.conf in the WSL2: Add these lines (i.e. changing hostname to “PC”). generateHosts = false to disable WSL to auto generate /etc/hosts. Edit /etc/hosts to match with the configured hostname. Close all WSL terminals, and open a Command Prompt (not WSL terminal). Note: shutdown nor reboot won’t work on WSL: Open a WSL terminal, […]
Install Visual Studio Code (VS Code) Install Visual Studio Code and Windows Terminal from the Microsoft Store. Install WSL2 and Ubuntu Open PowerShell and run the following command to install WSL2 and Ubuntu: Update Ubuntu and Install Required Packages Launch WSL2 Ubuntu terminal and update the system. Then, install the required Python packages: Configure Visual […]
Install Ollama and Open WebUI Stop and remove all containers which are already running. Ollama Docker to run with NVIDIA GPU (–gpus=all) You might see these errors. If see above errors, remove all containers as below and run again. Open WebUI Docker Run WebUI docker. Open this URL, add a model such as “phi3” Chooose […]
You may encounter these errors when integrating Ollama with Dify. This may happen if you install Dify and Ollama in separate Docker Compose setups. To avoid this error, ollama, and dify can be in the same docker component, so dify can simply access to ollama with, Install Dify Clone Dify Confirm to run containers Wait […]
Install NVIDIA Driver Disable Nouveau which conflicts with NVIDIA drivers, and may affect the GPU running reliability, so it should be disabled before using NVIDIA GPUs. Create the file and include these lines. Execute it Confirm the installed GPU model Remove installed nvidia and cuda drivers Confirm the recommended driver Install driver Reboot Confirm Install […]
Install Windows Terminal on Microsoft Store Multiple tabs are supported in Windows Terminal, so it is recommend to install it from the Microsoft Store. Change Settings -> Startup -> Default terminal application to “Windows Terminal” instead of “Windows Console Host” Install WSL2 Skip to next if your environment is not on WSL2. Open a PowerShell […]
Run a Container Run a Container in Detached Mode (Background) List Running Containers List Containers (including stopped ones) Start a Container Stop a Container Remove a stopped Container List Images Pull an Image from Docker Hub Remove an Image View Logs of a Running Container Log into a Running Container (-it=interactive, tty) Execute a command […]
You can resize the root partition on Ubuntu by booting from the installation disk (a live USB) and using a partition editor like gparted, which is available in the live environment, to adjust the size of your root partition directly on your system disk Click “Apply All Operations”