Using Ollama from the command line allows you to take advantage of LLM from within your programs and shells. This environment assumes that ollama is installed with Docker. Access ollama via CLI Check which model is installed. Models that are not installed will be downloaded automatically when you run the command, but you can also […]
Install Ollama and Open WebUI Stop and remove all containers which are already running. Ollama Docker to run with NVIDIA GPU (–gpus=all) You might see these errors. If see above errors, remove all containers as below and run again. Open WebUI Docker Run WebUI docker. Open this URL, add a model such as “phi3” Chooose […]
You may encounter these errors when integrating Ollama with Dify. This may happen if you install Dify and Ollama in separate Docker Compose setups. To avoid this error, ollama, and dify can be in the same docker component, so dify can simply access to ollama with, Install Dify Clone Dify Confirm to run containers Wait […]
Install NVIDIA Driver Disable Nouveau which conflicts with NVIDIA drivers, and may affect the GPU running reliability, so it should be disabled before using NVIDIA GPUs. Create the file and include these lines. Execute it Confirm the installed GPU model Remove installed nvidia and cuda drivers Confirm the recommended driver Install driver Reboot Confirm Install […]
Run a Container Run a Container in Detached Mode (Background) List Running Containers List Containers (including stopped ones) Start a Container Stop a Container Remove a stopped Container List Images Pull an Image from Docker Hub Remove an Image View Logs of a Running Container Log into a Running Container (-it=interactive, tty) Execute a command […]