Update README.md
Some checks failed
Build and Push Multi-Arch Docker Images / Build control-panel-backend (amd64) (push) Has been cancelled
Build and Push Multi-Arch Docker Images / Build control-panel-frontend (amd64) (push) Has been cancelled
Build and Push Multi-Arch Docker Images / Build resource-cluster (amd64) (push) Has been cancelled
Build and Push Multi-Arch Docker Images / Build tenant-app (amd64) (push) Has been cancelled
Build and Push Multi-Arch Docker Images / Build tenant-backend (amd64) (push) Has been cancelled
Build and Push Multi-Arch Docker Images / Build control-panel-backend (arm64) (push) Has been cancelled
Build and Push Multi-Arch Docker Images / Build control-panel-frontend (arm64) (push) Has been cancelled
Build and Push Multi-Arch Docker Images / Build resource-cluster (arm64) (push) Has been cancelled
Build and Push Multi-Arch Docker Images / Build tenant-app (arm64) (push) Has been cancelled
Build and Push Multi-Arch Docker Images / Build tenant-backend (arm64) (push) Has been cancelled
Build and Push Multi-Arch Docker Images / Create multi-arch manifest for control-panel-backend (push) Has been cancelled
Build and Push Multi-Arch Docker Images / Create multi-arch manifest for control-panel-frontend (push) Has been cancelled
Build and Push Multi-Arch Docker Images / Create multi-arch manifest for resource-cluster (push) Has been cancelled
Build and Push Multi-Arch Docker Images / Create multi-arch manifest for tenant-app (push) Has been cancelled
Build and Push Multi-Arch Docker Images / Create multi-arch manifest for tenant-backend (push) Has been cancelled
Some checks failed
Build and Push Multi-Arch Docker Images / Build control-panel-backend (amd64) (push) Has been cancelled
Build and Push Multi-Arch Docker Images / Build control-panel-frontend (amd64) (push) Has been cancelled
Build and Push Multi-Arch Docker Images / Build resource-cluster (amd64) (push) Has been cancelled
Build and Push Multi-Arch Docker Images / Build tenant-app (amd64) (push) Has been cancelled
Build and Push Multi-Arch Docker Images / Build tenant-backend (amd64) (push) Has been cancelled
Build and Push Multi-Arch Docker Images / Build control-panel-backend (arm64) (push) Has been cancelled
Build and Push Multi-Arch Docker Images / Build control-panel-frontend (arm64) (push) Has been cancelled
Build and Push Multi-Arch Docker Images / Build resource-cluster (arm64) (push) Has been cancelled
Build and Push Multi-Arch Docker Images / Build tenant-app (arm64) (push) Has been cancelled
Build and Push Multi-Arch Docker Images / Build tenant-backend (arm64) (push) Has been cancelled
Build and Push Multi-Arch Docker Images / Create multi-arch manifest for control-panel-backend (push) Has been cancelled
Build and Push Multi-Arch Docker Images / Create multi-arch manifest for control-panel-frontend (push) Has been cancelled
Build and Push Multi-Arch Docker Images / Create multi-arch manifest for resource-cluster (push) Has been cancelled
Build and Push Multi-Arch Docker Images / Create multi-arch manifest for tenant-app (push) Has been cancelled
Build and Push Multi-Arch Docker Images / Create multi-arch manifest for tenant-backend (push) Has been cancelled
This commit is contained in:
@@ -38,7 +38,7 @@ Note that the install scripts are unique for each OS and hardware architecture.
|
|||||||
Carefully choose the correct installation script for your host.
|
Carefully choose the correct installation script for your host.
|
||||||
|
|
||||||
## Embedding model GPU acceleration:
|
## Embedding model GPU acceleration:
|
||||||
NVIDIA GPU's and Apple Silicon will significantly accelerate embedding acceleration (uploading files and documents for Retrieval Augemented Generation "RAG").
|
NVIDIA GPU's will significantly accelerate embedding acceleration (uploading files and documents for Retrieval Augemented Generation "RAG").
|
||||||
As of release 2.0.34 the minimum GPU VRAM needed at installation time is 4GB as the embedding model installed is teh BAAI/bge-m3 which consumes around 3.78GB once fully loaded onto the GPU.
|
As of release 2.0.34 the minimum GPU VRAM needed at installation time is 4GB as the embedding model installed is teh BAAI/bge-m3 which consumes around 3.78GB once fully loaded onto the GPU.
|
||||||
We will be adjusting the installation scripts in future release so that smaller GPU's down to 1GB can be used on mini desktop computers.
|
We will be adjusting the installation scripts in future release so that smaller GPU's down to 1GB can be used on mini desktop computers.
|
||||||
|
|
||||||
|
|||||||
Reference in New Issue
Block a user