• 1 Post
  • 13 Comments
Joined 1 year ago
cake
Cake day: July 6th, 2023

help-circle

  • AWS has multiple teirs of storage options in s3, some replicate and some dont. by default those that do replicate do so in multiple availability zones, but not across regions. unless you turn on cross-region replication (CRR) which is an additional charge.

    So, for example without CRR if your bucket is in us-east-1 and 1 availability zone goes down you can still access the data, but if all of us-east-1 is down, you cannot.







  • There is one extra step. I have an 6700xt, and with the docker containers, you just have to pass the environment variable HSA_OVERRIDE_GFX_VERSION=10.3.0 to allow that card to work. For cards other than 6000 series, you would need to look up the version to pass for your generation.

    Here’s an example compose file that I use for ollama that runs ai models on my 6700xt.

    version: '3'
    services:
      ollama:
        image: ollama/ollama:rocm
        container_name: ollama
        devices:
          - /dev/kfd:/dev/kfd
          - /dev/dri:/dev/dri
        group_add:
          - video
        ports:
          - "11434:11434"
        environment:
          - HSA_OVERRIDE_GFX_VERSION=10.3.0
        volumes:
          - ollama_data:/root/.ollama
    
    volumes:
      ollama_data: