2024-11-12 15:32:14 +08:00
|
|
|
# Qwen2-VL deployment instances
|
|
|
|
|
|
|
|
# dependents
|
|
|
|
git+https://git.kaiyuancloud.cn/yumoqing/apppublic
|
|
|
|
git+https://git.kaiyuancloud.cn/yumoqing/ahserver
|
|
|
|
|
|
|
|
# preinstallation
|
|
|
|
first, create a new python virtual env
|
|
|
|
```
|
|
|
|
python3 -m venv ~/vl
|
|
|
|
```
|
|
|
|
create two shell scripts named vlpy and vlpip:
|
|
|
|
```vlpy
|
|
|
|
#!/usr/bin/bash
|
|
|
|
~/vl/bin/python $*
|
|
|
|
```
|
|
|
|
and
|
|
|
|
```vlpip
|
|
|
|
#!/usr/bin/bash
|
|
|
|
~/vl/bin/pip $*
|
|
|
|
```
|
|
|
|
and copy them to the bin under you $HOME folder, and chmod +x to them
|
|
|
|
```
|
|
|
|
mv vlpip vlpy ~/bin
|
|
|
|
chmod +x ~/bin/vl*
|
|
|
|
```
|
|
|
|
|
|
|
|
follow instuctions from [Qwen2-VL](https://github.com/QwenLM/Qwen2-VL), remember to change pip to vlpip
|
|
|
|
|
|
|
|
## isntallation
|
|
|
|
|
|
|
|
do the following
|
|
|
|
```
|
|
|
|
git clone https://git.kaiyauncloud.cn/yumoqing/qwenvl
|
|
|
|
cd qwenvl/script
|
|
|
|
sudo isntall.sh
|
|
|
|
```
|
|
|
|
|
|
|
|
## Change model or http port
|
|
|
|
there is a config.json file under qwenvl folder, change the "modelname" and "port" value to suite your requirements
|
|
|
|
|