🙋 问题交流 - 图像识别不行

[isseluxx]

操作系统

Windows

Python 版本

3.10.11

AI Vtuber 版本

20240913

描述问题

图像识别不行，Gemini和智普AI，能补充一下吗？像 open ai 和开源 blip_image_captioning_large 来进行图像识别？感谢您所做的出色工作。
（抱歉，我正在使用翻译器的语言）

复现步骤

图像识别不行，Gemini和智普AI，能补充一下吗？像 open ai 和开源 blip_image_captioning_large 来进行图像识别？感谢您所做的出色工作。
（抱歉，我正在使用翻译器的语言）

期望的结果

No response

截图或日志

No response

[isseluxx]

log:`2024-09-27 15:01:51.206 | INFO | main:http_api_thread:256 - HTTP API线程已启动！
2024-09-27 15:48:28.050 | INFO | main:image_recognition_screenshot_and_send:6344 - 3.0后触发截图识别
2024-09-27 15:48:31.306 | INFO | utils.common:capture_window_by_title:1523 - 截图已保存到：D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\out\screenshots\Immersive Translate - Text Translation: One-click text translation, while comparing multiple translation services. - Google Chrome.png
2024-09-27 15:49:23.249 | ERROR | utils.gpt_model.gemini:get_resp_with_img:117 - Traceback (most recent call last):
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\grpc_helpers.py", line 79, in error_remapped_callable
return callable_(*args, **kwargs)
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\grpc_channel.py", line 1161, in call
return _end_unary_response_blocking(state, call, False, None)
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\grpc_channel.py", line 1004, in _end_unary_response_blocking
raise _InactiveRpcError(state) # pytype: disable=not-instantiable
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "failed to connect to all addresses; last error: UNAVAILABLE: ipv4:127.0.0.1:10809: Connection refused"
debug_error_string = "UNKNOWN:failed to connect to all addresses; last error: UNAVAILABLE: ipv4:127.0.0.1:10809: Connection refused {created_time:"2024-09-27T12:49:23.098599271+00:00", grpc_status:14}"

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\retry.py", line 207, in retry_target
result = target()
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\timeout.py", line 120, in func_with_timeout
return func(*args, **kwargs)
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\grpc_helpers.py", line 81, in error_remapped_callable
raise exceptions.from_grpc_error(exc) from exc
google.api_core.exceptions.ServiceUnavailable: 503 failed to connect to all addresses; last error: UNAVAILABLE: ipv4:127.0.0.1:10809: Connection refused

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\utils\gpt_model\gemini.py", line 103, in get_resp_with_img
response = model.generate_content(
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\generativeai\generative_models.py", line 243, in generate_content
response = self._client.generate_content(request)
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\ai\generativelanguage_v1beta\services\generative_service\client.py", line 566, in generate_content
response = rpc(
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\gapic_v1\method.py", line 131, in call
return wrapped_func(*args, **kwargs)
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\retry.py", line 372, in retry_wrapped_func
return retry_target(
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\retry.py", line 226, in retry_target
raise exceptions.RetryError(
google.api_core.exceptions.RetryError: Deadline of 60.0s exceeded while calling target function, last exception: 503 failed to connect to all addresses; last error: UNAVAILABLE: ipv4:127.0.0.1:10809: Connection refused

2024-09-27 15:49:25.408 | ERROR | utils.common:send_request:1234 - Traceback (most recent call last):
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\urllib3\connection.py", line 196, in _new_conn
sock = connection.create_connection(
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\urllib3\util\connection.py", line 85, in create_connection
raise err
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\urllib3\util\connection.py", line 73, in create_connection
sock.connect(sa)
ConnectionRefusedError: [WinError 10061] No connection could be made because the target machine actively refused it

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\urllib3\connectionpool.py", line 789, in urlopen
response = self._make_request(
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\urllib3\connectionpool.py", line 495, in _make_request
conn.request(
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\urllib3\connection.py", line 398, in request
self.endheaders()
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\http\client.py", line 1278, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\http\client.py", line 1038, in _send_output
self.send(msg)
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\http\client.py", line 976, in send
self.connect()
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\urllib3\connection.py", line 236, in connect
self.sock = self._new_conn()
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\urllib3\connection.py", line 211, in _new_conn
raise NewConnectionError(
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x000002263A8656F0>: Failed to establish a new connection: [WinError 10061] No connection could be made because the target machine actively refused it

The above exception was the direct cause of the following exception:

urllib3.exceptions.ProxyError: ('Unable to connect to proxy', NewConnectionError('<urllib3.connection.HTTPConnection object at 0x000002263A8656F0>: Failed to establish a new connection: [WinError 10061] No connection could be made because the target machine actively refused it'))

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\requests\adapters.py", line 667, in send
resp = conn.urlopen(
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\urllib3\connectionpool.py", line 843, in urlopen
retries = retries.increment(
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\urllib3\util\retry.py", line 519, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='127.0.0.1', port=10809): Max retries exceeded with url: http://127.0.0.1:8082/send (Caused by ProxyError('Unable to connect to proxy', NewConnectionError('<urllib3.connection.HTTPConnection object at 0x000002263A8656F0>: Failed to establish a new connection: [WinError 10061] No connection could be made because the target machine actively refused it')))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\utils\common.py", line 1216, in send_request
response = requests.post(url, headers=headers, data=json.dumps(json_data), timeout=timeout)
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\requests\api.py", line 115, in post
return request("post", url, data=data, json=json, **kwargs)
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\requests\api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\requests\sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\requests\sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\requests\adapters.py", line 694, in send
raise ProxyError(e, request=request)
requests.exceptions.ProxyError: HTTPConnectionPool(host='127.0.0.1', port=10809): Max retries exceeded with url: http://127.0.0.1:8082/send (Caused by ProxyError('Unable to connect to proxy', NewConnectionError('<urllib3.connection.HTTPConnection object at 0x000002263A8656F0>: Failed to establish a new connection: [WinError 10061] No connection could be made because the target machine actively refused it')))

2024-09-27 15:49:25.412 | ERROR | utils.common:send_request:1235 - 请求出错: HTTPConnectionPool(host='127.0.0.1', port=10809): Max retries exceeded with url: http://127.0.0.1:8082/send (Caused by ProxyError('Unable to connect to proxy', NewConnectionError('<urllib3.connection.HTTPConnection object at 0x000002263A8656F0>: Failed to establish a new connection: [WinError 10061] No connection could be made because the target machine actively refused it')))
`

[isseluxx]

[Ikaros-521]

log:`2024-09-27 15:01:51.206 | INFO | main:http_api_thread:256 - HTTP API线程已启动！ 2024-09-27 15:48:28.050 | INFO | main:image_recognition_screenshot_and_send:6344 - 3.0后触发截图识别 2024-09-27 15:48:31.306 | INFO | utils.common:capture_window_by_title:1523 - 截图已保存到：D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\out\screenshots\Immersive Translate - Text Translation: One-click text translation, while comparing multiple translation services. - Google Chrome.png 2024-09-27 15:49:23.249 | ERROR | utils.gpt_model.gemini:get_resp_with_img:117 - Traceback (most recent call last): File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\grpc_helpers.py", line 79, in error_remapped_callable return callable_(*args, **kwargs) File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\grpc_channel.py", line 1161, in call return _end_unary_response_blocking(state, call, False, None) File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\grpc_channel.py", line 1004, in _end_unary_response_blocking raise _InactiveRpcError(state) # pytype: disable=not-instantiable grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with: status = StatusCode.UNAVAILABLE details = "failed to connect to all addresses; last error: UNAVAILABLE: ipv4:127.0.0.1:10809: Connection refused" debug_error_string = "UNKNOWN:failed to connect to all addresses; last error: UNAVAILABLE: ipv4:127.0.0.1:10809: Connection refused {created_time:"2024-09-27T12:49:23.098599271+00:00", grpc_status:14}"

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\retry.py", line 207, in retry_target result = target() File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\timeout.py", line 120, in func_with_timeout return func(*args, **kwargs) File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\grpc_helpers.py", line 81, in error_remapped_callable raise exceptions.from_grpc_error(exc) from exc google.api_core.exceptions.ServiceUnavailable: 503 failed to connect to all addresses; last error: UNAVAILABLE: ipv4:127.0.0.1:10809: Connection refused

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\utils\gpt_model\gemini.py", line 103, in get_resp_with_img response = model.generate_content( File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\generativeai\generative_models.py", line 243, in generate_content response = self._client.generate_content(request) File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\ai\generativelanguage_v1beta\services\generative_service\client.py", line 566, in generate_content response = rpc( File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\gapic_v1\method.py", line 131, in call return wrapped_func(*args, **kwargs) File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\retry.py", line 372, in retry_wrapped_func return retry_target( File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\retry.py", line 226, in retry_target raise exceptions.RetryError( google.api_core.exceptions.RetryError: Deadline of 60.0s exceeded while calling target function, last exception: 503 failed to connect to all addresses; last error: UNAVAILABLE: ipv4:127.0.0.1:10809: Connection refused

2024-09-27 15:49:25.408 | ERROR | utils.common:send_request:1234 - Traceback (most recent call last): File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\urllib3\connection.py", line 196, in _new_conn sock = connection.create_connection( File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\urllib3\util\connection.py", line 85, in create_connection raise err File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\urllib3\util\connection.py", line 73, in create_connection sock.connect(sa) ConnectionRefusedError: [WinError 10061] No connection could be made because the target machine actively refused it

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\urllib3\connectionpool.py", line 789, in urlopen response = self._make_request( File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\urllib3\connectionpool.py", line 495, in _make_request conn.request( File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\urllib3\connection.py", line 398, in request self.endheaders() File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\http\client.py", line 1278, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\http\client.py", line 1038, in _send_output self.send(msg) File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\http\client.py", line 976, in send self.connect() File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\urllib3\connection.py", line 236, in connect self.sock = self._new_conn() File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\urllib3\connection.py", line 211, in _new_conn raise NewConnectionError( urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x000002263A8656F0>: Failed to establish a new connection: [WinError 10061] No connection could be made because the target machine actively refused it

The above exception was the direct cause of the following exception:

urllib3.exceptions.ProxyError: ('Unable to connect to proxy', NewConnectionError('<urllib3.connection.HTTPConnection object at 0x000002263A8656F0>: Failed to establish a new connection: [WinError 10061] No connection could be made because the target machine actively refused it'))

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\requests\adapters.py", line 667, in send resp = conn.urlopen( File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\urllib3\connectionpool.py", line 843, in urlopen retries = retries.increment( File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\urllib3\util\retry.py", line 519, in increment raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type] urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='127.0.0.1', port=10809): Max retries exceeded with url: http://127.0.0.1:8082/send (Caused by ProxyError('Unable to connect to proxy', NewConnectionError('<urllib3.connection.HTTPConnection object at 0x000002263A8656F0>: Failed to establish a new connection: [WinError 10061] No connection could be made because the target machine actively refused it')))

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\utils\common.py", line 1216, in send_request response = requests.post(url, headers=headers, data=json.dumps(json_data), timeout=timeout) File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\requests\api.py", line 115, in post return request("post", url, data=data, json=json, **kwargs) File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\requests\api.py", line 59, in request return session.request(method=method, url=url, **kwargs) File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\requests\sessions.py", line 589, in request resp = self.send(prep, **send_kwargs) File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\requests\sessions.py", line 703, in send r = adapter.send(request, **kwargs) File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\requests\adapters.py", line 694, in send raise ProxyError(e, request=request) requests.exceptions.ProxyError: HTTPConnectionPool(host='127.0.0.1', port=10809): Max retries exceeded with url: http://127.0.0.1:8082/send (Caused by ProxyError('Unable to connect to proxy', NewConnectionError('<urllib3.connection.HTTPConnection object at 0x000002263A8656F0>: Failed to establish a new connection: [WinError 10061] No connection could be made because the target machine actively refused it')))

2024-09-27 15:49:25.412 | ERROR | utils.common:send_request:1235 - 请求出错: HTTPConnectionPool(host='127.0.0.1', port=10809): Max retries exceeded with url: http://127.0.0.1:8082/send (Caused by ProxyError('Unable to connect to proxy', NewConnectionError('<urllib3.connection.HTTPConnection object at 0x000002263A8656F0>: Failed to establish a new connection: [WinError 10061] No connection could be made because the target machine actively refused it'))) `

谷歌代理连接失败

google.api_core.exceptions.RetryError: Deadline of 60.0s exceeded while calling target function, last exception: 503 failed to connect to all addresses; last error: UNAVAILABLE: ipv4:127.0.0.1:10809: Connection refused

[Ikaros-521]

Caused by ProxyError('Unable to connect to proxy', NewConnectionError('<urllib3.connection.HTTPConnection object at 0x000002263A8656F0>: Failed to establish a new connection: [WinError 10061] No connection could be made because the target machine actively refused it'

你确定你开了代理 并且端口正确吗

[isseluxx]

感谢您回答我的问题，我尝试了这个代理：http://guardian-antenna-finish-sublime.trycloudflare.com，但我遇到了这个问题，日志：`2024-09-27 16:23:26.108 | INFO | main:image_recognition_screenshot_and_send:6344 - 3.0后触发截图识别
2024-09-27 16:23:29.285 | INFO | utils.common:capture_window_by_title:1523 - 截图已保存到：D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\out\screenshots\bad adcens ip.png ‎- Photos.png
2024-09-27 16:24:24.000 | ERROR | utils.gpt_model.gemini:get_resp_with_img:117 - Traceback (most recent call last):
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\grpc_helpers.py", line 79, in error_remapped_callable
return callable_(*args, **kwargs)
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\grpc_channel.py", line 1161, in call
return _end_unary_response_blocking(state, call, False, None)
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\grpc_channel.py", line 1004, in _end_unary_response_blocking
raise _InactiveRpcError(state) # pytype: disable=not-instantiable
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "failed to connect to all addresses; last error: UNKNOWN: ipv4:104.16.231.132:443: HTTP proxy returned response code 400"
debug_error_string = "UNKNOWN:failed to connect to all addresses; last error: UNKNOWN: ipv4:104.16.231.132:443: HTTP proxy returned response code 400 {grpc_status:14, created_time:"2024-09-27T13:24:23.99744159+00:00"}"

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\retry.py", line 207, in retry_target
result = target()
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\timeout.py", line 120, in func_with_timeout
return func(*args, **kwargs)
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\grpc_helpers.py", line 81, in error_remapped_callable
raise exceptions.from_grpc_error(exc) from exc
google.api_core.exceptions.ServiceUnavailable: 503 failed to connect to all addresses; last error: UNKNOWN: ipv4:104.16.231.132:443: HTTP proxy returned response code 400

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\utils\gpt_model\gemini.py", line 103, in get_resp_with_img
response = model.generate_content(
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\generativeai\generative_models.py", line 243, in generate_content
response = self._client.generate_content(request)
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\ai\generativelanguage_v1beta\services\generative_service\client.py", line 566, in generate_content
response = rpc(
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\gapic_v1\method.py", line 131, in call
return wrapped_func(*args, **kwargs)
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\retry.py", line 372, in retry_wrapped_func
return retry_target(
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\retry.py", line 226, in retry_target
raise exceptions.RetryError(
google.api_core.exceptions.RetryError: Deadline of 60.0s exceeded while calling target function, last exception: 503 failed to connect to all addresses; last error: UNKNOWN: ipv4:104.16.231.132:443: HTTP proxy returned response code 400

2024-09-27 16:24:24.221 | ERROR | utils.common:send_request:1234 - Traceback (most recent call last):
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\utils\common.py", line 1221, in send_request
response.raise_for_status()
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\requests\models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: http://127.0.0.1:8082/send

2024-09-27 16:24:24.227 | ERROR | utils.common:send_request:1235 - 请求出错: 403 Client Error: Forbidden for url: http://127.0.0.1:8082/send
`

[isseluxx]

如果您可以添加 blip_image_captioning_large 或/和 OpenAI，那就太好了

[Ikaros-521]

感谢您回答我的问题，我尝试了这个代理：http://guardian-antenna-finish-sublime.trycloudflare.com，但我遇到了这个问题，日志：`2024-09-27 16:23:26.108 | INFO | main:image_recognition_screenshot_and_send:6344 - 3.0后触发截图识别 2024-09-27 16:23:29.285 | INFO | utils.common:capture_window_by_title:1523 - 截图已保存到：D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\out\screenshots\bad adcens ip.png ‎- Photos.png 2024-09-27 16:24:24.000 | ERROR | utils.gpt_model.gemini:get_resp_with_img:117 - Traceback (most recent call last): File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\grpc_helpers.py", line 79, in error_remapped_callable return callable_(*args, **kwargs) File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\grpc_channel.py", line 1161, in call return _end_unary_response_blocking(state, call, False, None) File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\grpc_channel.py", line 1004, in _end_unary_response_blocking raise _InactiveRpcError(state) # pytype: disable=not-instantiable grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with: status = StatusCode.UNAVAILABLE details = "failed to connect to all addresses; last error: UNKNOWN: ipv4:104.16.231.132:443: HTTP proxy returned response code 400" debug_error_string = "UNKNOWN:failed to connect to all addresses; last error: UNKNOWN: ipv4:104.16.231.132:443: HTTP proxy returned response code 400 {grpc_status:14, created_time:"2024-09-27T13:24:23.99744159+00:00"}"

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\retry.py", line 207, in retry_target result = target() File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\timeout.py", line 120, in func_with_timeout return func(*args, **kwargs) File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\grpc_helpers.py", line 81, in error_remapped_callable raise exceptions.from_grpc_error(exc) from exc google.api_core.exceptions.ServiceUnavailable: 503 failed to connect to all addresses; last error: UNKNOWN: ipv4:104.16.231.132:443: HTTP proxy returned response code 400

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\utils\gpt_model\gemini.py", line 103, in get_resp_with_img response = model.generate_content( File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\generativeai\generative_models.py", line 243, in generate_content response = self._client.generate_content(request) File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\ai\generativelanguage_v1beta\services\generative_service\client.py", line 566, in generate_content response = rpc( File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\gapic_v1\method.py", line 131, in call return wrapped_func(*args, **kwargs) File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\retry.py", line 372, in retry_wrapped_func return retry_target( File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\retry.py", line 226, in retry_target raise exceptions.RetryError( google.api_core.exceptions.RetryError: Deadline of 60.0s exceeded while calling target function, last exception: 503 failed to connect to all addresses; last error: UNKNOWN: ipv4:104.16.231.132:443: HTTP proxy returned response code 400

2024-09-27 16:24:24.221 | ERROR | utils.common:send_request:1234 - Traceback (most recent call last): File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\utils\common.py", line 1221, in send_request response.raise_for_status() File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\requests\models.py", line 1024, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: http://127.0.0.1:8082/send

2024-09-27 16:24:24.227 | ERROR | utils.common:send_request:1235 - 请求出错: 403 Client Error: Forbidden for url: http://127.0.0.1:8082/send `

代理不能代理 localhost，8082是程序内部HTTP服务，代理影响了数据发送
The proxy cannot proxy localhost, and 8082 is an internal HTTP service of the program. The proxy has affected the data transmission

[Ikaros-521]

如果您可以添加 blip_image_captioning_large 或/和 OpenAI，那就太好了

OpenAI 没有密钥（没经费），blip_image_captioning_large 没听说过，有空的话可以看看
OpenAI has no key (no budget), and I haven't heard of blip_image_captioning_large; if you have time, you can check it out

[isseluxx]

谢谢你的回答，我不知道 Gemini 代理是如何工作的，如何在启动 (1.双击我启动程序.bat) 之前启动代理？
（127.0.0.1:10809） 是默认代理，我该如何运行它？

[Ikaros-521]

谢谢你的回答，我不知道 Gemini 代理是如何工作的，如何在启动 (1.双击我启动程序.bat) 之前启动代理？ （127.0.0.1:10809） 是默认代理，我该如何运行它？

如果你是在国外 可以直接访问gemini api，那就不需要启动代理。在“聊天”模式下，一键运行程序，然后再进行 摄像头识别操作
If you are abroad and can directly access the Gemini API, then there is no need to start the proxy. In 'chat' mode, run the program with one click, and then proceed with the camera recognition operation

[isseluxx]

是的，我来自国外，可以直接访问 Gemini API，但是当我一键运行程序并尝试运行图像识别时，我遇到了第一个问题。

[Ikaros-521]

是的，我来自国外，可以直接访问 Gemini API，但是当我一键运行程序并尝试运行图像识别时，我遇到了第一个问题。

第一个问题日志说明 并没有关闭代理，导致请求发送失败，配置修改后需要保存重启
The first issue in the log indicates that the proxy was not turned off, which led to a request sending failure. After modifying the configuration, it needs to be saved and the system restarted

[isseluxx]

我应该删除 （127.0.0.1:10809） 并将其留空吗？
关闭代理？

[isseluxx]

log: `2024-09-27 17:16:37.333 | INFO | utils.common:capture_window_by_title:1523 - 截图已保存到：D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\out\screenshots\Channel content - YouTube Studio - Opera.png
2024-09-27 17:16:39.729 | ERROR | utils.gpt_model.gemini:get_resp_with_img:117 - Traceback (most recent call last):
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\grpc_helpers.py", line 79, in error_remapped_callable
return callable_(*args, **kwargs)
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\grpc_channel.py", line 1161, in call
return _end_unary_response_blocking(state, call, False, None)
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\grpc_channel.py", line 1004, in _end_unary_response_blocking
raise _InactiveRpcError(state) # pytype: disable=not-instantiable
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.NOT_FOUND
details = "Gemini 1.0 Pro Vision has been deprecated on July 12, 2024. Consider switching to different model, for example gemini-1.5-flash."
debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B2a00:1450:4006:800::200a%5D:443 {grpc_message:"Gemini 1.0 Pro Vision has been deprecated on July 12, 2024. Consider switching to different model, for example gemini-1.5-flash.", grpc_status:5, created_time:"2024-09-27T14:16:39.714903561+00:00"}"

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\utils\gpt_model\gemini.py", line 103, in get_resp_with_img
response = model.generate_content(
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\generativeai\generative_models.py", line 243, in generate_content
response = self._client.generate_content(request)
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\ai\generativelanguage_v1beta\services\generative_service\client.py", line 566, in generate_content
response = rpc(
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\gapic_v1\method.py", line 131, in call
return wrapped_func(*args, **kwargs)
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\retry.py", line 372, in retry_wrapped_func
return retry_target(
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\retry.py", line 207, in retry_target
result = target()
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\timeout.py", line 120, in func_with_timeout
return func(*args, **kwargs)
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\google\api_core\grpc_helpers.py", line 81, in error_remapped_callable
raise exceptions.from_grpc_error(exc) from exc
google.api_core.exceptions.NotFound: 404 Gemini 1.0 Pro Vision has been deprecated on July 12, 2024. Consider switching to different model, for example gemini-1.5-flash.

2024-09-27 17:16:39.780 | ERROR | utils.common:send_request:1234 - Traceback (most recent call last):
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\utils\common.py", line 1221, in send_request
response.raise_for_status()
File "D:\AiRina\AI-Vtuber-20240913\AI-Vtuber-20240913\Miniconda3\lib\site-packages\requests\models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 422 Client Error: Unprocessable Entity for url: http://127.0.0.1:8082/send

2024-09-27 17:16:39.790 | ERROR | utils.common:send_request:1235 - 请求出错: 422 Client Error: Unprocessable Entity for url: http://127.0.0.1:8082/send`