夜莺采用vm数据源,写入数据时有WARNING,现象即解决方案 #1252
FengZh61
started this conversation in
Show and tell
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
技术路线:Prometheus主动抓取exporter数据,然后Prometheus remote write写入数据到n9e server,n9e server采用vm集群版做为持久化存储。
日志中产生warning告警
2022-11-03 19:25:45.896105 WARNING writer/writer.go:118 push data with remote write request got error: Post "http://192.168.159.133:8480/insert/0/prometheus/api/v1/write": read tcp 192.168.159.133:50207->192.168.159.133:8480: read: connection reset by peer, response body:
2022-11-03 19:25:45.896137 WARNING writer/writer.go:79 post to http://192.168.159.133:8480/insert/0/prometheus/api/v1/write got error: Post "http://192.168.159.133:8480/insert/0/prometheus/api/v1/write": read tcp 192.168.159.133:50207->192.168.159.133:8480: read: connection reset by peer
2022-11-03 19:25:45.896154 WARNING writer/writer.go:118 push data with remote write request got error: Post "http://192.168.159.133:8480/insert/0/prometheus/api/v1/write": read tcp 192.168.159.133:50163->192.168.159.133:8480: read: connection reset by peer, response body:
2022-11-03 19:25:45.896163 WARNING writer/writer.go:80 example timeseries:labels:<name:"name" value:"promhttp_metric_handler_requests_total" > labels:<name:"code" value:"200" > labels:<name:"hostname" value:"mydev01" > labels:<name:"ident" value:"192.168.159.133:9256" > labels:<name:"instance" value:"192.168.159.133:9256" > labels:<name:"ip" value:"192.168.159.133" > labels:<name:"job" value:"process_exporter" > samples:<value:2076 timestamp:1667474745895 >
2022-11-03 19:25:45.896166 WARNING writer/writer.go:79 post to http://192.168.159.133:8480/insert/0/prometheus/api/v1/write got error: Post "http://192.168.159.133:8480/insert/0/prometheus/api/v1/write": read tcp 192.168.159.133:50163->192.168.159.133:8480: read: connection reset by peer
2022-11-03 19:25:45.896182 WARNING writer/writer.go:80 example timeseries:labels:<name:"name" value:"node_memory_Inactive_bytes" > labels:<name:"hostname" value:"mydev01" > labels:<name:"ident" value:"192.168.159.133:9100" > labels:<name:"instance" value:"192.168.159.133:9100" > labels:<name:"ip" value:"192.168.159.133" > labels:<name:"job" value:"node_exporter" > samples:<value:1.746665472e+09 timestamp:1667474745895 >
2022-11-03 19:25:45.896190 WARNING writer/writer.go:118 push data with remote write request got error: Post "http://192.168.159.133:8480/insert/0/prometheus/api/v1/write": read tcp 192.168.159.133:50168->192.168.159.133:8480: read: connection reset by peer, response body:
2022-11-03 19:25:45.896196 WARNING writer/writer.go:79 post to http://192.168.159.133:8480/insert/0/prometheus/api/v1/write got error: Post "http://192.168.159.133:8480/insert/0/prometheus/api/v1/write": read tcp 192.168.159.133:50168->192.168.159.133:8480: read: connection reset by peer
2022-11-03 19:25:45.896206 WARNING writer/writer.go:80 example timeseries:labels:<name:"name" value:"node_memory_HugePages_Surp" > labels:<name:"hostname" value:"mydev01" > labels:<name:"ident" value:"192.168.159.133:9100" > labels:<name:"instance" value:"192.168.159.133:9100" > labels:<name:"ip" value:"192.168.159.133" > labels:<name:"job" value:"node_exporter" > samples:<timestamp:1667474745895 >
解决方法:vminsert启动参数中添加 -vmstorageDialTimeout=300s 修改从vminsert到vmstorage建立RPC连接的超时时间(默认为5s)。
Beta Was this translation helpful? Give feedback.
All reactions