use federate got error: append failed expected label name got invalid

[tanxiao1990]

What did you do?

When using the prometheus federation method to collect other prometheus instances, 1 of them reports an error ,else all fine

when i delete the params: 'match[]': Configuration item ,it work fine ,but nothing will be collected

What did you expect to see?

collect success

What did you see instead? Under which circumstances?

System information

centos7.4

Prometheus version

2.40.7

Prometheus configuration file

- job_name: 'federate'
    scrape_interval: 60s
    scrape_timeout: 40s
    honor_labels: true
    honor_timestamps: true
    metrics_path: '/federate'
    params:
      'match[]':
        - '{job="cadvisor"}'
        - '{job="etcd"}'
        - '{job="kube-apiserver"}'
        - '{job="kube-scheduler"}'
        - '{job="kube-state-metrics"}'
        - '{job="kubelet"}'        
    static_configs:
      - targets:
        - '192.168.1.1:30006'

Alertmanager version

No response

Alertmanager configuration file

No response

Logs

No response

[tanxiao1990]

The version of the prometheus instance I'm trying to collect is 2.39.1

[tanxiao1990]

I think I found the problem. The data returned by this prometheus instance in version 2.39.1 has tag names starting with a number, but why does that happen? How is such an indicator stored into that instance?
Here is the information and returned data for this instance from version 2.39.1

[roidelapluie]

This might come from an invalid relabel configuration.

[tanxiao1990]

For testing purposes, I removed the relabel-related configuration, which can be seen in my screenshot at the beginning. And, what puzzles me the most is why the federal sub-instance metrics with label names starting with numbers can be included in tsdb as much as possible?

[tanxiao1990]

I think this is a bug, because the sub-instance should have reported an error when it was collected, and it should not have been entered into tsdb, much less return such error data to the central node of the federation when it was collected