Sometimes the function page. Waitforxpath() does not detect the DOM that already exists

[aixinalei]

I use puppeter to collect a website，I'll loop collect a lot of pages。
It was normal at the beginning，After collecting many pages of data，the function page.waitforxpath() does not detect the DOM that already exists.and throw error, such as:TimeoutError: waiting for XPath "//table[@Class="hq_table"]/tbody/tr[position()>1]" failed: timeout 3000ms exceeded

i don't know how to deal it. It affected the speed of acquisition

[jnd0]

Same here I think it is the same issue that happened here: #4072

The behaviour I'm having (my browser is always running in the background, I don't close it on each request):

• The first page works just fine
• The second try fails on waitForXPath() timing out
• Third page works
• 4th fails, etc...

[SpamapS]

Seems unlikely that this is #4072 given that the issue was closed by devs a long, long time ago. We saw this today, where a page presumably got faster, leading to the DOM being loaded sooner, and thusly, the waitForXpath never returns despite the xPath matching the existing content.

[dev-point-team]

same problem here
( waitFor() % 2) == Timeout()

[LiamKarlMitchell]

I think I'm having the same issue, it's been quite a while since it was reported, any idea on a work around?

Seems to work in non headless mode.

await browser.newPage({ context: 'context-' + Math.floor(Math.random() * 10000) })

[FishBlanche]

same problems here
i am using the latest version 15.4.0,but the problem is still there

[OrKoN]

Could someone provide a repro script?

[stale]

We're marking this issue as unconfirmed because it has not had recent activity and we weren't able to confirm it yet. It will be closed if no further activity occurs within the next 30 days.

[stale]

We are closing this issue. If the issue still persists in the latest version of Puppeteer, please reopen the issue and update the description. We will try our best to accommodate it!

[FishBlanche]

I use puppeter to collect a website，I'll loop collect a lot of pages。 It was normal at the beginning，After collecting many pages of data，the function page.waitforxpath() does not detect the DOM that already exists.and throw error, such as:TimeoutError: waiting for XPath "//table[@Class="hq_table"]/tbody/tr[position()>1]" failed: timeout 3000ms exceeded

i don't know how to deal it. It affected the speed of acquisition

Have u fix this? I have same problem here (version 19.6.3)

[FishBlanche]

what 's this workaround based on?

[SwapnilSoni1999]

Any fixes on this?