Can't reach anything under noscript tag

[rightaway]

I've got cheerio.load(pageContent, { decodeEntities: false }), but then when I try to match an element that's under a noscript tag it doesn't work. I thought setting decodeEntities to false would allow this. How do I match that element?

[enricopolanski]

try cheerio.load(pageContent, [ xmlMode: true});

[ghost]

I'm seeing this too. This should not have been closed.

[fb55]

Enabling xml mode fixes this, otherwise parse5 will always strip noscript tags.

edit: See #1105 (comment) for how to fix this.

[ghost]

Right, but it's still an issue, right? It should stay open until it gets resolved.

[mitin001]

Try to match the noscript tag itself, get the html by calling .html() and then load that html with cheerio again. That way you'll be able to match any element under the noscript tag.

[paulsmithkc]

This is definitely still a bug with cheerio, as cheerio is essentially a browser without JavaScript support. The noscript tag is intended to provide content for browsers that do not support javascript (which would include search engines, web crawlers, and web scrapers).

"xmlMode: true" has several other side effects (see documentation) which can cause most pages, and especially those in question to fail to parse.

[joeybaker]

Quickly looking through, it seems like https://github.com/cheeriojs/cheerio/blob/208bce1ee8ed921dbd0fc2988644fd3a68bf8bd1/lib/parse.js needs to be updated to turn scriptingEnabled: false https://github.com/inikulin/parse5/blob/master/packages/parse5/docs/options/parser-options.md

I'm not sure if there are security implications of doing that though.

[paulsmithkc]

<noscript> tags should be parsed as HTML as that is what they contain, not text or javascript.

[dsmmcken]

This is the first google result for "cheerio noscript". If you are attempting to parse html inside a noscript tag with cheerio, see the doc page linked below.

Set the scriptingEnabled option to false.

const $ = cheerio.load(data, { scriptingEnabled: false });

[ggorlen]

xmlMode is deprecated in favor of xml.

[rishi-raj-jain]

https://rishi.app/blog/parsing-noscript-elements-using-cheerio-in-node-js/ is also another solution.