HTML data
Read the data of an HTML page that another function downloaded or that was saved as a file: the elements chosen by a CSS selector, every table as JSON rows with the spanned cells copied and the header found, the links made absolute against the address of the page, the title, description, Open Graph, Twitter cards and JSON-LD blocks, and the readable text with its line breaks. Typical uses: watch the prices of a supplier, list the next pages of a site to read, show a preview of a link, give the text of a page to a search index or an LLM.
html selecthtml selecthtml tableshtml tableshtml linkshtml linkshtml metahtml metahtml to_texthtml to_text
html select <html> <css_selector>
Description
The elements that match a CSS selector (jsoup syntax: tag, .class, #id, [attr=value], a > b, :contains(text), :eq(n)...): a JSON array of their texts
The elements that match a CSS selector (jsoup syntax: tag, .class, #id, [attr=value], a > b, :contains(text), :eq(n)...): a JSON array of their texts
Parameters
html: The HTML text (20 MB at most), or the path of an HTML file with {"file": true} - String - required
css_selector: The CSS selector - String - required
html: The HTML text (20 MB at most), or the path of an HTML file with {"file": true} - String - required
css_selector: The CSS selector - String - required
admin
html select "<html lang=\"fr\"><head><title>Vanille Bourbon - Épicerie du Sud</title><meta name=\"description\" content=\"Vanille Bourbon de La Réunion, gousses entières.\"><link rel=\"canonical\" href=\"/produits/vanille-bourbon\"><link rel=\"icon\" href=\"/favicon.png\" sizes=\"32x32\"><meta property=\"og:title\" content=\"Vanille Bourbon\"><meta property=\"og:image\" content=\"/img/vanille.jpg\"><meta name=\"twitter:card\" content=\"summary\"><script type=\"application/ld+json\">{\"@context\": \"https://schema.org\", \"@type\": \"Product\", \"name\": \"Vanille Bourbon\", \"offers\": {\"@type\": \"Offer\", \"price\": \"12.50\", \"priceCurrency\": \"EUR\"}}</script></head><body><nav><a href=\"/\">Accueil</a> <a href=\"../epices/\">Épices</a></nav><h1>Vanille Bourbon</h1><p class=\"price\" data-sku=\"VB-10\">12,50 €</p><p>Récoltée à <a href=\"https://fr.wikipedia.org/wiki/Saint-Philippe_(La_R%C3%A9union)\" rel=\"nofollow\">Saint-Philippe</a>, séchée trois mois.</p><ul class=\"tags\"><li>Bio</li><li>Gousses de 16 cm</li></ul><table id=\"tarifs\"><caption>Tarifs</caption><tr><th>Format</th><th>Prix</th><th>Stock</th></tr><tr><td>10 gousses</td><td>12,50</td><td rowspan=\"2\">En stock</td></tr><tr><td>25 gousses</td><td>27,00</td></tr></table></body></html>" "h1, p.price"
mentdb
["Vanille Bourbon", "12,50 €"]
html select <html> <css_selector> <json_params>
Description
The elements with parameters: return (text, html: the inner HTML, outer_html, attributes: {name: value}, all: {tag, text, html, attributes}), attribute (the value of this attribute; href, src, action... are made absolute when absolute is true), absolute (true), limit (1000 elements), first (false: true gives the first value only, as a text, or an empty text), and file (false: true reads the first argument as the path of a file), charset (of the file; by default its byte order mark, its meta charset, UTF-8 when valid, else the detected encoding), base_url (the address of the page, to make the links absolute), timeout_ms (10000)
The elements with parameters: return (text, html: the inner HTML, outer_html, attributes: {name: value}, all: {tag, text, html, attributes}), attribute (the value of this attribute; href, src, action... are made absolute when absolute is true), absolute (true), limit (1000 elements), first (false: true gives the first value only, as a text, or an empty text), and file (false: true reads the first argument as the path of a file), charset (of the file; by default its byte order mark, its meta charset, UTF-8 when valid, else the detected encoding), base_url (the address of the page, to make the links absolute), timeout_ms (10000)
Parameters
html: The HTML text (20 MB at most), or the path of an HTML file with {"file": true} - String - required
css_selector: The CSS selector - String - required
json_params: The parameters, as a JSON object - String - required
html: The HTML text (20 MB at most), or the path of an HTML file with {"file": true} - String - required
css_selector: The CSS selector - String - required
json_params: The parameters, as a JSON object - String - required
admin
html select "<html lang=\"fr\"><head><title>Vanille Bourbon - Épicerie du Sud</title><meta name=\"description\" content=\"Vanille Bourbon de La Réunion, gousses entières.\"><link rel=\"canonical\" href=\"/produits/vanille-bourbon\"><link rel=\"icon\" href=\"/favicon.png\" sizes=\"32x32\"><meta property=\"og:title\" content=\"Vanille Bourbon\"><meta property=\"og:image\" content=\"/img/vanille.jpg\"><meta name=\"twitter:card\" content=\"summary\"><script type=\"application/ld+json\">{\"@context\": \"https://schema.org\", \"@type\": \"Product\", \"name\": \"Vanille Bourbon\", \"offers\": {\"@type\": \"Offer\", \"price\": \"12.50\", \"priceCurrency\": \"EUR\"}}</script></head><body><nav><a href=\"/\">Accueil</a> <a href=\"../epices/\">Épices</a></nav><h1>Vanille Bourbon</h1><p class=\"price\" data-sku=\"VB-10\">12,50 €</p><p>Récoltée à <a href=\"https://fr.wikipedia.org/wiki/Saint-Philippe_(La_R%C3%A9union)\" rel=\"nofollow\">Saint-Philippe</a>, séchée trois mois.</p><ul class=\"tags\"><li>Bio</li><li>Gousses de 16 cm</li></ul><table id=\"tarifs\"><caption>Tarifs</caption><tr><th>Format</th><th>Prix</th><th>Stock</th></tr><tr><td>10 gousses</td><td>12,50</td><td rowspan=\"2\">En stock</td></tr><tr><td>25 gousses</td><td>27,00</td></tr></table></body></html>" "nav a" "{\"attribute\": \"href\", \"base_url\": \"https://epicerie.example.com/produits/vanille.html\"}"
mentdb
["https://epicerie.example.com/", "https://epicerie.example.com/epices/"]
One value only
admin
html select "<html lang=\"fr\"><head><title>Vanille Bourbon - Épicerie du Sud</title><meta name=\"description\" content=\"Vanille Bourbon de La Réunion, gousses entières.\"><link rel=\"canonical\" href=\"/produits/vanille-bourbon\"><link rel=\"icon\" href=\"/favicon.png\" sizes=\"32x32\"><meta property=\"og:title\" content=\"Vanille Bourbon\"><meta property=\"og:image\" content=\"/img/vanille.jpg\"><meta name=\"twitter:card\" content=\"summary\"><script type=\"application/ld+json\">{\"@context\": \"https://schema.org\", \"@type\": \"Product\", \"name\": \"Vanille Bourbon\", \"offers\": {\"@type\": \"Offer\", \"price\": \"12.50\", \"priceCurrency\": \"EUR\"}}</script></head><body><nav><a href=\"/\">Accueil</a> <a href=\"../epices/\">Épices</a></nav><h1>Vanille Bourbon</h1><p class=\"price\" data-sku=\"VB-10\">12,50 €</p><p>Récoltée à <a href=\"https://fr.wikipedia.org/wiki/Saint-Philippe_(La_R%C3%A9union)\" rel=\"nofollow\">Saint-Philippe</a>, séchée trois mois.</p><ul class=\"tags\"><li>Bio</li><li>Gousses de 16 cm</li></ul><table id=\"tarifs\"><caption>Tarifs</caption><tr><th>Format</th><th>Prix</th><th>Stock</th></tr><tr><td>10 gousses</td><td>12,50</td><td rowspan=\"2\">En stock</td></tr><tr><td>25 gousses</td><td>27,00</td></tr></table></body></html>" "p.price" "{\"attribute\": \"data-sku\", \"first\": true}"
mentdb
VB-10
Everything about an element
admin
html select "<html lang=\"fr\"><head><title>Vanille Bourbon - Épicerie du Sud</title><meta name=\"description\" content=\"Vanille Bourbon de La Réunion, gousses entières.\"><link rel=\"canonical\" href=\"/produits/vanille-bourbon\"><link rel=\"icon\" href=\"/favicon.png\" sizes=\"32x32\"><meta property=\"og:title\" content=\"Vanille Bourbon\"><meta property=\"og:image\" content=\"/img/vanille.jpg\"><meta name=\"twitter:card\" content=\"summary\"><script type=\"application/ld+json\">{\"@context\": \"https://schema.org\", \"@type\": \"Product\", \"name\": \"Vanille Bourbon\", \"offers\": {\"@type\": \"Offer\", \"price\": \"12.50\", \"priceCurrency\": \"EUR\"}}</script></head><body><nav><a href=\"/\">Accueil</a> <a href=\"../epices/\">Épices</a></nav><h1>Vanille Bourbon</h1><p class=\"price\" data-sku=\"VB-10\">12,50 €</p><p>Récoltée à <a href=\"https://fr.wikipedia.org/wiki/Saint-Philippe_(La_R%C3%A9union)\" rel=\"nofollow\">Saint-Philippe</a>, séchée trois mois.</p><ul class=\"tags\"><li>Bio</li><li>Gousses de 16 cm</li></ul><table id=\"tarifs\"><caption>Tarifs</caption><tr><th>Format</th><th>Prix</th><th>Stock</th></tr><tr><td>10 gousses</td><td>12,50</td><td rowspan=\"2\">En stock</td></tr><tr><td>25 gousses</td><td>27,00</td></tr></table></body></html>" "p.price" "{\"return\": \"all\"}"
mentdb
[{"tag": "p", "text": "12,50 €", "html": "12,50 €", "attributes": {"class": "price", "data-sku": "VB-10"}}]
html tables <html>
Description
Every table of the page: a JSON array of {index, id, caption, header_rows, columns, rows: [{column: text}]}
Every table of the page: a JSON array of {index, id, caption, header_rows, columns, rows: [{column: text}]}
Parameters
html: The HTML text (20 MB at most), or the path of an HTML file with {"file": true} - String - required
html: The HTML text (20 MB at most), or the path of an HTML file with {"file": true} - String - required
admin
html tables "<html lang=\"fr\"><head><title>Vanille Bourbon - Épicerie du Sud</title><meta name=\"description\" content=\"Vanille Bourbon de La Réunion, gousses entières.\"><link rel=\"canonical\" href=\"/produits/vanille-bourbon\"><link rel=\"icon\" href=\"/favicon.png\" sizes=\"32x32\"><meta property=\"og:title\" content=\"Vanille Bourbon\"><meta property=\"og:image\" content=\"/img/vanille.jpg\"><meta name=\"twitter:card\" content=\"summary\"><script type=\"application/ld+json\">{\"@context\": \"https://schema.org\", \"@type\": \"Product\", \"name\": \"Vanille Bourbon\", \"offers\": {\"@type\": \"Offer\", \"price\": \"12.50\", \"priceCurrency\": \"EUR\"}}</script></head><body><nav><a href=\"/\">Accueil</a> <a href=\"../epices/\">Épices</a></nav><h1>Vanille Bourbon</h1><p class=\"price\" data-sku=\"VB-10\">12,50 €</p><p>Récoltée à <a href=\"https://fr.wikipedia.org/wiki/Saint-Philippe_(La_R%C3%A9union)\" rel=\"nofollow\">Saint-Philippe</a>, séchée trois mois.</p><ul class=\"tags\"><li>Bio</li><li>Gousses de 16 cm</li></ul><table id=\"tarifs\"><caption>Tarifs</caption><tr><th>Format</th><th>Prix</th><th>Stock</th></tr><tr><td>10 gousses</td><td>12,50</td><td rowspan=\"2\">En stock</td></tr><tr><td>25 gousses</td><td>27,00</td></tr></table></body></html>"
mentdb
[{"index": 0, "id": "tarifs", "caption": "Tarifs", "header_rows": 1, "columns": ["Format", "Prix", "Stock"], "rows": [{"Format": "10 gousses", "Prix": "12,50", "Stock": "En stock"}, {"Format": "25 gousses", "Prix": "27,00", "Stock": "En stock"}]}]
html tables <html> <json_params>
Description
The tables with parameters: selector (table: a CSS selector to choose the tables), index (one table only, from 0: the result is then its object), header (auto, first_row, none), format (objects, arrays: rows as arrays of texts), skip_empty_rows (true), max_rows (100000), and file (false: true reads the first argument as the path of a file), charset (of the file; by default its byte order mark, its meta charset, UTF-8 when valid, else the detected encoding), base_url (the address of the page, to make the links absolute), timeout_ms (10000)
The tables with parameters: selector (table: a CSS selector to choose the tables), index (one table only, from 0: the result is then its object), header (auto, first_row, none), format (objects, arrays: rows as arrays of texts), skip_empty_rows (true), max_rows (100000), and file (false: true reads the first argument as the path of a file), charset (of the file; by default its byte order mark, its meta charset, UTF-8 when valid, else the detected encoding), base_url (the address of the page, to make the links absolute), timeout_ms (10000)
Parameters
html: The HTML text (20 MB at most), or the path of an HTML file with {"file": true} - String - required
json_params: The parameters, as a JSON object - String - required
html: The HTML text (20 MB at most), or the path of an HTML file with {"file": true} - String - required
json_params: The parameters, as a JSON object - String - required
admin
html tables "<table><thead><tr><th rowspan=\"2\">Région</th><th colspan=\"2\">Ventes</th></tr><tr><th>2024</th><th>2025</th></tr></thead><tbody><tr><td>Nord</td><td>1 200</td><td>1 350</td></tr><tr><td>Sud</td><td>980</td><td>1 105</td></tr></tbody></table>" "{\"index\": 0}"
mentdb
{"index": 0, "id": "", "caption": "", "header_rows": 2, "columns": ["Région", "Ventes / 2024", "Ventes / 2025"], "rows": [{"Région": "Nord", "Ventes / 2024": "1 200", "Ventes / 2025": "1 350"}, {"Région": "Sud", "Ventes / 2024": "980", "Ventes / 2025": "1 105"}]}
Rows as arrays
admin
html tables "<html lang=\"fr\"><head><title>Vanille Bourbon - Épicerie du Sud</title><meta name=\"description\" content=\"Vanille Bourbon de La Réunion, gousses entières.\"><link rel=\"canonical\" href=\"/produits/vanille-bourbon\"><link rel=\"icon\" href=\"/favicon.png\" sizes=\"32x32\"><meta property=\"og:title\" content=\"Vanille Bourbon\"><meta property=\"og:image\" content=\"/img/vanille.jpg\"><meta name=\"twitter:card\" content=\"summary\"><script type=\"application/ld+json\">{\"@context\": \"https://schema.org\", \"@type\": \"Product\", \"name\": \"Vanille Bourbon\", \"offers\": {\"@type\": \"Offer\", \"price\": \"12.50\", \"priceCurrency\": \"EUR\"}}</script></head><body><nav><a href=\"/\">Accueil</a> <a href=\"../epices/\">Épices</a></nav><h1>Vanille Bourbon</h1><p class=\"price\" data-sku=\"VB-10\">12,50 €</p><p>Récoltée à <a href=\"https://fr.wikipedia.org/wiki/Saint-Philippe_(La_R%C3%A9union)\" rel=\"nofollow\">Saint-Philippe</a>, séchée trois mois.</p><ul class=\"tags\"><li>Bio</li><li>Gousses de 16 cm</li></ul><table id=\"tarifs\"><caption>Tarifs</caption><tr><th>Format</th><th>Prix</th><th>Stock</th></tr><tr><td>10 gousses</td><td>12,50</td><td rowspan=\"2\">En stock</td></tr><tr><td>25 gousses</td><td>27,00</td></tr></table></body></html>" "{\"selector\": \"#tarifs\", \"index\": 0, \"format\": \"arrays\"}"
mentdb
{"index": 0, "id": "tarifs", "caption": "Tarifs", "header_rows": 1, "columns": ["Format", "Prix", "Stock"], "rows": [["10 gousses", "12,50", "En stock"], ["25 gousses", "27,00", "En stock"]]}
Used in use cases (1 recipe)
Web & API developer › Read the price table, the JSON-LD and the next links of a product page
Web & API developer › Read the price table, the JSON-LD and the next links of a product page
html links <html>
Description
The links of the page (a and area): a JSON array of {url, href (as written), text, tag, rel, title, absolute, internal (only when the base is known: same host)}
The links of the page (a and area): a JSON array of {url, href (as written), text, tag, rel, title, absolute, internal (only when the base is known: same host)}
Parameters
html: The HTML text (20 MB at most), or the path of an HTML file with {"file": true} - String - required
html: The HTML text (20 MB at most), or the path of an HTML file with {"file": true} - String - required
admin
html links "<html lang=\"fr\"><head><title>Vanille Bourbon - Épicerie du Sud</title><meta name=\"description\" content=\"Vanille Bourbon de La Réunion, gousses entières.\"><link rel=\"canonical\" href=\"/produits/vanille-bourbon\"><link rel=\"icon\" href=\"/favicon.png\" sizes=\"32x32\"><meta property=\"og:title\" content=\"Vanille Bourbon\"><meta property=\"og:image\" content=\"/img/vanille.jpg\"><meta name=\"twitter:card\" content=\"summary\"><script type=\"application/ld+json\">{\"@context\": \"https://schema.org\", \"@type\": \"Product\", \"name\": \"Vanille Bourbon\", \"offers\": {\"@type\": \"Offer\", \"price\": \"12.50\", \"priceCurrency\": \"EUR\"}}</script></head><body><nav><a href=\"/\">Accueil</a> <a href=\"../epices/\">Épices</a></nav><h1>Vanille Bourbon</h1><p class=\"price\" data-sku=\"VB-10\">12,50 €</p><p>Récoltée à <a href=\"https://fr.wikipedia.org/wiki/Saint-Philippe_(La_R%C3%A9union)\" rel=\"nofollow\">Saint-Philippe</a>, séchée trois mois.</p><ul class=\"tags\"><li>Bio</li><li>Gousses de 16 cm</li></ul><table id=\"tarifs\"><caption>Tarifs</caption><tr><th>Format</th><th>Prix</th><th>Stock</th></tr><tr><td>10 gousses</td><td>12,50</td><td rowspan=\"2\">En stock</td></tr><tr><td>25 gousses</td><td>27,00</td></tr></table></body></html>"
mentdb
[{"url": "/", "href": "/", "text": "Accueil", "tag": "a", "rel": "", "title": "", "absolute": false}, {"url": "../epices/", "href": "../epices/", "text": "Épices", "tag": "a", "rel": "", "title": "", "absolute": false}, {"url": "https://fr.wikipedia.org/wiki/Saint-Philippe_(La_R%C3%A9union)", "href": "https://fr.wikipedia.org/wiki/Saint-Philippe_(La_R%C3%A9union)", "text": "Saint-Philippe", "tag": "a", "rel": "nofollow", "title": "", "absolute": true}]
html links <html> <json_params>
Description
The links with parameters: tags (links: a and area; all: also link, img, script, iframe, source, video, audio, embed, form), scope (all, internal, external: needs a base), unique (false), skip_fragments (false: true skips the links #...), limit (10000), and file (false: true reads the first argument as the path of a file), charset (of the file; by default its byte order mark, its meta charset, UTF-8 when valid, else the detected encoding), base_url (the address of the page, to make the links absolute), timeout_ms (10000)
The links with parameters: tags (links: a and area; all: also link, img, script, iframe, source, video, audio, embed, form), scope (all, internal, external: needs a base), unique (false), skip_fragments (false: true skips the links #...), limit (10000), and file (false: true reads the first argument as the path of a file), charset (of the file; by default its byte order mark, its meta charset, UTF-8 when valid, else the detected encoding), base_url (the address of the page, to make the links absolute), timeout_ms (10000)
Parameters
html: The HTML text (20 MB at most), or the path of an HTML file with {"file": true} - String - required
json_params: The parameters, as a JSON object - String - required
html: The HTML text (20 MB at most), or the path of an HTML file with {"file": true} - String - required
json_params: The parameters, as a JSON object - String - required
admin
html links "<html lang=\"fr\"><head><title>Vanille Bourbon - Épicerie du Sud</title><meta name=\"description\" content=\"Vanille Bourbon de La Réunion, gousses entières.\"><link rel=\"canonical\" href=\"/produits/vanille-bourbon\"><link rel=\"icon\" href=\"/favicon.png\" sizes=\"32x32\"><meta property=\"og:title\" content=\"Vanille Bourbon\"><meta property=\"og:image\" content=\"/img/vanille.jpg\"><meta name=\"twitter:card\" content=\"summary\"><script type=\"application/ld+json\">{\"@context\": \"https://schema.org\", \"@type\": \"Product\", \"name\": \"Vanille Bourbon\", \"offers\": {\"@type\": \"Offer\", \"price\": \"12.50\", \"priceCurrency\": \"EUR\"}}</script></head><body><nav><a href=\"/\">Accueil</a> <a href=\"../epices/\">Épices</a></nav><h1>Vanille Bourbon</h1><p class=\"price\" data-sku=\"VB-10\">12,50 €</p><p>Récoltée à <a href=\"https://fr.wikipedia.org/wiki/Saint-Philippe_(La_R%C3%A9union)\" rel=\"nofollow\">Saint-Philippe</a>, séchée trois mois.</p><ul class=\"tags\"><li>Bio</li><li>Gousses de 16 cm</li></ul><table id=\"tarifs\"><caption>Tarifs</caption><tr><th>Format</th><th>Prix</th><th>Stock</th></tr><tr><td>10 gousses</td><td>12,50</td><td rowspan=\"2\">En stock</td></tr><tr><td>25 gousses</td><td>27,00</td></tr></table></body></html>" "{\"base_url\": \"https://epicerie.example.com/produits/vanille.html\", \"scope\": \"external\"}"
mentdb
[{"url": "https://fr.wikipedia.org/wiki/Saint-Philippe_(La_R%C3%A9union)", "href": "https://fr.wikipedia.org/wiki/Saint-Philippe_(La_R%C3%A9union)", "text": "Saint-Philippe", "tag": "a", "rel": "nofollow", "title": "", "absolute": true, "internal": false}]
Every resource of the page, once
admin
html links "<html lang=\"fr\"><head><title>Vanille Bourbon - Épicerie du Sud</title><meta name=\"description\" content=\"Vanille Bourbon de La Réunion, gousses entières.\"><link rel=\"canonical\" href=\"/produits/vanille-bourbon\"><link rel=\"icon\" href=\"/favicon.png\" sizes=\"32x32\"><meta property=\"og:title\" content=\"Vanille Bourbon\"><meta property=\"og:image\" content=\"/img/vanille.jpg\"><meta name=\"twitter:card\" content=\"summary\"><script type=\"application/ld+json\">{\"@context\": \"https://schema.org\", \"@type\": \"Product\", \"name\": \"Vanille Bourbon\", \"offers\": {\"@type\": \"Offer\", \"price\": \"12.50\", \"priceCurrency\": \"EUR\"}}</script></head><body><nav><a href=\"/\">Accueil</a> <a href=\"../epices/\">Épices</a></nav><h1>Vanille Bourbon</h1><p class=\"price\" data-sku=\"VB-10\">12,50 €</p><p>Récoltée à <a href=\"https://fr.wikipedia.org/wiki/Saint-Philippe_(La_R%C3%A9union)\" rel=\"nofollow\">Saint-Philippe</a>, séchée trois mois.</p><ul class=\"tags\"><li>Bio</li><li>Gousses de 16 cm</li></ul><table id=\"tarifs\"><caption>Tarifs</caption><tr><th>Format</th><th>Prix</th><th>Stock</th></tr><tr><td>10 gousses</td><td>12,50</td><td rowspan=\"2\">En stock</td></tr><tr><td>25 gousses</td><td>27,00</td></tr></table></body></html>" "{\"base_url\": \"https://epicerie.example.com/produits/vanille.html\", \"tags\": \"all\", \"unique\": true, \"scope\": \"internal\"}"
mentdb
[{"url": "https://epicerie.example.com/produits/vanille-bourbon", "href": "/produits/vanille-bourbon", "text": "", "tag": "link", "rel": "canonical", "title": "", "absolute": true, "internal": true}, {"url": "https://epicerie.example.com/favicon.png", "href": "/favicon.png", "text": "", "tag": "link", "rel": "icon", "title": "", "absolute": true, "internal": true}, {"url": "https://epicerie.example.com/", "href": "/", "text": "Accueil", "tag": "a", "rel": "", "title": "", "absolute": true, "internal": true}, {"url": "https://epicerie.example.com/epices/", "href": "../epices/", "text": "Épices", "tag": "a", "rel": "", "title": "", "absolute": true, "internal": true}]
Used in use cases (1 recipe)
Web & API developer › Read the price table, the JSON-LD and the next links of a product page
Web & API developer › Read the price table, the JSON-LD and the next links of a product page
html meta <html>
Description
The metadata of a page: JSON {title, description, canonical, lang, charset, robots, open_graph (og:..., article:..., product:...: a list when repeated), twitter, json_ld (the parsed blocks), json_ld_errors, icons, feeds (RSS, Atom, JSON feed), alternates (hreflang), meta (the other meta name / content)}
The metadata of a page: JSON {title, description, canonical, lang, charset, robots, open_graph (og:..., article:..., product:...: a list when repeated), twitter, json_ld (the parsed blocks), json_ld_errors, icons, feeds (RSS, Atom, JSON feed), alternates (hreflang), meta (the other meta name / content)}
Parameters
html: The HTML text (20 MB at most), or the path of an HTML file with {"file": true} - String - required
html: The HTML text (20 MB at most), or the path of an HTML file with {"file": true} - String - required
admin
html meta "<html lang=\"fr\"><head><title>Vanille Bourbon - Épicerie du Sud</title><meta name=\"description\" content=\"Vanille Bourbon de La Réunion, gousses entières.\"><link rel=\"canonical\" href=\"/produits/vanille-bourbon\"><link rel=\"icon\" href=\"/favicon.png\" sizes=\"32x32\"><meta property=\"og:title\" content=\"Vanille Bourbon\"><meta property=\"og:image\" content=\"/img/vanille.jpg\"><meta name=\"twitter:card\" content=\"summary\"><script type=\"application/ld+json\">{\"@context\": \"https://schema.org\", \"@type\": \"Product\", \"name\": \"Vanille Bourbon\", \"offers\": {\"@type\": \"Offer\", \"price\": \"12.50\", \"priceCurrency\": \"EUR\"}}</script></head><body><nav><a href=\"/\">Accueil</a> <a href=\"../epices/\">Épices</a></nav><h1>Vanille Bourbon</h1><p class=\"price\" data-sku=\"VB-10\">12,50 €</p><p>Récoltée à <a href=\"https://fr.wikipedia.org/wiki/Saint-Philippe_(La_R%C3%A9union)\" rel=\"nofollow\">Saint-Philippe</a>, séchée trois mois.</p><ul class=\"tags\"><li>Bio</li><li>Gousses de 16 cm</li></ul><table id=\"tarifs\"><caption>Tarifs</caption><tr><th>Format</th><th>Prix</th><th>Stock</th></tr><tr><td>10 gousses</td><td>12,50</td><td rowspan=\"2\">En stock</td></tr><tr><td>25 gousses</td><td>27,00</td></tr></table></body></html>"
mentdb
{"title": "Vanille Bourbon - Épicerie du Sud", "description": "Vanille Bourbon de La Réunion, gousses entières.", "canonical": "/produits/vanille-bourbon", "lang": "fr", "charset": "", "robots": "", "open_graph": {"og:title": "Vanille Bourbon", "og:image": "/img/vanille.jpg"}, "twitter": {"twitter:card": "summary"}, "json_ld": [{"@context": "https://schema.org", "@type": "Product", "name": "Vanille Bourbon", "offers": {"@type": "Offer", "price": "12.50", "priceCurrency": "EUR"}}], "json_ld_errors": [], "icons": [{"url": "/favicon.png", "rel": "icon", "sizes": "32x32", "type": ""}], "feeds": [], "alternates": [], "meta": {"description": "Vanille Bourbon de La Réunion, gousses entières."}}
html meta <html> <json_params>
Description
The metadata with parameters: max_json_ld (50 blocks), and file (false: true reads the first argument as the path of a file), charset (of the file; by default its byte order mark, its meta charset, UTF-8 when valid, else the detected encoding), base_url (the address of the page, to make the links absolute), timeout_ms (10000). The URLs of canonical, icons, feeds and of og:image, og:url, twitter:image... are made absolute. A JSON-LD block is read with a comma before } or ] and line breaks inside its strings, which pages often have
The metadata with parameters: max_json_ld (50 blocks), and file (false: true reads the first argument as the path of a file), charset (of the file; by default its byte order mark, its meta charset, UTF-8 when valid, else the detected encoding), base_url (the address of the page, to make the links absolute), timeout_ms (10000). The URLs of canonical, icons, feeds and of og:image, og:url, twitter:image... are made absolute. A JSON-LD block is read with a comma before } or ] and line breaks inside its strings, which pages often have
Parameters
html: The HTML text (20 MB at most), or the path of an HTML file with {"file": true} - String - required
json_params: The parameters, as a JSON object - String - required
html: The HTML text (20 MB at most), or the path of an HTML file with {"file": true} - String - required
json_params: The parameters, as a JSON object - String - required
admin
html meta "<html lang=\"fr\"><head><title>Vanille Bourbon - Épicerie du Sud</title><meta name=\"description\" content=\"Vanille Bourbon de La Réunion, gousses entières.\"><link rel=\"canonical\" href=\"/produits/vanille-bourbon\"><link rel=\"icon\" href=\"/favicon.png\" sizes=\"32x32\"><meta property=\"og:title\" content=\"Vanille Bourbon\"><meta property=\"og:image\" content=\"/img/vanille.jpg\"><meta name=\"twitter:card\" content=\"summary\"><script type=\"application/ld+json\">{\"@context\": \"https://schema.org\", \"@type\": \"Product\", \"name\": \"Vanille Bourbon\", \"offers\": {\"@type\": \"Offer\", \"price\": \"12.50\", \"priceCurrency\": \"EUR\"}}</script></head><body><nav><a href=\"/\">Accueil</a> <a href=\"../epices/\">Épices</a></nav><h1>Vanille Bourbon</h1><p class=\"price\" data-sku=\"VB-10\">12,50 €</p><p>Récoltée à <a href=\"https://fr.wikipedia.org/wiki/Saint-Philippe_(La_R%C3%A9union)\" rel=\"nofollow\">Saint-Philippe</a>, séchée trois mois.</p><ul class=\"tags\"><li>Bio</li><li>Gousses de 16 cm</li></ul><table id=\"tarifs\"><caption>Tarifs</caption><tr><th>Format</th><th>Prix</th><th>Stock</th></tr><tr><td>10 gousses</td><td>12,50</td><td rowspan=\"2\">En stock</td></tr><tr><td>25 gousses</td><td>27,00</td></tr></table></body></html>" "{\"base_url\": \"https://epicerie.example.com/produits/vanille.html\"}"
mentdb
{"title": "Vanille Bourbon - Épicerie du Sud", "description": "Vanille Bourbon de La Réunion, gousses entières.", "canonical": "https://epicerie.example.com/produits/vanille-bourbon", "lang": "fr", "charset": "", "robots": "", "open_graph": {"og:title": "Vanille Bourbon", "og:image": "https://epicerie.example.com/img/vanille.jpg"}, "twitter": {"twitter:card": "summary"}, "json_ld": [{"@context": "https://schema.org", "@type": "Product", "name": "Vanille Bourbon", "offers": {"@type": "Offer", "price": "12.50", "priceCurrency": "EUR"}}], "json_ld_errors": [], "icons": [{"url": "https://epicerie.example.com/favicon.png", "rel": "icon", "sizes": "32x32", "type": ""}], "feeds": [], "alternates": [], "meta": {"description": "Vanille Bourbon de La Réunion, gousses entières."}}
Used in use cases (1 recipe)
Web & API developer › Read the price table, the JSON-LD and the next links of a product page
Web & API developer › Read the price table, the JSON-LD and the next links of a product page
html to_text <html>
Description
The readable text of the page (not JSON): one line per block, an empty line between paragraphs, titles, lists and tables, - before the items of a list (1. 2. for a numbered list), the cells of a table separated by a tab; script, style, head, forms and hidden elements are skipped,
The readable text of the page (not JSON): one line per block, an empty line between paragraphs, titles, lists and tables, - before the items of a list (1. 2. for a numbered list), the cells of a table separated by a tab; script, style, head, forms and hidden elements are skipped,
keeps its spaces
Parameters
html: The HTML text (20 MB at most), or the path of an HTML file with {"file": true} - String - required
html: The HTML text (20 MB at most), or the path of an HTML file with {"file": true} - String - required
admin
html to_text "<html lang=\"fr\"><head><title>Vanille Bourbon - Épicerie du Sud</title><meta name=\"description\" content=\"Vanille Bourbon de La Réunion, gousses entières.\"><link rel=\"canonical\" href=\"/produits/vanille-bourbon\"><link rel=\"icon\" href=\"/favicon.png\" sizes=\"32x32\"><meta property=\"og:title\" content=\"Vanille Bourbon\"><meta property=\"og:image\" content=\"/img/vanille.jpg\"><meta name=\"twitter:card\" content=\"summary\"><script type=\"application/ld+json\">{\"@context\": \"https://schema.org\", \"@type\": \"Product\", \"name\": \"Vanille Bourbon\", \"offers\": {\"@type\": \"Offer\", \"price\": \"12.50\", \"priceCurrency\": \"EUR\"}}</script></head><body><nav><a href=\"/\">Accueil</a> <a href=\"../epices/\">Épices</a></nav><h1>Vanille Bourbon</h1><p class=\"price\" data-sku=\"VB-10\">12,50 €</p><p>Récoltée à <a href=\"https://fr.wikipedia.org/wiki/Saint-Philippe_(La_R%C3%A9union)\" rel=\"nofollow\">Saint-Philippe</a>, séchée trois mois.</p><ul class=\"tags\"><li>Bio</li><li>Gousses de 16 cm</li></ul><table id=\"tarifs\"><caption>Tarifs</caption><tr><th>Format</th><th>Prix</th><th>Stock</th></tr><tr><td>10 gousses</td><td>12,50</td><td rowspan=\"2\">En stock</td></tr><tr><td>25 gousses</td><td>27,00</td></tr></table></body></html>"
mentdb
Accueil Épices Vanille Bourbon 12,50 € Récoltée à Saint-Philippe, séchée trois mois. - Bio - Gousses de 16 cm Tarifs Format Prix Stock 10 gousses 12,50 En stock 25 gousses 27,00
html to_text <html> <json_params>
Description
The text with parameters: selector (only these elements, ex: article, main), links (false: true writes the URL after the text of a link), images (false: true writes [alt] for images), blank_lines (true), max_length (0: no limit), and file (false: true reads the first argument as the path of a file), charset (of the file; by default its byte order mark, its meta charset, UTF-8 when valid, else the detected encoding), base_url (the address of the page, to make the links absolute), timeout_ms (10000)
The text with parameters: selector (only these elements, ex: article, main), links (false: true writes the URL after the text of a link), images (false: true writes [alt] for images), blank_lines (true), max_length (0: no limit), and file (false: true reads the first argument as the path of a file), charset (of the file; by default its byte order mark, its meta charset, UTF-8 when valid, else the detected encoding), base_url (the address of the page, to make the links absolute), timeout_ms (10000)
Parameters
html: The HTML text (20 MB at most), or the path of an HTML file with {"file": true} - String - required
json_params: The parameters, as a JSON object - String - required
html: The HTML text (20 MB at most), or the path of an HTML file with {"file": true} - String - required
json_params: The parameters, as a JSON object - String - required
admin
html to_text "<html lang=\"fr\"><head><title>Vanille Bourbon - Épicerie du Sud</title><meta name=\"description\" content=\"Vanille Bourbon de La Réunion, gousses entières.\"><link rel=\"canonical\" href=\"/produits/vanille-bourbon\"><link rel=\"icon\" href=\"/favicon.png\" sizes=\"32x32\"><meta property=\"og:title\" content=\"Vanille Bourbon\"><meta property=\"og:image\" content=\"/img/vanille.jpg\"><meta name=\"twitter:card\" content=\"summary\"><script type=\"application/ld+json\">{\"@context\": \"https://schema.org\", \"@type\": \"Product\", \"name\": \"Vanille Bourbon\", \"offers\": {\"@type\": \"Offer\", \"price\": \"12.50\", \"priceCurrency\": \"EUR\"}}</script></head><body><nav><a href=\"/\">Accueil</a> <a href=\"../epices/\">Épices</a></nav><h1>Vanille Bourbon</h1><p class=\"price\" data-sku=\"VB-10\">12,50 €</p><p>Récoltée à <a href=\"https://fr.wikipedia.org/wiki/Saint-Philippe_(La_R%C3%A9union)\" rel=\"nofollow\">Saint-Philippe</a>, séchée trois mois.</p><ul class=\"tags\"><li>Bio</li><li>Gousses de 16 cm</li></ul><table id=\"tarifs\"><caption>Tarifs</caption><tr><th>Format</th><th>Prix</th><th>Stock</th></tr><tr><td>10 gousses</td><td>12,50</td><td rowspan=\"2\">En stock</td></tr><tr><td>25 gousses</td><td>27,00</td></tr></table></body></html>" "{\"selector\": \"body > p\", \"links\": true, \"base_url\": \"https://epicerie.example.com/produits/vanille.html\"}"
mentdb
12,50 € Récoltée à Saint-Philippe (https://fr.wikipedia.org/wiki/Saint-Philippe_(La_R%C3%A9union)), séchée trois mois.
Lines without empty lines
admin
html to_text "<h2>Livraison</h2><ol start=\"3\"><li>Commande</li><li>Paiement</li></ol><p>Délai : 48 heures</p>" "{\"blank_lines\": false}"
mentdb
Livraison 3. Commande 4. Paiement Délai : 48 heures
