Files
PsAgentAI/__pycache__
marcocosta10000 2323a2d1ab fix(fetch): improve SPA rendering and URL normalization in browser scraper
Increase hydration wait to 5s and scroll the page three times to
trigger lazy-loaded content before extracting text. Prefer body text
when it yields more content than main-content selectors.

Normalize URLs to https and strip the www. prefix for consistent
deduplication, and allow bare domains with no trailing path to match
the extraction pattern.

Also update agent/user profiles with site reputation and price
comparison guidance, and append conversation logs for 2026-10-27.
2026-10-27 20:14:50 -03:00
..