Background to the issue
Spegel currently only supports static web pages (GET requests), dynamic content that relies on JavaScript rendering (such as SPA applications) cannot be parsed properly.
alternative
- Pre-rendering tool fit: Use
puppeteermaybeplaywrightGet the full HTML of the dynamic web page and then process it through Spegel. - API Direct Calls: If the target website provides an API, scripts can be written to obtain structured data and format the output through Spegel's custom views.
- static cache: Use of
wgetSave the dynamic page as a local HTML file (e.g.wget --no-check-certificate -O page.html <URL>), then load the local file with Spegel.
Recommendations for future optimization
Developers can follow the Issues board in the project's GitHub (e.g. #42), where the community is discussing integrating Headless browser support. For now, it is recommended to prioritize sites with predominantly static content (e.g., documents, news).
This answer comes from the articleSpegel: using AI to transform web pages into an end-to-end browsing experienceThe





























