favicon errors and huge number of files

[grotesque]

gomita's scrapbook plus, scrapbook-x had the issue of large number of files on filesystem which can slow it (the filesystem) down giving system wide symptoms.
webscrapbook has resolved that problem with htz extension for storing webpage. Thank you Danny.

but the favicon design is causing similar problems of large number of files (to a smaller extent)

Other problems:

• lots of unnessary warnings like "icon 'xxx' is an absolute URL" while running the checker
• lots of unncessary errors like missing icon file 'xxx/favicon.ico'
• they occupy about 30% of the total number of files in my webscrapbook "database"
• they give no value to me

Q1. Have I configured by webscrapbook wrong because I don't see any icons usually in sidebar. Sometimes they're seen.
Q2. Can a setting be made to globally disable icons so that they are not even created.

[grotesque]

update:
favicons are not working for me in firefox webscrapbook (latest version)
They're working on chrome webscrapbook (latest version)

Chrome:

Any idea why?

[danny0838]

gomita's scrapbook plus, scrapbook-x had the issue of large number of files on filesystem which can slow it (the filesystem) down giving system wide symptoms. webscrapbook has resolved that problem with htz extension for storing webpage. Thank you Danny.

but the favicon design is causing similar problems of large number of files (to a smaller extent)

The only one way to really solve the issue is probably to convert scrapbooks to DBMS-based. Unfortunately this is a tremendous work and the difficulty and inconvenience of managing DBMS may overweight the benefit.

An easier solution would be to split your data into sub-scrapbooks.

Other problems:

* lots of unnessary warnings like "icon 'xxx' is an absolute URL" while running the checker

* lots of unncessary errors like missing icon file 'xxx/favicon.ico'

* they occupy about 30% of the total number of files in my webscrapbook "database"

* they give no value to me

Item icon with an absolute URL should be avoided because the icon is not really saved in your scrapbook and will be missing once the external website is down.

You can usually check the Automatically cache icons with absolute URL option to automatically fix the issue.

Missing icon file is of course an issue because the URL is wrong and the icon cannot be accessed. You should either correct the icon path or blank the icon path to use the default item icon instead.

Q1. Have I configured by webscrapbook wrong because I don't see any icons usually in sidebar. Sometimes they're seen.

Please check the item icon path and see if the file is missing. It may be due to network instability if it is an external absolute URL. It may be due to a server delay if it's local and there are too many icons to show, and can usually be solved by refreshing the page, or by switching to a more expert and performant local WSGI server.

Q2. Can a setting be made to globally disable icons so that they are not even created.

This seems to be a very large code work and I don't think it's good for UX. You can usually blank item icons using a script and remove cached icon files through the checker with Automatically remove unused favicon cache option checked.

[grotesque]

Please check the item icon path and see if the file is missing.

The favicon files are there. And they're kind of working in chrome not in firefox.
Pls see my earlier message.

[danny0838]

Check if the image URLs are correct, and try reloading the page to see if it changes.

[grotesque]

the image urls are like
.wsb/tree/favicon/b37ac89616b9e4c01a35991af59fe6b63e41a48e.ico
and they exists

funny thing is it works in chrome but not in firefox

[danny0838]

Have you tried reloading the page?

[grotesque]

yes

[danny0838]

What is the result?

[grotesque]

Same issue danny. Does anybody else using firefox face this issue too?

[danny0838]

Are all missing icons the same when the web page is refreshed?

Can you see the image if you right click on a missing icon and open the image in another tab?

[pausto]

I see the problem in FireFox too.
It does not work in 2 out of 3 Firefox (different computers, profiles), i.e. in one it works fine.
In Chrome it works fine.
Multibooks does not help.
In the server logs, when requesting a list there are many errors 400:

As far as I understand, this is Handshake Protocol (TLS 1.2). But why? Backend server settings are set to http

When used in normal Firefox or in Chrome, there are no errors on the Backend side.

Add: Additional analysis revealed:
The problem in Firefox is independent of the installed extensions.
As soon as I change 192.168.111.11:12345 -> 127.0.0.0.1:12345 in Backend settings (installed locally), everything starts working.

[pausto]

Add: Dev tools:

[pausto]

A quick analysis showed (I could be wrong) that Firefox considers the output in the panel as safe content and changes http to https for this purpose. An exception is made for the local address 127.0.0.1.
As I see there are 3 ways:

1. Use 127.0.0.1 to whom it suits.
2. Hide the backend server behind https via nginx or caddy, for example.
3. Improve the extension, use a background script and transfer the image to blob

[danny0838]

@pausto Thank you for the details.

Yes you should use localhost whenever suitable, not only for the issue but also allows local filesystem related commands, such as browsing an item in the file manager or open in an application.

Although it may be possible to configure Firefox not to upgrade protocol in a sidebar, it's not recommended due to a security consideration. If you intend to allow other devices to access the backend server, hosting with HTTPS is generally recommended. You can configure PyWSB to serve HTTPS if setting up an expert reverse proxy is not desired. Check the doc for more details.