Use Qt resource files, compile it to Python to obtain a window that has an icon! Finally! It is still using the Oxygen icon for Database, since I have nothing better to use.
Remove the compiled files from the source. Running from sources will require an extra make step that will generate the necessary ui modules.