Are you using any 3rd party app that alters the GUI? If so uninstall it.
In taskbar settings make sure "show badges on taskbar apps" is unchecked.
If it were me, rather than spend a lot of time I would quickly verify if it is a windows problem or a user account problem. Create another test account or temporarily enable the hidden administrator account. If it works correctly in another account, it's not a windows problem but some sort of corruption in your user account.
If the problem also exists in another user account:
1. Perform a clean boot to eliminate software conflict causing the issue. If it doesn't happen in a clean boot, you have some software conflicting with Windows. Brink's procedure will help you weed out which one.
Perform a Clean Boot in Windows 11 to Troubleshoot Software Conflicts Tutorial
2. Make sure you have no corrupt system files that is causing this problem. Open a command prompt as administrator and type
sfc /scannow
Pay attention to the scan results to see if SFC found anything it could not repair.
If it found corruption it could not fix followup with this command (note the spaces)
dism /online /cleanup-image /restorehealth
Restart computer
Report back what you find, and I'll tell you the steps to take to resolve it.