Yeah, it's probably because of light theme. You can try setting Titlebar Color of Explorer to Dark and setting the Backdrop Type to Tabbed to get dark themed Tabbed effect on explorer
What do you mean by using MFE on Taskbar? You want to get Tabbed Taskbar?
If yes, I don't know any app for that...