I came here searching for the same solution, and I think I may have found it.
I use Aegis for TOTP on my Andoid phone, and keep the TOTP keys stored in a keepass database.
It turns out, the Windows Keepass app, KeepassXC, has a TOTP generator. You right-click on a db entry, select <TOTP>Set up TOTP>, paste in the key. Then return and do the same with <TOTP>Show TOTP> to get the code. Or, you can even select <TOTP>Show QR code> to install it on another authenticator app. And, since you have the secret key stored, you have a backup in case you lose your phone.
Here's some more info:
In-depth tutorial: How to set up 2FA TOTP with KeepassXC, Aegis and Authy.
Does anyone see any downside here?