I think so. Checking their documentation, it seems that Magento only supports MariaDB 10.0, 10.1, and 10.2, while XAMPP ships MariaDB 10.4.
In case that it could help, here you have Bitnami Magento Stack for Windows:
This can not be installed on top of XAMPP, but it includes all the necessary components (Apache, PHP, MySQL...).
Alternatively, I could provide you with an old version of XAMPP.