Microsoft has started testing advertisements for its products within the Windows 11 file explorer, BleepingComputer reports.