In the Receive tab in Yoroi, click on the tick icon next to the address you wish to verify. A dialog window with address details will be displayed. Click on Verify on hardware wallet and check your Ledger/Trezor device. Then follow the instructions to verify the derivation path and address.