I understand that, in a perfect world, the CD/DVD drive wouldn't have anything to do with a USB install that asks me to install a CD/DVD driver, but I wonder if it could cause any issue.

We have previously noted that disabling Apple's CD/DVD driver may prevent certain types of Mac OS stalls. A recent Apple TIL article #31023 (dated July 2 but modified July 12) acknowledges this ...