Sadly, the ESP32-S3 drops USB host mode, so the use case presented by the OP won't work on the new part.

An M5Stack w/ the ESP32-S2 would open up a bunch of interesting use cases due to that feature.