Personally I wouldn't do it for safety reasons and also the fact that the mouse may be carrying disease which is no good ! I wouldn't trust it just keep with the feeders :) in my opinion
I just purchased one and was actually quite disappointed when it got here only because the bottom keeps the PVC, what I mean is I purchased the bottom piece which catches water but they don't send the screen piece to put it place of the PVC so it's kind of pointless. I have another cage from...