Thanks for trying to help me troubleshoot. I was actually able to resolve it. I was using my hosting sites Softaculous functionality to automatically install SilverStripe and something wasn't working properly.
I decided to just install SilverStripe manually myself by downloading the zip file from SilverStripe and following SilverStripe's install instructions. When I did that it worked fine and everything is up and running.