I was able to figure out a solution to this issue.
When installing postgres, /etc/postgresql/10/main/postgresql.conf contained port=5433. Updating this to port=5432 fixed the issue for me. I ran into this when using Ubuntu on Windows.
Extra Credit:
Running sudo service postgresql status lets you know which port postgres is listening on.