3G RAM + 1G Partition Swap - is it enough?

It should be. I routinely set up 1 and 2gb droplets with 2gb of swap and they work. Currently a rebuild takes a lot of ram, but that should work.

Your need a better imagination.

I run that much only on sites with on the order of a million page views per month and fairly large databases.