Edinburgh can be an expensive city, but with some planning it is possible to experience all the city has to offer without spending more than you need to.