You can make an on-the-cheap arm-sleeve if you have a sleeping bag. Take the carrying case off the sleeping bag, pull it up onto the arms behind, and pull the drawstring tight. Then just use a short piece of rope or the like to secure the wrists. Ta-Da!
for making a bondage horse without lots of skill in leather working or stitching, you can buy a regular wooden saw-horse (or build one if you are handy) and then take a few old throw pillows or an old comforter and bend them over the top, nailing them in place. Glue some foam to the legs or sand the corners if you are worried about splinters from the legs. Then drill/screw some eye bolts near the bases of the legs and up at the top at each end of the saw horse, and you have your very own piece of bondage furniture
Over time if you want to make it prettier, it's not that big a deal to wrap the legs and the crosspiece in foam, and then stitch some covers for it (I suggest something moisture resistant)
If you have a good coffee table that will support the weight of a person, it's practically already a piece of bondage furniture. If it's a coffee table with a lower and upper level, you can drill eye-bolts into the bottom of the lower level to use them for attachment points. If you don't mind people seeing eye bolts in your coffee table you can mount them anywhere of course...but you might not want to answer questions about them to guests who ask while sipping coffee at the table :P
It's also awfully handy to go pick up 40-50' of 3/8" - 5/8" nylon rope. Cut it into various lengths (from say 6' to 18") and tape off the ends with electrical tape. It's a cheap way to really expand your tying options, and leaves you with a variety of useful pre-made pieces that store easily. just be sure not to get rope that is too thin, as the safety hazards increase dramatically as the diameter of the rope decreases (it becomes easier for it to cut in, and less easy to quickly and easily manipulate it.)
If you have solid beams in your ceiling, you can drill eye bolts or hooks into them for suspension. When they aren't in use you can hang plants, mobiles, whatever from them for camouflage. Just remember suspension gets much less safe if a person is fully off the ground. Vertical suspension with feet touching the ground is by far the safest way to start
Bondage gear doesn't have to be expensive if you don't need need everything to be shiny leather and stainless steel.