I thought a math program would need special equipment. The supplies we used most were much simpler: pencils, erasers, paper, graph paper, index cards, rulers, and small whiteboards. Dice, cards, counters, craft sticks, tangrams, and pattern blocks gave us plenty of ways to turn a problem into something hands-on.
Some items were bought for the program. Others were donated or already at the library. Asking what the host already had saved us from buying things we didn't need. Small containers kept the dice and pieces from getting lost at the bottom of the bins.
We hardly used glue, and timers were less useful than I expected. Most activities worked better without pressure to finish quickly. Students often preferred a diagram or a few counters to a more elaborate material.
Start with a few supplies you can reuse. Add something when an activity actually needs it. A good puzzle and a good discussion matter more than an impressive supply cabinet.