Yes! The easiest way to combine them is in parallel. That is, you wire the caps such that corresponding leads from each are connected to each other. You'll have two "big leads" in the end where all of them are twisted together. In this case, the resulting capacitance is the sum of them all, and the effective voltage rating is the lowest of them all.
You can also wire them in series. In this configuration, the caps are wired such that one lead from each connects to the opposite lead of the next. The resulting capacitance is 1/(1/C1 + 1/C2 + ... + 1/Cn) where Cn is the capacitance of each capacitor in the string. The effective voltage rating is the sum of all of them. In this case, the voltage ratings really need to be the same, and you may need to force equal voltage sharing using a resistor ladder in parallel with the cap string, which makes the setup slightly more complicated.
You should normally only combine capacitors of the same type (electrolytic, ceramic, mylar, etc.) unless you know you have reason to mix.