Can I charge my portable speaker with an Apple power adapter?

I answered your other question with a different charger. Here is the deal: all of today's usb 5v chargers are smart chargers. So the only real variables here on charge time are the condition of your battery and the current capability of the charger. A 1 amp charger will charge it quicker than one with say 450 ma output.