Pea gravel and pebbles can weigh down windowboxes. Empty water bottles are a lightweight option. Place rinsed bottles inside the planter and add soil on top of them. The space between the bottles will allow proper drainage without the extra weight.
Life Is Just a Tire Swing: A Woodway, Texas Fixer-Upper