If your company has an office intercom system and you can disguise your voice, page your manager to different parts of the building. This works very well in large retail stores.
I pulled this prank when I used to work for a large superstore. I could see the floor managers station from my department. I would page her to a department far away from her station, then when I was sure she was at the location, I would page her to the opposite end of the store. She could never figure out who was doing it.
I let some other friends in on the joke and they started having her paged to obscure locations as well. We had her bouncing around like a pinball cosntantly ranting, "Who keeps paging me?"