The way to do a ball/socket magnet joint is to attach a pin to the ball magnet, use a non-magnetic cylinder as the base, and stick a cylindrical magnet inside the base, so the ball is drawn to but doesn't touch the magnet inside the base.
Different materials give you different levels of friction - these guys
http://www.magnet-solution.com/product/view/magnetic-ball-joints/# - make a good sized one for flyers at least - ball is 10mm diameter, so large-ball-bearing size. I'm waiting on price quotes from china for those, probably have to buy a ton of them, so hoping there might be others out there who want to jump in on the bulk deal