Square purchased approximately 4,709 bitcoins for a total purchase price of $50 million on Wednesday, the San Francisco-based firm said on Thursday morning.