Penny stocks often hold excitement and are attached with the potential to deliver outsized returns. These stocks are typically priced under $5 per share.