1. Make sure that your computer can receive inbound connections. Look at the peer list; there should be a local/remote column. If all of the peers are listed as local, your router or firewall is blocking inbound connections, which means that you see fewer peers.
2. Cap your upload to ~80% of your connection's maximum total upload speed. Otherwise, you end up throttling outbound ACKs, which kills your download speed.