I have the same kind of issue. More people are showing up as invisible in the lobbies (which means I can't connect), if the game fails to connect to a lobby it hangs, if I exit a lobby it hangs, and sometimes it does it if I create a room or just search for lobbies in player match. It's really annoying.
I'm playing on PS3.