Of course, you are perfectly free to meet people at a more suitable location outside the venue but you accept full responsibility for that location.
You may also want to consider that being outside of the venue may delay you getting to the next seminars or meetings, or just hearing any of the latest announcements re the event.