I don't think we should go without some form of review -- just that other academics are not representative of the real world. Perhaps a system where the 'relevance' claims are evaluated by industry reviewers, and the scientific claims are evaluated by academics?

Post-publication (I'm counting arxiv here as publication) review is an improvement. My branch of science doesn't use arxiv to any real extent, unfortunately.

Edit: I left a word out.