User-agent: * Disallow: /assets/ User-agent: * Disallow: /mbweb/ User-agent: * Disallow: /pub_repository/