# All robots can spider the domain User-agent: * Disallow:/new_customers_free_shipping.html Disallow:/new_customers_save20.html Disallow:/software_compatibility.html