'The crawler use this file to download all the reviews for all the URLs specified in the `urls.txt` file. 'The file `urls.txt` should contain a list valid URLs on the (). The parameter `-a urls=cnet/spiders/urls.txt` tells the crawler what URLs to scrape from the (). 'Then we call on `Scrapy` with the necessary parameters to start the cralwer. 'The input to the CNET crawler is a file containing a list of URLs that specifies which product reviews to download. '# 2.3 Specifying Product URLs to Crawl ', Therefore, we change the current working directory to the value in `PROJECT_PATH`. 'To start the scraping process, the crawler needs to be launched from the project directory. 'PROJECT_PATH = '/Users/mik/projects/review-analyser-ea/scrapers/cnet' ' We set this value to the `PROJECT_PATH` variable. 'For the CNET crawler, the project directory will be similar to `/review-analyser-ea/scrapers/cnet`. It will contain the file `scrapy.cfg`, and the directory name will be descriptive enough to relate to the project. 'The project directory normally exists within the ReviewAnalyzer source files. 'First, specify the project directory for the scraper you want to launch. '- TODO: Explain how to activate the virtual environment for the project ',

'# 2.1.4 Activate Virtual Environment ', '- TODO: Explain how to install project dependencies using pip. '# 2.1.3 Install Project Dependenices ', '- TODO: Explain how project is downloaded from Git ',

'- TODO: Explain how to set up a new virtual environment if necessary.

'The CNET scraper crawls the CNET website for expert reviews.

Cnet virtual audio cable