Move pages under tldr, lint run.sh, update docs

This commit is contained in:
2024-02-21 13:58:43 +02:00
parent 3d653cc7e6
commit 2c475fa62d
4806 changed files with 36 additions and 35 deletions

37
tldr/scrapy Normal file
View File

@@ -0,0 +1,37 @@
---
syntax: markdown
tags: [tldr, common]
source: https://github.com/tldr-pages/tldr.git
---
# scrapy
> Web-crawling framework.
> More information: <https://scrapy.org>.
- Create a project:
`scrapy startproject {{project_name}}`
- Create a spider (in project directory):
`scrapy genspider {{spider_name}} {{website_domain}}`
- Edit spider (in project directory):
`scrapy edit {{spider_name}}`
- Run spider (in project directory):
`scrapy crawl {{spider_name}}`
- Fetch a webpage as Scrapy sees it and print the source to `stdout`:
`scrapy fetch {{url}}`
- Open a webpage in the default browser as Scrapy sees it (disable JavaScript for extra fidelity):
`scrapy view {{url}}`
- Open Scrapy shell for URL, which allows interaction with the page source in a Python shell (or IPython if available):
`scrapy shell {{url}}`