alihan/news-please-content-crawler
1
0
Fork 0
mirror of https://github.com/fhamborg/news-please.git synced 2021-09-19 22:26:00 +03:00
Code Issues Projects Releases Wiki Activity
658 Commits 1 Branch 0 Tags
master
Commit Graph

658 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Felix Hamborg
a747da04dc Merge pull request #144 from thihara/thihara-patch-1 
Stopped the LOG_ENABLED variable from being unset
 2020-04-24 15:15:14 +02:00
Thihara Neranjya
26d9e2c34e Changes to make Scrapy Item class customizable via configuration 2020-04-22 19:10:50 +05:30
Felix Hamborg
5a3c595f4c Merge pull request #143 from jemisonf/master 
Updates from_url return type docs
 2020-04-20 16:49:02 +02:00
Thihara Jayathunga
8fd49f8c53 Merge pull request #1 from thihara/thihara-patch-1 
Stopped the LOG_ENABLED variable from being unset
 2020-04-20 07:16:59 +05:30
Thihara Jayathunga
c99cdede31 Stopped the LOG_ENABLED variable from being unset 
The LOG_ENABLED variable is not honored in the spider (using RecursiveSpider) because it's being unset here.
 2020-04-20 07:15:31 +05:30
Fischer Jemison
09a810ca72 updates from_url return type docs 2020-04-19 14:11:31 -07:00
Felix Hamborg
2b55c29798 Update README.md 2020-04-08 19:50:35 +02:00
Felix Hamborg
c9489e372c Update setup.py 2020-04-08 19:46:01 +02:00
Felix Hamborg
6b6c79f275 Update README.md 2020-04-08 19:45:42 +02:00
Felix Hamborg
7793d8aacd Update requirements.txt 2020-04-08 19:39:08 +02:00
Felix Hamborg
3595d4ce07 Update setup.py 2020-04-08 19:38:53 +02:00
Felix Hamborg
f9aa241520 Update README.md 2020-04-07 10:21:20 +02:00
Felix Hamborg
f3c20a061f Update README.md 2020-04-07 10:18:40 +02:00
Felix Hamborg
e070924204 inc version 2020-04-06 20:43:08 +02:00
Felix Hamborg
5ffcd0e7bf Merge pull request #140 from andreierdoss/master 
Add Postgresql Storage option with init and reset of data
 2020-04-06 20:40:41 +02:00
Andrei Erdoss
054d30a154 Add Postgresql Storage option with init and reset of data 2020-04-05 15:18:54 +03:00
Felix Hamborg
39aff553be Merge remote-tracking branch 'origin/master' 2020-03-20 11:25:11 +01:00
Felix Hamborg
838f230295 continue transition from text to maintext 2020-03-20 11:25:03 +01:00
Felix Hamborg
07c46fc25c continue transition from text to maintext 2020-03-20 11:24:50 +01:00
Felix Hamborg
d6ad357631 typo fix 2020-03-06 14:24:27 +01:00
Felix Hamborg
da19c3391f Delete _config.yml 2020-01-29 09:00:48 +01:00
Felix Hamborg
d3f635c265 Update setup.py 2020-01-14 21:52:03 +01:00
Felix Hamborg
fb8221bdd4 Merge pull request #135 from mxab/master 
url_extractor functions use crawler agent header and continue on exceptions
 2020-01-14 21:50:54 +01:00
Max Fröhlich
3d3fd2b9e4 Use user agent header in url extractor and rss crawler 
Also catch Exception when determining the crawler and continue
 2020-01-14 21:40:27 +01:00
Felix Hamborg
7d6d4cf78b Update bug_report.md 2020-01-11 14:53:00 +01:00
Felix Hamborg
9906cfc5f1 Update support_request.md 2020-01-11 14:52:45 +01:00
Felix Hamborg
2c2c8cf526 Delete help_request 2020-01-11 14:50:23 +01:00
Felix Hamborg
6050619269 Update support_request.md 2020-01-11 14:50:11 +01:00
Felix Hamborg
36bff17962 Create support_request.md 2020-01-11 14:49:47 +01:00
Felix Hamborg
550560f073 Create help_request 2020-01-11 14:48:31 +01:00
Felix Hamborg
76a343d3a2 Update bug_report.md 2020-01-11 14:46:54 +01:00
Felix Hamborg
1226587d93 Update README.md 2020-01-08 16:38:40 +01:00
Felix Hamborg
2956e6aff5 Update setup.py 2020-01-04 18:52:57 +01:00
Felix Hamborg
28f6ec751b Update requirements.txt 2020-01-04 18:48:30 +01:00
Felix Hamborg
806b0cfafe Update README.md 2019-11-14 15:04:04 +01:00
Felix Hamborg
eed3a5ca75 Update README.md 2019-11-14 15:02:58 +01:00
Felix Hamborg
53319ba7c9 remove py2.7 libs 2019-11-14 15:01:50 +01:00
Felix Hamborg
49ef9cef45 remove py2.7 libs 2019-11-14 15:00:54 +01:00
Felix Hamborg
faf10ee372 Update README.md 2019-11-14 10:45:47 +01:00
Felix Hamborg
f97b0a2519 Update README.md 2019-11-14 10:43:21 +01:00
Felix Hamborg
50499c86c4 Update README.md 2019-11-14 10:34:14 +01:00
Felix Hamborg
1609e77ddd Update README.md 2019-11-13 19:56:20 +01:00
Felix Hamborg
23cffaf5df fix mislogic in language comparison 
change name of extraction field from 'text' to 'maintext' (this is because 'text' is a protected name in some databases and when using it as a column may cause issues)
 2019-11-13 11:07:04 +01:00
Felix Hamborg
3b93656a87 Update README.md 2019-11-08 10:38:06 +01:00
Felix Hamborg
2d43bc3ab1 increase version 2019-11-08 10:29:56 +01:00
Felix Hamborg
aa752f6bb2 Merge pull request #132 from JeromeGill/fix/elasticsearch7.4 
fix/ ElasticSearch 7.4 support
 2019-11-08 10:29:06 +01:00
Jerome Gill
78fd594134 fix/ ElasticSearch 7.4 support 
Remove include_type_name header on elastic search post requests

https://www.elastic.co/guide/en/elasticsearch/reference/current/removal-of-types.html
 2019-11-07 19:08:33 +00:00
Felix Hamborg
56b93a0909 Update bug_report.md 2019-11-07 18:02:58 +01:00
Felix Hamborg
a7684d3d5e Update bug_report.md 2019-11-07 18:01:30 +01:00
Felix Hamborg
de7fdb603f Create FUNDING.yml 2019-11-07 17:51:18 +01:00