alihan/newsletter-crawler
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
186 Commits 2 Branches 0 Tags
master
Commit Graph

186 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
MAHMUT YILMAZ
d611192216 Pull request #75: automountServiceAccountToken: false inserted to under spec 
Merge in SE471652/newsletter-crawler from feature/fortify_fix to master

* commit '240b1caa2ca275237bc5e0c9cfd8a91b498ee340':
  automountServiceAccountToken: false inserted to under spec
 2023-12-18 10:18:16 +03:00
TCMAHYILMAZ
240b1caa2c automountServiceAccountToken: false inserted to under spec 2023-12-18 10:14:59 +03:00
ALIHAN DIKEL
f0a1874fdf Pull request #72: Develop 
Merge in SE471652/newsletter-crawler from develop to master

* commit 'cdf96658df34327251df2575ad490de3457e3bec':
  changed log string
  changed log string
  initial gcs source added to remember where left
  remove failing gcs source & remove gcs-required source from rss_craw_list & fix on failing rss_crawler
  Jenkinsfile edited online with Bitbucket
  implement fortify scan
  minor changes
  minor change on config
  update pod yaml
  search for endpoint_url error
  fix missing gcs env vars
  add gcs sdk to reqs.txt
  implement 3. crawl approach: generic crawler service & disable custom crawlers & first GCS source telecoms
  minot changes on logging
  minor changes on crawler logs, test new URLs, found some issues
  minor touch  rss crawler config urls
  add cm-newsletter-rss-config as yaml file
 2023-12-15 15:42:42 +03:00
ALIHAN DIKEL
cdf96658df Pull request #74: changed log string 
Merge in SE471652/newsletter-crawler from implement/fortify_scan to develop

* commit '132fd53d9e9141be33727259704e975ddbf1ae99':
  changed log string
  changed log string
 2023-12-15 15:42:26 +03:00
ALIHAN DIKEL
132fd53d9e changed log string 2023-12-15 15:29:38 +03:00
ALIHAN DIKEL
303244df6c changed log string 2023-12-15 15:27:50 +03:00
ALIHAN DIKEL
7e3d1ad2cb Pull request #73: Jenkinsfile edited online with Bitbucket 
Merge in SE471652/newsletter-crawler from implement/fortify_scan to develop

* commit '21cb716907abfa09f343c4c8d8691d0c2a6ddbbe':
  initial gcs source added to remember where left
  remove failing gcs source & remove gcs-required source from rss_craw_list & fix on failing rss_crawler
  Jenkinsfile edited online with Bitbucket
 2023-12-14 20:17:00 +03:00
ALIHAN DIKEL
21cb716907 Merge branch 'implement/fortify_scan' of https://stash.turkcell.com.tr/git/scm/ia471052/sensai-newsletter-crawler into implement/fortify_scan 2023-12-14 20:08:13 +03:00
ALIHAN DIKEL
cd1e9198fd initial gcs source added to remember where left 2023-12-14 20:07:52 +03:00
ALIHAN DIKEL
6a2c480baa remove failing gcs source & remove gcs-required source from rss_craw_list & fix on failing rss_crawler 2023-12-14 20:04:51 +03:00
ALIHAN DIKEL
ebdc0500ad Jenkinsfile edited online with Bitbucket 2023-12-12 19:40:58 +03:00
ALIHAN DIKEL
edc9769a24 Pull request #71: Implement/fortify scan 
Merge in SE471652/newsletter-crawler from implement/fortify_scan to develop

* commit '06e1366b014de588ae3ffebc587e25dce95d642c':
  implement fortify scan
  minor changes
 2023-12-12 12:45:16 +03:00
ALIHAN DIKEL
06e1366b01 implement fortify scan 2023-12-12 12:43:55 +03:00
ALIHAN DIKEL
dfcfdd1884 minor changes 2023-12-12 12:41:15 +03:00
ALIHAN DIKEL
de4093b744 Pull request #69: minor change on config 
Merge in SE471652/newsletter-crawler from feature/gcs_integration to develop

* commit '05a5aad1e6e14a29a697d8be2f0d27ca34660770':
  minor change on config
 2023-12-04 14:02:18 +03:00
ALIHAN DIKEL
05a5aad1e6 minor change on config 2023-12-04 13:50:19 +03:00
ALIHAN DIKEL
4a6782dd5a Pull request #68: search for endpoint_url error 
Merge in SE471652/newsletter-crawler from feature/gcs_integration to develop

* commit 'ce3c4038b8bbef9d3d141b36a942027394f33b84':
  update pod yaml
  search for endpoint_url error
 2023-12-04 13:40:44 +03:00
ALIHAN DIKEL
ce3c4038b8 update pod yaml 2023-12-04 13:39:06 +03:00
ALIHAN DIKEL
1f09f7e2af search for endpoint_url error 2023-12-04 13:37:24 +03:00
ALIHAN DIKEL
4395209693 Pull request #67: fix missing gcs env vars 
Merge in SE471652/newsletter-crawler from feature/gcs_integration to develop

* commit 'ca0308a1d238a57e49a6bfd6d06bc3c2504f6ce8':
  fix missing gcs env vars
 2023-12-04 13:19:21 +03:00
ALIHAN DIKEL
ca0308a1d2 fix missing gcs env vars 2023-12-04 13:14:29 +03:00
ALIHAN DIKEL
508dd61464 Pull request #66: add gcs sdk to reqs.txt 
Merge in SE471652/newsletter-crawler from feature/gcs_integration to develop

* commit 'c833c3fbd708b95667ddfacdfbd710157a0b17c9':
  add gcs sdk to reqs.txt
 2023-12-04 12:55:18 +03:00
ALIHAN DIKEL
c833c3fbd7 add gcs sdk to reqs.txt 2023-12-01 17:39:35 +03:00
ALIHAN DIKEL
73d8ba941f Pull request #65: implement 3rd crawl approach: generic crawler service & disable custom crawlers & first GCS source telecoms 
Merge in SE471652/newsletter-crawler from feature/gcs_integration to develop

* commit '4e680ad417fea4a164463dc990763a5ea6ee1fdc':
  implement 3. crawl approach: generic crawler service & disable custom crawlers & first GCS source telecoms
 2023-12-01 17:33:03 +03:00
ALIHAN DIKEL
4e680ad417 implement 3. crawl approach: generic crawler service & disable custom crawlers & first GCS source telecoms 2023-11-22 16:58:24 +03:00
ALIHAN DIKEL
362684c584 Pull request #64: Maintenance/logging configmap 
Merge in SE471652/newsletter-crawler from maintenance/logging_configmap to develop

* commit 'd6c9897c0df582b074e0de99d45dd52dc5701478':
  minot changes on logging
  minor changes on crawler logs, test new URLs, found some issues
  minor touch  rss crawler config urls
  add cm-newsletter-rss-config as yaml file
 2023-11-17 17:28:21 +03:00
ALIHAN DIKEL
d6c9897c0d minot changes on logging 2023-11-15 13:23:48 +03:00
ALIHAN DIKEL
9a336af2ff minor changes on crawler logs, test new URLs, found some issues 2023-11-15 13:13:20 +03:00
ALIHAN DIKEL
8516d99686 minor touch rss crawler config urls 2023-11-15 12:20:58 +03:00
ALIHAN DIKEL
5bfb3db93b add cm-newsletter-rss-config as yaml file 2023-11-15 12:20:22 +03:00
ALIHAN DIKEL
8f34dd1a52 Pull request #63: Develop 
Merge in SE471652/newsletter-crawler from develop to master

* commit '4b81377b0c7181cb4ffe8d5bad4edcc5ad0f7cf2':
  dbconn bug fixed
  dbconn bug fixed
 2023-09-26 14:21:33 +03:00
MAHMUT YILMAZ
4b81377b0c Pull request #62: Bugfix/dbconn 
Merge in SE471652/newsletter-crawler from bugfix/dbconn to develop

* commit '3857127c1ad25df54839c1e34da309184f96e05e':
  dbconn bug fixed
  dbconn bug fixed
 2023-09-22 17:02:31 +03:00
MAHMUT YILMAZ
3857127c1a dbconn bug fixed 2023-09-22 15:02:24 +03:00
MAHMUT YILMAZ
b83872ed19 dbconn bug fixed 2023-09-22 09:10:54 +03:00
MAHMUT YILMAZ
ed0b1a745c Pull request #61: Develop 
Merge in SE471652/newsletter-crawler from develop to master

* commit '163de0707880a6229ac5d2809995a8aef850e7b9':
  x
  mount path seperated
  mount path seperated
  crawler path file fixed, add rss
  crawler path file fixed, add rss
  file from configmap
  docker user changed
  file path finder
  full path added
  add virtual-pypi index-url
  python index_url added to dockerfile
  python index_url added to dockerfile
  python index_url added to dockerfile
  attempt to fix src/ caused error
  config yaml will load from configmap
  config yaml will load from configmap
 2023-08-25 14:15:58 +03:00
MAHMUT YILMAZ
163de07078 Pull request #60: Bugfix/file path fix 
Merge in SE471652/newsletter-crawler from bugfix/file_path_fix to develop

* commit '94116493682e10387d4a8596148be877ea86f98d':
  x
  mount path seperated
  mount path seperated
 2023-08-24 08:20:36 +03:00
MAHMUT YILMAZ
9411649368 x 2023-08-24 07:24:43 +03:00
MAHMUT YILMAZ
63d44850eb mount path seperated 2023-08-24 07:21:59 +03:00
MAHMUT YILMAZ
455a821901 mount path seperated 2023-08-24 07:07:23 +03:00
MAHMUT YILMAZ
f1f6669999 Pull request #59: Bugfix/file path fix 
Merge in SE471652/newsletter-crawler from bugfix/file_path_fix to develop

* commit '07e0e665b7505453cad1bc7d13253f95c5a077c4':
  crawler path file fixed, add rss
  crawler path file fixed, add rss
  file from configmap
 2023-08-23 15:42:02 +03:00
MAHMUT YILMAZ
07e0e665b7 crawler path file fixed, add rss 2023-08-23 15:41:05 +03:00
MAHMUT YILMAZ
0c73ff0ac6 crawler path file fixed, add rss 2023-08-23 15:21:18 +03:00
MAHMUT YILMAZ
21b2033e9c file from configmap 2023-08-21 10:04:15 +03:00
MAHMUT YILMAZ
a37108a223 Pull request #58: docker user changed 
Merge in SE471652/newsletter-crawler from bugfix/file_path_fix to develop

* commit 'c26380ccfd8afad3c6d558d0c1456fd3f8019d4a':
  docker user changed
 2023-08-21 09:21:04 +03:00
MAHMUT YILMAZ
c26380ccfd docker user changed 2023-08-21 09:17:09 +03:00
MAHMUT YILMAZ
2e448038d9 Pull request #57: file path finder 
Merge in SE471652/newsletter-crawler from bugfix/file_path_fix to develop

* commit '9de87874af46073d3fcf3aad5ace5d3a9091deb6':
  file path finder
 2023-08-21 08:56:02 +03:00
MAHMUT YILMAZ
9de87874af file path finder 2023-08-21 08:50:34 +03:00
MAHMUT YILMAZ
516344eac6 Pull request #56: full path added 
Merge in SE471652/newsletter-crawler from bugfix/file_path_fix to develop

* commit 'd45868968b40696aeffe2971e6c58489feebc6a8':
  full path added
 2023-08-18 15:55:04 +03:00
MAHMUT YILMAZ
d45868968b full path added 2023-08-18 15:53:00 +03:00
TURKCAN KESKIN
d4365e30a7 add virtual-pypi index-url 2023-08-18 15:23:38 +03:00