kvazar
/
crawler
mirror of https://github.com/kvazar-network/crawler.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
Kvazar Index Crawler
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
39 Commits
1 Branch
0 Tags
359 KiB
 
Branch: main
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from 'main'
${ noResults }
crawler/README.md

722 B
Raw Permalink Blame History

KVAZAR Index Crawler

Compatible

Install

  • apt install git composer manticore php-fpm php-curl php-mbstring php-pdo php-bcmath
  • git clone https://github.com/kvazar-network/crawler.git
  • cd crawler
  • composer update

Setup

  • cp example/config.json config.json
  • crontab -e:* * * * * php src/index.php
    • drop index: php src/index.php drop
    • optimize index: php src/index.php optimize

To prevent data lose on server failures, change default binlog flush strategy to binlog_flush = 1