kvazar
/
crawler
mirror of https://github.com/kvazar-network/crawler.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
Kvazar Index Crawler
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
37 Commits
1 Branch
0 Tags
359 KiB
 
Tree: 8c8fb43635
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from '8c8fb43635'
${ noResults }
ghost 8c8fb43635
update readme 		10 months ago
example define index drivers config 10 months ago
src skip empty transactions 10 months ago
.gitignore implement transaction parser 10 months ago
LICENSE Initial commit 10 months ago
README.md update readme 10 months ago
composer.json use kevaGroupFilter as tmp solution for #10 10 months ago

README.md

KVAZAR Index Crawler

Compatible

Install

  • apt install git composer manticore php-fpm php-curl php-mbstring php-pdo php-bcmath
  • git clone https://github.com/kvazar-network/crawler.git
  • cd crawler
  • composer update

Setup

  • cp example/config.json config.json
  • crontab -e:* * * * * php src/index.php
    • drop index: php src/index.php drop
    • optimize index: php src/index.php optimize

To prevent data lose on server failures, set binlog flush strategy to binlog_flush = 1 in /etc/manticoresearch/manticore.conf