Create crawlers automatically using the existing templates

[dipu-bd]

After the new changes to dev now it is possible to create crawlers automatically using the existing templates.

A guide to how to do it:

(venv) $ python -m lncrawl --bot lookup
================================================================================
╭╮╱╱╱╱╱╱╭╮╱╭╮╱╱╱╱╱╱╱╱╱╱╱╱╭╮╱╭━━━╮╱╱╱╱╱╱╱╱╱╭╮
┃┃╱╱╱╱╱╱┃┃╭╯╰╮╱╱╱╱╱╱╱╱╱╱╱┃┃╱┃╭━╮┃╱╱╱╱╱╱╱╱╱┃┃
┃┃╱╱╭┳━━┫╰┻╮╭╋━╮╭━━┳╮╭┳━━┫┃╱┃┃╱╰╋━┳━━┳╮╭╮╭┫┃╭━━┳━╮
┃┃╱╭╋┫╭╮┃╭╮┃┃┃╭╮┫╭╮┃╰╯┃┃━┫┃╱┃┃╱╭┫╭┫╭╮┃╰╯╰╯┃┃┃┃━┫╭╯
┃╰━╯┃┃╰╯┃┃┃┃╰┫┃┃┃╰╯┣╮╭┫┃━┫╰╮┃╰━╯┃┃┃╭╮┣╮╭╮╭┫╰┫┃━┫┃
╰━━━┻┻━╮┣╯╰┻━┻╯╰┻━━╯╰╯╰━━┻━╯╰━━━┻╯╰╯╰╯╰╯╰╯╰━┻━━┻╯
╱╱╱╱╱╭━╯┃ v3.0.0
╱╱╱╱╱╰━━╯ 🔗 https://github.com/dipu-bd/lightnovel-crawler
--------------------------------------------------------------------------------

➡ Press  Ctrl + C  to exit

? Enter novel page url: https://www.novelmtl.com/novel/ancient-true-dragon-art.html
🍀 Checking MadaraTemplate [1 of 2] 
  ➡ Create instance : success
  ➡ initialize() : success
  ➡ read_novel_info() : failed
    No title found

🍀 Checking NovelMTLTemplate [2 of 2] 
  ➡ Create instance : success
  ➡ initialize() : success
  ➡ read_novel_info() : success
  ➡ download_chapter_body() : success

? Enter language: en
? Does it contain Manga/Manhua/Manhwa? No
? Does it contain Machine Translations? No

📦 Generated source file 📦
➡ /home/dipu/projects/lightnovel-crawler/sources/en/n/novelmtl.py

If you are confused about the language, check the language_codes.

[mygithub-acct]

If this didn't work and I manually try to create my own source, where should I copy the file to? The normal source folder no longer exist in the lncrawl folder like it used to be.

[dipu-bd]

check one level above it. i recommend cloning the repository and edit there. send a Pull Request once you are done

[mygithub-acct]

Found it, thanks! Copied my file into the folder however lncrawl doesn't recognise the new website because it doesn't know there is a new file in sources folder. How can I trigger it to update the list of sources? Sorry, lots of newbie questions