Create crawler application

Create a new application instance via createCrawl():

import { createCrawl } from 'x-crawl'

const crawlApp = createCrawl({
  // options
})

Related options can refer to CreateCrawlConfig.