A web crawler to stress test a Bubble.
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Jonathan Cobb d58e91a688 remove driver termination 1 year ago
ansible install firefox and driver in ansible, add support for chromium 1 year ago
bin set default JAVA_OPTS 1 year ago
examples add firefox support 1 year ago
src/main remove driver termination 1 year ago
.gitignore ignore configs dir 1 year ago
README.md add firefox support 1 year ago
pom.xml initial commit 1 year ago

README.md

Bubble Crunch

A load-testing tool for Bubble. Crawls URLs to put a lot of traffic through a Bubble.

Requirements

  • Java 11
  • Maven 3

For Ubuntu, you can run:

apt install openjdk-11-jdk maven

Building

To build from source:

mvn -Puberjar clean package

Install Browsers and Web Driver

Before running, you need to install one or both of:

  • Google Chrome and the Chrome web driver for Selenium.
  • Firefox and the Firefox web driver for Selenium.

If you are running a desktop, you can probably just install Chrome or Firefox normally, if you haven’t already.

Install Firefox

apt install firefox

Install Chrome

apt install software-properties-common -y
add-apt-repository ppa:canonical-chromium-builds/stage -y
apt-get update -y
apt install chromium-browser -y

Install Web Drivers:

./bin/update_firefox_driver.sh
./bin/update_chrome_driver.sh

Running

Look at the files in examples for sample configurations.

Run a simple crawl with default settings:

./bin/crunch.sh -c ./examples/crawl_sites.txt

Same as the above, but uses a full configuration:

./bin/crunch.sh -c ./examples/crawl_config.json